{"id":13,"date":"2021-11-19T17:56:17","date_gmt":"2021-11-19T17:56:17","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/?page_id=13"},"modified":"2022-02-25T21:37:01","modified_gmt":"2022-02-25T21:37:01","slug":"system","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/system\/","title":{"rendered":"Design"},"content":{"rendered":"\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\"><div id=\"pl-gb13-6ab69da5bb2ca\"  class=\"panel-layout\" ><div id=\"pg-gb13-6ab69da5bb2ca-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-gb13-6ab69da5bb2ca-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-gb13-6ab69da5bb2ca-0-0-0\" class=\"so-panel widget widget_atframework_projects atframework_projects_widget panel-first-child panel-last-child\" data-index=\"0\" ><\/div><\/div><\/div><\/div>\n\n\n<p class=\"has-medium-font-size\"><strong>System Requirements <\/strong><\/p>\n\n\n\n<p>Based on the analysis of needs and use cases, the desired system specifications arrived at are as below:<\/p>\n\n\n\n<p><\/p>\n\n\n\n<h2 class=\"has-normal-font-size wp-block-heading\">Mandatory Performance Requirements<\/h2>\n\n\n\n<p>The system will:<\/p>\n\n\n\n<p><strong>M.P.1<\/strong> Have an operating range greater than 250 meters<\/p>\n\n\n\n<p><strong>M.P.2<\/strong> Classify fire pixels from thermal images with accuracy of 70%<\/p>\n\n\n\n<p><strong>M.P.3<\/strong> Provide fire map updates of at least 25 m x 25 m at a spatial resolution of 0.5m x 0.5m for users at least once every 10 sec<\/p>\n\n\n\n<p><strong>M.P.4<\/strong> Localize 5 fire hotspots with absolute accuracy of \u00b1 5 meters and relative accuracy of \u00b1 2.5 meters in a 10,000 square meter region within 15 minutes with 0 false positives and 0 false negatives<\/p>\n\n\n\n<h2 class=\"has-normal-font-size wp-block-heading\">Mandatory Non Functional Requirements<\/h2>\n\n\n\n<p>The system shall:<\/p>\n\n\n\n<p><strong>M.N.1<\/strong> Meet FAA regulations for an sUAS<\/p>\n\n\n\n<p><strong>M.N.2<\/strong> Have a user friendly ground station interface<\/p>\n\n\n\n<p><strong>M.N.3<\/strong> Be easy to use<\/p>\n\n\n\n<p><strong>M.N.4<\/strong> Utilize angled cameras such that a wildfire can be monitored without having to fly the sUAS directly above the fire in the smoke<\/p>\n\n\n\n<p><\/p>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Functional Architecture<\/strong><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"494\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-1024x494.png\" alt=\"\" class=\"wp-image-157\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-1024x494.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-300x145.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-768x371.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-1536x741.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-700x338.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-520x251.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-360x174.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-250x121.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio-100x48.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Functional-Architecture.drawio.png 1662w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/div>\n\n\n\n<p class=\"has-medium-font-size\"><strong>Cyberphysical Architecture <\/strong><\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"402\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-1024x402.png\" alt=\"\" class=\"wp-image-153\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-1024x402.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-300x118.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-768x301.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-1536x603.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-700x275.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-520x204.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-360x141.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-250x98.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio-100x39.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/Cyberphysical-Architecture.drawio.png 1901w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/div>\n\n\n\n<p class=\"has-medium-font-size\"><strong>System Design Description<\/strong><\/p>\n\n\n\n<p>An illustration of how we envision the complete system to work is represented below:<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep.png\" alt=\"\" class=\"wp-image-143\" width=\"459\" height=\"317\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep.png 777w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-300x207.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-768x530.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-700x483.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-520x359.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-360x248.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-250x172.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/graphical_rep-100x69.png 100w\" sizes=\"auto, (max-width: 459px) 100vw, 459px\" \/><figcaption><strong>Full system graphical representation<\/strong><\/figcaption><\/figure><\/div>\n<\/div><\/div>\n\n\n<div id=\"pl-gb13-6ab69da5bcf58\"  class=\"panel-layout\" ><div id=\"pg-gb13-6ab69da5bcf58-0\"  class=\"panel-grid panel-no-style\" ><div id=\"pgc-gb13-6ab69da5bcf58-0-0\"  class=\"panel-grid-cell\" ><div id=\"panel-gb13-6ab69da5bb2ca-0-0-0\" class=\"so-panel widget widget_atframework_projects atframework_projects_widget panel-first-child panel-last-child\" data-index=\"0\" ><\/div><\/div><\/div><\/div>\n\n\n<p class=\"has-normal-font-size\"><strong>Subsystems:<\/strong><\/p>\n\n\n\n<p><strong>Hardware platform<\/strong><\/p>\n\n\n\n<p>We chose to use a DJI M600 Pro hex-rotor UAV as our platform to carry our sensors and navigate the site of the wildfire.  The M600 Pro has a payload capacity of 6kg and a no load flight time of 30 minutes and will carry our payload (optics and on-board computer). <\/p>\n\n\n\n<p>This choice was arrived at after considering alternatives among other fixed wing, VTOL and multi-rotor UAVs. The M600 Pro worked out to be the optimal choice in terms of range and maneuvrability.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600.jpg\" alt=\"\" class=\"wp-image-245\" width=\"226\" height=\"226\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600.jpg 374w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600-360x360.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600-250x250.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/m600-100x100.jpg 100w\" sizes=\"auto, (max-width: 226px) 100vw, 226px\" \/><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center has-small-font-size\">DJI M600 Pro<\/p>\n\n\n\n<p><strong>Optics<\/strong><\/p>\n\n\n\n<p>Our optics system will be used to sense the local conditions of the fire to provide input to the perception subsystem.  We will be using a FLIR Boson uncooled thermal camera for this purpose as it gives us the advantages of being able to detect a fire through smoke and at night as opposed to an RGB camera.  Using a cooled thermal camera is not feasible due to weight and power constraints. Another possible alternative is the use of a radiometric camera, which we decided not to use due to high cost and ready availability of the FLIR Boson.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-1024x536.jpg\" alt=\"\" class=\"wp-image-246\" width=\"233\" height=\"121\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-1024x536.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-300x157.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-768x402.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-700x366.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-520x272.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-360x188.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-250x131.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news-100x52.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/flir-boson-r-news.jpg 1200w\" sizes=\"auto, (max-width: 233px) 100vw, 233px\" \/><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center has-small-font-size\">FLIR Boson<\/p>\n\n\n\n<p><strong>Planning<\/strong><\/p>\n\n\n\n<p>The fire monitoring path planner subsystem is responsible for generating paths for the drone to follow, allowing the drone to perceive the entire fire perimeter to generate a global map. This is important because the drone will not see the entire fire perimeter from a single location.<\/p>\n\n\n\n<p>From the results of our trade studies, the Importance-Based, Alternating Direction path planner will be used. This planner switches between traveling clockwise and counterclockwise around the perimeter. The planner takes in a global map of the fire perimeter represented as cells in a grid. For each fire front cell, an importance value is calculated based on an estimate of how far the fire will have traveled once the drone reaches that cell since the previous visit. Cells with a high rate of spread and cells that haven\u2019t been visited in a long time have the highest importance.<\/p>\n\n\n\n<p><strong>Mapping<\/strong><\/p>\n\n\n\n<p>The mapping subsystem will create and maintain a global fire perimeter map. This would include localizing the edge of the fire in the global frame. The map will consist of grid cells, which will then be marked based on whether the cell is on fire or not. This will be done using the GPS coordinates of the drone and ray-tracing. When the drone is flying over an area, it will detect whether the area is on fire or not and then detect the fire\u2019s perimeter. After that, the drone will update the grid cell corresponding to that area in the map. During ray-tracing, the fire region will be assumed to be flat for simplicity.<\/p>\n\n\n\n<p><strong>Perception<\/strong><\/p>\n\n\n\n<p>The fire front perception subsystem is responsible for detecting if an image contains fire. If it does, the fire front perception will then detect the edge of the fire in the image, which would correspond to the fire front.<\/p>\n\n\n\n<p>We intend to implement the UNet architecture shown below for our purpose as it works well with less data, something that is a constraint for us, it is small and implementable in real-time and is state of the art.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"518\" height=\"328\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet.png\" alt=\"\" class=\"wp-image-265\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet.png 518w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet-300x190.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet-360x228.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet-250x158.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-content\/uploads\/sites\/57\/2022\/02\/unet-100x63.png 100w\" sizes=\"auto, (max-width: 518px) 100vw, 518px\" \/><\/figure><\/div>\n\n\n\n<p class=\"has-text-align-center has-small-font-size\"><strong>UNet architecture<\/strong> <\/p>\n\n\n\n<p class=\"has-text-align-center has-small-font-size\">(<em>U-Net: Convolutional Networks for Biomedical Image Segmentation, 2015, Ronneberger et.al<\/em>)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>System Requirements Based on the analysis of needs and use cases, the desired system specifications arrived at are as below: Mandatory Performance Requirements The system will: M.P.1 Have an operating range greater than 250 meters M.P.2 Classify fire pixels from [&hellip;]<\/p>\n","protected":false},"author":265,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-13","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/pages\/13","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/users\/265"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/comments?post=13"}],"version-history":[{"count":10,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/pages\/13\/revisions"}],"predecessor-version":[{"id":268,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/pages\/13\/revisions\/268"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamd\/wp-json\/wp\/v2\/media?parent=13"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}