{"id":829,"date":"2024-12-05T21:07:24","date_gmt":"2024-12-05T21:07:24","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/?page_id=829"},"modified":"2024-12-13T05:25:38","modified_gmt":"2024-12-13T05:25:38","slug":"system-performance","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/system\/system-performance\/","title":{"rendered":"System Performance"},"content":{"rendered":"\n<h2 class=\"wp-block-heading has-very-light-gray-to-cyan-bluish-gray-gradient-background has-background\">Fall Validation Demo<\/h2>\n\n\n\n<p>Below is the one-pager for FVD which explains the Mission flow, demonstration logistics, and the Performance Requirements that were focused on in this demonstration.<\/p>\n\n\n\n<div data-wp-interactive=\"core\/file\" class=\"wp-block-file\"><object data-wp-bind--hidden=\"!state.hasPdfPreview\" hidden class=\"wp-block-file__embed\" data=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/TeamB-FVD.pdf\" type=\"application\/pdf\" style=\"width:100%;height:340px\" aria-label=\"Embed of TeamB-FVD.\"><\/object><a id=\"wp-block-file--media-3a2e6aa7-589c-44ed-9b2d-72207c567cd8\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/TeamB-FVD.pdf\">TeamB-FVD<\/a><a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/TeamB-FVD.pdf\" class=\"wp-block-file__button wp-element-button\" download aria-describedby=\"wp-block-file--media-3a2e6aa7-589c-44ed-9b2d-72207c567cd8\">Download<\/a><\/div>\n\n\n\n<p>Performance Requirement Evaluation Table for FVD<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><th>PR<\/th><th class=\"has-text-align-center\" data-align=\"center\">Set Metric<\/th><th class=\"has-text-align-center\" data-align=\"center\">FVD Metric (Achieved)<\/th><\/tr><\/thead><tbody><tr><td>Hotspot detection accuracy<\/td><td class=\"has-text-align-center\" data-align=\"center\">3 out of 4 = 75%<\/td><td class=\"has-text-align-center\" data-align=\"center\">Out of 6 runs ~ 87%<\/td><\/tr><tr><td>Hotspot localization accuracy<\/td><td class=\"has-text-align-center\" data-align=\"center\">2.5m<\/td><td class=\"has-text-align-center\" data-align=\"center\">1m<\/td><\/tr><tr><td>Tree separation for navigation<\/td><td class=\"has-text-align-center\" data-align=\"center\">5m<\/td><td class=\"has-text-align-center\" data-align=\"center\">3.8m<\/td><\/tr><tr><td>Flight Time<\/td><td class=\"has-text-align-center\" data-align=\"center\">5 mins<\/td><td class=\"has-text-align-center\" data-align=\"center\">16 mins recorded<\/td><\/tr><tr><td>Environment <\/td><td class=\"has-text-align-center\" data-align=\"center\">GPS degraded<\/td><td class=\"has-text-align-center\" data-align=\"center\">GPS denied<\/td><\/tr><tr><td>VIO Drift Accuracy<\/td><td class=\"has-text-align-center\" data-align=\"center\">&lt;4%<\/td><td class=\"has-text-align-center\" data-align=\"center\">&lt;1%<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Subsystem Performance<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Phoenix Pro<\/h3>\n\n\n\n<p>insert para here (kavin)<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">GCS+Streaming<\/h3>\n\n\n\n<p>insert para here (kavin)<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Fire Localization<\/h3>\n\n\n\n<p>For FVD, we had set up the environment so that the hotspots were at varying heights, on the way to the coarse hotspots, within the exploration region, and outside the virtual boundary (As shown in the figure below. We also demonstrated the run with real-time alterations to the hotspot locations.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"451\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf-1024x451.png\" alt=\"\" class=\"wp-image-897 img-responsive\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf-1024x451.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf-300x132.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf-768x338.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf-750x330.png 750w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-content\/uploads\/sites\/75\/2024\/12\/fvd_fire_mapping_perf.png 1040w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>For FVD Encore, to show hotspot generalizability, we moved the hotspots to new locations and also demonstrated the clustering quality of our mapping algorithm. This included keeping hotspots at varying distances and reaching a point where 2 hotspots were near enough to be classified as one larger hotspot. Encore also included hotspot variability that was up to the end user.<\/p>\n\n\n\n<p>Our new sensor fusion-based approach for fire localization worked extremely well compared to our implementation demonstrated in SVD. However, we still face the issue of false detections when the heater is partially occluded due to imperfect extrinsic calibration between the D456 depth camera and the FLIR Boson-640 thermal camera.<\/p>\n\n\n\n<p>As demonstrated in the 3 live runs, the platform detected 3\/4, 4\/4, and 4\/4 hotspots respectively. Of these, the last run contained a false positive owing to the calibration limitation mentioned above in the fire localization subsystem performance.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">State Estimation<\/h3>\n\n\n\n<p>During both the FVD and FVD Encore demonstrations, the module consistently delivered reliable performance across all runs. Even during emergency landings that involved erratic movements of the UAS platform, the drift remained under 1%, significantly surpassing the performance metric of 5%.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Autonomy<\/h3>\n\n\n\n<p>insert para here (ishir)<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Fall Validation Demo Below is the one-pager for FVD which explains the Mission flow, demonstration logistics, and the Performance Requirements that were focused on in this demonstration. Performance Requirement Evaluation Table for FVD PR Set Metric FVD Metric (Achieved) Hotspot detection accuracy 3 out of 4 = 75% Out of 6 runs ~ 87% Hotspot &#8230; <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/system\/system-performance\/\" class=\"more-link text-uppercase small\"><strong>Continue Reading<\/strong> <i class=\"fa fa-angle-double-right\" aria-hidden=\"true\"><\/i><\/a><\/p>\n","protected":false},"author":349,"featured_media":0,"parent":328,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-829","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/pages\/829","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/users\/349"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/comments?post=829"}],"version-history":[{"count":10,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/pages\/829\/revisions"}],"predecessor-version":[{"id":933,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/pages\/829\/revisions\/933"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/pages\/328"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamb\/wp-json\/wp\/v2\/media?parent=829"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}