{"id":13,"date":"2024-11-22T19:49:26","date_gmt":"2024-11-22T19:49:26","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/?page_id=13"},"modified":"2025-12-12T05:26:42","modified_gmt":"2025-12-12T05:26:42","slug":"system-performance","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/system-implementation-2\/system-performance\/","title":{"rendered":"System Performance"},"content":{"rendered":"\n

FVD Performance Evaluation<\/h2>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Targeted Performance Requirements and Validation Results<\/h2>\n\n\n\n

Perception Subsystem<\/h3>\n\n\n\n
Test<\/td>PR<\/td>Success Criteria<\/td>Result<\/td><\/tr>
Patient Detection<\/td>PR3<\/td>False negative < 5%; false positive < 2%<\/td>Detection validated in field; class filtering operational; thresholds met during FVD<\/td><\/tr>
Patient GPS Localization<\/td>PR8<\/td>GPS position within 2m of ground truth<\/td>\u00b11m accuracy validated at 15m altitude; exceeded requirement<\/td><\/tr>
Coordinate Transform<\/td>PR9<\/td>Coordinate position within 2m of ground truth<\/td>6\/6 tests passed; center offset 0.00m; cardinal directions within 0.1\u00b0<\/td><\/tr>
Standoff Distance<\/td>PR10<\/td>Maintain distance 6\u201310m<\/td>Distance maintained during target inspection behaviors<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Communication Subsystem<\/h3>\n\n\n\n
Test<\/td>PR<\/td>Success Criteria<\/td>Result<\/td><\/tr>
Active Transmission<\/td>PR5<\/td>Latency < 500ms; packet loss < 2%<\/td>Latency ~500ms; packet loss within tolerance during field demo<\/td><\/tr>
Video Streaming<\/td>PR15<\/td>\u22652 FPS<\/td>10 FPS @ 640\u00d7512; exceeded requirement<\/td><\/tr>
Logging Data<\/td>PR11<\/td>Foxglove packet loss < 1%; PX4 logs retrievable<\/td>Foxglove operational; PX4 logs retrieved post-flight<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Flight Control Subsystem<\/h3>\n\n\n\n
Test<\/td>PR<\/td>Success Criteria<\/td>Result<\/td><\/tr>
Waypoint Navigation<\/td>PR2<\/td>Survey course with <1m deviation<\/td>Waypoint acceptance radius tuned; deviation within tolerance<\/td><\/tr>
Course Maintenance<\/td>PR6<\/td>Maintain course; no unintended deviation<\/td>Stable hover \u00b11m maintained throughout FVD<\/td><\/tr>
Flight Endurance<\/td>PR7<\/td>\u226540 min flight time<\/td>40 min achieved on standard battery; exceeded minimum 20 min<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Safety Subsystem<\/h3>\n\n\n\n
Test<\/td>PR<\/td>Success Criteria<\/td>Result<\/td><\/tr>
Subsystem Safety<\/td>PR1<\/td>No critical safety-compromising paths<\/td>All add-ons validated; no safety risks found<\/td><\/tr>
E-Stop Response<\/td>PR12<\/td>Manual & Foxglove E-stop <0.5s; hover on comm loss<\/td>Kill switch <50ms on 900MHz Jeti; comm-loss hover validated<\/td><\/tr>
Battery Failsafe<\/td>PR13<\/td>Return-to-home at 10% battery<\/td>RTH validated; low-voltage cutoff operational<\/td><\/tr>
Obstacle Avoidance<\/td>PR16<\/td>Maintain \u22651m distance<\/td>RRT* replanning verified; separation maintained<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

Ground Algorithms<\/h3>\n\n\n\n
Test<\/td>PR<\/td>Success Criteria<\/td>Result<\/td><\/tr>
Swarm Coordination<\/td>PR14<\/td>Select shortest path among 6 permutations<\/td>Algorithm validated locally; optimal path selected<\/td><\/tr>
Triage Report<\/td>PR17<\/td>Submit 6 frames (\u22651 with patient), boolean trauma indicators, assessment & actions<\/td>VLM-generated reports include indicators & recommended actions<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

System’s Performance Validation<\/h2>\n\n\n\n

The following table provides a transparent overview of our system’s performance validation.
Each functional requirement (FN) was evaluated against specific, measurable performance targets.
The results demonstrate strong capabilities in most areas: sensing, localization, navigation, patient detection, communication latency, and safety features.<\/p>\n\n\n\n

Regarding the data recording reliability (FN10), which is a focus for ongoing improvement.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

FVD Performance Evaluation Targeted Performance Requirements and Validation Results Perception Subsystem Test PR Success Criteria Result Patient Detection PR3 False negative < 5%; false positive < 2% Detection validated in field; class filtering operational; thresholds met during FVD Patient GPS Localization PR8 GPS position within 2m of ground truth \u00b11m accuracy validated at 15m altitude;
+ Read More<\/a><\/p>\n","protected":false},"author":394,"featured_media":0,"parent":629,"menu_order":2,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-13","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/pages\/13","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/users\/394"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/comments?post=13"}],"version-history":[{"count":11,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/pages\/13\/revisions"}],"predecessor-version":[{"id":1159,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/pages\/13\/revisions\/1159"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/pages\/629"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamb\/wp-json\/wp\/v2\/media?parent=13"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}