{"id":625,"date":"2022-12-13T04:39:24","date_gmt":"2022-12-13T04:39:24","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/?page_id=625"},"modified":"2022-12-13T04:54:46","modified_gmt":"2022-12-13T04:54:46","slug":"system-performance-fall","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/system-performance-fall\/","title":{"rendered":"Performance &#8211; Fall"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\"><strong>Fall Validation Demonstration &#8211; Verification Criteria<\/strong><\/h2>\n\n\n\n<ol class=\"wp-block-list\"><li>VTOL is able to takeoff and reach target location autonomously in fixed wing mode.<\/li><li>System demonstrates VTOL transitions without any errors.<\/li><li>The marker is detected by the VTOL from at least <strong>40 ft <\/strong>above the ground.<\/li><li>The package is delivered from at least <strong>4 ft <\/strong>above the ground.<\/li><li>Package is dropped within <strong>2 ft<\/strong> of the target location<\/li><li>All eggs in the package are delivered intact, with no breakage.<\/li><\/ol>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/4xWt7ZaE_hc\" frameborder=\"0\" allowfullscreen=\"\"><\/iframe>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\">\n<p>In a succesful FVD Encore, we delivered 3 times while meeting all Verification criteria in each of those runs! <\/p>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Flight Subsystem<\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.1.1<\/strong> Complete a delivery up to 8 miles away within 30 minutes.<\/p><\/blockquote>\n\n\n\n<p>In the fall semester, the VTOL was rigorously tested in Fixed wing mode with transitions and autonomous capabilities were developed to meet the performance requirement defined by MPF.1.1. A mission was set up for the VTOL system to travel a distance of ~8 miles(travel to location), perform delivery and travel a distance of ~8 miles again(travel back from location). The system was able to meet MPF.1.1 and below are the metrics of the test. <\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Total Time: 26 minutes<\/li><li>Total Distance: 27.3km (~17 miles)<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Travel to Delivery Location<\/td><td>14 minutes<\/td><\/tr><tr><td>Delivery<\/td><td>2 minutes<\/td><\/tr><tr><td>Return Home<\/td><td>10 minutes<\/td><\/tr><\/tbody><\/table><figcaption>Time Breakdown<\/figcaption><\/figure>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_024006.png\" alt=\"\" class=\"wp-image-591\" width=\"409\" height=\"314\" \/><figcaption>Flight Path<\/figcaption><\/figure><\/div>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/LYGVtohQXpI\" frameborder=\"0\" allowfullscreen=\"\"><\/iframe>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\">\n<p>Check out what a delivery mission would look like, with complete transitions into and out of fixed wing flight, even in windy conditions!<\/p>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Perception Subsystem<\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.3.1<\/strong> Detect marker from 40 ft above ground 95% of the time.<\/p><\/blockquote>\n\n\n\n<p>The performance requirement was verified by measuring and logging the height of the VTOL during the first instance of marker detection. The plot below shows the performance of the system across 18 different flights with height measurements from the onboard GPS and the marker pose.  The system is able to meet the requirement succesfully.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart.png\" alt=\"\" class=\"wp-image-593\" width=\"490\" height=\"303\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart.png 825w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-300x185.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-768x475.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-700x433.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-520x321.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-360x223.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-500x310.png 500w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-250x155.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-100x62.png 100w\" sizes=\"auto, (max-width: 490px) 100vw, 490px\" \/><\/figure><\/div>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.3.2<\/strong> Drop package within 2 ft of the target.<\/p><\/blockquote>\n\n\n\n<p>To verify MPF.3.2, the package position is measured from the outer boundary of the marker. This was logged for 14 flights and the system failed to meet the requirement only during one trial. The trials that show distance as 0 mean that the package was dropped on the marker. <\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1.png\" alt=\"\" class=\"wp-image-595\" width=\"500\" height=\"309\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1.png 600w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-300x186.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-520x322.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-360x223.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-500x310.png 500w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-250x155.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/chart-1-100x62.png 100w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><\/figure><\/div>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"348\" height=\"261\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_023517.png\" alt=\"\" class=\"wp-image-596\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_023517.png 348w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_023517-300x225.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_023517-250x188.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/Screenshot_20221201_023517-100x75.png 100w\" sizes=\"auto, (max-width: 348px) 100vw, 348px\" \/><figcaption>Measuring package distance from the marker<\/figcaption><\/figure><\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"block-477918ee-7ade-4fb9-a701-e873ef98bc22\">Delivery Subsystem<\/h2>\n\n\n\n<p>There were 5 mandatory performance requirements for the delivery subsystem requirements that if met, would ensure that we are able to reliably deliver small high-value packages without landing. We encountered great success in meeting all performance requirements, as highlighted below.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.4.1<\/strong> Ensure we can deliver eggs without breaking them.<br><strong>MPF.4.3<\/strong> Not drop the package mid-flight 100% of the time.<br><strong>MPF.4.5<\/strong> Hold, lower, and release a package of at least 500 grams.<\/p><\/blockquote>\n\n\n\n<div class=\"wp-block-columns are-vertically-aligned-center is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"976\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-1024x976.jpg\" alt=\"\" class=\"wp-image-601\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-1024x976.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-300x286.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-768x732.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-1536x1464.jpg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-700x667.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-520x496.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-360x343.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-250x238.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320-100x95.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/IMG_0320.jpg 1935w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>The package of eggs used for delivery!<\/figcaption><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\">\n<p>In validation testing of over 25 flights and 19 deliveries, we are proud to report <strong>0 breakages<\/strong> and <strong>0 accidental drops<\/strong>.<\/p>\n<\/div>\n<\/div>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.4.2<\/strong> Release the package successfully 90% of the time.<br><strong>MPF.4.4<\/strong> Deliver package from at least 4 ft above the ground.<\/p><\/blockquote>\n\n\n\n<div class=\"wp-block-columns are-vertically-aligned-center is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:66.66%\">\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/-T-4_o8PZv4\" frameborder=\"0\" allowfullscreen=\"\"><\/iframe>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-vertically-aligned-center is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:33.33%\">\n<p>In 20 delivery validation attempts, we separated 19 times, yielding a success rate of <strong>95%<\/strong>.<\/p>\n\n\n\n<p>Our average delivery height was <strong>above 10.5ft<\/strong>, well above our performance requirement. We delivered from as high as <strong>20ft<\/strong> in the air!<\/p>\n\n\n\n<p><\/p>\n<\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">GPSND <\/h2>\n\n\n\n<blockquote class=\"wp-block-quote is-layout-flow wp-block-quote-is-layout-flow\"><p><strong>MPF.2.1<\/strong> Achieve a relative trajectory error of 3% or less during fixed wing modes.<\/p><\/blockquote>\n\n\n\n<p>To determine if we achieved MPF.2.1, we collected data from several different runs at both the Hawkins and Nardo flight locations, which represent urban and forested areas respectively. We then ran our GPSND system on the collected data and used the onboard GPS data as a ground truth to compare the output. The figure below shows the average relative trajectory error results from these runs for various segment lengths. The dotted red line represents the 3% bar, proving that for both urban and forested environments we are able to achieve the requirement we set.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results.png\" alt=\"\" class=\"wp-image-623\" width=\"587\" height=\"375\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results.png 909w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-300x192.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-768x492.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-700x448.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-520x333.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-360x230.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-250x160.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-content\/uploads\/sites\/63\/2022\/12\/gps-results-100x64.png 100w\" sizes=\"auto, (max-width: 587px) 100vw, 587px\" \/><\/figure><\/div>\n","protected":false},"excerpt":{"rendered":"<p>Fall Validation Demonstration &#8211; Verification Criteria VTOL is able to takeoff and reach target location autonomously in fixed wing mode. System demonstrates VTOL transitions without any errors. The marker is detected by the VTOL from at least 40 ft above [&hellip;]<\/p>\n","protected":false},"author":297,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":{"footnotes":""},"class_list":["post-625","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/pages\/625","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/users\/297"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/comments?post=625"}],"version-history":[{"count":5,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/pages\/625\/revisions"}],"predecessor-version":[{"id":646,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/pages\/625\/revisions\/646"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamj\/wp-json\/wp\/v2\/media?parent=625"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}