{"id":34,"date":"2015-09-14T09:52:11","date_gmt":"2015-09-14T13:52:11","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/?page_id=34"},"modified":"2016-05-06T22:15:37","modified_gmt":"2016-05-07T02:15:37","slug":"system-performance","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/system-performance\/","title":{"rendered":"4. System Performance"},"content":{"rendered":"<p><strong>DEC. 2015 FALL VALIDATION EXPERIMENT RESULTS:<\/strong><\/p>\n<p>(Note: Project scope has changed since this experiment)<\/p>\n<table style=\"height: 737px\" width=\"813\">\n<tbody>\n<tr>\n<td width=\"226\"><strong>Functional Requirements<\/strong><\/td>\n<td width=\"227\"><strong>Test item<\/strong><\/td>\n<td width=\"100\"><strong>Result<\/strong><\/td>\n<\/tr>\n<tr>\n<td rowspan=\"2\" width=\"226\">\u00a0Rotorcraft shall sense position of deck in relation to the rotorcraft.<\/td>\n<td width=\"227\">Heading detection at minimum 50m distance<\/td>\n<td width=\"100\">Check \u2714<\/td>\n<\/tr>\n<tr>\n<td width=\"227\">10m distance : Orientation and position of deck can be seen<\/td>\n<td width=\"100\">Check \u2714<\/td>\n<\/tr>\n<tr>\n<td width=\"226\">\u00a0Rotorcraft shall land on stationary deck.<\/td>\n<td width=\"227\">Rotorcraft shall land within 50cm of center of the deck, as measured from the center of the rotorcraft.<\/td>\n<td width=\"100\">Fail \u2716<\/td>\n<\/tr>\n<tr>\n<td width=\"226\"><strong>Non-Functional Requirements<\/strong><\/td>\n<td width=\"227\"><strong>Test item<\/strong><\/td>\n<td width=\"100\"><strong>Result<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"226\">\u00a0Operation of autonomous landing mode shall be possible without radio commands and in GPS-denied conditions.<\/td>\n<td width=\"227\">Does the system operate in GPS-denied condition?<\/td>\n<td width=\"100\">Check \u2714<\/td>\n<\/tr>\n<tr>\n<td width=\"226\">\u00a0Autonomous landing sequence shall execute after a single user &#8220;go&#8221; command.<\/td>\n<td width=\"227\">Is the user interface very simple?<\/td>\n<td width=\"100\">Check \u2714<\/td>\n<\/tr>\n<tr>\n<td width=\"226\">\u00a0System shall operate without damage to rotorcraft or deck.<\/td>\n<td width=\"227\">Is the system still perfect?<\/td>\n<td width=\"100\">Check \u2714<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><strong>APRIL 2016 SPRING VALIDATION EXPERIMENT RESULTS:<\/strong><\/p>\n<ol>\n<li>Evaluate Functional &amp; Non-functional Requirements<\/li>\n<\/ol>\n<table width=\"623\" cellspacing=\"0\" cellpadding=\"1\">\n<colgroup>\n<col width=\"138\" \/>\n<col width=\"291\" \/>\n<col width=\"186\" \/> <\/colgroup>\n<tbody>\n<tr valign=\"top\">\n<td style=\"text-align: center\" bgcolor=\"#ffffff\" width=\"138\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Functional Requirements<\/span><\/span><\/strong><\/td>\n<td style=\"text-align: center\" width=\"291\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Performance Requirement<\/span><\/span><\/strong><\/td>\n<td style=\"text-align: center\" width=\"186\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Result<\/span><\/span><\/strong><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td rowspan=\"2\" width=\"138\"><span style=\"color: #000000\"><span style=\"font-size: small\">Identify the deck within the environment<\/span><\/span><\/td>\n<td width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">1 false positive deck identification allowable in 100 trials<\/span><\/span><\/td>\n<td width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Succeed with 100 % identification rate<\/span><\/span><\/td>\n<\/tr>\n<tr>\n<td valign=\"top\" width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall sense position of deck relative to the rotorcraft:<\/span><\/span><\/p>\n<p><span style=\"color: #000000\"><span style=\"font-size: small\">1. Detection at 5m distance<\/span><\/span><\/p>\n<p><span style=\"color: #000000\"><span style=\"font-size: small\">2. 10cm + 4cm\/m allowable error<\/span><\/span><\/td>\n<td valign=\"top\" width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Succeed with required distance and the error is less than 5 cm<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"138\"><span style=\"color: #000000\"><span style=\"font-size: small\">Predict dynamics of the deck<\/span><\/span><\/td>\n<td width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Predict the deck within 4cm\/m of current distance to the deck<\/span><\/span><\/td>\n<td width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"138\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall robustly follow a trajectory<\/span><\/span><\/td>\n<td width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Follow planned trajectory 99% of time, within 0.8cm\/m of current distance to deck<\/span><\/span><\/td>\n<td width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Failed with error larger than the requirement<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td rowspan=\"3\" width=\"138\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall land on the landing zone of the deck.<\/span><\/span><\/td>\n<td width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall land within 50cm of center of the deck, as measured from the center of the rotorcraft<\/span><\/span><\/td>\n<td width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/td>\n<\/tr>\n<tr>\n<td valign=\"top\" width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall land on a dynamically moving deck<\/span><\/span><\/td>\n<td valign=\"top\" width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/td>\n<\/tr>\n<tr>\n<td valign=\"top\" width=\"291\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall perform 8 successful landings over a 10 cycle lifetime.<\/span><\/span><\/td>\n<td valign=\"top\" width=\"186\"><span style=\"color: #000000\"><span style=\"font-size: small\">Failed with the landing rate around 60%<\/span><\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<table style=\"height: 408px\" width=\"622\" cellspacing=\"0\" cellpadding=\"7\">\n<colgroup>\n<col width=\"82*\" \/>\n<col width=\"97*\" \/>\n<col width=\"78*\" \/> <\/colgroup>\n<tbody>\n<tr valign=\"top\">\n<td bgcolor=\"#ffffff\" width=\"32%\">\n<p style=\"text-align: center\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Nonfunctional Requirements<\/span><\/span><\/strong><\/p>\n<\/td>\n<td width=\"38%\">\n<p style=\"text-align: center\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Constraint\/Requirement<\/span><\/span><\/strong><\/p>\n<\/td>\n<td width=\"30%\">\n<p style=\"text-align: center\"><strong><span style=\"color: #000000\"><span style=\"font-size: small\">Result<\/span><\/span><\/strong><\/p>\n<\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"32%\"><span style=\"color: #000000\"><span style=\"font-size: small\">System shall operate in EMCON conditions.<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Operation of autonomous landing mode shall be possible without radio commands and in GPS-denied conditions.<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"32%\"><span style=\"color: #000000\"><span style=\"font-size: small\">System shall operate with minimal user input.<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Autonomous landing sequence shall execute after a single user &#8220;go&#8221; command.<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"32%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Rotorcraft shall land safely.<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">System shall operate without damage to rotorcraft or deck.<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>2. Evaluate with SVE Test Plan<\/p>\n<table style=\"height: 860px\" width=\"620\" cellspacing=\"0\" cellpadding=\"7\">\n<colgroup>\n<col width=\"82*\" \/>\n<col width=\"97*\" \/>\n<col width=\"78*\" \/> <\/colgroup>\n<tbody>\n<tr valign=\"top\">\n<td bgcolor=\"#ffffff\" width=\"32%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Test Plan<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Criteria<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Result<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td rowspan=\"2\" width=\"32%\" height=\"2\"><span style=\"color: #000000\"><span style=\"font-size: small\">Stable Hovering<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad shall not display jerky movements<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad does not move greater than 30cm away from original position during hovering<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Succeed with the error less than 30cm<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td rowspan=\"3\" width=\"32%\" height=\"2\"><span style=\"color: #000000\"><span style=\"font-size: small\">Landing in a static deck<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands within three minutes of switching to autonomous mode<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Succeed with landing time less than 30 seconds<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands without damage to itself, the deck, or any surroundings<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands within 50cm of the center of the deck<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td rowspan=\"3\" width=\"32%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Landing on a dynamically moving deck<\/span><\/span><\/td>\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands within three minutes of switching to autonomous mode<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Succeed with landing time less than 30 seconds<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands without damage to itself, the deck, or any surroundings<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/td>\n<\/tr>\n<tr valign=\"top\">\n<td width=\"38%\"><span style=\"color: #000000\"><span style=\"font-size: small\">Quad lands within 50cm of the center of the deck<\/span><\/span><\/td>\n<td width=\"30%\"><span style=\"color: #000000\"><span style=\"font-size: small\"><span style=\"color: #000000\"><span style=\"font-size: small\">Success<\/span><\/span><\/span><\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>DEC. 2015 FALL VALIDATION EXPERIMENT RESULTS: (Note: Project scope has changed since this experiment) Functional Requirements Test item Result \u00a0Rotorcraft shall sense position of deck in relation to the rotorcraft. Heading detection at minimum 50m distance Check \u2714 10m distance : Orientation and position of deck can be seen Check \u2714 \u00a0Rotorcraft shall land on<br \/><a class=\"moretag\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/system-performance\/\">+ Read More<\/a><\/p>\n","protected":false},"author":15,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"template_parts\/page-fullwidth_template.php","meta":{"footnotes":""},"class_list":["post-34","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/pages\/34","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/users\/15"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/comments?post=34"}],"version-history":[{"count":12,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/pages\/34\/revisions"}],"predecessor-version":[{"id":627,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/pages\/34\/revisions\/627"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamj\/wp-json\/wp\/v2\/media?parent=34"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}