{"id":195,"date":"2019-02-22T19:31:00","date_gmt":"2019-02-22T19:31:00","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/?page_id=195"},"modified":"2019-05-07T03:26:01","modified_gmt":"2019-05-07T03:26:01","slug":"test-plan","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/project-management\/test-plan\/","title":{"rendered":"Test Plan"},"content":{"rendered":"<hr \/>\n<h1><span style=\"font-weight: 400\">Spring Validation Experiments<\/span><\/h1>\n<p><b>Test 1: Master Computer Subsystem Validation Experiment<\/b><\/p>\n<table>\n<tbody>\n<tr>\n<td><span style=\"font-weight: 400\">Objective<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">To validate the correctness of the modeling and sampling algorithm.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Location<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">No specific requirement.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Equipment<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">Master Computer, Intel Lab Data [9]<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Procedure <\/span><\/td>\n<td colspan=\"3\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Master computer updates temperature model.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Master computer determines next interest points.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Master computer allocates corresponding interest point to each robot.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Directly return temperature data from Intel data set.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Loop through procedure 1 &#8211; 4 until temperature model converges.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Computer root mean square error between the generated model and ground truth temperature distribution.<\/span><\/li>\n<\/ol>\n<\/td>\n<\/tr>\n<tr>\n<td>Requirements<\/td>\n<td colspan=\"3\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">The root mean square error is less than 1 \u2103.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">UGV and UAV are never allocated to the same point.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Temperature model converges within 50 loops.<\/span><\/li>\n<\/ol>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<p><b>Test 2 &amp; 3: UGV\/UAV Subsystem Validation Experiment<\/b><\/p>\n<p><b>Note: <\/b><span style=\"font-weight: 400\">The test design is the same for UGV and UAV. We will perform one test for each robot.<\/span><\/p>\n<table>\n<tbody>\n<tr>\n<td><span style=\"font-weight: 400\">Objective<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">To validate the correctness of UGV\/UAV subsystem.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Location<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">A 20m x 20m x 5m outdoor area behind the NSH hall<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Equipment<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">Jackal UGV\/ AscTec Pelican UAV, Tape measure, Temperature sensor, Stopwatch<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Procedure <\/span><\/td>\n<td colspan=\"3\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Power on Jackal UGV\/ AscTec Pelican UAV.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Assign a target location within the test field to Jackal UGV\/AscTec Pelican UAV.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Jackal UGV\/AscTec Pelican UAV autonomously moves to the target location.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Jackal UGV\/AscTec Pelican UAV stops when it localizes itself close enough to the target location.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Jackal UGV\/AscTec Pelican UAV takes and reports temperature sample.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Loop step 2 &#8211; 5 ten times and measure location error between Jackal reached position and the target position, and temperature error between Jackal\u2019s measurement and ground truth temperature at each time. <\/span><\/li>\n<\/ol>\n<\/td>\n<\/tr>\n<tr>\n<td>Requirements<\/td>\n<td colspan=\"3\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Mean location error is less than 2 meters.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Mean temperature error is less than 2 \u2103.<\/span><\/li>\n<\/ol>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><b>\u00a0<\/b><\/p>\n<hr \/>\n<h1><span style=\"font-weight: 400\">Fall Validation Experiments<\/span><\/h1>\n<p><strong>Integrated System Validation Experiment<\/strong><\/p>\n<table>\n<tbody>\n<tr>\n<td><span style=\"font-weight: 400\">Objective<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">To validate the correctness of the whole system.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Location<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">A 20m x 20m x 5m outdoor area behind the NSH hall<\/span><\/td>\n<\/tr>\n<tr>\n<td>Test Field<\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">A 20m x 20m x 5m area with designed obstacles randomly placed. 3 &#8211; 5 heat sources are also placed within the test field to increase temperature distribution variation.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Equipment\u00a0<\/span><\/td>\n<td colspan=\"3\"><span style=\"font-weight: 400\">Master Computer, Jackal UGV, AscTec Pelican UAV, Tape measure, Temperature sensor, Stopwatch, Heat source.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">Procedure <\/span><\/td>\n<td colspan=\"3\">\n<table style=\"font-family: inherit;font-size: inherit\">\n<tbody>\n<tr>\n<td><b>1<\/b><\/td>\n<td colspan=\"2\">Manually collect 100 temperature samples within the test fields to build a ground truth temperature distribution.<\/td>\n<\/tr>\n<tr>\n<td><b>2<\/b><\/td>\n<td colspan=\"2\">Master computer updates temperature model<\/td>\n<\/tr>\n<tr>\n<td><b>3<\/b><\/td>\n<td>Jackal UGV asks master computer for the location of next interest point.<\/td>\n<td>AscTec Pelican UAV asks master computer for the location of next interest point.<\/td>\n<\/tr>\n<tr>\n<td><b>4<\/b><\/td>\n<td>Master determines the next interest point for Jackal UGV.<\/td>\n<td>Master determines the next interest point for AscTec Pelican UAV.<\/td>\n<\/tr>\n<tr>\n<td><b>5<\/b><\/td>\n<td>Master computer sends the next interest point to Jackal UGV.<\/td>\n<td>Master computer sends the next interest point to AscTec Pelican UAV.<\/td>\n<\/tr>\n<tr>\n<td><b>6<\/b><\/td>\n<td>Jackal UGV autonomously moves to the target location.<\/td>\n<td>AscTec Pelican UAV autonomously moves to the target location.<\/td>\n<\/tr>\n<tr>\n<td><b>7<\/b><\/td>\n<td>Jackal UGV stops when it localizes itself close enough to the target location.<\/td>\n<td>AscTec Pelican UAV stops when it localizes itself close enough to the target location.<\/td>\n<\/tr>\n<tr>\n<td><b>8<\/b><\/td>\n<td>Jackal UGV measures temperature and report it to master computer.<\/td>\n<td>AscTec Pelican UAV measures temperature and report it to master computer.<\/td>\n<\/tr>\n<tr>\n<td><b>9<\/b><\/td>\n<td colspan=\"2\">Loop through procedure 3 &#8211; 8 simultaneously for Jackal UGV and AscTec Pelican UAV until the temperature model converges.<\/td>\n<\/tr>\n<tr>\n<td><b>10<\/b><\/td>\n<td colspan=\"2\">Computer root mean square error between the generated model and ground truth temperature distribution.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<\/td>\n<\/tr>\n<tr>\n<td>Requirements<\/td>\n<td colspan=\"3\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">The root mean square error is less than 3 \u2103.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">UGV and UAV never collides with obstacles or each other.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Temperature model converges within 50 loops.<\/span><\/li>\n<\/ol>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>Spring Validation Experiments Test 1: Master Computer Subsystem Validation Experiment Objective To validate the correctness of the modeling and sampling algorithm. Location No specific requirement. Equipment Master Computer, Intel Lab Data [9] Procedure Master computer updates temperature model. Master computer [&hellip;]<\/p>\n","protected":false},"author":163,"featured_media":0,"parent":180,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-195","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/pages\/195","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/users\/163"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/comments?post=195"}],"version-history":[{"count":6,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/pages\/195\/revisions"}],"predecessor-version":[{"id":383,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/pages\/195\/revisions\/383"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/pages\/180"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamg\/wp-json\/wp\/v2\/media?parent=195"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}