{"id":41,"date":"2019-01-17T01:30:08","date_gmt":"2019-01-17T01:30:08","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/?page_id=41"},"modified":"2019-12-10T05:49:49","modified_gmt":"2019-12-10T10:49:49","slug":"test-plan","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/project-management\/test-plan\/","title":{"rendered":"Test Plan"},"content":{"rendered":"<h1><b>Team D SVD Test: CuBi<\/b><\/h1>\n<h4><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-347\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-content\/uploads\/sites\/34\/2019\/05\/image2.jpg\" alt=\"\" width=\"800\" height=\"600\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-content\/uploads\/sites\/34\/2019\/05\/image2.jpg 800w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-content\/uploads\/sites\/34\/2019\/05\/image2-300x225.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-content\/uploads\/sites\/34\/2019\/05\/image2-768x576.jpg 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><\/h4>\n<h4 style=\"text-align: left\"><b>Test Procedure:<\/b><\/h4>\n<p><span style=\"font-weight: 400\">1. Randomly place 5 toys inside the designated area<\/span><\/p>\n<p><span style=\"font-weight: 400\">2. Turn on Cubi.<\/span><\/p>\n<p><span style=\"font-weight: 400\">3. Search for a toy and move towards it.<\/span><\/p>\n<p><span style=\"font-weight: 400\">4. Pick up the toy.<\/span><\/p>\n<p><span style=\"font-weight: 400\">5. Return to the start position.<\/span><\/p>\n<p><span style=\"font-weight: 400\">6. Drop the toy to a designated drop-off location (into a box). <\/span><\/p>\n<p><span style=\"font-weight: 400\">7. Repeat steps 2 to 5 until all toys are picked up.<\/span><\/p>\n<p><span style=\"font-weight: 400\">8. If Cubi fails, we place Cubi at the start location and turn it on again. <\/span><\/p>\n<h4><b>Verification Criteria:<\/b><\/h4>\n<p><strong>Overall Goal: <\/strong><\/p>\n<p><span style=\"font-weight: 400\">Pick up 3 toys and drop them to a designated location <\/span><span style=\"font-weight: 400\">within 25 minutes.<\/span><\/p>\n<p><strong>Secondary Goals: <\/strong><\/p>\n<ol>\n<li style=\"list-style-type: none\">\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Detect a toy and calculate its pose relative to Cubi<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Approach a toy within 2 cm<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Pick up one toy on the tray<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Lift the tray (with a toy inside) up from the ground.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Return to the start position<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Drop a toy in the box<\/span><\/li>\n<\/ol>\n<\/li>\n<\/ol>\n<h4><b>Evaluation Result:<\/b><\/h4>\n<p><strong>Overall Goal: <\/strong><\/p>\n<p><span style=\"font-weight: 400\">Picked up <\/span><strong>all 5 toys<\/strong><span style=\"font-weight: 400\"> and dropped them into a box <\/span><strong>within 10 minutes<\/strong><span style=\"font-weight: 400\">.<\/span><\/p>\n<p><strong>Secondary Goals:<\/strong><\/p>\n<p>All the secondary goals are achieved.<\/p>\n<p>&nbsp;<\/p>\n<p>Check out the video of CuBi in action <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/media\/spring-fall-videos\/\">here<\/a>!<\/p>\n<p><b style=\"font-size: 35px\">Team D Test Plan &#8211; CuBi<\/b><\/p>\n<p><a href=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-content\/uploads\/sites\/34\/2019\/10\/TeamD_TestPlan.pdf\">Fall 2019 Test Plan<\/a><\/p>\n<p><b style=\"font-size: 35px\">Team D FVD &#8211; CuBi<\/b><\/p>\n<p><b>Objective<\/b><span style=\"font-weight: 400\">:Validate all of CuBi\u2019s subsystems and their integration and to meet all the performance requirements. <\/span><\/p>\n<p><b>Location: <\/b><span style=\"font-weight: 400\">Indoor open area near the RI commons on the 4th floor, Newell Simon Hall. It will have obstacles like chairs placed in the area. Area will be closed with walls created by furniture<\/span><b>.<\/b><\/p>\n<p><b>Equipment: <\/b><span style=\"font-weight: 400\">6 tennis ball-sized toys, CuBi, any necessary replacements for any major subsystems which are at high risk of breaking, AprilTag<\/span><\/p>\n<p><b>Setup:<\/b><\/p>\n<ol>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Third party places 6 toys in the designated area and can place obstacles as desired.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Team CuBi start at the starting location and a box will be placed in the test area.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">CuBi is placed in the designated starting position.<\/span><\/li>\n<\/ol>\n<p><b>Procedure:<\/b><\/p>\n<table>\n<tbody>\n<tr>\n<td><b>Step<\/b><\/td>\n<td><b>Description<\/b><\/td>\n<td><b>Performance Measures<\/b><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">1<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi must be able to traverse over carpets with thickness of 12mm or lesser.<\/span><\/td>\n<td><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">2<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi starts to explore the room and perform SLAM to build a 2D map of the room. <\/span><\/td>\n<td><span style=\"font-weight: 400\">90% of the reachable area should be mapped by the robot; validated using ground truth<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">3<\/span><\/td>\n<td><span style=\"font-weight: 400\">As SLAM is performed, CuBi also uses its perception pipeline to detect objects and classify them as pickable or obstacles and records their rough positions in current map.<\/span><\/td>\n<td><span style=\"font-weight: 400\">Classification error is less than 20%<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">4<\/span><\/td>\n<td><span style=\"font-weight: 400\">After building the 2D map, CuBi applies path planning to generate a traversable path through positions of objects, obstacles and drop off location, and achieve the desired poses.<\/span><\/td>\n<td><span style=\"font-weight: 400\">The error should be less than 10% of the desired configuration<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">5<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi \u00a0avoids slow-moving and stationary obstacles.<\/span><\/td>\n<td><span style=\"font-weight: 400\">Avoid 75% of the obstacles<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">6<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi then uses its manipulator to pick up at least two objects off the ground.<\/span><\/td>\n<td><span style=\"font-weight: 400\">Manipulator should pickup within 5 attempts<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">7<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi should be able to pick most of the toys off the ground.<\/span><\/td>\n<td><span style=\"font-weight: 400\">At least 80% of the toys should be picked up by CuBi <\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">8<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi should be able to drop the clutter into a box at the designated position accurately.<\/span><\/td>\n<td><span style=\"font-weight: 400\">The success rate of dropping should be more than 90%. Error is the difference in euclidean distance between the center of the box and the dropped toy\u2019s location. The threshold for counting as a failed drop is 0.5m<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400\">9<\/span><\/td>\n<td><span style=\"font-weight: 400\">CuBi should be able to clean up 10m\u00b2 area in a reasonable time.<\/span><\/td>\n<td><span style=\"font-weight: 400\">The time should be within 10 minutes<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n","protected":false},"excerpt":{"rendered":"<p>Team D SVD Test: CuBi Test Procedure: 1. Randomly place 5 toys inside the designated area 2. Turn on Cubi. 3. Search for a toy and move towards it. 4. Pick up the toy. 5. Return to the start position. 6. Drop the toy to a designated drop-off location (into a box). 7. Repeat steps &hellip; <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/project-management\/test-plan\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Test Plan<\/span><\/a><\/p>\n","protected":false},"author":151,"featured_media":0,"parent":35,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-41","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/pages\/41","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/users\/151"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/comments?post=41"}],"version-history":[{"count":7,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/pages\/41\/revisions"}],"predecessor-version":[{"id":503,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/pages\/41\/revisions\/503"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/pages\/35"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teamd\/wp-json\/wp\/v2\/media?parent=41"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}