{"id":174,"date":"2022-02-20T17:48:48","date_gmt":"2022-02-20T17:48:48","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/?page_id=174"},"modified":"2022-05-06T00:08:36","modified_gmt":"2022-05-06T00:08:36","slug":"spring-validation-demonstration","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/performance\/spring-validation-demonstration\/","title":{"rendered":"Spring Validation Demonstration"},"content":{"rendered":"\n<p>The SVD demonstration will need all 5 members of the team to be present and will take place outside the cage. The Hello Robot, operator\u2019s computer, customized tools, and the test setup will be needed for the demonstration.&nbsp;<\/p>\n\n\n\n<p>Procedure :&nbsp;<\/p>\n\n\n\n<ol class=\"wp-block-list\"><li><strong>To show pollination, navigation and perception<\/strong><\/li><\/ol>\n\n\n\n<ul class=\"wp-block-list\"><li>Robot is placed at the start of the test environment\u2019s first row.<\/li><li>Reactive navigation package is launched. It follows the path as shown in Fig 1. <\/li><li>Perception package is launched.<\/li><li>Bounding boxes for flowers for the first row are obtained as shown in Fig 2.&nbsp;<\/li><li>Robot stops at the bounding box location as shown in Fig 2.<\/li><li>Robot arm reaches the bounding box location as shown in Fig 2.&nbsp;&nbsp;<\/li><li>Robot arm reaches the POI location(given via aruco markers) as shown in Fig 3.<\/li><li>Robot performs the pollination test (<a href=\"https:\/\/drive.google.com\/file\/d\/1TYhbl4XMF8C3h6ZYtdYIyzO03hA55f5Q\/view?usp=sharing\">as mentioned in test 11<\/a>) as shown in Fig 4.<\/li><li>Robot navigates to the next pollination point and repeats this for two more instances.<\/li><li>Robot reaches the end of the row, does row switching using aruco markers.<\/li><li>Robot navigates through one more row and then stops.&nbsp;<\/li><\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"2\"><li><strong>To show harvesting, navigation and perception<\/strong><\/li><\/ol>\n\n\n\n<ul class=\"wp-block-list\"><li>Robot is placed at the start of the test environment\u2019s first row.<\/li><li>Reactive navigation package is launched. It follows the path as shown in Fig 1.<\/li><li>Perception package is launched.<\/li><li>Bounding boxes for fruits for the first row are obtained as shown in Fig 2.&nbsp;<\/li><li>Robot stops at the bounding box location as shown in Fig 2.<\/li><li>Robot arm reaches the bounding box location as shown in Fig 2.&nbsp;<\/li><li>Robot arm reaches the POI location(given via aruco markers) as shown in Fig 3.<\/li><li>Robot performs the harvesting test (<a href=\"https:\/\/drive.google.com\/file\/d\/1TYhbl4XMF8C3h6ZYtdYIyzO03hA55f5Q\/view?usp=sharing\">as mentioned in test 1<\/a>0)  as shown in Fig 5.<\/li><li>Robot navigates to the next harvesting point and repeats this for two more instances.<\/li><li>Robot reaches the end of the row, does row switching using aruco markers.<\/li><li>Robot navigates through one more row and then stops.&nbsp;<\/li><\/ul>\n\n\n\n<ol class=\"wp-block-list\" start=\"3\"><li><strong>To show harvester tool capability&nbsp;<\/strong><\/li><\/ol>\n\n\n\n<ul class=\"wp-block-list\"><li>Tomato bunch is placed near the robot end effector such that the stem is in between the gripper pads as shown in Fig 5.<\/li><li>Run harvesting program which will activate the gripper and cutter sequence as shown in Fig 5.<\/li><\/ul>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"483\" height=\"512\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav.jpg\" alt=\"\" class=\"wp-image-561\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav.jpg 483w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav-283x300.jpg 283w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav-230x244.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav-350x371.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/nav-480x509.jpg 480w\" sizes=\"auto, (max-width: 483px) 100vw, 483px\" \/><figcaption>Fig 1. Navigation route<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"394\" height=\"512\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/per.jpg\" alt=\"\" class=\"wp-image-563\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/per.jpg 394w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/per-231x300.jpg 231w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/per-230x299.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/per-350x455.jpg 350w\" sizes=\"auto, (max-width: 394px) 100vw, 394px\" \/><figcaption>Fig 2. Bounding box recognized by the head camera, bot stops, and arm moves towards it<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"512\" height=\"342\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi.jpg\" alt=\"\" class=\"wp-image-564\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi.jpg 512w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi-300x200.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi-230x154.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi-350x234.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/poi-480x321.jpg 480w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><figcaption>Fig 3. POI recognized by the wrist camera (aruco for SVD) and arm moves towards it<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"512\" height=\"430\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate.jpg\" alt=\"\" class=\"wp-image-565\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate.jpg 512w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate-300x252.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate-230x193.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate-350x294.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/pollinate-480x403.jpg 480w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><figcaption>Fig 4. Pollination action<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"512\" height=\"457\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest.jpg\" alt=\"\" class=\"wp-image-567\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest.jpg 512w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest-300x268.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest-230x205.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest-350x312.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/04\/harvest-480x428.jpg 480w\" sizes=\"auto, (max-width: 512px) 100vw, 512px\" \/><figcaption>Fig 5. Harvesting action<\/figcaption><\/figure>\n\n\n\n<p><strong>Validation&nbsp;<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>The robot must track the rows within \u00b115 cm accuracy (M.P.1) while not colliding with plants and pots (M.P.2).<\/li><li>The robot must successfully change rows when at the end of one row (D.P.1).<\/li><li>The robot detects tomatoes\/flower clusters with a success rate of 60%. (M.P.3, M.P.5).<\/li><li>Clusters of flowers \/ tomatoes located to within 10cm (Euclidean) (D.P.3, D.P.4).<\/li><li>The harvesting tool should cut the stem in two or less passes (D.P.6).<\/li><li>The payload capacity of the harvesting tool should be atleast 500g (M.N.1, M.N.2).<\/li><li>Flowers will be preserved 60% of the time (D.P.4).<\/li><\/ul>\n\n\n\n<p>Fig. 5 shows the performance evaluation following SVD and SVD Encore.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"472\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-1024x472.png\" alt=\"\" class=\"wp-image-632\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-1024x472.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-300x138.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-768x354.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-920x424.png 920w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-230x106.png 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-350x161.png 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3-480x221.png 480w, https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-content\/uploads\/sites\/60\/2022\/05\/image-3.png 1177w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption>Fig 5. Performance Evaluation<\/figcaption><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>The SVD demonstration will need all 5 members of the team to be present and will take place outside the cage. The [&hellip;]<\/p>\n","protected":false},"author":281,"featured_media":0,"parent":169,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-174","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/pages\/174","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/users\/281"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/comments?post=174"}],"version-history":[{"count":10,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/pages\/174\/revisions"}],"predecessor-version":[{"id":633,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/pages\/174\/revisions\/633"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/pages\/169"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2022teamg\/wp-json\/wp\/v2\/media?parent=174"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}