{"id":160,"date":"2025-02-14T18:57:16","date_gmt":"2025-02-14T18:57:16","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/?page_id=160"},"modified":"2025-11-12T15:50:24","modified_gmt":"2025-11-12T15:50:24","slug":"component-testing-experiment-results","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/component-testing-experiment-results\/","title":{"rendered":"Component Testing &amp; Experiment Results"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Spring Semester<\/h2>\n\n\n\n<p>To verify the reliability of our motion planning system, we did a series of runs in Gazebo simulation and real hardware. We recorded the time to execute policy, the number of automatic replans, the number of manual replans triggered by the user, and whether it passed or failed. If it failed, we reported why it failed. The goal was to pass 4 out of 5 runs and we have met that goal in both real and sim. <\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"392\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-1024x392.png\" alt=\"\" class=\"wp-image-523\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-1024x392.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-300x115.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-768x294.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-1536x587.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-2048x783.png 2048w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-700x268.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-520x199.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-360x138.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-250x96.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/Screenshot-from-2025-04-23-18-25-17-100x38.png 100w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Simulation<\/figcaption><\/figure>\n<\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"416\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-1024x416.png\" alt=\"\" class=\"wp-image-538\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-1024x416.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-300x122.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-768x312.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-1536x623.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-700x284.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-520x211.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-360x146.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-250x101.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image-100x41.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/04\/image.png 2045w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Real robots with varying object positions<\/figcaption><\/figure>\n<\/div>\n\n\n<p>On the perception side, we did some data collection to see what the best parameters would be for the pipeline. The conclusion was:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>15 FPS @ 1080p for 60s \u2192 fastest pipeline without loss in reconstruction quality<\/li>\n\n\n\n<li>Median filtering (frame-to-frame) + SOR (final output) \u2192 best denoising with calibrated camera<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"362\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-1024x362.png\" alt=\"\" class=\"wp-image-586\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-1024x362.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-300x106.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-150x53.png 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-768x272.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-1536x544.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-700x248.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-520x184.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-360x127.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-250x88.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06-100x35.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/05\/Screenshot-from-2025-05-01-16-21-06.png 1950w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h2 class=\"wp-block-heading\">Fall Semester<\/h2>\n\n\n\n<p>We ran a series of stress testing on the manipulation subsystem to explore the initial object pose limitations of where the arms are able to plan within the constrained workspace. The table below shows the different x and y positions as well as yaw angles that we tried. We found that the arms are successful when the object are place in the (0,0) position +\/- 5 cm and the yaw angle range was between 35 to 60 degrees.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"297\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-1024x297.png\" alt=\"\" class=\"wp-image-642\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-1024x297.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-300x87.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-150x44.png 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-768x223.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-1536x446.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-700x203.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-520x151.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-360x105.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-250x73.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04-100x29.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-content\/uploads\/sites\/90\/2025\/11\/Screenshot-from-2025-11-12-10-49-04.png 1994w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Spring Semester To verify the reliability of our motion planning system, we did a series of runs in Gazebo simulation and real hardware. We recorded the time to execute policy, the number of automatic replans, the number of manual replans [&hellip;]<\/p>\n","protected":false},"author":425,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":{"footnotes":""},"class_list":["post-160","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/pages\/160","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/users\/425"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/comments?post=160"}],"version-history":[{"count":7,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/pages\/160\/revisions"}],"predecessor-version":[{"id":643,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/pages\/160\/revisions\/643"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamh\/wp-json\/wp\/v2\/media?parent=160"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}