{"id":119,"date":"2024-11-24T18:33:03","date_gmt":"2024-11-24T18:33:03","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/?page_id=119"},"modified":"2024-11-25T03:47:58","modified_gmt":"2024-11-25T03:47:58","slug":"system-summary","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/system\/system-summary\/","title":{"rendered":"System Summary"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Problem Statement<\/h2>\n\n\n\n<p>The goal of this project is to implement a robotic system which autonomously harvest green peppers from outdoor farms. The robotic system will be mobile to navigate around the fields and be equipped with robotic arms to grasp and separate the peppers from the plant. A brief description of our system is as follows :   <\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A robotic system implementing a combination of computer vision models to detect peppers and compute reachable targets within the workspace.<\/li>\n\n\n\n<li>This system will not be restrained to greenhouse environments. This system&#8217;s ability to withstand environmental changes in lighting and weather allows continuous field operation, making it ideal for agriculture<\/li>\n\n\n\n<li>This system has a bimanual arm setup, with a gripper mounted on one arm for precisely grasping the fruit and a pruner\/cutter mounted on another to perform extraction.<\/li>\n\n\n\n<li>Each of the system&#8217;s arms has independent control which accounts for dexterity, to adjust for different orientation of the peppers and to avoid accidentally drop of peppers during harvesting.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Use Case<\/h2>\n\n\n\n<p>It&#8217;s harvesting season, and our farmer Tom, who has a mid sized pepper farm is looking to make a bountiful harvest. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time.jpg\" alt=\"\" class=\"wp-image-130\" style=\"aspect-ratio:1.3333333333333333;object-fit:cover;width:444px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-1000x1000.jpg 1000w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-230x230.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-350x350.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-farmer-standing-next-to-his-mid-sized-pepper-field-feeling-excited-to-harvest-fresh-bell-peppers-at-night-time-480x480.jpg 480w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>He <strong><em>deploys<\/em><\/strong> <strong>VADER, an autonomous pepper harvesting robot<\/strong> into the field, and <strong><em>selects<\/em><\/strong> the mode of operation. When set to autonomous mode, <strong>VADER<\/strong> reaches the appropriate position near the pepper plant using the farmer&#8217;s guidance to start harvesting. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field.jpg\" alt=\"\" class=\"wp-image-132\" style=\"object-fit:cover;width:322px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-1000x1000.jpg 1000w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-230x230.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-350x350.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-human-farmer-standing-behind-two-robotic-arms-gripping-and-cutting-bell-peppers-hanging-from-plant-branches-in-the-field-480x480.jpg 480w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong><em>It scans<\/em><\/strong> the plant and <strong><em>identifies<\/em><\/strong> reachable peppers and their peduncles, and <em><strong>selects <\/strong><\/em>one of them for harvesting.  VADER <em><strong>moves<\/strong><\/em> it&#8217;s gripper arm near the pepper and it&#8217;s cutter arm near the peduncle. It <strong><em>aligns<\/em><\/strong> its gripper and cutter to <strong><em>match<\/em><\/strong> the pepper&#8217;s orientation and then performs precise <strong><em>extractions<\/em><\/strong>, and <strong><em>places <\/em><\/strong>it in the designated storage area. The entire process repeats until all the peppers are harvested.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field.jpg\" alt=\"\" class=\"wp-image-133\" style=\"width:305px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-1000x1000.jpg 1000w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-230x230.jpg 230w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-350x350.jpg 350w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-content\/uploads\/sites\/87\/2024\/11\/A-computer-vision-method-scanning-bell-peppers-in-a-field-480x480.jpg 480w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>In the case of failure, VADER<strong><em> prompts<\/em><\/strong> Tom to select the teleoperation mode, where he monitors a real-time video feed, and remotely <strong><em>guides<\/em><\/strong> <strong>VADER<\/strong> to <strong><em>pick<\/em><\/strong> peppers with accuracy.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Problem Statement The goal of this project is to implement a robotic system which autonomously harvest green peppers from outdoor farms. The robotic system will be mobile to navigate around the fields and be equipped with robotic arms to grasp [&hellip;]<\/p>\n","protected":false},"author":408,"featured_media":0,"parent":45,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-119","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/pages\/119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/users\/408"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/comments?post=119"}],"version-history":[{"count":6,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/pages\/119\/revisions"}],"predecessor-version":[{"id":135,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/pages\/119\/revisions\/135"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/pages\/45"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teame\/wp-json\/wp\/v2\/media?parent=119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}