{"id":288,"date":"2024-04-04T17:51:46","date_gmt":"2024-04-04T22:51:46","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/?page_id=288"},"modified":"2024-12-12T17:45:06","modified_gmt":"2024-12-12T22:45:06","slug":"system-implementation","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/system\/system-implementation\/","title":{"rendered":"System Implementation"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Weeding Manipulator Subsystem<\/h2>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/8BmoferNKyk?si=ruWZZlejrqZuqQ8q\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<p class=\"has-text-align-center\">Linear Stage Motion Demo<\/p>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/rgFYSNS9Ds0?si=y-uhvIcDUC4NgNeJ\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<p class=\"has-text-align-center\">Angular Motion Demo<\/p>\n\n\n\n<p>Two videos above shows manual commands of manipulator and individual accuracy in position the tool. <\/p>\n\n\n\n<p>Our weeding manipulator is designed for precision and speed, effectively directing the end effector to targeted areas with two degrees of freedom. This is achieved through a linear carriage powered by a BLDC motor and a hinge actuated by a linear actuator, providing full ground coverage.<\/p>\n\n\n\n<p><strong>Design and Construction<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Frame and Mounting:<\/strong>\u00a0The subsystem is securely mounted on a Husky robot using a robust aluminum frame bolted onto a structural steel plate. The frame extends 8 inches above the Husky, ensuring sufficient workspace and an optimal field of view for the downward-facing camera. A cable tray accommodates cable flexibility as the carriage moves.<\/li>\n\n\n\n<li><strong>Actuation Mechanism:<\/strong>\u00a0A steel cable system, chosen for its high strength-to-weight ratio, drives the linear carriage. This minimizes oscillating mass and improves response times. The cable is powered by a custom-machined aluminum pulley connected to a BLDC motor, with tension ensuring smooth operation. A secondary pulley redirects the cable for optimal alignment.<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"771\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-1024x771.jpeg\" alt=\"\" class=\"wp-image-518\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-1024x771.jpeg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-300x226.jpeg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-768x578.jpeg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-700x527.jpeg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-520x392.jpeg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-360x271.jpeg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-250x188.jpeg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray-100x75.jpeg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/cable_tray.jpeg 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>Control System<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>ROS Integration:<\/strong>\u00a0A single ROS node controls the manipulator, including laser activation. The BLDC motor uses a rotary encoder for relative positioning, complemented by a homing routine to map encoder counts to absolute distances.<\/li>\n\n\n\n<li><strong>Precision Control:<\/strong>\u00a0Both actuators are managed by a proportional-derivative controller with static friction compensation. The system detects when the actuator is stationary and applies additional force to reach the desired position. This compensation adapts geometrically for the BLDC motor near workspace limits, overcoming increased static friction.<\/li>\n<\/ul>\n\n\n\n<p><strong>Performance Highlights<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Accuracy:<\/strong>\u00a0The manipulator system accurately targets small weeds (~1 cm\u00b2) within its workspace, achieving a 90% success rate in tests. Even under challenging conditions, such as varied weed sizes and placements, the system maintained an 80% accuracy rate.<\/li>\n\n\n\n<li><strong>Reliability:<\/strong>\u00a0All failures during testing were attributed to detection limitations or workspace boundaries, not the manipulator system itself.<\/li>\n<\/ul>\n\n\n\n<p><a href=\"https:\/\/youtube.com\/shorts\/Kb4K6s2XCwE\">Additional video<\/a> here demonstrates the angular motion accuracy in a slight variation.<\/p>\n\n\n\n<p>Video below demonstrated manipulator accuracy. The video is a combination of manipulator accuracy test, eye-safe laser functional, and downward detection accuracy. The video is a part of SVD records.<\/p>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/xtt7nMd8iNs?si=ER9nrJxsxuOstqp4\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<h2 class=\"wp-block-heading\">Weeding Mechanism<\/h2>\n\n\n\n<p>The mechanism will be capable of both chemical spraying and laser weeding, with designs allowing for easy interchangeability. The spraying system uses a peristaltic pump and atomizing nozzle, while the laser system involves a custom PCB and diode laser with heatsink.<\/p>\n\n\n\n<p>The dual-solution approach allows for flexibility and adaptability to different weeding scenarios. Precision spraying offers simplicity, whereas laser weeding provides an environmentally friendly solution. The trade study led to this dual approach over singular methods to capitalize on the strengths of both systems. In the Fall Semester, having proven the laser\u2019s effectiveness, we focused on integrating the laser control with our system.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Laser Mechanism<\/h3>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/BWVidBdJWEE?si=ldsFGxjz8a-XUlXS\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<p>Traditional weeding methods in agriculture are labor-intensive, environmentally harmful, or require bulky machinery. Our system builds on mossTM\u2019s autonomous mobile platform by introducing a lightweight laser-based weeding tool. This innovative approach avoids the drawbacks of conventional tools, ensuring compatibility with the existing autonomous system.<\/p>\n\n\n\n<p><strong>Design Choices<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Laser Diodes vs. CO2 Lasers:<\/strong> Unlike CO2 lasers, which are inefficient (\u224820% efficiency) and require massive power (e.g., 22.5 kW for Carbon Robotics\u2019 30-laser tractor system), our solution leverages laser diodes. These diodes offer a much higher efficiency range (\u224850\u201380%) and are compact, eliminating the need for additional systems like vacuum pumps.<\/li>\n\n\n\n<li><strong>Laser Specification:<\/strong>\n<ul class=\"wp-block-list\">\n<li><strong>Full-Power Laser:<\/strong>\u00a0A 5 W, 447 nm laser diode was chosen for its cost-effectiveness in safety equipment compared to higher wavelengths.<\/li>\n\n\n\n<li><strong>Eye-Safe Laser:<\/strong>\u00a0A 515 nm laser diode operating below CMU\u2019s safety limit (4.99 mW) ensures safe operation.<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n\n\n\n<p><strong>Safety Measures<\/strong><\/p>\n\n\n\n<p>Developing a laser system involves significant safety precautions:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Compliance with CMU\u2019s Laser Safety Program.<\/li>\n\n\n\n<li>Use of laser safety goggles tailored to the chosen wavelengths.<\/li>\n\n\n\n<li>Targeting strategies informed by research, such as focusing on the weed\u2019s meristem for optimal damage.<\/li>\n<\/ul>\n\n\n\n<p><strong>Results<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Eye-Safe Laser:<\/strong>\u00a0Successfully tested to meet SVD requirements for functionality and power limits.<\/li>\n\n\n\n<li><strong>Full-Power Laser:<\/strong>\u00a0Demonstrated effective weed damage, meeting the SVD requirement for killing weeds.<\/li>\n<\/ul>\n\n\n\n<p><strong>Performance Highlight<\/strong><\/p>\n\n\n\n<p>The system effectively balances precision and safety, offering a lightweight yet powerful solution for autonomous agricultural weeding.<\/p>\n\n\n\n<p>Effect of full power laser damage to plants @ 50% capability<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"771\" height=\"1024\" data-id=\"294\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-771x1024.jpg\" alt=\"\" class=\"wp-image-294\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-771x1024.jpg 771w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-226x300.jpg 226w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-768x1020.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-1157x1536.jpg 1157w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-1542x2048.jpg 1542w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-700x930.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-520x691.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-360x478.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-250x332.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-100x133.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser1-scaled.jpg 1928w\" sizes=\"auto, (max-width: 771px) 100vw, 771px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"771\" height=\"1024\" data-id=\"295\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-771x1024.jpg\" alt=\"\" class=\"wp-image-295\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-771x1024.jpg 771w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-226x300.jpg 226w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-768x1020.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-1157x1536.jpg 1157w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-1542x2048.jpg 1542w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-700x930.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-520x691.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-360x478.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-250x332.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-100x133.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser2-scaled.jpg 1928w\" sizes=\"auto, (max-width: 771px) 100vw, 771px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"771\" height=\"1024\" data-id=\"296\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-771x1024.jpg\" alt=\"\" class=\"wp-image-296\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-771x1024.jpg 771w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-226x300.jpg 226w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-768x1020.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-1157x1536.jpg 1157w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-1542x2048.jpg 1542w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-700x930.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-520x691.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-360x478.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-250x332.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-100x133.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/04\/Laser3-scaled.jpg 1928w\" sizes=\"auto, (max-width: 771px) 100vw, 771px\" \/><\/figure>\n<\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"934\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-1024x934.jpeg\" alt=\"\" class=\"wp-image-520\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-1024x934.jpeg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-300x274.jpeg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-768x701.jpeg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-700x639.jpeg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-520x475.jpeg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-360x329.jpeg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-250x228.jpeg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed-100x91.jpeg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/weed.jpeg 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Video below demonstrated eye-safe laser functional. The video is a combination of manipulator accuracy test, eye-safe laser functional, and downward detection accuracy.<\/p>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/xtt7nMd8iNs?si=ER9nrJxsxuOstqp4\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<h3 class=\"wp-block-heading\">Sprayer Mechanism<\/h3>\n\n\n\n<p><strong>Why We Chose a Sprayer<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"769\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-1024x769.jpg\" alt=\"\" class=\"wp-image-374\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-1024x769.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-300x225.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-768x576.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-1536x1153.jpg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-700x525.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-520x390.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-360x270.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-250x188.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents-100x75.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/05\/sprayerComponents.jpg 1804w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Reuse of Existing Components:<\/strong>\u00a0Our sponsor\u2019s system already included a sprayer mechanism, allowing us to repurpose spare parts.<\/li>\n\n\n\n<li><strong>Ease of Development:<\/strong>\u00a0Sprayers are simple to build and test, enabling rapid, iterative development.<\/li>\n\n\n\n<li><strong>Fallback Safety:<\/strong>\u00a0With limited expertise in laser development, the sprayer provided a reliable backup plan.<\/li>\n<\/ol>\n\n\n\n<p><strong>Design and Construction<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A\u00a0<strong>herbicide reservoir tank<\/strong>\u00a0(not shown in figures).<\/li>\n\n\n\n<li>A\u00a0<strong>peristaltic pump<\/strong>\u00a0connected to the tank and an atomizing nozzle via hoses.<\/li>\n\n\n\n<li>A\u00a0<strong>Phidgets module<\/strong>\u00a0controlling the pump for seamless integration with the manipulator.<\/li>\n<\/ul>\n\n\n\n<p>The final design ensures herbicide delivery through the nozzle to target weeds efficiently.<\/p>\n\n\n\n<p><strong>Performance Results<\/strong><\/p>\n\n\n\n<p>The sprayer subsystem was evaluated based on two criteria:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>No Leakage:<\/strong>\u00a0All runtime tests confirmed a leak-free system.<\/li>\n\n\n\n<li><strong>Consistent Output:<\/strong>\u00a0Trials demonstrated uniform spraying performance. Table below shows the mass output results during SVD and SVD Encore trials:<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td>Trial<\/td><td>SVD (g)<\/td><td>SVD Encore (g)<\/td><\/tr><tr><td>1<\/td><td>6<\/td><td>7<\/td><\/tr><tr><td>2<\/td><td>7<\/td><td>7<\/td><\/tr><tr><td>3<\/td><td>8<\/td><td>8<\/td><\/tr><\/tbody><\/table><figcaption class=\"wp-element-caption\">Three trials showing the sprayer prototype delivering consistent liquid quantity.<\/figcaption><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Weed Perception Subsystem<\/h2>\n\n\n\n<p>The perception subsystem plays a critical role in detecting and tracking weeds within the robot\u2019s environment. It ensures fast and reliable results, enabling visual servoing to precisely target weeds.<\/p>\n\n\n\n<p><strong>Deep Learning Model and Data<\/strong><\/p>\n\n\n\n<p>We fine-tuned the&nbsp;<strong>YOLOv8 Segmentation model<\/strong>&nbsp;for weed detection, leveraging approximately 2,000 labeled images with ground-truth segmentation masks. These datasets were collected from:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Lake Forest Gardens tree nursery<\/strong>\u00a0(outdoor environment near Pittsburgh).<\/li>\n\n\n\n<li><strong>Mill 19 testing environment<\/strong>\u00a0(two distinct camera orientations: forward-facing and downward-facing).<\/li>\n<\/ol>\n\n\n\n<p><strong>Key Observations:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Models trained on one perspective had reduced performance when deployed on another, necessitating pre-training on combined datasets followed by fine-tuning for the target orientation.<\/li>\n\n\n\n<li>Data augmentation techniques (e.g., Gaussian noise and simulated exposure variations) improved robustness against motion blur and auto-exposure inconsistencies.<\/li>\n<\/ul>\n\n\n\n<p><strong>Performance Metrics<\/strong><\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\" style=\"flex-basis:100%\">\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-1024x1024.jpg\" alt=\"\" class=\"wp-image-505\" style=\"width:416px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-1024x1024.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-1536x1536.jpg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-700x700.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-520x520.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-360x360.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-250x250.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results-100x100.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/fvd_segmentation_results.jpg 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-1024x1024.jpg\" alt=\"\" class=\"wp-image-500\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-1024x1024.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-1536x1536.jpg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-700x700.jpg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-520x520.jpg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-360x360.jpg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-250x250.jpg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred-100x100.jpg 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/FARM_pred.jpg 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n\n\n<p>Our model met precision and recall benchmarks across environments, as shown in Table below:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table><tbody><tr><td><strong>Environment<\/strong><\/td><td><strong>Precision<\/strong><\/td><td><strong>Recall<\/strong><\/td><td><strong>mAP@50%IOU<\/strong><\/td><\/tr><tr><td>FVD Forward-facing<\/td><td>98%<\/td><td>91%<\/td><td>97%<\/td><\/tr><tr><td>FVD Downward-facing<\/td><td>99%<\/td><td>95%<\/td><td>99%<\/td><\/tr><tr><td>Lake Forest Gardens<\/td><td>80%<\/td><td>62%<\/td><td>72%<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p><strong>FVD Evaluation<\/strong><\/p>\n\n\n\n<p>During the Functional Verification Demonstration (FVD), detection models excelled:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>High precision and recall enabled consistent weed detection and tracking.<\/li>\n\n\n\n<li>Visual servoing achieved a success rate exceeding 80%, surpassing key performance metrics.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Localization Subsystem<\/h2>\n\n\n\n<p>The localization subsystem achieves two primary goals:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Weed Localization:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Determine weed positions in the robot\u2019s base frame for:<\/li>\n\n\n\n<li>Developing a farm-wide weed density map.<\/li>\n\n\n\n<li>Providing input cues to the targeting system.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Robot-to-World Mapping:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Track the robot\u2019s position in the world frame for waypoint navigation.<\/li>\n\n\n\n<li>Convert weed positions to the world frame for accurate weed map generation.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<p><strong>Weed Localization Process<\/strong><\/p>\n\n\n\n<p>The localization pipeline transforms camera detections into robot-frame coordinates. Key steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Input Data:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Detections and depth images from the Realsense D435 Camera.<\/li>\n\n\n\n<li>A pre-calibrated camera matrix.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Processing:<\/strong>\n<ul class=\"wp-block-list\">\n<li>Filter out invalid depth values (0\u00a0readings).<\/li>\n\n\n\n<li>Smooth depth images to remove noise.<\/li>\n\n\n\n<li>De-project detections into camera-frame coordinates using the camera matrix.<\/li>\n\n\n\n<li>Transform camera-frame coordinates to robot-frame coordinates using the Camera-to-Base Transformation matrix.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"262\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-1024x262.png\" alt=\"\" class=\"wp-image-539\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-1024x262.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-300x77.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-768x197.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-1536x393.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-700x179.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-520x133.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-360x92.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-250x64.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture-100x26.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/localization_architecture.png 1620w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>Validation:<\/strong><\/p>\n\n\n\n<p>To verify accuracy, Aruco markers with known positions were used as stand-ins for weed detections. The detected positions were compared against ground-truth coordinates, ensuring reliability.<\/p>\n\n\n\n<p><strong>Robot and Weed Mapping in the World Frame<\/strong><\/p>\n\n\n\n<p>Mapping robot and weed positions to the world frame involved:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Pointcloud Generation:<\/strong>\u00a0Using Ouster OS1-64 LiDAR.<\/li>\n\n\n\n<li><strong>Initialization:<\/strong>\u00a0Aligning LiDAR pointclouds with a known environmental map via the\u00a0<strong>ICP (Iterative Closest Point)<\/strong>\u00a0algorithm.<\/li>\n\n\n\n<li><strong>Odometry Calculation:<\/strong>\u00a0Leveraging the\u00a0<strong>Fast-LIO2 algorithm<\/strong>\u00a0to calculate robot motion from LiDAR data.<\/li>\n<\/ul>\n\n\n\n<p>This integration provided accurate world-frame odometry, enabling waypoint navigation and weed mapping.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"246\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-1024x246.png\" alt=\"\" class=\"wp-image-544\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-1024x246.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-300x72.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-768x184.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-700x168.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-520x125.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-360x86.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-250x60.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch-100x24.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/robot_loc_arch.png 1270w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>Performance Highlights<\/strong><\/p>\n\n\n\n<p>The localization subsystem excelled during the Functional Verification Demonstration (FVD):<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Weed Localization:<\/strong>\u00a0Accurate world-frame weed positions were showcased using the downward-facing camera.<\/li>\n\n\n\n<li><strong>Waypoint Navigation:<\/strong>\u00a0The robot successfully navigated world-frame waypoints and recorded weed removal, allowing for effective planning and mapping.<\/li>\n<\/ul>\n\n\n\n<p>The weed map below, in red (killed weeds) and green (live weeds), as well as robot position in yellow demonstrate the localization subsystem performance. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"930\" height=\"829\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom.png\" alt=\"\" class=\"wp-image-511\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom.png 930w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-300x267.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-768x685.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-700x624.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-520x464.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-360x321.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-250x223.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/WeedMapAndRobotOdom-100x89.png 100w\" sizes=\"auto, (max-width: 930px) 100vw, 930px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Targeting Subsystem<\/h2>\n\n\n\n<p>The Targeting System is a closed-loop control mechanism that uses weed detections from the perception subsystem to precisely align the laser with weeds. By employing\u00a0<strong>visual servoing<\/strong>, it integrates image processing, robotics, and control theory to ensure accurate weed targeting and elimination.<\/p>\n\n\n\n<p>Downward facing demonstration is a combination of manipulator accuracy test, eye-safe laser functional, and downward detection accuracy. The video below shows the result of the implementation. <\/p>\n\n\n\n<iframe loading=\"lazy\" width=\"560\" height=\"315\" src=\"https:\/\/www.youtube.com\/embed\/xtt7nMd8iNs?si=ER9nrJxsxuOstqp4\" frameborder=\"0\" allowfullscreen><\/iframe>\n\n\n\n<p><strong>How does it work?<\/strong><\/p>\n\n\n\n<p>The Targeting System processes inputs from the downward-facing camera and weed detections to precisely align the laser with the weed\u2019s center using visual servoing. It identifies the exact hit-point by converting the weed\u2019s segmentation mask into a binary image, applying an erosion loop to reduce noise and isolate the central region, and calculating the hit-point by averaging the remaining coordinates. Simultaneously, the system ensures alignment with the laser-pixel using a Proportional Controller (P-controller), which adjusts the manipulator to minimize the error between the hit-point and the laser-pixel. Calibration determines the fixed laser-pixel position, enabling precise and consistent targeting.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"600\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-1024x600.png\" alt=\"\" class=\"wp-image-517\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-1024x600.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-300x176.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-768x450.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-700x410.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-520x305.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-360x211.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-250x147.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model-100x59.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/targeting_model.png 1218w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><strong>System Interface<\/strong><\/p>\n\n\n\n<p>Implemented as a ROS Action Server, the Targeting System provides scalability and modularity. The\u00a0\/kill_weed\u00a0endpoint accepts a weed\u2019s tracking ID and returns a success or failure status, while streaming real-time feedback. This feedback includes the L2-norm error between the hit-point and the laser-pixel, allowing continuous monitoring of the targeting process.<\/p>\n\n\n\n<p><strong>Performance and Results<\/strong><\/p>\n\n\n\n<p>During the Functional Verification Demonstration (FVD), the system achieved less than\u00a0<strong>20 mm<\/strong>accuracy, significantly surpassing the required 200 mm threshold (PR-7). Challenges, such as targeting unreachable weeds and hit-point fluctuations, were addressed by tightening the targetable area and enhancing the erosion cycle, resulting in a stable and reliable targeting process. These improvements ensured outstanding performance during both the FVD and FVD-Encore demonstrations.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Behavior Subsystem<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"563\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-1024x563.jpeg\" alt=\"\" class=\"wp-image-551\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-1024x563.jpeg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-300x165.jpeg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-768x422.jpeg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-1536x844.jpeg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-2048x1126.jpeg 2048w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-700x385.jpeg 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-520x286.jpeg 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-360x198.jpeg 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-250x137.jpeg 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-content\/uploads\/sites\/79\/2024\/12\/Haffaz-Aladeen.The-Dictator-2-100x55.jpeg 100w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>The Behavior Node, humorously nicknamed the\u00a0<strong>\u201cAladeen Node\u201d<\/strong>\u00a0after\u00a0<em>The Dictator<\/em>, serves as the command center for the autonomous weed-killing robot. It orchestrates navigation, weed detection, and manipulator control, dynamically assigning tasks based on real-time feedback from sensors and systems. Built on the ROS2 Humble framework, the Behavior System ensures efficient and seamless operation.<\/p>\n\n\n\n<p><strong>Functionality and Architecture<\/strong><\/p>\n\n\n\n<p>At the core of the system, the Behavior Node processes data from:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Odometry:<\/strong>\u00a0Received through\u00a0\/odometry\/wf, this data determines the robot\u2019s position for navigation planning.<\/li>\n\n\n\n<li><strong>Weed Detection:<\/strong>\u00a0Published through\u00a0\/downward_facing\/detections, the camera data is integrated into a live weed map via the\u00a0<strong>WeedMapper<\/strong>\u00a0library.<\/li>\n\n\n\n<li><strong>Global Planner:<\/strong>\u00a0Generates waypoint sequences, enabling the robot to traverse the field while avoiding obstacles.<\/li>\n<\/ul>\n\n\n\n<p>The Behavior Node operates as a finite state machine with three primary states:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>IDLE:<\/strong>\u00a0Standby mode, waiting for tasks.<\/li>\n\n\n\n<li><strong>MOVING:<\/strong>\u00a0Navigation between waypoints, updating the live weed map.<\/li>\n\n\n\n<li><strong>KILLING:<\/strong>\u00a0Halts movement to align with and target weeds using visual servoing.<\/li>\n<\/ol>\n\n\n\n<p><strong>Dynamic Decision-Making<\/strong><\/p>\n\n\n\n<p>The system dynamically prioritizes reachable, unattempted weeds and seamlessly transitions between states as needed. If a weed moves out of view, a timeout mechanism prevents delays by reprioritizing tasks. This decision-making approach ensures efficient operation and adaptability in dynamic environments.<\/p>\n\n\n\n<p><strong>Key Features<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Weed Mapping:<\/strong>\u00a0Tracks live, killed, and aborted weeds using\u00a0<strong>WeedMapper<\/strong>, publishing maps for real-time monitoring.<\/li>\n\n\n\n<li><strong>Post-Operation Reporting:<\/strong>\u00a0Generates a summary of weed statuses for analysis and system optimization.<\/li>\n\n\n\n<li><strong>Asynchronous Communication:<\/strong>\u00a0Interfaces with the\u00a0<strong>KillWeed action server<\/strong>, enabling multitasking while targeting actions are in progress.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Weeding Manipulator Subsystem Linear Stage Motion Demo Angular Motion Demo Two videos above shows manual commands of manipulator and individual accuracy in position the tool. Our weeding manipulator is designed for precision and speed, effectively directing the end effector to [&hellip;]<\/p>\n","protected":false},"author":366,"featured_media":0,"parent":67,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-288","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/288","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/users\/366"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/comments?post=288"}],"version-history":[{"count":28,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/288\/revisions"}],"predecessor-version":[{"id":552,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/288\/revisions\/552"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/67"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/media?parent=288"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}