{"id":144,"date":"2024-02-23T15:55:56","date_gmt":"2024-02-23T20:55:56","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/?page_id=144"},"modified":"2024-12-12T18:10:58","modified_gmt":"2024-12-12T23:10:58","slug":"system-performance","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/system\/system-performance\/","title":{"rendered":"System Performance"},"content":{"rendered":"\n

Fall Semester (Final Semester)<\/h2>\n\n\n\n

Our mandatory functional and performance requirements are detailed below.<\/p>\n\n\n\n

ID<\/td>Functional Requirements<\/td>Performance Requirements<\/td><\/tr>
M.F.1<\/td>The system shall detect weeds in its environment and path.<\/td>M.P.1 Precision > 60 %
M.P.2 Recall > 60 %<\/td><\/tr>
M.F.2<\/td>The system shall localize detected weeds in the world frame.<\/td>M.P.3 Localization RMSE < 100 \ud835\udc5a\ud835\udc5a<\/td><\/tr>
M.F.3<\/td>The system shall position the tool to target the desired location.<\/td>M.P.4 Manipulator Positioning RMSE < 50 \ud835\udc5a\ud835\udc5a<\/td><\/tr>
M.F.4<\/td>The system shall eliminate the weeds within the area of operation.<\/td>M.P.5 Targeting RMSE < 50 \ud835\udc5a\ud835\udc5a
M.P.6 Efficacy of Elimination > 70 %<\/td><\/tr>
M.F.5<\/td>System shall maintain throughput and effectiveness<\/td>M.P.7 Throughput > 100 m^2\/hr
M.P.8 Effectiveness > 50 %<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n
ID<\/td>Performance Requirements<\/td>Result<\/td><\/tr>
M.P.1 (Passed<\/mark><\/strong>)<\/td>Precision > 60 %<\/td>>= 98% @ FVD<\/td><\/tr>
M.P.2 (Passed<\/mark><\/strong>)<\/td>Recall > 60 %<\/td>>= 90% @ FVD <\/td><\/tr>
M.P.3 (Acceptable<\/mark><\/strong>)<\/td>Localization RMSE < 100 \ud835\udc5a\ud835\udc5a<\/td><= 150 mm @ FVD<\/td><\/tr>
M.P.4 (Passed<\/mark><\/strong>)<\/td>Manipulator Positioning RMSE < 50 \ud835\udc5a\ud835\udc5a<\/td>RMSE < 10 mm
achieved 90% success rate
w\/ visual servoing<\/td><\/tr>
M.P.5 (Passed<\/mark><\/strong>)<\/td>Targeting RMSE < 50 \ud835\udc5a\ud835\udc5a<\/td>< 30 mm on avg @ FVD<\/td><\/tr>
M.P.6 (Passed<\/mark><\/strong>)<\/td>Efficacy of Elimination > 70 %<\/td>> 90% of weeds results in visible
damage from full-power laser
<\/td><\/tr>
M.P.7 (Passed<\/mark><\/strong>)<\/td>Throughput > 100 m^2\/hr<\/td>>= 300 m^2 \/ hr<\/td><\/tr>
M.P.8 (Passed<\/mark><\/strong>)<\/td>Effectiveness > 50 %<\/td>>=70% Hit-ratio<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n

The Localization RMSE exceeding 100 mm is acceptable for several reasons. First, the testing environment was an indoor setup without access to RTK GPS, differing significantly from the conditions of the final outdoor product. Second, the 50 mm discrepancy is minimal when considering the typical farm size, which averages over 150 acres, making such a deviation negligible in practical applications. Finally, our system compensates for any localization error with visual servoing, ensuring the laser remains precisely targeted on the weed regardless of a 50 mm offset in localization.<\/p>\n\n\n\n

Spring Semester<\/h2>\n\n\n\n

Our spring validation requirements are described below, along with the current status of the system. <\/p>\n\n\n\n

We successfully validated all our target \ud83c\udf89.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Detailed testing results can be view here<\/a>. <\/p>\n","protected":false},"excerpt":{"rendered":"

Fall Semester (Final Semester) Our mandatory functional and performance requirements are detailed below. ID Functional Requirements Performance Requirements M.F.1 The system shall detect weeds in its environment and path. M.P.1 Precision > 60 %M.P.2 Recall > 60 % M.F.2 The system […]<\/p>\n","protected":false},"author":366,"featured_media":0,"parent":67,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":{"footnotes":"[]"},"class_list":["post-144","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/144","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/users\/366"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/comments?post=144"}],"version-history":[{"count":12,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/144\/revisions"}],"predecessor-version":[{"id":559,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/144\/revisions\/559"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/pages\/67"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2024teamf\/wp-json\/wp\/v2\/media?parent=144"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}