{"id":217,"date":"2019-04-06T01:50:38","date_gmt":"2019-04-06T01:50:38","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/?page_id=217"},"modified":"2019-10-02T00:18:30","modified_gmt":"2019-10-02T00:18:30","slug":"plant-health-monitoring","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/system-implementation\/plant-health-monitoring\/","title":{"rendered":"Plant Health Monitoring"},"content":{"rendered":"<h1><b>Plant Health Monitoring: Overview<\/b><\/h1>\n<p><span style=\"font-weight: 400\">In order to monitor plant health, our system makes use of different features. Specifically, holes and fungus area extracted from Mask-RCNN, leaf area calculated from stereo image pair. With these features, we then use a threshold function to predict the severity of pest and disease. <\/span><\/p>\n<p>The main challenge arises from quantifying the performance and setting up baseline for ground truth. Originally the system was meant to directly report a problem-to-leave -ratio, e.g. 5% of the leave area are consist of holes or fungus, and thus the evaluation metric was pixel-wise. However, that turned out to be unreasonable &#8212; the human can hardly annotate ground truth for fungus\/holes on a pixel-wise level. Therefore, the first attempt to relax the constraint is to use intersection over union (IOU) and report discrete severity levels:\u00a0<span style=\"font-weight: 400\">mild, moderate and alarming to farmers. <\/span><\/p>\n<p><span style=\"font-weight: 400\">However, from a farmer&#8217;s perspective, it&#8217;s probably too late when it gets alarming: the real value is in early detection. Thus the problem was further simplified into a binary classification problem.\u00a0 Note that the deep learning model will still try to pick up fungus\/holes from an image, and those features would be used to classify whether an image is problematic i.e. has hole or fungus. The evaluation metric, however, is base one the correctness of the final binary label, whose ground truth is far more easier\u00a0 to establish: human can confidently tell whether an image contains holes or fungus or not.\u00a0<\/span><\/p>\n<h2>Progress Review 1<\/h2>\n<h3>Plant Health Monitoring:\u00a0Training and \u00a0testing data<\/h3>\n<p><span style=\"font-weight: 400\">The system is developed over data collected during the farm visit. The training and testing data are sourced from different locations in the field e.g. different rows. The training data-set consists of 700 color segmentation labels per plant for four types of plants. The test data is manually labeled as positive or negative (both moderate and alarming are considered as positive)<\/span><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-305\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/05\/train_test_data.png\" alt=\"\" width=\"752\" height=\"336\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/05\/train_test_data.png 752w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/05\/train_test_data-300x134.png 300w\" sizes=\"auto, (max-width: 752px) 85vw, 752px\" \/><\/p>\n<h2><\/h2>\n<h2>Progress Review 2<\/h2>\n<h3>Mitigation of over-segmentation<\/h3>\n<ul>\n<li>Mitigation of over-segmentation of diseases and holes by closer re-labeling of data.<br \/>\n<img loading=\"lazy\" decoding=\"async\" class=\"wp-image-218 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Mitigate-over_seg.png\" alt=\"\" width=\"803\" height=\"236\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Mitigate-over_seg.png 876w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Mitigate-over_seg-300x88.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Mitigate-over_seg-768x226.png 768w\" sizes=\"auto, (max-width: 803px) 85vw, 803px\" \/><\/li>\n<\/ul>\n<h3>Automatic data labeling pipeline<\/h3>\n<ul>\n<li>Create an automatic re-labelling script to perform 100 labels\/ hr instead of previous 50 labels\/ hr.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-219 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_labelling_piepeline.png\" alt=\"\" width=\"1034\" height=\"432\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_labelling_piepeline.png 1034w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_labelling_piepeline-300x125.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_labelling_piepeline-768x321.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_labelling_piepeline-1024x428.png 1024w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<h3>Initial results with hole and disease detection<\/h3>\n<ul>\n<li>Trained Mask R-CNN with 100 samples with resulting confidence of 70%.<\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-220 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial-Results-in-Plant-Health-monitoring-.png\" alt=\"\" width=\"652\" height=\"659\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial-Results-in-Plant-Health-monitoring-.png 560w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial-Results-in-Plant-Health-monitoring--297x300.png 297w\" sizes=\"auto, (max-width: 652px) 85vw, 652px\" \/><\/p>\n<h2><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-221 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial_result_graph.png\" alt=\"\" width=\"774\" height=\"392\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial_result_graph.png 624w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Initial_result_graph-300x152.png 300w\" sizes=\"auto, (max-width: 774px) 85vw, 774px\" \/><br \/>\nProgress Review 3<\/h2>\n<h3>Automatic quantitative analysis pipeline<\/h3>\n<p>&nbsp;<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-224 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis.png\" alt=\"\" width=\"918\" height=\"449\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis.png 1206w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis-300x147.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis-768x376.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis-1024x501.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/Automatic_quant_analysis-1200x587.png 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<h2>Progress Review 4<\/h2>\n<p>&nbsp;<\/p>\n<h3>Change in error metric from hole\/leaf area to severity levels<\/h3>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-222 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/change_in_metric.png\" alt=\"\" width=\"1012\" height=\"247\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/change_in_metric.png 1086w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/change_in_metric-300x73.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/change_in_metric-768x187.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/change_in_metric-1024x250.png 1024w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/h3>\n<p>&nbsp;<\/p>\n<h3>Leaf segmentation using semi-global matching<\/h3>\n<h3><img loading=\"lazy\" decoding=\"async\" class=\"size-full wp-image-223 aligncenter\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/segment_leaf.png\" alt=\"\" width=\"1137\" height=\"479\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/segment_leaf.png 1137w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/segment_leaf-300x126.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/segment_leaf-768x324.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-content\/uploads\/sites\/35\/2019\/04\/segment_leaf-1024x431.png 1024w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/h3>\n","protected":false},"excerpt":{"rendered":"<p>Plant Health Monitoring: Overview In order to monitor plant health, our system makes use of different features. Specifically, holes and fungus area extracted from Mask-RCNN, leaf area calculated from stereo image pair. With these features, we then use a threshold function to predict the severity of pest and disease. The main challenge arises from quantifying &hellip; <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/system-implementation\/plant-health-monitoring\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Plant Health Monitoring&#8221;<\/span><\/a><\/p>\n","protected":false},"author":158,"featured_media":0,"parent":43,"menu_order":1,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-217","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/pages\/217","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/users\/158"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/comments?post=217"}],"version-history":[{"count":3,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/pages\/217\/revisions"}],"predecessor-version":[{"id":366,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/pages\/217\/revisions\/366"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/pages\/43"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2018teame\/wp-json\/wp\/v2\/media?parent=217"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}