{"id":354,"date":"2017-12-12T01:37:09","date_gmt":"2017-12-12T01:37:09","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/?page_id=354"},"modified":"2017-12-12T22:37:58","modified_gmt":"2017-12-12T22:37:58","slug":"fve-results","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/demonstrations\/fall-validation-experiment\/fve-results\/","title":{"rendered":"FVE Results"},"content":{"rendered":"<p><strong>Results<\/strong><\/p>\n<p><iframe loading=\"lazy\" width=\"980\" height=\"551\" src=\"https:\/\/www.youtube.com\/embed\/cXXHdaDRS1M?feature=oembed\" frameborder=\"0\" gesture=\"media\" allow=\"encrypted-media\" allowfullscreen><\/iframe><\/p>\n<p>The video describes the FVE.<\/p>\n<p>Coming to the results, we have been able to satisfy all the listed performance requirements and in some cases have performed even better than we expected.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-355 img-responsive\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-content\/uploads\/sites\/24\/2017\/12\/target-requirements.png\" alt=\"\" width=\"1159\" height=\"719\" \/><\/p>\n<p><strong>Voice Command Test Results:<\/strong><\/p>\n<p>Performed tests for 50 iterations in noiseless and noisy environments to check the accuracy of the recognition system.<br \/>\nTested for:<br \/>\n&#8211; Recognizing the words and performing suitable action<br \/>\n&#8211; Recognizing incorrect word<br \/>\n&#8211; Rejecting Garbage before activation<br \/>\n&#8211; Rejecting Garbage after activation<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-394 img-responsive\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-content\/uploads\/sites\/24\/2017\/11\/table1.jpg\" alt=\"\" width=\"765\" height=\"621\" \/><\/p>\n<p>Results in Noiseless Environment:<br \/>\n\u2022 In a noiseless environment, the accuracy of recognizing the activation word is 86%<br \/>\n\u2022 The accuracy of recognizing Alpha, Bravo and Charlie is 76%, 92%, and 90% respectively<br \/>\n\u2022 The overall mean accuracy is 86%<br \/>\n\u2022 Garbage words before \u201cComputer\u201d are completely rejected with an accuracy of 100%<br \/>\n\u2022 Garbage words after \u201cComputer\u201d are all accepted with 0% correct results (none are rejected)<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone  wp-image-395 img-responsive\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-content\/uploads\/sites\/24\/2017\/11\/10.jpg\" alt=\"\" width=\"763\" height=\"626\" \/><\/p>\n<p>Results in Noisy Environment:<br \/>\n\u2022 In a noisy environment, the accuracy of recognition goes down drastically<br \/>\n\u2022 The accuracy in recognizing the activation word \u201cComputer\u201d is 50%<br \/>\n\u2022 The accuracy of recognizing Alpha, Bravo and Charlie is 58%, 74%, and 68% respectively<br \/>\n\u2022 The overall mean accuracy is 62.5%<br \/>\n\u2022 Garbage words before \u201cComputer\u201d are completely rejected with an accuracy of 100% in static noise, all bets are off in dynamic noise<br \/>\n\u2022 Garbage words after \u201cComputer\u201d are all accepted with 0% correct results (none are rejected)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Results The video describes the FVE. Coming to the results, we have been able to satisfy all the listed performance requirements and in some cases have performed even better than we expected. Voice Command Test Results: Performed tests for 50 iterations in noiseless and noisy environments to check the accuracy of the recognition system. Tested &#8230; <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/demonstrations\/fall-validation-experiment\/fve-results\/\" class=\"more-link text-uppercase small\"><strong>Continue Reading<\/strong> <i class=\"fa fa-angle-double-right\" aria-hidden=\"true\"><\/i><\/a><\/p>\n","protected":false},"author":105,"featured_media":0,"parent":342,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-354","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/pages\/354","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/users\/105"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/comments?post=354"}],"version-history":[{"count":3,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/pages\/354\/revisions"}],"predecessor-version":[{"id":402,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/pages\/354\/revisions\/402"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/pages\/342"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamc\/wp-json\/wp\/v2\/media?parent=354"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}