{"id":262,"date":"2017-12-15T07:15:51","date_gmt":"2017-12-15T07:15:51","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/?page_id=262"},"modified":"2017-12-15T07:15:51","modified_gmt":"2017-12-15T07:15:51","slug":"performance-evaluation","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/performance-evaluation\/","title":{"rendered":"Performance Evaluation"},"content":{"rendered":"<h1>FVE\u00a0Performance Evaluation<\/h1>\n<h4><span style=\"font-size: 16px\">Scenario<\/span><\/h4>\n<p>\u2013 \u00a0A spam can, a bottle, and a soup can each with an AprilTag<\/p>\n<p>\u2013 \u00a0The objects have a peripheral distance of at least 10 cm and are placed height- wise, in a specific orientation, and within a bounded region<\/p>\n<h4>Manipulation Standalone<\/h4>\n<p>\u2013 The manipulator should grasp the object, given an ID, without colliding in atleast 12 out of 20 trials<\/p>\n<h4>Gaze Standalone<\/h4>\n<p>\u2013 When a non-keyword phrase is spoken and the user gazes at the object, the\u00a0gaze should accurately identify intent in at least 16 out of 20 trials.<\/p>\n<h4>Integration<\/h4>\n<p>\u2013 Speech and gaze, when combined together should correctly identify intent in at least 12 out of 20 trials.<\/p>\n<h4>Bounding Box Size Error<\/h4>\n<p>\u2013 The bounding box error as per the stated\u00a0criteria in FVE could be atmost 10%.<\/p>\n<h4>Performance Statistics<\/h4>\n<div id=\"attachment_265\" style=\"width: 487px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-265\" class=\"wp-image-265 img-responsive\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-content\/uploads\/sites\/29\/2017\/12\/FVE-Performance-Statistics.png\" alt=\"\" width=\"477\" height=\"285\" \/><p id=\"caption-attachment-265\" class=\"wp-caption-text\">Fig.1 FVE Performance Statistics<\/p><\/div>\n<p>&nbsp;<\/p>\n<div id=\"attachment_266\" style=\"width: 530px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-266\" class=\"wp-image-266 img-responsive\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-content\/uploads\/sites\/29\/2017\/12\/FVE-Performance-Statistics-Table.png\" alt=\"\" width=\"520\" height=\"168\" \/><p id=\"caption-attachment-266\" class=\"wp-caption-text\">Table 1. Performance Statistics<\/p><\/div>\n<h4><\/h4>\n","protected":false},"excerpt":{"rendered":"<p>FVE\u00a0Performance Evaluation Scenario \u2013 \u00a0A spam can, a bottle, and a soup can each with an AprilTag \u2013 \u00a0The objects have a peripheral distance of at least 10 cm and are placed height- wise, in a specific orientation, and within a bounded region Manipulation Standalone \u2013 The manipulator should grasp the object, given an ID, &#8230; <a href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/performance-evaluation\/\" class=\"more-link text-uppercase small\"><strong>Continue Reading<\/strong> <i class=\"fa fa-angle-double-right\" aria-hidden=\"true\"><\/i><\/a><\/p>\n","protected":false},"author":129,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-262","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/pages\/262","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/users\/129"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/comments?post=262"}],"version-history":[{"count":3,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/pages\/262\/revisions"}],"predecessor-version":[{"id":267,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/pages\/262\/revisions\/267"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2017teamh\/wp-json\/wp\/v2\/media?parent=262"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}