{"id":320,"date":"2021-01-28T15:44:37","date_gmt":"2021-01-28T20:44:37","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/?page_id=320"},"modified":"2021-10-09T00:55:09","modified_gmt":"2021-10-09T04:55:09","slug":"test-plan","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/project-management\/test-plan\/","title":{"rendered":"Test Plan"},"content":{"rendered":"\n

Fall Validation Demonstration<\/h3>\n\n\n\n

Objective: Ensure that the entire system functions as expected and can sufficiently perform the
described use case for an \u201caverage user\u201d under normal circumstances.<\/p>\n\n\n\n

Procedure:<\/p>\n\n\n\n

  1. During the test an assistant will record successes, failures, measure errors, and time procedures<\/li>
  2. User will put on Coborg backpack<\/li>
  3. User will hold a matte panel overhead in one corner of the task space and say, \u201cCoborg, move to target\u201d<\/li>
  4. Coborg will operate<\/li>
  5. User will move 6 inches in cardinal directions<\/li>
  6. User will rotate 90 degrees to the left, followed by returning to the center, rotating 20 degrees to the right, and
    returning to the center again<\/li>
  7. User will screw in the panel and say, \u201cCoborg, go home\u201d<\/li>
  8. User will place hands on panel and say, \u201cCoborg, move to target\u201d<\/li>
  9. Coborg will operate<\/li>
  10. User will unscrew panel and say, \u201cCoborg, go home\u201d<\/li>
  11. User will flip panel to shiny side and repeat previous steps for a diagonal corner of the task space<\/li>
  12. Test will be repeated as time allows<\/li><\/ol>\n\n\n\n

    Verification Criteria:<\/p>\n\n\n\n

    \u25cf Panel is successfully screwed into the board all times without interference from the user
    \u25cf Euclidean distance error to target is less than 6\u201d in \u2265 60% of trials
    \u25cf Target is received less than 5 seconds after command issue
    \u25cf End-effector will shift less than 6\u201d during screwing process
    \u25cf The robot is able to hold the part overhead without dropping it
    \u25cf The percentage of all commands correctly identified (out of all true\/false positives and false negatives) is \u2265
    60%
    \u25cf Both the number and length of commands are inherent to the test
    \u25cf Release of part takes less than 5 seconds
    \u25cf Point of arm furthest from base motor will be \u2264 20\u201d in compact mode
    \u25cf User will be unharmed during test, also inherent to system (e-stops, torque limits, etc.)
    \u25cf User does not have difficulties, automation works as intended
    \u25cf Robot battery performs for at least 20 minutes or less than a corresponding percentage of the battery has
    been used during the whole test
    \u25cf A number of NM requirements are inherent to the system
    \u25cf The speaker is audible to all present<\/p>\n\n\n\n

    For reference, the full test document can be found here<\/a>.<\/p>\n\n\n\n

    \n\n\n\n

    Spring Validation Demonstration<\/h3>\n\n\n\n

    The Spring Validation Demonstration will be held in Newell Simon Hall Lab B512. The necessary equipment includes the COBORG backpack, the vision subsystem, the voice subsystem, a computer to run the subsystems, a stopwatch, a ruler, the record sheets, a measuring tape, and a testing structure with shiny and matte finish. An area of roughly 10 feet in diameter will be required for the test.<\/p>\n\n\n\n

    First, the vision subsystem will be tested. The plate and camera will be fixed at specific locations, with a known relative pose. Then, a team member will place their hands on the plate and the camera will be signaled to determine its pose. The estimated pose will be compared to the ground truth, validating PM1.1, PD1.1, and PD1.3. The time from signaling to pose estimation result will be recorded, validating PM1.2. This test will be repeated for two other locations. The testing structure will then be moved to a different surface finish and then the test will be run again, validating PD1.2.<\/p>\n\n\n\n

    Second, the actuation and manipulation subsystem will be tested. The COBORG backpack will be fixed at a specific location and the testing structure will be fixed in a different location, including targets with known relative pose. Then, the backpack will be signaled to reach out to the target. The distance between the target and the center of the paddle will be measured, validating PM2. Then, the COBORG backpack will be signaled to return to compact mode. The maximum distance from the center of the first motor to any distal part of the arm will be measured, validating PM6. This process will be repeated. Then the process as a whole will be repeated for two different target locations to build confidence in the validation. Afterwards, a strength test will be performed, by signaling the COBORG backpack arm to hold up a representative panel, validating PM3.2.<\/p>\n\n\n\n

    Third, the voice subsystem will be tested. During the test, every trigger of the microphone will be recorded, as well as triggers that were supposed to occur, but did not. The microphone will be signaled to start listening. The user will say, “Coborg, move to goal” and record the subsystem\u2019s response. The user will then read a randomly generated sentence. The user will then say, “Coborg, move to home” and record the subsystem\u2019s response. The user will then read another randomly generated sentence. This process will be repeated twice to build confidence in the validation. Comparing the number of correct and incorrect responses verses triggers will validate PM4.1. Using appropriate commands will validate PM4.2 and PM4.3.<\/p>\n\n\n\n

    Finally, the nonfunctional aspects of the system will be tested. The COBORG backpack will be weighed on a scale, validating NM2. The COBORG backpack will be put on by all members present and their remarks about its comfort will be recorded, validating NM1.<\/p>\n","protected":false},"excerpt":{"rendered":"

    Fall Validation Demonstration Objective: Ensure that the entire system functions as expected and can sufficiently perform thedescribed use case for an \u201caverage user\u201d under normal circumstances. Procedure: During the test an assistant will record successes, failures, measure errors, and time procedures User will put on Coborg backpack User will hold a matte panel overhead in
    + Read More<\/a><\/p>\n","protected":false},"author":239,"featured_media":0,"parent":26,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-320","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/pages\/320","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/users\/239"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/comments?post=320"}],"version-history":[{"count":7,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/pages\/320\/revisions"}],"predecessor-version":[{"id":755,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/pages\/320\/revisions\/755"}],"up":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/pages\/26"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamc\/wp-json\/wp\/v2\/media?parent=320"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}