{"id":79,"date":"2015-09-16T08:29:12","date_gmt":"2015-09-16T12:29:12","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/?page_id=79"},"modified":"2017-05-05T08:37:34","modified_gmt":"2017-05-05T12:37:34","slug":"performance","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/performance\/","title":{"rendered":"Performance"},"content":{"rendered":"

Spring Validation Experiment<\/strong><\/p>\n

Experiment: <\/strong>Acquire at least 3 items from shelf bins and drop in the order bin in under 20 minutes.<\/strong><\/p>\n

Description: A shelf will be setup with 25 items distributed over different shelf bins (1-3 items per shelf, no occlusion). The PR2 based assistive robot should autonomously grasp items off the shelf and drop them in the order bin.<\/p>\n

Location: NSH \u2013 B level<\/p>\n

Equipment: UR5, Kinect,Custom UR5 end effector and Kinect mount,UR5 robot and support structure,UR5 interface,<\/span>\u00a0laptop, shelf, items with different geometries (shortlisted from APC 2015 item dictionary), order bin, gripper subsystem \u2013 ShopVac, suction cup based end-effecter, Arduino Nano based suction PCB, pressure sensor<\/p>\n

    \n
  1. Populate shelf with all 25 items from the 2015 APC item dictionary<\/li>\n
  2. Input text file indicating the 10 randomly selected items as well as bin locations<\/li>\n
  3. The system will\u2026\n
      \n
    1. Automatically recognize items in the bin and report results to a GUI on the computer<\/li>\n
    2. Automatically detect object and recognize its pose to find a valid suction surface<\/li>\n
    3. Automatically move the arm to the desired grasping location<\/li>\n
    4. Attempt to grasp the item without damaging or dropping it<\/li>\n
    5. Withdraw the end effector \/ item from the shelf bin and place it into the order bin<\/li>\n<\/ol>\n<\/li>\n
    6. The system will repeat the delivery process for 20 minutes and attempt to deliver as many items into the order bin as possible<\/li>\n<\/ol>\n

      Results<\/strong><\/p>\n

      While testing, we had a 61% success rate with 147 successful picks and 97 failed picks. Items such as the plush puppies squeaky toy, pencils, bunny book, scotch bubble mailer had really good success rates as they had distinct textures and easily graspable surfaces. The table below shows the high level overview of our performance.<\/p>\n

      \"sve_stats\"<\/a>System failures are broken down in figure 19. A majority of our failures were due to identification errors. It is difficult to correctly identify items if they are occluded. Identification failure occurred between items with similar textures such as the 40w light bulb and dove soap. Suction and grasping failure occurs for objects such as the DVD, joke book and duct tape. Also, some items such as the water bottle, glue sticks and command hooks were specular \u2013 creating sparse point clouds. This made it difficult to compute correct grasp surfaces. The figures below show our failure analysis statistics.<\/p>\n

      \"sve_stats_2\"<\/a><\/p>\n

      Item by Item failure analysis<\/strong><\/p>\n

      \"Capture\"<\/a><\/p>\n

       <\/p>\n

      Fall Validation Experiments<\/strong><\/p>\n

      \"Untitled\"<\/a><\/p>\n

      During the fall validation experiment, all targeted requirements were met. In addition, during the fall validation experiment encore, we transitioned from running in simulation to running the system on PR2. Tabulation above highlights the outcome of the Fall Validation Experiments.<\/p>\n

      Experiment 1: Perception Experiment<\/strong><\/p>\n

      Description: A setup will be made with shelf bin containing 1-3 items (no occlusion) and the perception system outputs the shelf location of the item of interest<\/p>\n

      Location: NSH \u2013 B level<\/p>\n

      Equipment: Kinect, Laptop, Shelf bin, items with different geometries (shortlisted from APC 2015 item dictionary)<\/p>\n

        \n
      1. Station Kinect opposite to shelf; shelf position with respect to Kinect is known<\/li>\n
      2. Randomly place 1 item on the shelf, non-occluding.<\/li>\n
      3. Run perception through command line<\/li>\n
      4. Output 3D scene w\/ bounding box around item of interest<\/li>\n
      5. Repeat steps 2-4 four times<\/li>\n
      6. Repeat steps 2-5 for 2 items and 3 items on the shelf, record 50% success.<\/li>\n<\/ol>\n

        Experiment Results<\/strong><\/p>\n

        \"fve_PERCEPTION_RESULTS\"<\/a><\/p>\n

        Experiment 2: State Control and Hardware in the Loop Grasping Experiment<\/strong><\/p>\n

        Description: A shelf bin will be setup with a random assortment of items. The gripper subsystem should autonomously grasp items off the shelf and drop them in the order bin. The arm should move between the shelf and order bin in simulation.<\/p>\n

        Location: NSH \u2013 B level<\/p>\n

        Equipment: Complete Gripper Subsystem – ShopVac, suction cup based gripper end-effector, Arduino Nano based suction PCB, desktop computer<\/p>\n

          \n
        1. Professor Dolan randomly selects and distribute up to 3 items on the real world<\/strong> shelf bin<\/li>\n
        2. State controller is initiated, arm moves to the shelf bin in simulation<\/strong><\/li>\n
        3. The state controller enters the grasping state and the vacuum turns on in the real world<\/strong><\/li>\n
        4. The item is manually acquired in the real world<\/strong> by an external operator holding the suction gripper, approached from the top.<\/li>\n
        5. The pressure sensor sense a seal is formed in the real world<\/strong><\/li>\n
        6. The robot arm moves from the shelf to the order bin in simulation<\/strong><\/li>\n
        7. The vacuum turns off when the robot reaches the order bin; the item is dropped in the real world<\/strong><\/li>\n
        8. Repeat steps 3-8 for 10 items, recording 70% success<\/li>\n<\/ol>\n

          Experiment Results<\/strong><\/p>\n

          The video below shows the results of the initial fall validation experiment. The PR2 was able to access all shelf bins and control the gripper hardware.<\/p>\n

          https:\/\/www.youtube.com\/watch?v=eHtsyebAPBU<\/a><\/p>\n

          The video below shows the results of the second fall validation experiment. We were able to execute all PR2 actions on the SBPL PR2.<\/p>\n

          https:\/\/www.youtube.com\/watch?v=8L7bmdsayGA<\/a><\/p>\n

          Spring Test Plan<\/strong><\/p>\n\n\n\n\n\n\n\n\n\n\n\n
          Test<\/b><\/td>\nProgress Review<\/b><\/td>\n<\/tr>\n
          Run FVE using UR5 simulator – feroze<\/span><\/td>\nPR07 (Week 3)<\/span><\/td>\n<\/tr>\n
          Demonstrate UR5 accessing the APC config space – \u00a0feroze<\/span><\/p>\n
            \n
          • Teleop control of UR5 moving end-effector into x cm of each shelf<\/span><\/li>\n<\/ul>\n<\/td>\n
          		PR08 (Week 5)<\/span><\/td>\n<\/tr>\n
          Fully integrated system – rick<\/span><\/p>\n
            \n
          • Demonstrate localization within x mm accuracy<\/span>\n
              \n
            • Kinect calibration within x accuracy<\/span><\/li>\n<\/ul>\n<\/li>\n
            • Autonomous UR5 movement within each shelf<\/span>\n
                \n
              • end -effector collision avoidance<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n

                Grasp planner results in simulation<\/span><\/td>\n

          		PR09 (Week 7)<\/span><\/td>\n<\/tr>\n
          Autonomous single bin test – lekha<\/span><\/p>\n
            \n
          • Grasp planner results<\/span><\/li>\n
          • Grasp feedback<\/span><\/li>\n<\/ul>\n

            Perception test<\/span><\/td>\n

          		PR10 (Week 10)<\/span><\/td>\n<\/tr>\n
          Failure mode testing – alex<\/span><\/p>\n
            \n
          • Localization<\/span><\/li>\n
          • Perception<\/span><\/li>\n
          • Grasping<\/span><\/li>\n
          • Move arm collision problems<\/span><\/li>\n<\/ul>\n<\/td>\n
          		PR11 (Week 12)<\/span><\/td>\n<\/tr>\n
          Autonomous 12-bin run – rick<\/span><\/p>\n
            \n
          • Advanced perception<\/span><\/li>\n
          • Aggregate stats<\/span><\/li>\n
          • Attempt to get items from each shelf in 15 minutes<\/span>\n
              \n
            • No failures<\/span><\/li>\n<\/ul>\n<\/li>\n
            • Output updated JSON file<\/span><\/li>\n<\/ul>\n<\/td>\n
          		PR12 (Week 14)<\/span><\/td>\n<\/tr>\n
          Pick at least 3 correct items from the shelf in 15 minutes – abhishek<\/span><\/td>\nSVE (Week 15)<\/span><\/td>\n<\/tr>\n
          Pick at least 3 correct items from the shelf in 15 minutes – abhishek<\/span><\/td>\nSVE Encore (Week 16)<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

           <\/p>\n","protected":false},"excerpt":{"rendered":"

          Spring Validation Experiment Experiment: Acquire at least 3 items from shelf bins and drop in the order bin in under 20 minutes. Description: A shelf will be setup with 25 items distributed over different shelf bins (1-3 items per shelf, no occlusion). The PR2 based assistive robot should autonomously grasp items off the shelf and
          + Read More<\/a><\/p>\n","protected":false},"author":10,"featured_media":0,"parent":0,"menu_order":3,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-79","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/pages\/79","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/comments?post=79"}],"version-history":[{"count":16,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/pages\/79\/revisions"}],"predecessor-version":[{"id":645,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/pages\/79\/revisions\/645"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2015teamd\/wp-json\/wp\/v2\/media?parent=79"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}