{"id":279,"date":"2020-04-03T15:15:03","date_gmt":"2020-04-03T19:15:03","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/?page_id=279"},"modified":"2020-12-18T19:42:33","modified_gmt":"2020-12-19T00:42:33","slug":"data-capture-subsystem","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/","title":{"rendered":"Data Capture Subsystem"},"content":{"rendered":"\n<h1 class=\"wp-block-heading\"><strong>Data Capture<\/strong><\/h1>\n\n\n\n<p>Data is a crucial part of our system as it brings the &#8220;realism&#8221; to our behavior model. This system is built to capture and use data from which we can extract realistic behavior for our models. This includes recording video data by placing a camera at a traffic light intersection. We have collected data from both the simulation environment and from the real world. The simulation environment is the CARLA simulator. In the real world we mounted&nbsp; two cameras at diagonally opposite ends of an intersection and recorded video from them.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Carla<\/strong><\/h3>\n\n\n\n<p>Using CARLA for data capture has two benefits. It helped us identify the best mounting points for the cameras for an ideal video stream. Additionally, it provides us with ground truth information about the state inside simulator, which helped us prototype and test the downstream subsystems. The simulator allows us to vary the location of the traffic camera, the weather, and the density of the vehicles in the simulator. This has helped us train a detection model robust to such variations.<\/p>\n\n\n\n<p>We mount two cameras at the two opposite sides of the intersection to enable 100% view<\/p>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<figure class=\"wp-block-gallery aligncenter columns-2 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1-1024x576.png\" alt=\"\" data-id=\"687\" data-link=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/cam_view_53-1\/\" class=\"wp-image-687\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1-1024x576.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1-300x169.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1-768x432.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1-1536x864.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_53-1.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1-1024x576.png\" alt=\"\" data-id=\"688\" data-full-url=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1.png\" data-link=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/cam_view_50-1\/\" class=\"wp-image-688\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1-1024x576.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1-300x169.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1-768x432.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1-1536x864.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/cam_view_50-1.png 1920w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure><\/li><\/ul><figcaption class=\"blocks-gallery-caption\">Carla Data Capture : Same intersection viewed from opposite sides<\/figcaption><\/figure>\n<\/div><\/div>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-flow wp-block-group-is-layout-flow\">\n<h3 class=\"wp-block-heading\">Real-World<\/h3>\n\n\n\n<p>Similar to Carla intersection, we capture videos from opposite sides in a real-world inter-section. We have used a GoPro for data capture as it has enabled us to capture a wide view of the intersection and provides a good frame rate, which retains high quality information for use in the Data Processing subsystem. From prototyping within CARLA, we realized placing the camera higher up is better for us as it prevents occlusion between vehicles. We used tripod stands to manage the vertical position of the camera. Below we see our camera system deployed at Fifth and Craig Intersection, Pittsburgh, PA.<\/p>\n\n\n\n<figure class=\"wp-block-gallery columns-2 is-cropped wp-block-gallery-2 is-layout-flex wp-block-gallery-is-layout-flex\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"1024\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-1024x1024.jpg\" alt=\"\" data-id=\"703\" data-link=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/gopro1\/\" class=\"wp-image-703\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-1024x1024.jpg 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-300x300.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-150x150.jpg 150w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-768x768.jpg 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-1536x1536.jpg 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/gopro1-2048x2048.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"blocks-gallery-item__caption\">Data Capture Hardware: Go-Pro Hero 8<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"610\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1-1024x610.png\" alt=\"\" data-id=\"704\" data-full-url=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1.png\" data-link=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/fifth_craig1\/\" class=\"wp-image-704\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1-1024x610.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1-300x179.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1-768x458.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-content\/uploads\/sites\/47\/2020\/12\/fifth_craig1.png 1086w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"blocks-gallery-item__caption\">Camera system at intersection (marked in yellow)<\/figcaption><\/figure><\/li><\/ul><\/figure>\n<\/div><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Performance Analysis<\/h2>\n\n\n\n<p>We had the following two evaluation criteria for this subsystem:<\/p>\n\n\n\n<ul class=\"wp-block-list\"><li>Percentage of intersection captured in the recorded video &#8211; M.P.1<\/li><li>Frames per second (fps) of captured video &#8211; M.P.2<\/li><\/ul>\n\n\n\n<p>Mounting two camera on opposite sides of intersection allows us 100% view of the intersection, fulfilling M.P.1.<br>Both CARLA camera and GoPro allow us to adjust fps to very high values. In our work we captured data at 30 and 60 fps respectively, hence we fulfill M.P.2.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Strengths and Weaknesses<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Strengths<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li>The current traffic camera-based data capture system is a convenient way to capture bulk data from CARLA.<\/li><li>It allows variations in traffic density, weather and behavioral parameters, thus producing varied training and test cases.<\/li><\/ul>\n\n\n\n<h3 class=\"wp-block-heading\">Weakness<\/h3>\n\n\n\n<ul class=\"wp-block-list\"><li>Real world data capture system needs significant setup work before recording data. It requires user involvement in determining good mount positions, avoid occlusions from traffic lights and other traffic signs. It also requires sufficient space on the pavement for placing the tripod.<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Data Capture Data is a crucial part of our system as it brings the &#8220;realism&#8221; to our behavior model. This system is built to capture and use data from which we can extract realistic behavior for our models. This includes recording video data by placing a camera at a traffic light intersection. We have collected<br \/><a class=\"moretag\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/data-capture-subsystem\/\">+ Read More<\/a><\/p>\n","protected":false},"author":217,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-279","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/pages\/279","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/users\/217"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/comments?post=279"}],"version-history":[{"count":15,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/pages\/279\/revisions"}],"predecessor-version":[{"id":730,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/pages\/279\/revisions\/730"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2020teamh\/wp-json\/wp\/v2\/media?parent=279"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}