{"id":180,"date":"2020-10-20T15:31:31","date_gmt":"2020-10-20T15:31:31","guid":{"rendered":"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/?page_id=180"},"modified":"2021-05-21T22:39:54","modified_gmt":"2021-05-22T02:39:54","slug":"system-summary","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/system-summary\/","title":{"rendered":"System Summary"},"content":{"rendered":"\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"#problem\">Problem Description<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link\" href=\"#usecase\">Use Case<\/a><\/div>\n<\/div>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"Problem\">Problem Description<\/h2>\n\n\n<p style=\"text-align: left\">Once first responders arrive on the scene of a collapsed structure, time is short. Responders must locate and rescue survivors trapped in rubble, often with dust and haze obfuscating their line of sight. Currently, responders employ K9 units and manual search parties within these types of environments. This approach can be time-consuming and expose the search party to gases, chemicals, and grievous danger from further structural collapse.<\/p>\n<p style=\"text-align: left\">DR<b><span lang=\"el\" title=\"Greek language text\">\u039b<\/span><\/b>GOON is a mobile ground vehicle that scouts interior spaces through teleoperation, localizes points of interest under poor visibility and relays a coherent representation of the vehicle&#8217;s environment and points of interest back to the user. Of particular interest is the detection and localization of humans in a debris field: A time-critical task often necessary in the wake of structural collapse or natural disasters. Relaying a consistent representation of the interior environment is critical to first responders for the planning and execution of rescue operations. Accomplishing these tasks with airborne particulate obfuscation, adverse lighting conditions and debris occlusion is critical to DR<b><span lang=\"el\" title=\"Greek language text\">\u039b<\/span><\/b>GOON&#8217;s success in relevant disaster scenarios.<\/p>\n<p style=\"text-align: left\">The high-level objectives of our system are shown in figure below. Our system aims to tackle several engineering challenges including developing a feasible human detection algorithm with low-cost sensors and maintaining detection capability in a dark and obfuscated room.<\/p>\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/Objectives-Tree-2.0.jpg\" alt=\"\" class=\"wp-image-242\" width=\"605\" height=\"493\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/Objectives-Tree-2.0.jpg 1001w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/Objectives-Tree-2.0-300x245.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/Objectives-Tree-2.0-768x627.jpg 768w\" sizes=\"auto, (max-width: 605px) 100vw, 605px\" \/><figcaption>DR<strong>\u039b<\/strong>GOON Objectives Tree<\/figcaption><\/figure><\/div>\n\n\n\n<hr class=\"wp-block-separator\" \/>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"usecase\">Use Case<\/h2>\n\n\n\n<figure class=\"wp-block-gallery columns-2 is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\"><ul class=\"blocks-gallery-grid\"><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"826\" height=\"550\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_outside_cropped.jpg\" alt=\"\" data-id=\"240\" data-full-url=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_outside_cropped.jpg\" data-link=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/system-summary\/render_outside_cropped\/\" class=\"wp-image-240\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_outside_cropped.jpg 826w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_outside_cropped-300x200.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_outside_cropped-768x511.jpg 768w\" sizes=\"auto, (max-width: 826px) 100vw, 826px\" \/><figcaption class=\"blocks-gallery-item__caption\">First responders deploy DR<strong>\u039b<\/strong>GOON at ingress point of the partially collapsed building<\/figcaption><\/figure><\/li><li class=\"blocks-gallery-item\"><figure><img loading=\"lazy\" decoding=\"async\" width=\"950\" height=\"633\" src=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_inside.jpg\" alt=\"\" data-id=\"239\" data-full-url=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_inside.jpg\" data-link=\"http:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/system-summary\/render_inside\/\" class=\"wp-image-239\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_inside.jpg 950w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_inside-300x200.jpg 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-content\/uploads\/sites\/51\/2021\/01\/render_inside-768x512.jpg 768w\" sizes=\"auto, (max-width: 950px) 100vw, 950px\" \/><figcaption class=\"blocks-gallery-item__caption\">DR<strong>\u039b<\/strong>GOON surveys the interior of the building interior and searches for survivors<\/figcaption><\/figure><\/li><\/ul><\/figure>\n\n\n\n<p>A 7.5 magnitude earthquake strikes downtown Los Angeles in the middle of the night. The entire city plunges into panic as buildings collapse with victims trapped inside. The recon team of the Urban Search &amp; Rescue (US &amp; R) California Task Force 2 (CA-TF2) arrives at the site of a partially collapsed office building. The building used to boast a wide entrance into its lobby, but the team is met with broken chunks of concrete that block all access paths. Recon team leader Capt. Gisel Montag faces a difficult situation; she could ask her team to start removing rubble from the entrance, but this will cost them precious time without any guarantee that they will find survivors.<\/p>\n\n\n\n<p>The Captain pulls out a pelican case and quickly deploys the DR<strong>\u039b<\/strong>GOON disaster reconnaissance robot at an ingress point of the building. Within seconds of powering the robot on, she uses the remote teleoperation device to drive the robot deeper into the building. The screen in front of Capt. Gisel lights up and forms a clear picture of the geometry of the room inside, riddled with debris from the building collapse. Capt. Montag can tell from the display that DR<strong>\u039b<\/strong>GOON has about 18 minutes of battery life left, and that all subsystems are up and running. Armed with this knowledge, Montag proceeds to start the mission, confident that DR<strong>\u039b<\/strong>GOON will perform to its fullest extent. Capt. Montag controls DR<strong>\u039b<\/strong>GOON through a set of joysticks on a controller and steers the vehicle into voids between debris, using its sensor suite to scan for trapped survivors and identify hazards that rescue crews would face upon entry.<\/p>\n\n\n\n<p>Capt. Montag pilots DR<strong>\u039b<\/strong>GOON through a field of collapsed steel beams, avoiding collisions by relying heavily on DR<strong>\u039b<\/strong>GOON&#8217;s real-time sensors to guide her control inputs. The visualizer displays the path DR<strong>\u039b<\/strong>GOON has taken through the field of beams, offering hints for the entry path of rescue crews during survivor extraction. Montag commands DR<strong>\u039b<\/strong>GOON around a corner and enters a room occluded by lingering smoke and dust. Montag is unable to make out any environmental features on the RGB camera port, but DR<strong>\u039b<\/strong>GOON is still able to map the room using its on-board haze and smoke sensor correction algorithms. Montag suddenly sees a hot spot on the infrared display port of her visualizer. Within a few seconds, DR<strong>\u039b<\/strong>GOON identifies this hot spot as a human trapped beneath a broken slab of concrete. DR<strong>\u039b<\/strong>GOON calculates the human&#8217;s location relative to the map that it has been generating. After localizing the human, DR<strong>\u039b<\/strong>GOON&#8217;s visual interface displays a marker at the human&#8217;s location. As the team ventures into the rubble to retrieve the survivor, they know to avoid a structural beam that fell in the path thanks to DR<strong>\u039b<\/strong>GOON&#8217;s on-board mapping software, which identifies obstacles using a combination of infrared and visual light sensors and draws their location on the map.<\/p>\n\n\n\n<p>Capt. Montag felt relieved that her team had obtained situational awareness of hazards using DR<strong>\u039b<\/strong>GOON in order to execute a quick retrieval of the survivors. After the extraction operation, Capt. Montag and her team are able to review the mission logs from DR<strong>\u039b<\/strong>GOON in order to learn what they can and improving future performance.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Problem Description Once first responders arrive on the scene of a collapsed structure, time is short. Responders must locate and rescue survivors trapped in rubble, often with dust and haze obfuscating their line of sight. Currently, responders employ K9 units and manual search parties within these types of environments. This approach can be time-consuming and<br \/><a class=\"moretag\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/system-summary\/\">+ Read More<\/a><\/p>\n","protected":false},"author":236,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-180","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/pages\/180","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/users\/236"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/comments?post=180"}],"version-history":[{"count":23,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/pages\/180\/revisions"}],"predecessor-version":[{"id":740,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/pages\/180\/revisions\/740"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2021teamb\/wp-json\/wp\/v2\/media?parent=180"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}