{"id":2,"date":"2025-11-20T20:48:25","date_gmt":"2025-11-20T20:48:25","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/?page_id=2"},"modified":"2026-05-02T04:31:59","modified_gmt":"2026-05-02T04:31:59","slug":"system-summary","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/","title":{"rendered":"System Summary"},"content":{"rendered":"\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h3 class=\"wp-block-heading has-text-align-center\">System Details<\/h3>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-a89b3969 wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-design\/\"><strong>System Design<\/strong><\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-performance\/\"><strong>System Performance<\/strong><\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-implementation\/\">System Implementation<\/a><\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading has-text-align-center\">Subsystem Details<\/h3>\n\n\n\n<div class=\"wp-block-buttons is-content-justification-center is-layout-flex wp-container-core-buttons-is-layout-a89b3969 wp-block-buttons-is-layout-flex\">\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-text-align-center wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/payload-versions\/\">Payload Design<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-text-align-center wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/communications\/\">Communication Stack<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-text-align-center wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/pcb-design\/\">PCB Design<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-text-align-center wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/mac-vio\/\">MAC-VIO Frontend<\/a><\/div>\n\n\n\n<div class=\"wp-block-button\"><a class=\"wp-block-button__link has-text-align-center wp-element-button\" href=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/system-summary\/slam\/\">SLAM Backend<\/a><\/div>\n<\/div>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h2 class=\"wp-block-heading\">Problem Description<\/h2>\n\n\n\n<p>Residential building fires pose a severe threat to public safety, resulting in thousands of deaths and over $11 billion in financial losses in 2023 alone, as shown below.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"584\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-1024x584.png\" alt=\"\" class=\"wp-image-54\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-1024x584.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-300x171.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-768x438.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-1536x876.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/firedata-2048x1168.png 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p><br>During these emergencies, the first few minutes (primary search) are the most critical in minimizing casualties and damages. Firefighters conducting primary searches in smoke filled rooms face critical operational challenges, such as missing directional cues and a sensing range limited to their immediate physical reach.<br>Furthermore, Fire Chiefs coordinating efforts outside the hazard zone often lack real-time information regarding the interior layout and the precise location of their team members, significantly hampering effective coordination and decision-making.<\/p>\n\n\n\n<p>To address these critical safety gaps, FireSense is a modular sensing system designed to aid firefighters by establishing real-time operational awareness during structural fires.<br>Unlike traditional robotic solutions that rely on independent platforms, this project utilizes a human-centric approach where wearable payloads are carried directly by firefighters.<br>This design eliminates the friction of deploying separate ground or aerial robots, allowing the system to seamlessly integrate into existing firefighter workflows while extending their situational awareness beyond physical barriers.<\/p>\n\n\n\n<p>The system fulfills the distinct operational needs of two primary user groups: deployed firefighters and the Fire Chief.<br>For the Fire Chief at the Command Station, the system provides a centralized interface that displays a collaboratively generated 3D map of the building in real-time.<br>By tracking the live positions of firefighters and identifying the locations of victims, the system enables the fire chief to make faster tactical decisions, vector rescue teams efficiently to points of interest, and coordinate rapid interventions based on live data.<br>Simultaneously, the system functions as a digital partner for the firefighter, automatically detecting and mapping the environment to locate victims, thereby improving overall safety and speeding up the primary search process.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h2 class=\"wp-block-heading\">Use Case<\/h2>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"804\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1-1024x804.png\" alt=\"\" class=\"wp-image-56\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1-1024x804.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1-300x235.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1-768x603.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1-1536x1206.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/02\/usecase-1.png 1716w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Upon arrival at a residential structure fire, the <strong>Fire Chief<\/strong> performs a 360\u00b0 exterior inspection to identify entry points, hazards, and structural risks. Once the primary search begins, two firefighters enter the smoke-filled building equipped with the <strong>FireSense wearable payload system<\/strong>, integrated with their air-tank backpack.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Wearable Payload Deployment<\/h4>\n\n\n\n<p>The FireSense payload is mounted on the firefighter&#8217;s <strong>shoulder and upper back<\/strong>, maintaining balance and minimizing interference with standard gear and movement. The heavy compute unit (Jetson AGX Orin) and power supply sit on the back, with wired connections running to the lighter sensors on the shoulder. As firefighters advance through hallways, staircases, and rooms under zero-visibility conditions, the payload continuously senses the environment using <strong>thermal stereo cameras and radar<\/strong>. Even in hot smoke where vision is limited to arm&#8217;s length, the system captures structural layout, obstacles, and potential victims.<\/p>\n\n\n\n<figure class=\"wp-block-gallery has-nested-images columns-default is-cropped wp-block-gallery-1 is-layout-flex wp-block-gallery-is-layout-flex\">\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"647\" data-id=\"264\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/payload_concept2-1024x647.png\" alt=\"\" class=\"wp-image-264\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/payload_concept2-1024x647.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/payload_concept2-300x190.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/payload_concept2-768x485.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/payload_concept2.png 1200w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/figure>\n\n\n\n<h4 class=\"wp-block-heading\">Edge Processing &amp; Wireless Transmission<\/h4>\n\n\n\n<p>Instead of transmitting heavy raw data streams, the wearable payload processes sensor inputs <strong>locally on the AGX Orin<\/strong> to generate lightweight SLAM constraints and Point-of-Interest (POI) detections. These compact outputs are transmitted wirelessly through walls via a <strong>915 MHz Wi-Fi HaLow link<\/strong> to the Command Station located safely outside the hazard zone. This edge-processing approach reduces bandwidth requirements and allows the system to tolerate intermittent connectivity through dense walls.Edge Processing &amp; Wireless Transmission<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Command Station &amp; Collaborative SLAM<\/h4>\n\n\n\n<p>At the Command Station, a centralized <strong>Collaborative SLAM (C-SLAM) backend<\/strong> fuses data from all deployed payloads to construct a consistent, real-time 3D map of the building interior. The interface provides the Fire Chief with operational awareness that traditionally does not exist during interior operations, displaying:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A <strong>live global 3D map<\/strong> of the structure<\/li>\n\n\n\n<li>The <strong>real-time positions<\/strong> of all active firefighters<\/li>\n\n\n\n<li><strong>Detected Points of Interest<\/strong> (e.g., victims, exits, hazards)<\/li>\n\n\n\n<li><strong>Navigation path recommendations<\/strong> to the nearest egress or victim location<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"887\" height=\"595\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/3D_pointcloud.png\" alt=\"\" class=\"wp-image-263\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/3D_pointcloud.png 887w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/3D_pointcloud-300x201.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/3D_pointcloud-768x515.png 768w\" sizes=\"auto, (max-width: 887px) 100vw, 887px\" \/><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\">Tactical Decision-Making<\/h4>\n\n\n\n<p>Using this real-time operational awareness, the commander can coordinate the nearest firefighter or dispatch a rescue team to the exact location provided by the live map. In the event of a critical situation such as a <strong>Mayday call<\/strong>, the instant 3D mapping and 2D annotated floor plan allow the incident commander to make faster tactical decisions\u2014dispatching rescue teams to a precise location rather than relying on rough verbal descriptions.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"559\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/usecase2.png\" alt=\"\" class=\"wp-image-265\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/usecase2.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/usecase2-300x164.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-content\/uploads\/sites\/97\/2026\/05\/usecase2-768x419.png 768w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>System Details Subsystem Details Problem Description Residential building fires pose a severe threat to public safety, resulting in thousands of deaths and over $11 billion in financial losses in 2023 alone, as shown below. During these emergencies, the first few minutes (primary search) are the most critical in minimizing casualties and damages. Firefighters conducting primary [&hellip;]<\/p>\n","protected":false},"author":456,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"open","template":"","meta":{"footnotes":""},"class_list":["post-2","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/pages\/2","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/users\/456"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/comments?post=2"}],"version-history":[{"count":8,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/pages\/2\/revisions"}],"predecessor-version":[{"id":289,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/pages\/2\/revisions\/289"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2026teamf\/wp-json\/wp\/v2\/media?parent=2"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}