{"id":404,"date":"2025-04-04T22:55:00","date_gmt":"2025-04-04T22:55:00","guid":{"rendered":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/?page_id=404"},"modified":"2025-11-21T22:41:49","modified_gmt":"2025-11-21T22:41:49","slug":"system-design-description","status":"publish","type":"page","link":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/system-design-description\/","title":{"rendered":"System Design Description"},"content":{"rendered":"\n<p>Since the robot\u2019s main physical characteristics were predefined\u2014specifically, the use of the Unitree Humanoid G1 platform\u2014we concentrated our efforts on leveraging the various features and capabilities offered by the Unitree system.<\/p>\n\n\n\n<p>Given that the humanoid robot must autonomously navigate and traverse the factory floor, we directed our efforts toward learning-based approaches. Deep learning methods, in particular, offer the potential to generalize across the diverse scenarios the humanoid may encounter in such an environment.<\/p>\n\n\n\n<p>With the robot&#8217;s 27 degrees of freedom, we chose to simplify the control problem by strategically partitioning the roles of the lower and upper body. The lower body was designated to handle stabilization and mobility, operating independently from the upper body. In contrast, the upper body was tasked with performing bimanual manipulation, which we controlled through inverse kinematics.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"415\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-1024x415.png\" alt=\"\" class=\"wp-image-411\" style=\"width:840px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-1024x415.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-300x122.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-768x311.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-1536x622.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-700x284.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-520x211.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-360x146.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-250x101.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1-100x41.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-1.png 1651w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>Based on the sub-sytem level trade study shown above, the hybrid approach combining upper body model-based control with lower body learning-based control achieves the highest overall weighted score (4.5\/5). This suggests that combining the strengths of both methodologies provides the best balance of performance across all criteria.<\/p>\n\n\n\n<p>The pure learning-based approach (4.0\/5) outperforms the pure model-based approach (3.4\/5), primarily due to its superior generalizability, which carries the highest weight factor (40%).<\/p>\n\n\n\n<p>The model-based approaches excel in accuracy, while learning-based methods offer better generalizability. The hybrid solution effectively leverages the strengths of both approaches, achieving excellent scores in both implementation complexity and accuracy while maintaining good performance in computation requirements and generalizability.<\/p>\n\n\n\n<p>We then chose to sub-divide our efforts into three main categories: <\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"99\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-1024x99.png\" alt=\"\" class=\"wp-image-413\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-1024x99.png 1024w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-300x29.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-768x75.png 768w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-1536x149.png 1536w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-700x68.png 700w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-520x50.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-360x35.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-250x24.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2-100x10.png 100w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-2.png 1730w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p>With the &#8220;User Interface&#8221; a goal for the Fall semester.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Perception<\/h2>\n\n\n\n<p>The perception system consists of Unitree\u2019s integrated LiDAR and a RealSense depth camera. The depth camera will be utilized for estimating the pose of the tote as well as for localizing the robot within its environment.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"577\" height=\"304\" src=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3.png\" alt=\"\" class=\"wp-image-422\" style=\"width:329px;height:auto\" srcset=\"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3.png 577w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3-300x158.png 300w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3-520x274.png 520w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3-360x190.png 360w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3-250x132.png 250w, https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-content\/uploads\/sites\/88\/2025\/04\/image-3-100x53.png 100w\" sizes=\"auto, (max-width: 577px) 100vw, 577px\" \/><\/figure>\n<\/div>\n\n\n<h2 class=\"wp-block-heading\">Motion Planner<\/h2>\n\n\n\n<p>Motion planning for humanoid robots involves two key components: trajectory planning and whole-body motion planning. This work focuses on developing efficient algorithms that enable a humanoid robot to navigate in a structured environment while avoiding obstacles and ensuring smooth movement.<\/p>\n\n\n\n<p>To develop and test the trajectory planning approach, a MuJoCo simulation was set up. The simulation environment provides a physics-based platform to evaluate motion planning strategies before deploying them on real hardware.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Initially, a map of the known space was manually created, defining obstacles and free-space regions in XML format, which MuJoCo reads to construct the environment.<\/li>\n\n\n\n<li>This manually constructed map serves as an input for testing and may later be replaced with a more realistic warehouse or factory layout to reflect real-world conditions.<\/li>\n<\/ul>\n\n\n\n<p><strong>Path Planning Algorithm<\/strong><\/p>\n\n\n\n<p>For trajectory planning, an A* (A-star) algorithm was implemented\u2014a well-known graph-based search algorithm for finding the shortest path from a start pose to a goal pose while avoiding obstacles. The process involves:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li><strong>Input Handling<\/strong>: The planner takes in:\n<ul class=\"wp-block-list\">\n<li>The environment map (free space and obstacles).<\/li>\n\n\n\n<li>The start pose of the humanoid robot.<\/li>\n\n\n\n<li>The goal pose where the robot needs to reach.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li><strong>Path Generation<\/strong>: Using the A* algorithm, the planner computes an optimal trajectory, ensuring minimal cost while considering obstacle constraints.<\/li>\n\n\n\n<li><strong>Obstacle Avoidance<\/strong>: The algorithm ensures the robot avoids all obstacles and follows a collision-free path.<\/li>\n<\/ol>\n\n\n\n<p>To enhance interpretability, MuJoCo&#8217;s visualization libraries were integrated to render the planned path within the simulation, enabling better debugging, analysis, and fine-tuning of the trajectory planner.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Locomotion &amp; Manipulation<\/h2>\n\n\n\n<p>To address the complex demands of humanoid mobility and bimanual manipulation, we adopted a hybrid control strategy. Locomotion is handled via a learning-based policy trained in simulation, allowing the robot to generalize across uneven terrain and dynamic environments. For manipulation, we implemented model-based inverse kinematics to enable precise, real-time control of the upper body. This separation of control enables robust performance across diverse factory scenarios while maintaining real-time responsiveness.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Since the robot\u2019s main physical characteristics were predefined\u2014specifically, the use [&hellip;]<\/p>\n","protected":false},"author":413,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/page_fullwidth.php","meta":{"footnotes":""},"class_list":["post-404","page","type-page","status-publish","hentry","clearfix"],"_links":{"self":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/pages\/404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/users\/413"}],"replies":[{"embeddable":true,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/comments?post=404"}],"version-history":[{"count":10,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/pages\/404\/revisions"}],"predecessor-version":[{"id":464,"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/pages\/404\/revisions\/464"}],"wp:attachment":[{"href":"https:\/\/mrsdprojects.ri.cmu.edu\/2025teamf\/wp-json\/wp\/v2\/media?parent=404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}