System Implementation

User Interface

iOS Application

Developed an integrated UI for teleoperation and navigation.

Teleoperation

  • Established ROS2 communication between the iOS app and the wheelchair.
  • Implemented fundamental movement controls (forward, backward, left turn, right turn, stop).
  • Designed intuitive push-and-hold buttons for continuous movement, ensuring immediate stop upon release for safety.

Navigation

  • Integrated Google Maps API and Navigation SDK for wheelchair route planning.
  • Enabled users to set destinations by tapping on the map.
  • Implemented an algorithm to plan and display optimal cycling routes to the chosen destination.

User Interaction

Speech Recognition

  • Seamless speech-to-text conversion with multi-language support.
  • Use case: Voice commands for setting a destination.

Smart Assistant

  • Processing time improvement planned for future updates.
  • Use case: ChatGPT integration for answering various questions.