PROJECT DESCRIPTION
The project showcases an immersive AR/VR and IoT-powered humanoid system integrated with gesture recognition, brainwave interaction, and VR-based control. It features a robotic exoskeleton, smart glove, BCI headset, and VR headset to provide seamless real-world control through virtual environments.
OBJECTIVE
To create an intelligent, interactive system that combines AR/VR technology with IoT-based gesture and brainwave control for real-time robot manipulation, educational simulation, and human-robot interface enhancement.
CHALLENGES
Integration of multiple hardware systems (robot, glove, VR, BCI).
Achieving real-time motion tracking and low-latency control.
Accurate interpretation of hand gestures using flex sensors.
Reliable wireless communication between devices.
Synchronization between physical and virtual environments.
DESIGN PROCESS
Ideation & Planning – Identified practical use-cases for IoT + AR/VR integration.
Hardware Assembly – Developed a 3D humanoid robot using servo motors and custom chassis.
Glove Design – Built a flex sensor-based glove for hand gesture recognition.
BCI Integration – Used brainwave headset for cognitive input (focus/blink-based actions).
VR Syncing – Linked the robotic motion to VR simulations for immersive control.
Testing & Iteration – Conducted multiple real-world test cases and refined system latency.
