feat: add gesture-based drone control example script using MediaPipe#161
feat: add gesture-based drone control example script using MediaPipe#161sushantkumarkhobian-lab wants to merge 3 commits into
Conversation
|
Nice work! I think it's a cool addition :). Can you upload to this PR a video/screenshots of this script working? |
|
Hi @LucasJSch! Thanks for the kind words. I actually have a demo GIF hosted over in my main project repository readme AirSim-Gesture-Drone-Control. Here is a quick look at it in action:
Let me know if you'd like me to add any additional screenshots! |
|
I have a question seeing your code and GIF. Are you using AirSim or ProjectAirsim? |
|
The script was originally written and tested using the legacy Microsoft AirSim Python API, which explains why you noticed that in the code and GIF. |
|
Hi @LucasJSch, thanks for the review. I have updated the implementation to be fully compatible with ProjectAirSim and cleaned up the control flow accordingly. The script has been simplified and stabilized, with proper handling of gesture-based navigation and shutdown behavior. A short demo GIF of the working system is attached below for reference.
Please let me know if any further changes are required. |


Description
This PR adds a Python-based gesture-controlled multirotor simulation example using AirSim (ProjectAirSim), MediaPipe, and OpenCV.
The system uses real-time webcam hand tracking to interpret predefined finger gestures and convert them into drone motion commands inside a simulated environment.
Features
Control Mapping
Purpose
This example demonstrates a clean integration of computer vision and drone simulation control, enabling intuitive gesture-based navigation. It is designed as an educational and experimental interface for understanding real-time robotics control, motion mapping, and human–drone interaction systems using AirSim.
Dependencies
opencv-python)mediapipe)