1.1 Project Introduction
This project uses the micro:bit development board as the main controller and integrates the HUSKYLENS 2 AI vision sensor to build a human-computer interaction system based on gesture recognition. The system identifies the left-right and up-down movements of Gesture ID 1 in real time, and maps the gesture coordinates to the launch angle and force of the bird in Angry Birds. Based on the gesture recognition algorithm of the HUSKYLENS 2 and combined with the Mind+ real-time mode stage, players can complete actions such as drawing the bow, aiming and launching with simple hand gestures, and experience the game mode of touchless control.
1.2 Demo Video
2. Hardware and Software Preparation
2.2 Software Preparation
2.2.1 Install Mind+
Download and install the Mind+ installation package(Version 2 or above) from the official website. Double-click to open it after installation.
2.2.2 Set video streaming
Video streaming setup in PC
To use the wired real-time video streaming function, install the RNDIS driver first. If the RNDIS driver has not been installed before, it must be installed. The steps for Windows 11 are as follows: for other systems, if the operation fails as described below, please refer to the system version for guidance or contact technical support.
WebRTC video streaming setup in HUSKYLENS 2
Make connections by referring to the diagram below.
Swipe the HUSKYLENS 2 screen to find "Video Streaming". If not found, perform a firmware update first. In the Video Streaming menu, toggle the WebRTC Streaming switch to ON and YES.
This will automatically return to the main interface. The top-right status bar will show a real-time video streaming icon, indicating that you are currently in video streaming mode.
Choose Hand Recognition mode.
Open a browser and enter the URL http://192.168.88.1 to see the video streaming.
Video streaming has been successfully established.
2.3 Hardware Connection
Make the hardware connections by referring to the diagram below:
3. Project Making
Step 1: Video Streaming
Set WebRTC streaming on HUSKYLENS 2 by following the section 2.2.2.
Step 2: Get coordinate data with micro:bit
Open Mind+ Upload mode and load project "xy-data.mpcode".
Connect Device → Switch to Manual edit → Upload
Disconnect micro:bit after the upload is successful.
Step 3: Interact with the game in Realtime Mode
Open Realtime Mode and load project "Angry birds.mpcode".
Serialport → Connect → Click the green flag(Go) to start
The effect is as follows:
4. Attachment
Angry Bird.zip 
