Building a Pose Recognition Robot Using HUSKYLENS 2

This project demonstrates the following: A pose robot assembled with a micro:bit and servo motors can in real time imitate human poses recognized by the HUSKYLENS 2, so as to reflect the pose recognition effect of HUSKYLENS 2.

What You’ll Need

Hardware Preparation

To follow this tutorial, here’s the hardware you’ll need to get ready:

Check HUSKYLENS 2 firmware version: System Settings → Device Information.

If the firmware version is too old, update it to System Version 1.2.1 and above in time. For firmware updates, check out this guide:
https://wiki.dfrobot.com/_SKU_SEN0638_Gravity_HUSKYLENS_2_AI_Camera_Vision_Sensor#7.1%20%20Latest%20Version

Software Preparation

Ensure Mind+ V2 is downloaded and installed.

How it works

Step 1: Setup RNDIS Driver for PC

To use the wired real-time video streaming function, install the RNDIS driver first. If the RNDIS driver is not already installed on your computer, you will need to install it first. The steps for Windows 11 are as follows: for other systems, if the operation fails as described below, please refer to the system version for guidance or contact technical support.

Step 2: Make Connections

Step 3: Setup video streaming to get result from HUSKYLENS 2

Swipe the HUSKYLENS 2 screen to find "Video Streaming". If not found, perform a firmware update first. In the Video Streaming menu, toggle the WebRTC Streaming switch to ON and select YES.

This will automatically return to the main interface. The top-right status bar will show a real-time video streaming icon, indicating that you are currently in video streaming mode.

Choose Pose Recognition mode.

Open a browser and enter the URL http://192.168.88.1 to see the video streaming.

Video streaming has been successfully established.

Step 4: Upload program to micro:bit on Mind+

Connect micro:bit to your computer.

Open Mind+ and load the project file robot.mpcode in Upload Mode.

Upload this project to your micro:bit.

Step 5: Build your robot

1. Connect three Geekservos to Pin P0, P1 and P2 respectively.
2. Connect HUSKYLENS 2 to the I2C port of the expansion board, and connect the HUSKYLENS 2 to a computer via a Type-C cable.
3. Insert the micro:bit into the IO Expansion Board.
4. Connect the expansion board to a power supply.

Assemble the robot structure with building blocks, then mount the HUSKYLENS 2 and servo motors at the appropriate positions on the structure. The key construction parts are shown in the figure below.

Step 6: Test

After the program starts, wait for 5 seconds. Press the A button to enter the recognition mode after the servo motor stops. In the recognition mode, press the B button to pause and press the A button to resume.
Change your pose to interact with the robot.

Attachment