Tag Recognition-Based Museum Guide

1.1 Project Introduction

When visiting a museum, there are always frustrating moments: standing in front of precious cultural relics, eager to learn their history, but unable to find a tour guide. Using a phone to search for information disrupts the visit rhythm and easily causes you to miss details of the artifacts. This project will develop an audio explanation device based on Tag Recognition, helping you solve these problems effortlessly—identifying exclusive tags near cultural relics automatically triggers audio explanations. For example: when approaching the display case of the Warring States Crystal Cup, simply scan the tag next to the case with the device, and you'll immediately hear explanations about its manufacturing techniques and historical background. No need to search or find a tour guide; you can immerse yourself in the cultural relics' charm at your own pace.

From the collection of artifact tag images, tag recognition model training and inference, to explanation content matching and explanation content display, this complete process clearly demonstrates the easy application of AI technology in cultural scenarios. It makes Tag Recognition technology tangible and interactive, making museum visits more rewarding and enjoyable!

1.2 Demo Video

2. Project Implementation Principle

Its core logic is as follows: First, the HUSKYLENS 2 camera collects and learns cultural relic tag data—different cultural relics (such as the Warring States Crystal Cup), which correspond to exclusive tag features, are "recorded" into the system through the process of "cultural relic tag image acquisition→incremental training of tag recognition model". When tourists visit the museum and approach the cultural relic display case, HUSKYLENS 2 will capture the tags next to the display case in real-time through the camera, and then perform model inference to identify the tag ID and store the result in the system cache.
Next, the UNIHIKER K10 receives the recognition result from HUSKYLENS 2, performs data calculation and instruction matching: if the recognized tag is "Crystal Cup Tag", it will display the cultural relic name and core information through the screen as feedback; if HUSKYLENS 2 recognizes multiple tags, it will prompt the tourist to select the needed tag for recognition and feedback.

3. Hardware and Software Preparation

3.1 Equipment List

Note: HUSKYLENS requires Version HUSKYLENS 2.

3.2 Hardware Connection

Make connections by referring to the diagram below.

3.3 Software Preparation

Download and install the Mind+ installation package (Version 2 and above) from the official website. Double-click to open it after installation.

4. Project Making

4.1 HUSKYLENS 2

First, select the protocol type for HUSKYLENS 2.  
Tap System Settings -> Protocol Type -> Select I2C communication mode, then return to the main menu interface.

Second, swipe the screen to find the "Tag Recognition" function.

Direct HUSKYLENS 2 toward the image containing AprilTag labels. All detected tags will be enclosed by white bounding boxes, and the information contained in each tag will be displayed on the bounding box.

Align HUSKYLENS 2 with the specified AprilTag label you want to learn. Adjust the angle of HUSKYLENS 2 so that the "cross" in the middle of the screen is within the white bounding box, then press the A key in the upper right corner of HUSKYLENS 2 to learn this tag.

After learning an AprilTag, if a previously learned AprilTag is detected, the screen will enclose it in a colored bounding box and display "name: IDx" above it, where "name" defaults to the text content inside the tag. To learn more AprilTag markers, repeat the same process.

AprilTag can be generated through the following website:
https://www.2weima.com/aruco.html

For more detailed usage of HUSKYLENS 2, please refer to the following URL:
https://wiki.dfrobot.com/_SKU_SEN0638_Gravity_HUSKYLENS_2_AI_Camera_Vision_Sensor

After learning tags in HUSKYLENS 2, you can start writing code to implement the tag recognition-based museum guide.

4.2 Programming

Open the programming software Mind+, choose "Coding" mode, then click "Upload Mode" to create a new project.

Next, add the required extensions in Mind+, including UNIHIKER K10 and HUSKYLENS 2.
Enter the "Extensions" page, switch to "Board" tab, search for "K10", click "UNIHIKER K10".

Load the "HUSKYLENS 2 AI Camera" library by the same way from "Module" page.

Click the "Back" button to return to the programming interface.

Click the "Connect Device", choose your device and "Connect".

After the device is successfully connected, write the program as follows:

The analysis of the core code is as follows:

There is a complete program file for this project in the attachment. 
Open Project→Open Local File to load project.

Select the project in the attachment and click "Open".

Click "Upload" to run the program.

The effect is as follows:
 

5. Attachment