Introducing AI Vision Sensor HUSKYLENS: AI Camera with Kendryte K210

MakerA Jun 04.2020

2 48025 Easy

1. Introduction to HUSKYLENS (AI Vision Sensor)

About HUSKYLENS

Built with the Kendryte K210 chip, HUSKYLENS (AI Vision Sensor) for DFROBOT is user friendly and easy on the wallet. This AI-powered camera positions all components on a small PCB (44.5 mm × 52 mm), with a 2 MP (or 5 MP) imaging sensor on the front and a 2" IPS display on the back.

Images shot by the imaging sensor (including faces, colors, and tags) are analyzed, recognized, and tracked by the Kendryte K210 on the printed circuit board. The UART/I2C delivers the output of identified and tracked objects (i.e., dimensions and coordinates).

Image 1-1.HUSKYLENS（Face side）

Image 1-2.HUSKYLENS（Back side）

Six Recognition and Tracking Algorithms

HUSKYLENS is programmed with six algorithms, namely, face recognition, object recognition, color recognition, tag recognition, object tracking, and line tracking. When connected to the power supply, HUSKYLENS is immediately available for recognition and tracking shown by the display on the back. Fig. 1-3 illustrates face recognition (ID1) displays registered with HUSKYLENS.

External Connection

Its UART/I2C portal allows connection to a microcontroller, including micro:bit, Arduino, and Raspberry Pi. The dimensions and coordinates of a recognized object to be acquired on a real-time basis may help develop self-driving robotic vehicles and interactive applications in response to human faces and gestures.

HuskyLens can connect to Arduino, Raspberry Pi, LattePanda, or micro:bit

HUSKYLENS Specifications

HUSKYLENS comes with a processor, imaging sensor, and display as shown below.

1-1.HUSKYLENS Specification

About Kendryte K210

The Kendryte K210 processor adopted by HUSKYLENS is a high-performance system-on-chip (SoC) developed by CANAAN CREATIVE for the AI and IoT markets.

Image 1-4.Kendryte K210

Kendryte K210 integrates various processors, including two FPUs powered by 64-bit RISC-V cores, neutral network processor (KPU), and audio processor (APU), as well as accelerators, including fast Fourier transform (FFT). The low-power Kendryte K210 can achieve high-performance image processing.

2.Component Details

The various components found within HUSKYLENS are described below.

Imaging Sensor (Camera)

This imaging sensor (camera) is for shooting photographs. Modules for HUSKYLENS may vary from model to model. For instance, SEN0305 HUSKYLENS refers to the OV2640 (2-MP camera) and SEN0336 HUSKYLENS Pro refers to Ov5640 (5-MP camera). Upon purchase, the seal on the camera may be removed before use.

Image 2-1.Image Sensor（Camera）

Function Button

The function button is reserved for adjusting, changing, and confirming the settings menu. When the function button is pressed, the settings menu displays. You may select items by swiping left or right.

Image 2-2.Function Button

In addition to regular settings including communications protocols and display brightness, you may configure settings related to various algorithms (including face recognition, object recognition, color recognition, tag recognition, object tracking, and line tracking).

Image 2-3.General Settings

Learning Button

The learning button is reserved for learning tasks. For instance, it is used to learn a human face and register such information with HUSKYLENS. In addition, the learning button allows shots from various angles to learn the human face. This enables face recognition from various angles.

Image 2-4. Learning Button

UART/12C Portal

The 4-pin portal allows connection to an external microcontroller, including micro:bit, Arduino, and Raspberry Pi. The communications protocols include UART (9,600/115,200/1,000,000) or I2C. By default, the protocols can be fixed by auto recognition or manual configuration of settings.

Image 2-5.UART/12C Portal

USB Portal

This Micro-B portal connects to the PC for power supply and firmware update of HUSKYLENS.

Image 2-6. USB Portal

RGB LED

The LED lights up when the object is being recognized.

Image 2-7.RGB LED

LED

Two (2) LEDs cast light on the object. Lighting adjustments, including on/off and brightness level, can be configured on the settings menu.

Image 2-8.LED

Display

The display shows images shot by the imaging sensor. If the object is recognized, related details will display simultaneously. Furthermore, HUSKYLENS’ settings menu will appear.