Introducing AI Vision Sensor HUSKYLENS: AI Camera with Kendryte K210
userhead
MakerA 2020-06-09 18:02:41
recommend article

1. Introduction to HUSKYLENS (AI Vision Sensor) 

 About HUSKYLENS 

Built with the Kendryte K210 chip, HUSKYLENS (AI Vision Sensor) for DFROBOT is user friendly and easy on the wallet. This AI-powered camera positions all components on a small PCB (44.5 mm × 52 mm), with a 2 MP (or 5 MP) imaging sensor on the front and a 2" IPS display on the back.

Images shot by the imaging sensor (including faces, colors, and tags) are analyzed, recognized, and tracked by the Kendryte K210 on the printed circuit board. The UART/I2C delivers the output of identified and tracked objects (i.e., dimensions and coordinates).

projectImage

Image 1-1.HUSKYLENS(Face side)

projectImage

Image 1-2.HUSKYLENS(Back side)

Six Recognition and Tracking Algorithms 

HUSKYLENS is programmed with six algorithms, namely, face recognition, object recognition, color recognition, tag recognition, object tracking, and line tracking. When connected to the power supply, HUSKYLENS is immediately available for recognition and tracking shown by the display on the back. Fig. 1-3 illustrates face recognition (ID1) displays registered with HUSKYLENS.

External Connection

Its UART/I2C portal allows connection to a microcontroller, including micro:bit, Arduino, and Raspberry Pi. The dimensions and coordinates of a recognized object to be acquired on a real-time basis may help develop self-driving robotic vehicles and interactive applications in response to human faces and gestures.

HuskyLens can connect to Arduino, Raspberry Pi, LattePanda, or micro:bit

projectImage

HUSKYLENS Specifications 

HUSKYLENS comes with a processor, imaging sensor, and display as shown below.

 1-1.HUSKYLENS Specification

projectImage

About Kendryte K210 

The Kendryte K210 processor adopted by HUSKYLENS is a high-performance system-on-chip (SoC) developed by CANAAN CREATIVE for the AI and IoT markets.

projectImage

  Image 1-4.Kendryte K210  

Kendryte K210 integrates various processors, including two FPUs powered by 64-bit RISC-V cores, neutral network processor (KPU), and audio processor (APU), as well as accelerators, including fast Fourier transform (FFT). The low-power Kendryte K210 can achieve high-performance image processing.

 2.Component Details 

 The various components found within HUSKYLENS are described below.

Imaging Sensor (Camera) 

This imaging sensor (camera) is for shooting photographs. Modules for HUSKYLENS may vary from model to model. For instance, SEN0305 HUSKYLENS refers to the OV2640 (2-MP camera) and SEN0336 HUSKYLENS Pro refers to Ov5640 (5-MP camera). Upon purchase, the seal on the camera may be removed before use.

projectImage

 Image 2-1.Image Sensor(Camera)

Function Button 

The function button is reserved for adjusting, changing, and confirming the settings menu. When the function button is pressed, the settings menu displays. You may select items by swiping left or right.

projectImage

 Image 2-2.Function Button 

In addition to regular settings including communications protocols and display brightness, you may configure settings related to various algorithms (including face recognition, object recognition, color recognition, tag recognition, object tracking, and line tracking).

projectImage

Image 2-3.General Settings

Learning Button 

The learning button is reserved for learning tasks. For instance, it is used to learn a human face and register such information with HUSKYLENS. In addition, the learning button allows shots from various angles to learn the human face. This enables face recognition from various angles.

projectImage

 Image 2-4. Learning Button 

UART/12C Portal 

The 4-pin portal allows connection to an external microcontroller, including micro:bit, Arduino, and Raspberry Pi. The communications protocols include UART (9,600/115,200/1,000,000) or I2C. By default, the protocols can be fixed by auto recognition or manual configuration of settings.

projectImage

  Image 2-5.UART/12C Portal 

projectImage

 USB Portal 

This Micro-B portal connects to the PC for power supply and firmware update of HUSKYLENS.

projectImage

 Image 2-6. USB Portal 

RGB LED 

The LED lights up when the object is being recognized.

projectImage

 Image 2-7.RGB LED 

LED 

Two (2) LEDs cast light on the object. Lighting adjustments, including on/off and brightness level, can be configured on the settings menu.

projectImage

 Image 2-8.LED  

Display 

The display shows images shot by the imaging sensor. If the object is recognized, related details will display simultaneously. Furthermore, HUSKYLENS’ settings menu will appear.  

projectImage

 Image 2-9.Display  

projectImage

 Image 2-10.Facial recognition  

TF Card Slot 

It is a slot for TF cards (MicroSD cards). The card is inserted following the arrow sign. Currently, its purpose remains unclear.

projectImage

 Image 2-11.TF Card Slot  

3.HUSKYLENS Documentation 

To learn more about HUSKYLENS, please see HUSKYLENS_V1.0_SKU_SEN0305_SEN0336-DFROBOT.

License
1
All Rights
Reserved
[[i.text]]
licensBg
0
0
COMMENTS ([[commentTotla]])
[[c.user_name]] [[c.create_time]]
[[c.parent_comment.count]]
[[c.comment_content]]