[Lensing CSK6 Visual AI Development Kit Trial] First Experience of CSK6 Series Head and Shoulders Recognition

This article comes from the CSK6 visual AI development kit activity organized by Jishu Community and Lesi Technology. For more development board trial activities, please pay attention to the Jishu Community website. Author: Tension

background

foreword

Lenses CSK4002, with its advanced AI algorithm, excellent price-performance ratio, and superior head-and-shoulders tracking capability, occupies more than 80% of the gimbal market, and its product sales channels cover major e-commerce platforms such as Amazon, Douyin, and Pinduoduo. The major solution providers and brand manufacturers that have cooperated with Lens, with the support of strong software and hardware capabilities, have been able to go against the current and achieve impressive results despite the unsatisfactory market environment. In view of the CSK4 series achieved It was a huge success, and the upgraded version of the 6 series products is even more exciting. After seeing the open class and development kit trial activities jointly organized by the Jishu community and Lingsi Technology, I participated in the whole process with the mentality of learning and looking for product entry points , and was honored to have the opportunity to try out the development kit.

Hardware Configuration

The CSK6 series is a new generation of AI from Lesions. It adopts a multi-core heterogeneous architecture
, equipped with ARM Technology’s “Star” ARM STAR processor, HiFi4
DSP, and the newly designed AI neural network processing core NPU from Lesions.

[External link picture transfer failed, the source site may have an anti-theft link mechanism, it is recommended to save the picture and upload it directly (img-I9byf7To-1676947296613)(https://pic2.zhimg.com/80/v2-ec8617918a0b3328647cb80d0c0626e1_1440w.jpg)]

Environment build

Software Installation

Operating system: Support Windows 10 and above or support Ubuntu 18.04 LTS and newer versions.
Step 1: Read the development guide.
Step 2: Install the necessary dependencies.

sudo apt install --no-install-recommends git wget

Step 3: Download and install the CSK6 one-click installation package

https://cdn.iflyos.cn/public/cskTools/csk6_integration_installer_v1.6.5.exe

Step 4: Check the development environment

lisa info zep
Operating System - Windows 10 Enterprise LTSC 2019, version 10.0.17763 x64

@listenai/lisa - 2.4.5

Account - jerry

Node.js environment
  Node.js - v16.14.0
  npm - 8.3.1
  yarn - 1.22.19

Global environment
发现可更新的版本: 2.6.1,执行 lisa update 进行更新
  git - git version 2.32.0.windows.1

Plugin info
  zep - 1.6.8 (latest: 1.6.8)

SDK

download sample

git clone https://cloud.listenai.com/zephyr/applications/app_algo_hsd_sample_for_csk6.git

compiler directive

lisa zep build -b csk6011a_nano
lisa zep build -b csk6011a_nano -p

Burn firmware

lisa zep flash

Burn resource files

lisa zep exec cskburn -s \\.\COM3 -C 6 0x400000 .\resource\cp.bin -b 748800
lisa zep exec cskburn -s \\.\COM3 -C 6 0x500000 .\resource\res.bin -b 748800

First Experience


Download PC tools

git clone https://cloud.listenai.com/zephyr/applications/csk_view_finder_spd.git

experience screen

OK gesture

LIKE gesture

STOP gesture

advanced development

For this trial, the basic functions and operations of the CSK6 visual AI development kit that I have initially understood have basically reached my goal. Due to work reasons, there is no further research, and only when the company deploys actual product development. Further development work.
In terms of product design, CSK6 can be used as the main body to develop offline products such as gimbals and sitting posture detection. It can also be used with WiFi chips, such as Allwinner XR872 , to develop online products, and communicate with XR872 through serial port instructions. Realize the playback and pause of audio, alarm for parents in sitting position, etc. In a word, with the strong software and hardware technology and strong technical support of Lenses, any product form can be the best.

conclusion

I am very grateful to the Jishu community and Lingsi Technology for this event, which allowed me to experience the excellent functions and development process of the CSK6 series for the first time, and provide a reference direction for subsequent product positioning and development. I believe that the CSK6 series will definitely be able to achieve success in the AI ​​chip market. shine.

Guess you like

Origin blog.csdn.net/weixin_47569031/article/details/129138226