introduction:
Introducing the current version
Today we are going to introduce ai kit2023, aikit2023 is a new upgraded version of aikit.
AIkit 2023 is an entry-level artificial intelligence suite that integrates vision, positioning and grabbing, and automatic sorting modules.
Based on the python platform, the kit can realize the control of the robotic arm creative culture.
The artificial intelligence suit 2023 is a scene for the application of the robotic arm, imitating the industrial scene. In this imitation industrial scene, the robotic arm will replace the manual to achieve intelligent sorting, initially realizing industrial automation . The core of this scene is the five vision algorithms and the robotic arm motion control algorithm, which can quickly identify objects and perform accurate sorting.
The five vision algorithms are:
● 形状识别算法
● 特征点识别算法
● 二维码识别算法
● 颜色识别算法
● YOLOv5识别算法
OpenCV is an open source computer vision library used in the fields of computer image processing, computer vision, and machine learning . OpenCV supports a variety of programming languages, including C++ , Python, etc., and provides a large number of image processing and computer vision functions to help developers implement various applications, such as image recognition, target tracking, robot navigation, etc.
The first four algorithms are based on the OpenCV algorithm for image processing and machine vision , including color gamut recognition, feature point recognition, two-dimensional code recognition and shape recognition.
YoloV5 (You Only Look Once version 5) is a popular target detection algorithm in recent years, v5 represents its version number (fifth version), which uses a convolutional neural network (CNN) to predict the objects, and can complete the detection faster while still maintaining high accuracy.
Next, let's take a look at how it works.
shape recognition algorithm
feature point recognition
color recognition
QR code recognition
yolov5 recognition
Let's go over how to use
how to use
environment
The program of Artificial Intelligence Suite 2023 is a set of programs written based on python.
When using the my series robotic arm with M5Stack as the core control, the computer needs to install the python compilation environment when using it , and some corresponding python libraries such as openCV have been installed, such as: myCobot 280 M5Stack, mechArm 270 M5Stack, myPalle ti zer 260 M5Stack.
When using a robotic arm controlled by Raspberry Pi as the core, it can be used without installing the environment, such as myCobot 280 Pi , mechArm 270 Pi, myPalletizer 260 Pi
The programs used by aikit 2023 need to be downloaded from Github.
https://github.com/elephantrobotics/AiKit_UI
Part of the intercepted code
Let's start the program!
Use process
start main.py
This is the visual program interface after startup
Select the model of the robotic arm, the serial port number and the baud rate to connect
Display the picture under the camera to realize the relevant algorithms of machine vision.
This is the most critical part of the program. Select different algorithms to perform different functions in the algorithm selection column.
This is the general explanation of this visual interface.
The running process:
Connect the robotic arm -> select the algorithm -> turn on the camera -> turn on the automatic mode
aikit2023 is ready to run.
Summarize
How would you rate this set?
As mentioned at the beginning, this is a set that is very suitable for getting started with learning machine vision algorithms, basic knowledge of robotic arms, and the use of python.
The whole program is open source, each piece of code is written with detailed comments, and the code can be modified freely, from which users can understand how the framework of a program is built, and the most important thing is how to combine the visual algorithm with the motion control of the robotic arm Up, there are not too many complicated parameters, concise and clear.
When it comes to the application of the robotic arm, "Hand-Eye Calibration" must be inseparable. Hand-eye calibration is very important in the application scenario of the robotic arm. There are two cases: eye to hand and eye in hand, to deal with the data in the real environment and the data in the computer. relationship between data.
Users who own aikit 1 must know at a glance where the most special point of aikit2023 is.
The design of the visual interface is used to display data, status, results and other information, providing an intuitive and easy-to-understand information display method. Visual interfaces are used to simplify operations, help users quickly identify, access, and manipulate data, and can interact and operate in a variety of ways. Even if you don't know anything about code, you can successfully run the entire suite.
There must be many users who want to know the differences and differences between aikit2023 and the previous aikit upgrade. We will explain it to you in future articles!
If you like this article, please leave a message and like it, and we will see you next time.