RK3588+FPGA video real-time processing and dual-screen display, storage solutions

Schematic diagram of the main functional circuit of the motherboard platform

On the ARM side:
the foot switch is a level input port 10, two-way.
The connection between the touch panel and the main board is UART plus 12V power supply.
The keyboard is a self-developed product, which transparently transmits UART through USB, and transmits 12V power supply USB, Gigabit network interface on the main board, USB is version 3.0 host interface, and
SSD is a built-in hard disk.
Image output video interfaces mainly include HDMI, DVI, DP, SDI, analog RGB, CVBS, and Svideo, among which HDMI, on the FPGA side: image input interfaces include SDI and MIPl, and SDI input supports 1080P60FPS. The main application scenario is external connection with external system DP , SDI supports 4K 60fps. The system realizes the picture-in-picture display of image data of multiple devices, and MIPI is the signal interface of the mirror body, which supports up to 4Lane4K60FPSRAW data input.
ARM works with the Linux system, and the redundant parts of the Linux system are cut to optimize the system startup time. ARM and FPGA previously transmitted video streams through the PCIE interface. The ARM system can store or record images of the real-time video stream transmitted from the FPGA. During playback, the images saved by the ARM system will be transmitted back to the FPGA for processing and displayed.
The motherboard starts automatically after power-on, and immediately configures each video interface chip, so that the system will display a boot screen within 3 seconds after power-on, and the boot screen is provided by the FPGA system.
After the system is started, the UI interface provided by the ARM system is synthesized with the real-time image on the FPGA side to form a complete endoscope system screen.

The PS side of the FPGA is responsible for the control of the mirror body, including the detection of mirror body insertion and power-on control, power-on configuration of the mirror body, receiving and processing of mirror body button messages, sending and receiving and verifying mirror body information.
Linux system design requirements: Peripheral device drivers: (1) MIPI DSI (2) MIPI CSI (3) PCIE input and output (4) HDMI (5) 12C (6) SPI (7) SSD hard disk storage (8) SD card (9 ) EMMC flash memory (10) DDR memory (11) USB3.0/2.0 keyboard and mouse, U disk, etc. (12) GPIO (13) Ethernet, TCP/IP protocol (14) RTC (15) UART software environment (16) Linux Kernel 5.x
(17) Gnome or Unity GUI components
(18) transplant Qt5.11 and above
(19) support dual-screen different display
(20) hardware encoder, decoder, gstreamer
(21) provide device nodes for all peripheral drivers, The software only needs simple operations such as write read ioctrl 

Guess you like

Origin blog.csdn.net/YEYUANGEN/article/details/131759080