Table of contents
1. Implemented through Java with the help of third-party libraries
Use maven to import pom dependencies:
2. Use the methods provided by third-party storage (such as Alibaba Cloud OSS, Huawei Cloud OBS)
Preface
In actual projects, after uploading a video, you may encounter the need to intercept the first frame of the video or specify the frame as a picture for display use. This requirement itself is not difficult, and there are a lot of searches on the Internet. Today I will summarize some of the methods on the Internet.
1. Implemented through Java with the help of third-party libraries
1. Quote ffmpeg
-
Use maven to import pom dependencies:
<!-- 操作视频流 -->
<dependency>
<groupId>org.bytedeco</groupId>
<artifactId>javacpp</artifactId>
<version>1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco</groupId>
<artifactId>javacv</artifactId>
<version>1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco.javacpp-presets</groupId>
<artifactId>opencv-platform</artifactId>
<version>3.4.1-1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco.javacpp-presets</groupId>
<artifactId>ffmpeg-platform</artifactId>
<version>3.4.2-1.4.1</version>
</dependency>
-
Tools
import org.bytedeco.javacpp.opencv_core;
import org.bytedeco.javacpp.opencv_core.IplImage;
import org.bytedeco.javacv.FFmpegFrameGrabber;
import org.bytedeco.javacv.Frame;
import org.bytedeco.javacv.FrameGrabber.Exception;
import org.bytedeco.javacv.Java2DFrameConverter;
import org.bytedeco.javacv.OpenCVFrameConverter;
import javax.imageio.ImageIO;
import java.awt.image.BufferedImage;
import java.io.File;
import java.io.IOException;
import lombok.extern.slf4j.Slf4j;
/**
* 视频操作工具类
*/
@Slf4j
public class VideoUtils {
/**
* 截取视频第一帧为图片展示
*
* @param filePath 视频路径
* @param targetFilePath 第一帧图片存储位置
* @param targetFileName 图片名称
*/
public static void getVideoFirstFrameImage(String filePath, String targetFilePath, String targetFileName) throws Exception {
FFmpegFrameGrabber ff = FFmpegFrameGrabber.createDefault(filePath);
ff.start();
String rotate = ff.getVideoMetadata("rotate");
Frame f;
int i = 0;
while (i < 1) {
f = ff.grabImage();
IplImage src;
if (null != rotate && rotate.length() > 1) {
OpenCVFrameConverter.ToIplImage converter = new OpenCVFrameConverter.ToIplImage();
src = converter.convert(f);
f = converter.convert(rotate(src, Integer.parseInt(rotate)));
}
doExecuteFrame(f, targetFilePath, targetFileName);
i++;
}
ff.stop();
}
/**
* 进行旋转角度操作（为了保证截取到的第一帧图片与视频中的角度方向保持一致）
*/
public static IplImage rotate(IplImage src, int angle) {
IplImage img = IplImage.create(src.height(), src.width(), src.depth(), src.nChannels());
opencv_core.cvTranspose(src, img);
opencv_core.cvFlip(img, img, angle);
return img;
}
public static void doExecuteFrame(Frame f, String targetFilePath, String targetFileName) {
if (null == f || null == f.image) {
return;
}
Java2DFrameConverter converter = new Java2DFrameConverter();
String imageMat = "jpg";
String fileName = targetFilePath + File.separator + targetFileName + "." + imageMat;
BufferedImage bi = converter.getBufferedImage(f);
File output = new File(fileName);
try {
ImageIO.write(bi, imageMat, output);
} catch (IOException e) {
e.printStackTrace();
}
}
public static void main(String[] args) throws Exception {
String url = "C:\\Users\\admin\\Desktop\\test.mp4";
getVideoFirstFrameImage(url, "C:\\Users\\admin\\Desktop", "first");
}
}
2. Quote jcodec
There are still many cases of intercepting the first frame of online videos. The common method is to use ffmpeg to intercept it. In practice, I found that intercepting locally or on a window was successful. However, the interception failed in the Linux environment. The failure content is posted here for others to view the failure reason.
#
# A fatal error has been detected by the Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x000000000000d1f6, pid=14, tid=0x00007fe8b67e6b10
#
# JRE version: OpenJDK Runtime Environment (8.0_212-b04) (build 1.8.0_212-b04)
# Java VM: OpenJDK 64-Bit Server VM (25.212-b04 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 3.12.0
# Distribution: Custom build (Sat May 4 17:33:35 UTC 2019)
# Problematic frame:
# C 0x000000000000d1f6
#
# Core dump written. Default location: //core or core.14
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
# https://icedtea.classpath.org/bugzilla
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#
--------------- T H R E A D ---------------
Current thread (0x00005565ead9c800): JavaThread "http-nio-8889-exec-9" daemon [_thread_in_native, id=109, stack(0x00007fe8b66e6000,0x00007fe8b67e6ad0)]
siginfo: si_signo: 11 (SIGSEGV), si_code: 1 (SEGV_MAPERR), si_addr: 0x000000000000d1f6
（省略部分）
Stack: [0x00007fe8b66e6000,0x00007fe8b67e6ad0], sp=0x00007fe8b67e1558, free space=1005k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C 0x000000000000d1f6
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j org.bytedeco.javacpp.avformat.avformat_open_input(Lorg/bytedeco/javacpp/avformat$AVFormatContext;Ljava/lang/String;Lorg/bytedeco/javacpp/avformat$AVInputFormat;Lorg/bytedeco/javacpp/avutil$AVDictionary;)I+0
j org.bytedeco.javacv.FFmpegFrameGrabber.startUnsafe()V+624
j org.bytedeco.javacv.FFmpegFrameGrabber.start()V+1
j com.megvii.qingqiu.middle.platform.provider.util.VideoFrameUtil.fetchFrame(Ljava/io/File;Ljava/io/File;)V+26
j com.megvii.qingqiu.middle.platform.provider.util.VideoFrameUtil.fetchFrame(Lorg/springframework/web/multipart/MultipartFile;)Ljava/io/File;+148
j
（省略部分）
Now change the ffmpeg interception method to jcodec and jcodec-javase for processing.
- Import pom dependencies:
<dependency>
<groupId>org.jcodec</groupId>
<artifactId>jcodec</artifactId>
<version>0.2.5</version>
</dependency>
<dependency>
<groupId>org.jcodec</groupId>
<artifactId>jcodec-javase</artifactId>
<version>0.2.5</version>
</dependency>
<!--<dependency>
<groupId>org.bytedeco</groupId>
<artifactId>javacv</artifactId>
<version>1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco</groupId>
<artifactId>javacpp</artifactId>
<version>1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco.javacpp-presets</groupId>
<artifactId>opencv-platform</artifactId>
<version>3.4.1-1.4.1</version>
</dependency>
<dependency>
<groupId>org.bytedeco.javacpp-presets</groupId>
<artifactId>ffmpeg-platform</artifactId>
<version>3.4.2-1.4.1</version>
</dependency>-->
- Tools
import lombok.extern.slf4j.Slf4j;
import org.apache.commons.io.FileUtils;
import org.jcodec.api.FrameGrab;
import org.jcodec.api.JCodecException;
import org.jcodec.common.model.Picture;
import org.jcodec.scale.AWTUtil;
import org.springframework.web.multipart.MultipartFile;
import javax.imageio.ImageIO;
import java.awt.image.BufferedImage;
import java.io.File;
import java.io.IOException;
import java.util.UUID;
/**
* 视频操作工具类
*/
@Slf4j
public class VideoUtils {
/*** 图片格式*/
private static final String FILE_EXT = "jpg";
/*** 帧数*/
private static final int THUMB_FRAME = 5;
/**
* 获取指定视频的帧并保存为图片至指定目录
*
* @param videoFilePath 源视频文件路径
* @param frameFilePath 截取帧的图片存放路径
*/
public static void fetchFrame(String videoFilePath, String frameFilePath) throws Exception {
File videoFile = new File(videoFilePath);
File frameFile = new File(frameFilePath);
getThumbnail(videoFile, frameFile);
}
/**
* 获取指定视频的帧并保存为图片至指定目录
*
* @param videoFile 源视频文件
* @param targetFile 截取帧的图片
*/
public static void fetchFrame(MultipartFile videoFile, File targetFile) throws Exception {
File file = new File(videoFile.getName());
FileUtils.copyInputStreamToFile(videoFile.getInputStream(), file);
getThumbnail(file, targetFile);
}
/**
* 获取指定视频的帧并保存为图片至指定目录
*
* @param videoFile 源视频文件
*/
public static File fetchFrame(MultipartFile videoFile) {
String originalFilename = videoFile.getOriginalFilename();
File file = new File(originalFilename);
File targetFile = null;
try {
FileUtils.copyInputStreamToFile(videoFile.getInputStream(), file);
int i = originalFilename.lastIndexOf(".");
String imageName;
if (i > 0) {
imageName = originalFilename.substring(0, i);
} else {
imageName = UUID.randomUUID().toString().replace("-", "");
}
imageName = imageName + ".jpg";
targetFile = new File(imageName);
getThumbnail(file, targetFile);
} catch (Exception e) {
log.error("获取视频指定帧异常：", e);
} finally {
if (file.exists()) {
file.delete();
}
}
log.debug("视频文件 - 帧截取 - 处理结束");
return targetFile;
}
/**
* 获取第一帧缩略图
*
* @param videoFile 视频路径
* @param targetFile 缩略图目标路径
*/
public static void getThumbnail(File videoFile, File targetFile) {
try {
// 根据扩展名创建一个新文件路径
Picture picture = FrameGrab.getFrameFromFile(videoFile, THUMB_FRAME);
BufferedImage bufferedImage = AWTUtil.toBufferedImage(picture);
ImageIO.write(bufferedImage, FILE_EXT, targetFile);
} catch (IOException | JCodecException e) {
e.printStackTrace();
log.error("获取第一帧缩略图异常：", e);
}
}
public static void main(String[] args) {
try {
long startTime = System.currentTimeMillis();
getThumbnail(new File("C:\\Users\\admin\\Desktop\\test.mp4"), new File("C:\\Users\\admin\\Desktop\\test.jpg"));
System.out.println("截取图片耗时：" + (System.currentTimeMillis() - startTime));
} catch (Exception e) {
e.printStackTrace();
}
}
}2. Use the methods provided by third-party storage (such as Alibaba Cloud OSS, Huawei Cloud OBS)
If our video is uploaded and saved on a third-party server, then we can use the video frame interception method provided by Alibaba to directly intercept the specified frame of the video based on the URL.
The specific method is to add some parameters after the url of the video, and then access the new url to get the specified screenshot.
The following is an example of Alibaba Cloud OSS:
要加入的参数：
"?x-oss-process=video/snapshot,t_0,f_jpg,w_0,h_0,m_fast,ar_auto"
新的url：
"https://gnd.oss-cn-zhangjiakou.aliyuncs.com/vidio/test.map?x-oss-process=video/snapshot,t_0,f_jpg,w_0,h_0,m_fast,ar_auto" （直接访问这个新的url即可得到截图）Parameter Description
Things to note :
- Only video frame capture is supported for video files with video encoding formats of H264 and H265.
- OSS does not save video frame capture images by default. Video frame capture images need to be manually downloaded and saved locally.
I personally tested it and found that mainstream video formats such as mp4, mov, avi, etc. can all use this method to capture frames.
For specific operations, please refer to Alibaba official documentation: Alibaba Cloud Video Frame Capture Operation Document
The usage of other third-party cloud storage is similar to that of Alibaba Cloud. Just develop according to their respective documentation.
If this article is helpful or inspiring to you, please click three links: Like, Comment, Collection➕Follow. Your support is my biggest motivation to keep writing.