TS尝试
想利用JavaCV实现h264编码的TS视频流进行flv封装转换（不转码），但是失败了，源视频信息：
Warning: [mpegts @ 00000199a03ac980] Packet corrupt (stream = 0, dts = 165600)
Warning: .
Info: Input #0, mpegts, from 'java.io.BufferedInputStream@25900bca':
Info: Duration:
Info: N/A
Info: , start:
Info: 1.480000
Info: , bitrate:
Info: N/A
Info:
Info: Program 1
Info: Metadata:
Info: service_name :
Info: Service01
Info:
Info: service_provider:
Info: FFmpeg
Info:
Info: Stream #0:0
Info: [0x100]
Info: : Video: h264 (High) ([27][0][0][0] / 0x001B), yuvj420p(pc, progressive), 1920x1080
Info: ,
Info: 25 fps,
Info: 25 tbr,
Info: 90k tbn
Info:
可以发现视频的确是h264编码，但是仍然会报错，猜测是flv转换器内部的bug？
Error: [flv @ 00000199c166b6c0] Tag [27][0][0][0] incompatible with output codec id '27' ([7][0][0][0])
org.bytedeco.javacv.FFmpegFrameRecorder$Exception: avformat_write_header error() error -1094995529: Could not write header to 'test_h264.flv' (For more details, make sure FFmpegLogCallback.set() has been called.)
at org.bytedeco.javacv.FFmpegFrameRecorder.startUnsafe(FFmpegFrameRecorder.java:923)
at org.bytedeco.javacv.FFmpegFrameRecorder.start(FFmpegFrameRecorder.java:423)
at org.bytedeco.javacv.FFmpegFrameRecorder.start(FFmpegFrameRecorder.java:418)
at com.tplink.cloud.JavaCVProcessThread.run(threadTs2flv.java:200)
尝试利用ffmpeg命令直接转换成FLV就可以实现（但不确定有没有转码）：
ffmpeg -i h264.ts -c copy output.flv
提示：
ffmpeg version 4.3.1-2021-01-01-essentials_build-www.gyan.dev Copyright (c) 2000-2021 the FFmpeg developers
built with gcc 10.2.0 (Rev5, Built by MSYS2 project)
configuration: --enable-gpl --enable-version3 --enable-static --disable-w32threads --disable-autodetect --enable-fontconfig --enable-iconv --enable-gnutls --enable-libxml2 --enable-gmp --enable-lzma --enable-zlib --enable-libsrt --enable-libssh --enable-libzmq --enable-avisynth --enable-sdl2 --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxvid --enable-libaom --enable-libopenjpeg --enable-libvpx --enable-libass --enable-libfreetype --enable-libfribidi --enable-libvidstab --enable-libvmaf --enable-libzimg --enable-amf --enable-cuda-llvm --enable-cuvid --enable-ffnvcodec --enable-nvdec --enable-nvenc --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-libgme --enable-libopenmpt --enable-libopencore-amrwb --enable-libmp3lame --enable-libtheora --enable-libvo-amrwbenc --enable-libgsm --enable-libopencore-amrnb --enable-libopus --enable-libspeex --enable-libvorbis --enable-librubberband
libavutil 56. 51.100 / 56. 51.100
libavcodec 58. 91.100 / 58. 91.100
libavformat 58. 45.100 / 58. 45.100
libavdevice 58. 10.100 / 58. 10.100
libavfilter 7. 85.100 / 7. 85.100
libswscale 5. 7.100 / 5. 7.100
libswresample 3. 7.100 / 3. 7.100
libpostproc 55. 7.100 / 55. 7.100
Input #0, mpegts, from 'h264.ts':
Duration: 00:00:04.00, start: 1.480000, bitrate: 3551 kb/s
Program 1
Metadata:
service_name : Service01
service_provider: FFmpeg
Stream #0:0[0x100]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuvj420p(pc, progressive), 1920x1080, 25 fps, 25 tbr, 90k tbn, 50 tbc
Output #0, flv, to 'output.flv':
Metadata:
encoder : Lavf58.45.100
Stream #0:0: Video: h264 (High) ([7][0][0][0] / 0x0007), yuvj420p(pc, progressive), 1920x1080, q=2-31, 25 fps, 25 tbr, 1k tbn, 90k tbc
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Press [q] to stop, [?] for help
frame= 100 fps=0.0 q=-1.0 Lsize= 1599kB time=00:00:03.88 bitrate=3376.1kbits/s speed=1.05e+03x
video:1597kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.140628%
其他格式的h264视频
拿mkv格式的视频进行flv转换，视频信息如下：
Info: Input #0, matroska,webm, from 'java.io.BufferedInputStream@7f46e640':
Info: Metadata:
Info: encoder :
Info: libebml v1.3.4 + libmatroska v1.4.5
Info:
Info: creation_time :
Info: 2017-08-08T01:40:58.000000Z
Info:
Info: Duration:
Info: 00:00:30.07
Info: , start:
Info: 0.000000
Info: , bitrate:
Info: N/A
Info:
Info: Stream #0:0
Info: : Video: h264 (High), yuv420p(progressive), 1280x720 [SAR 3:4 DAR 4:3]
Info: ,
Info: 25 fps,
Info: 25 tbr,
Info: 1k tbn
Info: (default)
Info:
Info: Stream #0:1
Info: : Audio: aac (LC), 44100 Hz, stereo, fltp
Info: (default)
Info:
可以发现也是h264编码，但这种就可以成功转换并输出：
Info: Output #0, flv, to 'C:\Users\wjy\Videos\test_h264.flv':
Info: Metadata:
Info: encoder :
Info: Lavf59.27.100
Info:
Info: Stream #0:0
Info: : Video: h264 (High) ([7][0][0][0] / 0x0007), yuv420p(progressive), 1280x720 [SAR 3:4 DAR 4:3], q=2-31
Info: ,
Info: 25 fps,
Info: 1k tbn
Info:
mkv转ts再转flv尝试
先将h264的mkv视频转成ts，再将转换后的ts转成flv：
Info: Input #0, matroska,webm, from 'java.io.BufferedInputStream@7f46e640':
Info: Metadata:
Info: encoder :
Info: libebml v1.3.4 + libmatroska v1.4.5
Info:
Info: creation_time :
Info: 2017-08-08T01:40:58.000000Z
Info:
Info: Duration:
Info: 00:00:30.07
Info: , start:
Info: 0.000000
Info: , bitrate:
Info: N/A
Info:
Info: Stream #0:0
Info: : Video: h264 (High), yuv420p(progressive), 1280x720 [SAR 3:4 DAR 4:3]
Info: ,
Info: 25 fps,
Info: 25 tbr,
Info: 1k tbn
Info: (default)
Info:
Info: Stream #0:1
Info: : Audio: aac (LC), 44100 Hz, stereo, fltp
Info: (default)
Info:
转成ts成功
Info: Output #0, mpegts, to 'C:\Users\wjy\Videos\test_h264.ts':
Info: Metadata:
Info: encoder :
Info: Lavf59.27.100
Info:
Info: Stream #0:0
Info: : Video: h264 (High), yuv420p(progressive), 1280x720 [SAR 3:4 DAR 4:3], q=2-31
Info: ,
Info: 25 fps,
Info: 90k tbn
Info:
ts转flv还是失败：
Info: Input #0, mpegts, from 'java.io.BufferedInputStream@4e680516':
Info: Duration:
Info: N/A
Info: , start:
Info: 0.000000
Info: , bitrate:
Info: N/A
Info:
Info: Program 1
Info: Metadata:
Info: service_name :
Info: Service01
Info:
Info: service_provider:
Info: FFmpeg
Info:
Info: Stream #0:0
Info: [0x100]
Info: : Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(progressive), 1280x720 [SAR 3:4 DAR 4:3]
Info: ,
Info: 25 fps,
Info: 25 tbr,
Info: 90k tbn
Info:
报错：
Error: [flv @ 000001d0561aec00] Tag [27][0][0][0] incompatible with output codec id '27' ([7][0][0][0])
org.bytedeco.javacv.FFmpegFrameRecorder$Exception: avformat_write_header error() error -1094995529: Could not write header to 'C:\Users\wjy\Videos\test_h264.flv' (For more details, make sure FFmpegLogCallback.set() has been called.)
at org.bytedeco.javacv.FFmpegFrameRecorder.startUnsafe(FFmpegFrameRecorder.java:923)
at org.bytedeco.javacv.FFmpegFrameRecorder.start(FFmpegFrameRecorder.java:423)
at org.bytedeco.javacv.FFmpegFrameRecorder.start(FFmpegFrameRecorder.java:418)
at com.tplink.cloud.JavaCVProcessThread.run(threadTs2flv.java:212)
总结猜测
以上实验中视频都是h264编码，但是TS的h264编码为avc，mkv中的h264编码为avc1，关于这两种的区别可以参考链接: H264/AVC视频解码时AVC1和H264的区别
因此，猜测可能JavaCV解析时只支持不带开始码的h264编码？
但是mkv转TS封装应该也没有改变h264编码吧？所以有可能是flv的muxer出了问题。