origin
Recently, some classmates often ask me how to learn audio and video, how can I get started quickly? Some students who are not familiar with audio and video asked me should I study audio and video? As a 10-year Android veteran in the audio and video industry, I have some thoughts to share with you, hoping to help you.
major trend
Judging from the general trend in the future, with the advent of the 5G era, audio and video have gradually become a necessity in people's daily lives. In addition to online education, audio and video conferencing, and instant messaging products that must use audio and video technology, other products also need to add audio and video elements. For example, is it safer to change all the graphics and text methods of website registration and login to voice methods? I believe that with the popularization of audio and video technologies, more creative products will spring up like mushrooms.
At present, it is an indisputable fact that audio and video technology has gradually moved from the previous **"ivory tower" to "people's home"**. It is precisely because of such a big trend that in addition to major factories, other small factories are also beginning to look for audio and video talents. A slightly better audio and video talent may now have 3-4 companies rushing to get it and earning it.
The demand for audio and video talents has changed from a niche to the masses, which is more a result of everyone's expectations of the future market. To make an inappropriate analogy, the emergence of 3G/4G has contributed to the 10-year prosperity of the mobile Internet. The emergence of 5G will also contribute to the prosperity of the audio and video industry for at least 10 years.
**In addition to the arrival of 5G, which will allow a wider range of applications for audio and video, audio and video technology will play a more important role in the future. **In fact, among the information that humans can recognize, audio and video contain the most abundant information, but humans do not make good use of them.
The reason is that this information is unstructured data, and humans are good at processing structured data (such as databases). But there is no way to start with these unstructured data, so these audio and video data are wasted.
However, with the development of computer vision and artificial intelligence, people have begun to grasp how to convert unstructured data such as audio and video into structured data. Once we convert audio and video data into structured data, we can use existing technologies (such as search engines, big data, data mining, etc.) to perform various analyses on these data. Is this value even more amazing? The foundation of all this is audio and video technology.
Therefore, the future of audio and video research and development is extremely broad. It can be said that this is the best time to learn audio and video. Join the audio and video research and development team as early as possible to make yourself more effective in the future workplace.
Audio and video job prospects
The salary of audio and video is much higher than that of ordinary development, and the salary of audio and video engineering development is 40% higher than that of Android application layer development.
The audio and video development sheet is no problem from the perspective of salary. Remember that the salary level is determined by the market. The demand for audio and video in the market is actually very large, and it has increased year by year. Live broadcast, on-demand, video conference, etc. have all been up over the years. s project. In comparison, audio and video practitioners are scary. The market I learned is that several companies are poaching each other, and the competition for talent belongs to the stock fight!
Now companies want audio and video talents to basically train internally, because there are really very few newcomers!
In addition, from Douyin to the international ins and WeChat to become the top international apps is a good example. The arrival of 5g, knowledge fragmentation, fast food, entertainment content diversification, traffic civilianization, etc., the future In the development direction, short video and live broadcast will certainly occupy a place, and the corresponding demand for audio and video research and development staff will never decrease.
And not in the short-term, but in the long-term, this will be the case. The technological development will only get faster and faster, the video field will become more and more popular, and the demand will increase.
How to learn audio and video development
1. Elementary Introduction:
Draw a picture
1. ImageView draws pictures
2. SurfaceView draws pictures
3. Customize View to draw pictures
Second, AudioRecord API detailed explanation
3. Use AudioRecord to achieve recording and generate wav
- Create an AudioRecord object
- Initialize a buffer
- start recording
- Create a data stream. While reading the sound data from AudioRecord to the initialized buffer, import the data in the buffer into the data stream.
- Close data stream
- Stop recording
Fourth, use AudioTrack to play PCM audio
1. Basic use of AudioTrack
- MODE_STATIC mode
- MODE_STREAM mode
2.AudioTrack detailed
- Type of audio stream
- The concept of Buffer allocation and Frame
- AudioTrack construction process
3. Comparison of AudioTrack and MediaPlayer
- the difference
- contact
- SoundPool
5. Use Camera API to collect video data
1. Preview Camera data
2. Get the data callback of NV21
6. Use MediaExtractor and MediaMuxer API to parse and encapsulate mp4 files
1. Introduction to MediaExtractor API
2. Introduction to MediaMuxer API
3. Use context
7. Detailed MediaCodec API
1. Introduction to MediaCodec
2.MediaCodec API description
3.MediaCodec flow control
- Basic concepts of flow control
- Android hard-coded flow control
- Android flow control strategy selection
Due to the limited length of the article, the remaining content is too much, and the illustrations in the article are limited, the following can only be shown in the screenshot directory:
2. Intermediate advanced articles:
- Android OpenGL ES Development (1): Introduction to OpenGL ES
- Android OpenGL ES development (two): OpenGL ES environment construction
- Android OpenGL ES Development (3): OpenGL ES defines the shape
- Android OpenGL ES Development (4): OpenGL ES drawing shapes
- Android OpenGL ES development (5): OpenGL ES uses projection and camera view
- Android OpenGL ES Development (6): OpenGL ES adds motion effects
- Android OpenGL ES development (7): OpenGL ES responds to touch events
- Android OpenGL ES development (8): OpenGL ES shader language GLSL
- Android OpenGL ES development (9): OpenGL ES texture mapping
- Android OpenGL ES development (ten): interact with shaders through GLES20
- Use OpenGL to display a picture
- GLSurfaceviw draws Camera preview screen and realizes taking pictures
- Use OpenGL ES to complete the video recording and realize the video watermark effect
Advanced inquiry:
- In-depth study of audio and video coding, such as H.264, AAC, study the use of open source codec libraries, such as x.264, JM, etc.
- In-depth study of audio and video-related network protocols, such as rtmp, hls, and packet formats, such as flv, mp4
- In-depth study of some open source projects in the audio and video field, such as webrtc, ffmpeg, ijkplayer, librtmp, etc.
- Port the ffmpeg library to the Android platform, and combine the accumulated experience above to write a simple audio and video player
- Port the x264 library to the Android platform and combine the accumulated experience above to complete the H264 soft editing function of video data
- Port the librtmp library to the Android platform and combine the accumulated experience above to complete the Android RTMP streaming function
Audio and video codec technology
- Audio and video codec technology (1): MPEG-4/H.264 AVC codec standard
- Audio and video coding and decoding technology (two): AAC audio coding technology
Streaming protocol
- Streaming media protocol (1): HLS protocol
- Streaming media protocol (two): RTMP protocol
Multimedia file format
- Multimedia file format (1): MP4 format
- Multimedia file format (2): FLV format
- Multimedia file format (3): M3U8 format
- Multimedia file format (4): TS format
- Multimedia file format (5): PCM / WAV format
FFmpeg learning record
- FFmpeg command line tool learning (1): View the media file header information tool ffprobe
- FFmpeg command-line tool learning (2): ffplay, a tool for playing media files
- FFmpeg command line tool learning (3): media file conversion tool ffmpeg
- FFmpeg command line tool learning (4): FFmpeg acquisition equipment
- FFmpeg command line tool learning (5): FFmpeg adjusts the audio and video playback speed
- FFmpeg learning (1): Introduction to FFmpeg
- FFmpeg learning (2): install FFmpeg under Mac
- FFmpeg learning (3): port FFmpeg to the Android platform
- FFmpeg learning (4): FFmpeg API introduction and general API analysis
- FFmpeg learning (5): FFmpeg codec API analysis
- FFmpeg learning (6): FFmpeg core module libavformat and libavcodec analysis
- FFmpeg structure learning (1): AVFormatContext analysis
- FFmpeg structure learning (two): AVStream analysis
- FFmpeg structure learning (3): AVPacket analysis
- FFmpeg structure learning (four): AVFrame analysis
- FFmpeg structure learning (5): AVCodec analysis
- FFmpeg structure learning (6): AVCodecContext analysis
- FFmpeg structure learning (7): AVIOContext analysis
- FFmpeg structure learning (eight): the relationship between important structures in FFMPEG
More catalog screenshots:
**Summary:** The above is the strongest sorting and summary of the information about audio and video (there are some content without screenshots), I believe it should be the most complete in the entire network, all the information is shared with everyone for free, and save I went to the time for friends who are interested in audio and video to look for information. If you just need it, you can click here to get it for free
The prospects of audio and video development, I believe you can see from the relevant recruitment websites, whether it is streaming media development or audio and video processing development, a large number of people are recruited, and because the entry threshold is relatively high, the learning cycle is long, and the salary It is also high.
In addition: The editor also collects and organizes some audio and video related supporting videos, which I believe can make everyone learn faster and more effectively:
All the information in this article is shared with everyone for free, just click here with your fingers to get the free way.
The road to Android architects is very long, let's encourage together! The road of learning is like traveling against the current. If you don't advance, you will retreat. If you relax, then you will regress. There is no unique technology in Android development work, and it is impossible to get a high salary. Be a diligent and progressive person, step up your study, grasp the center, and prefer to be skilled than miscellaneous, rather than expert.
If you happen to need this full version of Android audio and video development, you only need to support me in this article.
Quick start channel: (click here) to download! Full of sincerity! ! !
It is not easy to organize, friends who feel helpful can help like, share and support the editor~
Your support, my motivation; I wish you all a bright future and constant offers! ! !