20230912Use pigz under ubuntu18.04 to improve the speed of tar command compression and decompression
2023/9/15 22:19
https://blog.csdn.net/wb4916/article/details/128447298
20221226 Compile Android12 system 2-SDK preprocessing for Toybrick’s TB-RK3588X development board
4. Single-thread compression. It is recommended to use: pigz multi-thread compression, which will save unpacking time!
# Pack and compress
tar --use-compress-program=pigz -cvpf XXX.tgz path/files
# Unzip
tar --use-compress-program=pigz -xvpf XXX.tgz
https://blog.csdn.net/tootsy_you/article/details/124920911?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522169478498116800188589478%2522%252C%2522scm%2522% 253A%252220140713.130102334..%2522%257D&request_id =169478498116800188589478&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~all~sobaiduend~default-2-124920911-null-null.142^v94^chatsearchT3_1&utm_term=tar%20--use-compress-program %3Dpigz&spm= 1018.2226.3001.4187
https://blog.csdn.net/tootsy_you/article/details/124920911
Multi-threaded decompression of tar 9am to 12pm Modified on 2022-07-25 18:09:41
The pigz command comes from the abbreviation of the English phrase "parallel implementation of gzip", and its function is for multi-threaded decompression of files. Unlike other decompression commands, the pigz command supports multi-threaded parallel processing, which is more than 60% faster than gzip. Of course, the CPU consumption will be higher.
#Compress file
tar --use-compress-program=pigz -cvpf app.tar.gz app
#Extract the file
tar --use-compress-program=pigz -xvpf app.tar.gz
https://blog.csdn.net/weixin_31286719/article/details/116856126?ops_request_misc=&request_id=&biz_id=102&utm_term=tar%20--use-compress-program=pig&utm_medium=distribute.pc_search_result.none-task-blog-2~all~sobaiduweb~default-0-116856126.nonecase&spm=1018.2226.3001.4187
https://blog.csdn.net/weixin_31286719/article/details/116856126
duo dou published on 2021-05-12 06:43:49
https://blog.csdn.net/q871761987/article/details/72230355
https://blog.csdn.net/woodcorpse/article/details/82052209
http://zlib.net/pigz/ ##Official website
Compression:
tar --use-compress-program=pigz -cvpf /directory name/file name.tgz (space) /boot (compressed file or directory) --use-
compress-program=pigz is specified ( pigz ) to perform Compression
-cvpf -c creates a compressed file -v displays the compression or decompression process -p retains the original permissions and attributes -f target file name
--exclude=/xx excludes this directory from compression
Decompression:
tar --use-compress-program=pigz -xvpf file.tgz -C / (this is to specify the directory to be decompressed)
--use-compress-program=pigz is to specify (pigz) to decompress
-xvpf -x Unzip the compressed file -v Display the compression or decompression process -p Keep the original permissions and attributes -f Target file name
-C Specify the directory to be decompressed
Reference:
https://blog.csdn.net/guotianqing/article/details/124382802
Improving compression speed under Linux - multi-threaded compression pigz
https://blog.csdn.net/MRQ1734/article/details/121566042
tar multi-threaded compression and decompression files
tar --use-compress-program=pigz -cvpf b.tar.gz ./*
tar --use-compress-program=pigz -xvpf sale_1126.tar.gz
https://blog.csdn.net/sumengnan/article/details/125017002
linux tar multi-threaded compression and decompression
2. compression operator
-cvpf - $Dir | pigz -9 -p 6 $target-name
tar -cvpf - /home/admin/abcd | pigz -9 -p 6 abcd.tgz
pigz:
-9: represents the compression rate
-p: represents the number of CPUs
3. Decompression operation
tar --use-compress-program=pigz -cvpf cc.tar.gz
tar --use-compress-program=pigz -xvpf aa.tar.gz
https://blog.csdn.net/weixin_42493325/article/details/116776520
linux multi-thread compression, Linux parallel gzip compression tool pigz
2. Use
compression
where packages is the directory to be compressed and packages.tgz is the compressed name.
tar --use-compress-program=pigz -cpvf packages.tgz packages
Unzip
tar --use-compress-program=pigz -xvf packages.tgz
https://blog.csdn.net/lj402159806/article/details/76618174
Use CPU concurrent decompression to speed up under Linux
Install pigz
sudo apt install pigz
打包
tar --use-compress-program=pigz -cvpf package.tgz ./package
解包
tar --use-compress-program=pigz -xvpf package.tgz -C ./package
https://blog.csdn.net/weixin_30547797/article/details/99055799
Pigz, a compression artifact under Linux
2. Use pigz to pack and unpack
tar --use-compress-program=pigz -cvpf /home/bak/h5clinical_2019-01-14.tgz h5clinical/ #Package
tar --use-compress-program=pigz -xvpf /home/ bak/h5clinical_2019-01-14.tgz -C h5clinical#unzip
https://blog.csdn.net/xujiamin0022016/article/details/122740550?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522169478498116800213093392%2522%252C%2522s cm%2522%253A%252220140713.130102334.pc%255Fall.% 2522%257D&request_id=169478498116800213093392&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~all~first_rank_ecpm_v1~rank_v31_ecpm-11-122740550-null-null.142^v9 4^chatsearchT3_1&utm_term=tar%20--use-compress-program %3Dpigz&spm=1018.2226.3001.4187
https://blog.csdn.net/xujiamin0022016/article/details/122740550
pzstd with better performance than pigz
https://www.cnblogs.com/skylifelei/p/14728296.html
Installation and use of Linux parallel compression tool pigz
CPU usage when decompressing using PIGZ:
CPU usage when using PIGZ compression:
It takes less than 10 minutes to package the 60GB RK3568 Android11 SDK on SSD: