20230912 Use pigz to improve the compression and decompression speed of tar command under ubuntu18.04

20230912Use pigz under ubuntu18.04 to improve the speed of tar command compression and decompression
2023/9/15 22:19


https://blog.csdn.net/wb4916/article/details/128447298
20221226 Compile Android12 system 2-SDK preprocessing for Toybrick’s TB-RK3588X development board

4. Single-thread compression. It is recommended to use: pigz multi-thread compression, which will save unpacking time!
# Pack and compress
tar --use-compress-program=pigz -cvpf XXX.tgz path/files

# Unzip
tar --use-compress-program=pigz -xvpf XXX.tgz


https://blog.csdn.net/tootsy_you/article/details/124920911?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522169478498116800188589478%2522%252C%2522scm%2522% 253A%252220140713.130102334..%2522%257D&request_id =169478498116800188589478&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~all~sobaiduend~default-2-124920911-null-null.142^v94^chatsearchT3_1&utm_term=tar%20--use-compress-program %3Dpigz&spm= 1018.2226.3001.4187
https://blog.csdn.net/tootsy_you/article/details/124920911
Multi-threaded decompression of tar 9am to 12pm Modified on 2022-07-25 18:09:41

The pigz command comes from the abbreviation of the English phrase "parallel implementation of gzip", and its function is for multi-threaded decompression of files. Unlike other decompression commands, the pigz command supports multi-threaded parallel processing, which is more than 60% faster than gzip. Of course, the CPU consumption will be higher.

#Compress file
tar --use-compress-program=pigz -cvpf app.tar.gz app

#Extract the file
tar --use-compress-program=pigz -xvpf app.tar.gz


https://blog.csdn.net/weixin_31286719/article/details/116856126?ops_request_misc=&request_id=&biz_id=102&utm_term=tar%20--use-compress-program=pig&utm_medium=distribute.pc_search_result.none-task-blog-2~all~sobaiduweb~default-0-116856126.nonecase&spm=1018.2226.3001.4187
https://blog.csdn.net/weixin_31286719/article/details/116856126

duo dou published on 2021-05-12 06:43:49

https://blog.csdn.net/q871761987/article/details/72230355
https://blog.csdn.net/woodcorpse/article/details/82052209
http://zlib.net/pigz/ ##Official website

Compression:
tar --use-compress-program=pigz -cvpf /directory name/file name.tgz (space) /boot (compressed file or directory) --use-
compress-program=pigz is specified ( pigz ) to perform Compression
-cvpf -c creates a compressed file -v displays the compression or decompression process -p retains the original permissions and attributes -f target file name
--exclude=/xx excludes this directory from compression

Decompression:
tar --use-compress-program=pigz -xvpf file.tgz -C / (this is to specify the directory to be decompressed)
--use-compress-program=pigz is to specify (pigz) to decompress
-xvpf -x Unzip the compressed file -v Display the compression or decompression process -p Keep the original permissions and attributes -f Target file name
-C Specify the directory to be decompressed


Reference:
https://blog.csdn.net/guotianqing/article/details/124382802
Improving compression speed under Linux - multi-threaded compression pigz


https://blog.csdn.net/MRQ1734/article/details/121566042
tar multi-threaded compression and decompression files

tar --use-compress-program=pigz -cvpf b.tar.gz ./*
tar --use-compress-program=pigz -xvpf sale_1126.tar.gz


https://blog.csdn.net/sumengnan/article/details/125017002
linux tar multi-threaded compression and decompression

2. compression operator
-cvpf - $Dir | pigz -9 -p 6 $target-name
tar -cvpf - /home/admin/abcd | pigz -9 -p 6 abcd.tgz

pigz:
-9: represents the compression rate
-p: represents the number of CPUs

3. Decompression operation
tar --use-compress-program=pigz -cvpf cc.tar.gz
tar --use-compress-program=pigz -xvpf aa.tar.gz


https://blog.csdn.net/weixin_42493325/article/details/116776520
linux multi-thread compression, Linux parallel gzip compression tool pigz

2. Use
compression
where packages is the directory to be compressed and packages.tgz is the compressed name.
tar --use-compress-program=pigz -cpvf packages.tgz packages

Unzip
tar --use-compress-program=pigz -xvf packages.tgz


https://blog.csdn.net/lj402159806/article/details/76618174
Use CPU concurrent decompression to speed up under Linux

Install pigz
sudo apt install pigz

打包
tar --use-compress-program=pigz -cvpf package.tgz ./package

解包
tar --use-compress-program=pigz -xvpf package.tgz -C ./package


https://blog.csdn.net/weixin_30547797/article/details/99055799
Pigz, a compression artifact under Linux

2. Use pigz to pack and unpack
tar --use-compress-program=pigz -cvpf /home/bak/h5clinical_2019-01-14.tgz h5clinical/ #Package
tar --use-compress-program=pigz -xvpf /home/ bak/h5clinical_2019-01-14.tgz -C h5clinical#unzip


https://blog.csdn.net/xujiamin0022016/article/details/122740550?ops_request_misc=%257B%2522request%255Fid%2522%253A%2522169478498116800213093392%2522%252C%2522s cm%2522%253A%252220140713.130102334.pc%255Fall.% 2522%257D&request_id=169478498116800213093392&biz_id=0&utm_medium=distribute.pc_search_result.none-task-blog-2~all~first_rank_ecpm_v1~rank_v31_ecpm-11-122740550-null-null.142^v9 4^chatsearchT3_1&utm_term=tar%20--use-compress-program %3Dpigz&spm=1018.2226.3001.4187
https://blog.csdn.net/xujiamin0022016/article/details/122740550
pzstd with better performance than pigz


https://www.cnblogs.com/skylifelei/p/14728296.html
Installation and use of Linux parallel compression tool pigz

CPU usage when decompressing using PIGZ:

CPU usage when using PIGZ compression:

It takes less than 10 minutes to package the 60GB RK3568 Android11 ​​SDK on SSD:

Guess you like

Origin blog.csdn.net/wb4916/article/details/132912421