>> в дефолтных режимах
> Вот именно, однако на не дефолтных все еще хуже, чем у gzip выше 1.
% zstd --version && pigz --version
*** zstd command line interface 64-bits v1.3.3, by Yann Collet ***
pigz 2.4% du -b clang-check && echo this is tmpfs
50295304 clang-check
this is tmpfs
% time zstd -kf -T4 clang-check && time zstd -T4 -fd clang-check.zst
clang-check : 36.34% (50295304 => 18277404 bytes, clang-check.zst)
zstd -kf -T4 clang-check 2,29s user 0,11s system 362% cpu 0,660 total
zstd -T4 -fd clang-check.zst 0,22s user 0,03s system 99% cpu 0,248 total
% time zstd -8kf -T4 clang-check && time zstd -T4 -fd clang-check.zst
clang-check : 33.12% (50295304 => 16657200 bytes, clang-check.zst)
zstd -8kf -T4 clang-check 6,11s user 0,17s system 350% cpu 1,793 total
zstd -T4 -fd clang-check.zst 0,23s user 0,03s system 99% cpu 0,262 total
% time pigz -1kf -p4 clang-check && du -b clang-check.gz && time pigz -fd -p4 clang-check.gz
pigz -1kf -p4 clang-check 2,56s user 0,06s system 384% cpu 0,683 total
20917773 clang-check.gz
pigz -fd -p4 clang-check.gz 0,46s user 0,06s system 127% cpu 0,406 total
% time pigz -3kf -p4 clang-check && du -b clang-check.gz && time pigz -fd -p4 clang-check.gz
pigz -3kf -p4 clang-check 3,05s user 0,03s system 385% cpu 0,798 total
20084223 clang-check.gz
pigz -fd -p4 clang-check.gz 0,46s user 0,03s system 128% cpu 0,388 total
% time pigz -9kf -p4 clang-check && du -b clang-check.gz && time pigz -fd -p4 clang-check.gz
pigz -9kf -p4 clang-check 11,19s user 0,09s system 388% cpu 2,905 total
19011252 clang-check.gz
pigz -fd -p4 clang-check.gz 0,42s user 0,05s system 131% cpu 0,354 total
clang-check - это попавшийся под руку "XXL"-бинарник
Можно взять более классическое:
https://github.com/dwyl/english-words/blob/master/words.txt
% repeat 10 cat words.txt >> words
% du -b words
48629660 words% time pigz -1kf -p4 words && du -b words.gz && time pigz -fd -p4 words.gz
pigz -1kf -p4 words 2,86s user 0,07s system 383% cpu 0,766 total
17584106 words.gz
pigz -fd words.gz 0,45s user 0,04s system 127% cpu 0,383 total
% time pigz -3kf -p4 words && du -b words.gz && time pigz -fd -p4 words.gz
pigz -3kf -p4 words 2,66s user 0,07s system 384% cpu 0,710 total
16477338 words.gz
pigz -fd words.gz 0,43s user 0,05s system 127% cpu 0,372 total
% time pigz -9kf -p4 words && du -b words.gz && time pigz -fd -p4 words.gz
pigz -9kf -p4 words 17,01s user 0,07s system 384% cpu 4,438 total
14679310 words.gz
pigz -fd words.gz 0,41s user 0,05s system 129% cpu 0,356 total
% time zstd -1kf -T4 words && time zstd -T4 -fd words.zst
words : 36.30% (48629660 => 17653676 bytes, words.zst)
zstd -1kf -T4 words 1,47s user 0,12s system 363% cpu 0,439 total
zstd -T4 -fd words.zst 0,20s user 0,04s system 99% cpu 0,240 total
% time zstd -8kf -T4 words && time zstd -T4 -fd words.zst
words : 29.98% (48629660 => 14579479 bytes, words.zst)
zstd -8kf -T4 words 6,29s user 0,17s system 311% cpu 2,075 total
zstd -T4 -fd words.zst 0,23s user 0,06s system 101% cpu 0,290 total
В общем, не убедили.
ЗЫ:
Чисто для сравнения:
% time xz -9e words && du -b words.xz
xz -9e words 199,43s user 1,26s system 99% cpu 3:21,11 total
1 235 472 words.xz
% time xz -d words.xz
xz -d words.xz 0,43s user 0,09s system 99% cpu 0,521 total% time lrzip -f -z -L9 -p4 words && du -b words.lrz && time lrzip -p4 -df words.lrz
Output filename is: words.lrz
words - Compression Ratio: 68.015. Average Compression Speed: 2.000MB/s.
Total time: 00:00:23.12
lrzip -f -z -L9 -p4 words 22,73s user 0,48s system 100% cpu 23,132 total
714 986 words.lrz
Output filename is: words
Decompressing...
100% 46.38 / 46.38 MB 1:100% 2:100%
Average DeCompression Speed: 2.190MB/s
Output filename is: words: [OK] - 48629660 bytes
Total time: 00:00:21.18
lrzip -p4 -df words.lrz 20,80s user 0,34s system 99% cpu 21,193 total
