Today, having a little free time I repeated the test...
...All Test Input Data 420MB.
Here we have as a benchmark compression via ZSTD v1.0 no CLS.
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 09:58:52
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd_1.0 419,6°MB 195,9°MB 46,69 % 14°Files 00:03:22:986 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
Here the version tested ZSTD540 with CLS, with variables set "MT = 2 or 4" and chunksize in a range from 50m to 500m.
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:31:18
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt2cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:946 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:32:47
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt4cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:932 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:34:25
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt2cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:948 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:35:18
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt4cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:951 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:15:35
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt2cs100 419,6°MB 199,2°MB 47,47 % 14°Files 00:01:35:918 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:22:12
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt4cs100 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:942 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:23:41
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt2cs250 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:26:36
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt4cs250 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:937 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:28:34
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt2cs500 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:951 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:29:56
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd540mt4cs500 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:941 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
Here the version tested zstd620 with CLS, with the same variables set "MT = 2 or 4" and the chunksize in a range from 50m to 512m.
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:38:55
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt2cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:947 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:41:04
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt4cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:932 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:42:46
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt2cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:43:55
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt4cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:45:15
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt2cs128 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:950 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:46:23
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt4cs128 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:03:04 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:47:33
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt2cs256 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:941 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:48:40
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt4cs256 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:957 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:49:40
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt2cs512 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:50:02
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd620mt4cs512 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:948 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
As you can see the difference between the versions ZSTD 540 & 620 with CLS is nothing in percentage of compression, and of a few thousandths of seconds in compression time.
A distinct difference between the ZSTD version v1.0, and versions with no CLS 540 and CLS 620, with the latter results in a marked improvement in speed at the expense of better compression with ZSTD v1.0, so the choice is purely subjective, whether to use the version with or without CLS, but personally have not seen anything of sensational in these versions with CLS support.
Razor your lesson on the block of memory and the allocation thereof is correct, but in this case will be interpreted theoretically, in practice way I did not have any difference of advantage or disadvantage, both as a percentage of compression, that compression time , whatever of the range utilized for the memory blocks.