|
#16
|
||||
|
||||
|
Quote:
Chunk size works this way. It feeds a specified chunk size to a thread. If you have 4 threads for example, you set 100m chunk size on a 360mb input. thread 1-3 will get 100mb thread 4 will get 60mb for your case, it really doesn't matter how many threads you set, compression will always be single threaded because chunk size is bigger than main input, all this just goes to 1 thread, all other threads have nothing to process. Last edited by Razor12911; 08-10-2016 at 15:32. |
| The Following 3 Users Say Thank You to Razor12911 For This Useful Post: | ||
| Sponsored Links |
|
#17
|
||||
|
||||
|
Excellent elucidation, when I have time I'll just repeat the test..
..though honestly I think the difference will be minimal, but I hope to be wrong.
__________________
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ « I Mediocri Imitano, I Geni Copiano, Dio Crea & Distrugge » (Io Ridefinisco & Perfeziono le Loro Opere Rendendole Uniche) ![]() ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ « Mediocrities Imitate, Genius Copy, God Creates & Destroys » (I Reconsider & Improve Their Works, Rending Them One And Only)
Last edited by felice2011; 08-10-2016 at 15:28. |
| The Following User Says Thank You to felice2011 For This Useful Post: | ||
Razor12911 (08-10-2016) | ||
|
#18
|
||||
|
||||
|
Today, having a little free time I repeated the test...
...All Test Input Data 420MB.Here we have as a benchmark compression via ZSTD v1.0 no CLS. Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 09:58:52
=============================================================================================================================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○
Arc+zstd_1.0 419,6°MB 195,9°MB 46,69 % 14°Files 00:03:22:986 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd
=============================================================================================================================================
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:31:18 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt2cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:946 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:32:47 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt4cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:932 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:34:25 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt2cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:948 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:35:18 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt4cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:951 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:15:35 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt2cs100 419,6°MB 199,2°MB 47,47 % 14°Files 00:01:35:918 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:22:12 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt4cs100 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:942 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:23:41 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt2cs250 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:26:36 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt4cs250 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:937 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:28:34 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt2cs500 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:951 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:29:56 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd540mt4cs500 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:941 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:38:55 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt2cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:947 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:41:04 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt4cs50 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:932 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:42:46 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt2cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:43:55 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt4cs64 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:45:15 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt2cs128 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:950 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:46:23 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt4cs128 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:03:04 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:47:33 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt2cs256 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:941 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:48:40 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt4cs256 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:957 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:49:40 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt2cs512 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:944 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= -↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 15/10/2016 12:50:02 ============================================================================================================================================= ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○ Arc+zstd620mt4cs512 419,6°MB 235,6°MB 56,15 % 14°Files 00:00:02:948 a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd ============================================================================================================================================= A distinct difference between the ZSTD version v1.0, and versions with no CLS 540 and CLS 620, with the latter results in a marked improvement in speed at the expense of better compression with ZSTD v1.0, so the choice is purely subjective, whether to use the version with or without CLS, but personally have not seen anything of sensational in these versions with CLS support. Razor your lesson on the block of memory and the allocation thereof is correct, but in this case will be interpreted theoretically, in practice way I did not have any difference of advantage or disadvantage, both as a percentage of compression, that compression time , whatever of the range utilized for the memory blocks.
__________________
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ « I Mediocri Imitano, I Geni Copiano, Dio Crea & Distrugge » (Io Ridefinisco & Perfeziono le Loro Opere Rendendole Uniche) ![]() ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ « Mediocrities Imitate, Genius Copy, God Creates & Destroys » (I Reconsider & Improve Their Works, Rending Them One And Only)
|
| The Following User Says Thank You to felice2011 For This Useful Post: | ||
Razor12911 (15-10-2016) | ||
|
#19
|
|||
|
|||
|
is there update for cls-zstd to the latest ver 1.2 ?
|
![]() |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Masked Compression (Ultimate compression in one go) | panker1992 | Conversion Tutorials | 661 | 13-05-2024 16:51 |
| Simple splitting and compress by DLG | felice2011 | Conversion Tutorials | 106 | 14-01-2018 15:32 |
| Reflate+Static+Fazip | 1234567890123 | Conversion Tutorials | 20 | 14-04-2016 20:53 |
| lzma2 on freearc as external | panker1992 | Conversion Tutorials | 39 | 19-12-2015 09:01 |