Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials
Reload this Page CLS-ZStd
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old 07-10-2016, 09:29
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
  
Join Date: Jul 2012
Location: South Africa
Posts: 3,753
Thanks: 2,189
Thanked 11,219 Times in 2,311 Posts
Razor12911 is on a distinguished road
Yup. I doubt that there will much diff though.
Reply With Quote
Sponsored Links
  #2  
Old 08-10-2016, 05:18
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
  
Join Date: Feb 2011
Location: italy
Posts: 836
Thanks: 357
Thanked 1,158 Times in 390 Posts
felice2011 is on a distinguished road
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:54:37
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

        Arc+zstd          95,4°MB           26,2°MB       27,46 %              1°Files    00:00:44:940   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:56:59
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd32_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:959   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:59:05
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd64_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:956   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 14:09:55
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+pzstd_gcc620          95,4°MB           26,7°MB       27,99 %              1°Files    00:00:09:946   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mpzstd 
=============================================================================================================================================
All test ZSTD Same Options :
Code:
Level=19
ChunkSize=100M
Threads=2
Test PZSTD Options
Code:
pzstd -19 -f
__________________
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈
« I Mediocri Imitano, I Geni Copiano, Dio Crea & Distrugge » (Io Ridefinisco & Perfeziono le Loro Opere Rendendole Uniche)
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈
« Mediocrities Imitate, Genius Copy, God Creates & Destroys » (I Reconsider & Improve Their Works, Rending Them One And Only)
Reply With Quote
  #3  
Old 08-10-2016, 06:57
~MAK~'s Avatar
~MAK~ ~MAK~ is offline
Registered User
  
Join Date: Sep 2016
Location: Moon
Posts: 44
Thanks: 25
Thanked 43 Times in 13 Posts
~MAK~ is on a distinguished road
Quote:
Originally Posted by felice2011 View Post
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:54:37
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

        Arc+zstd          95,4°MB           26,2°MB       27,46 %              1°Files    00:00:44:940   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:56:59
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd32_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:959   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:59:05
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd64_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:956   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 14:09:55
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+pzstd_gcc620          95,4°MB           26,7°MB       27,99 %              1°Files    00:00:09:946   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mpzstd 
=============================================================================================================================================
All test ZSTD Same Options :
Code:
Level=19
ChunkSize=100M
Threads=2
Test PZSTD Options
Code:
pzstd -19 -f
no matey, he actually mean, test between cls with zstd and cls without zstd for speed
__________________
"The possession of knowledge does not kill the sense of wonder and mystery. There is always more mystery."
Reply With Quote
  #4  
Old 08-10-2016, 08:25
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
  
Join Date: Feb 2011
Location: italy
Posts: 836
Thanks: 357
Thanked 1,158 Times in 390 Posts
felice2011 is on a distinguished road
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 17:14:41
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

       Arc+zstd          95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:973   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================
This ZSTD v1.0.0 normal NO-CLS, the previous post the tests already carried out with CLS.
same all settings "-19" performed with enwik8.
Try you also with the same input file
__________________
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈
« I Mediocri Imitano, I Geni Copiano, Dio Crea & Distrugge » (Io Ridefinisco & Perfeziono le Loro Opere Rendendole Uniche)
≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈ ≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈≈
« Mediocrities Imitate, Genius Copy, God Creates & Destroys » (I Reconsider & Improve Their Works, Rending Them One And Only)
Reply With Quote
  #5  
Old 08-10-2016, 08:32
~MAK~'s Avatar
~MAK~ ~MAK~ is offline
Registered User
  
Join Date: Sep 2016
Location: Moon
Posts: 44
Thanks: 25
Thanked 43 Times in 13 Posts
~MAK~ is on a distinguished road
Quote:
Originally Posted by felice2011 View Post
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 17:14:41
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

       Arc+zstd          95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:973   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================
This ZSTD v1.0.0 normal NO-CLS, the previous post the tests already carried out with CLS.
same all settings "-19" performed with enwik8.
Try you also with the same input file
So, the conclusion in the last is, we finally made a zstd cls with no drawback of speed and ratio, and with full support to Inno, Am happy my zstdlib_x86.dll was useful here
__________________
"The possession of knowledge does not kill the sense of wonder and mystery. There is always more mystery."
Last edited by ~MAK~; 08-10-2016 at 10:08.
Reply With Quote
  #6  
Old 16-06-2017, 02:14
doofoo24 doofoo24 is offline
Registered User
  
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 474 Times in 227 Posts
doofoo24 is on a distinguished road
is there update for cls-zstd to the latest ver 1.2 ?
Reply With Quote
  #7  
Old 26-06-2017, 06:23
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
  
Join Date: Jul 2012
Location: South Africa
Posts: 3,753
Thanks: 2,189
Thanked 11,219 Times in 2,311 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by doofoo24 View Post
is there update for cls-zstd to the latest ver 1.2 ?
I'm pretty sure dropping in a v1.2 dll wouldn't be much of a problem.
Reply With Quote
The Following User Says Thank You to Razor12911 For This Useful Post:
doofoo24 (27-06-2017)
  #8  
Old 08-10-2016, 10:01
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
  
Join Date: Jul 2012
Location: South Africa
Posts: 3,753
Thanks: 2,189
Thanked 11,219 Times in 2,311 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by felice2011 View Post
Code:
-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:54:37
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

        Arc+zstd          95,4°MB           26,2°MB       27,46 %              1°Files    00:00:44:940   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:56:59
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd32_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:959   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 13:59:05
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+zstd64_gcc620         95,4°MB           26,2°MB       27,46 %              1°Files    00:00:43:956   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mzstd 
=============================================================================================================================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 08/10/2016 14:09:55
=============================================================================================================================================
 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc+pzstd_gcc620          95,4°MB           26,7°MB       27,99 %              1°Files    00:00:09:946   a -ma9 -ds -lc1024 -ld1024 -ep1 -di -i2 -ed -r -s; -w"temp" -mpzstd 
=============================================================================================================================================
All test ZSTD Same Options :
Code:
Level=19
ChunkSize=100M
Threads=2
Test PZSTD Options
Code:
pzstd -19 -f
felice, chunk size is set to 100m, input is less than 100m, obviously no comparison with pzstd here because cls-zstd was single threaded either way.

Chunk size works this way.

It feeds a specified chunk size to a thread.
If you have 4 threads for example, you set 100m chunk size on a 360mb input.
thread 1-3 will get 100mb
thread 4 will get 60mb
for your case, it really doesn't matter how many threads you set, compression will always be single threaded because chunk size is bigger than main input, all this just goes to 1 thread, all other threads have nothing to process.
Last edited by Razor12911; 08-10-2016 at 15:32.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
felice2011 (08-10-2016), RamiroCruzo (08-10-2016), Simorq (09-10-2016)
Reply

« Previous Thread | Next Thread »
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes
Hybrid Mode Hybrid Mode

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Masked Compression (Ultimate compression in one go) panker1992 Conversion Tutorials 661 13-05-2024 16:51
Simple splitting and compress by DLG felice2011 Conversion Tutorials 106 14-01-2018 15:32
Reflate+Static+Fazip 1234567890123 Conversion Tutorials 20 14-04-2016 20:53
lzma2 on freearc as external panker1992 Conversion Tutorials 39 19-12-2015 09:01



All times are GMT -7. The time now is 07:57.

FileForums - Archive - Privacy Statement - Top

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com