Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 07-12-2017, 08:46
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 542
Thanks: 617
Thanked 643 Times in 239 Posts
78372 is on a distinguished road
CLS-FP8MT(multi tasking)

Another cls based on chunks as cls-rz, but this time it's mt.

Nothing to say, just set up cls.ini, you know how to use a cls.

FP8 is slow, even in store mode because it precompresses data and then compresses it, so in level 0 it just precompresses, you get better result using level 0 fp8+srep+lzma rather than srep+lzma.

You can't set up how much threads to use because cls automatically defines it. Usually it uses all threads except one.

Configuring ini file:

There is already an example inside, but this is how it's done.

cls.ini

[fp8]
Level=5
ChunkSize=64m

Enjoy!

Original fp8 homepage in encode
Attached Files
File Type: 7z cls-fp8mt.7z (473.9 KB, 152 views)

Last edited by 78372; 07-12-2017 at 20:56. Reason: added fp8 link in encode
Reply With Quote
The Following 11 Users Say Thank You to 78372 For This Useful Post:
arkantos7 (11-12-2017), danswano (19-12-2017), EzzEldin16 (09-12-2017), KaktoR (07-12-2017), kassane (07-12-2017), mikey26 (07-12-2017), Mini (07-12-2017), oltjon (07-12-2017), Razor12911 (07-12-2017), shazzla (07-12-2017), Simorq (07-12-2017)
Sponsored Links
  #2  
Old 07-12-2017, 09:40
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 343
Thanks: 99
Thanked 376 Times in 200 Posts
doofoo24 is on a distinguished road
so did quick test on Inside with fp8mt and without it , fp8mt level 0. the rest of the setting fp8mt+srep:m3f:a2+4x4:lzma:a1:mfbt4:d1m:fb273:mc10 000:lc8
so with fp8mt is 939mb,
and without fp8mt is 995mb..

Last edited by doofoo24; 07-12-2017 at 10:49.
Reply With Quote
  #3  
Old 07-12-2017, 10:12
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 2,642
Thanks: 669
Thanked 3,857 Times in 1,388 Posts
KaktoR is on a distinguished road
Never heard of fp8, any further info for some reading on this?
__________________
Haters gonna hate
RIP GOD
Reply With Quote
  #4  
Old 07-12-2017, 10:13
-NORO- -NORO- is offline
Registered User
 
Join Date: May 2017
Location: France
Posts: 42
Thanks: 44
Thanked 12 Times in 11 Posts
-NORO- is on a distinguished road
whats for FP8 ?
Reply With Quote
  #5  
Old 07-12-2017, 10:27
kassane's Avatar
kassane kassane is offline
Registered User
 
Join Date: Nov 2011
Location: Somewhere in the World
Posts: 176
Thanks: 559
Thanked 115 Times in 47 Posts
kassane is on a distinguished road
FP8 (Fast PAQ8) is based paq8px, technically similar to precomp.
__________________
"Knowledge is infinite, but the experience is parallel".
Reply With Quote
The Following 2 Users Say Thank You to kassane For This Useful Post:
KaktoR (07-12-2017), Simorq (07-12-2017)
  #6  
Old 07-12-2017, 10:42
oltjon's Avatar
oltjon oltjon is offline
Registered User
 
Join Date: Dec 2013
Location: UNITED STATES OF ALBANIA
Posts: 213
Thanks: 1,053
Thanked 157 Times in 78 Posts
oltjon is on a distinguished road
:man you are crazy
Reply With Quote
  #7  
Old 07-12-2017, 12:20
-NORO- -NORO- is offline
Registered User
 
Join Date: May 2017
Location: France
Posts: 42
Thanks: 44
Thanked 12 Times in 11 Posts
-NORO- is on a distinguished road
what about arc.ini ?
what should it be ?
Reply With Quote
  #8  
Old 07-12-2017, 12:22
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 343
Thanks: 99
Thanked 376 Times in 200 Posts
doofoo24 is on a distinguished road
bug decompression stuck

so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage

Last edited by doofoo24; 12-05-2018 at 21:14.
Reply With Quote
The Following 3 Users Say Thank You to doofoo24 For This Useful Post:
78372 (07-12-2017), oltjon (07-12-2017), Simorq (07-12-2017)
  #9  
Old 07-12-2017, 12:24
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 2,642
Thanks: 669
Thanked 3,857 Times in 1,388 Posts
KaktoR is on a distinguished road
does it support stdin/out?
__________________
Haters gonna hate
RIP GOD
Reply With Quote
  #10  
Old 07-12-2017, 19:46
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 542
Thanks: 617
Thanked 643 Times in 239 Posts
78372 is on a distinguished road
Quote:
Originally Posted by doofoo24 View Post
so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage
This doesn't look like a cls bug because here everything works fine, but fp8 is crazy if you ask me. And if it isn't working, it would not use that much cpu in idle stat.
Attached Images
File Type: jpg FB_IMG_15127043828983122.jpg (249.9 KB, 205 views)
Reply With Quote
  #11  
Old 07-12-2017, 20:02
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,222
Thanks: 1,738
Thanked 7,905 Times in 1,783 Posts
Razor12911 is on a distinguished road
My test:
Code:
FreeArc 0.67 (March 15 2014) updating archive: data.bin
Compressed 1 file, 86,347,072 => 62,944 bytes. Ratio 0.07%
Compression time: cpu 0.17 sec/real 0.61 sec = 28%. Speed 142.70 mB/s
All OK
fp8 is buggy

Code:
Creating archive C:\Users\Zee\Downloads\Compressed\cls-fp8mt\UI.sb.fp8 with 1 file(s)...

File list (16 bytes)
Compressed from 16 to 21 bytes.

1/1  Filename: C:/Users/Zee/Downloads/Compressed/cls-fp8mt/UI.sb (86347072 bytes)
Block segmentation:
 0           | default          |      2728 bytes [0 - 2727]
 1           | zlib             |     42678 bytes [2728 - 45405]
tmpfile: Permission denied
Code:
C:\Users\Zee\Downloads\Compressed\cls-fp8mt>fp8 -d UI.sb.fp8
Extracting ./UI.sb 86347072 ->   2.96%
-Stays like this and in taskmgr looks like that
Attached Images
File Type: png Capture33.PNG (73.3 KB, 192 views)
__________________
Looking for something?
Visit the
Tutorial Index


Last edited by Razor12911; 07-12-2017 at 20:38.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
78372 (07-12-2017), kassane (08-12-2017), Simorq (08-12-2017)
  #12  
Old 07-12-2017, 20:19
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 542
Thanks: 617
Thanked 643 Times in 239 Posts
78372 is on a distinguished road
So it works and it doesn't work

Good, so fp8 bugs made the cls buggy, else it works

Last edited by 78372; 07-12-2017 at 20:32.
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
oltjon (08-12-2017)
  #13  
Old 07-12-2017, 20:39
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,222
Thanks: 1,738
Thanked 7,905 Times in 1,783 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by doofoo24 View Post
so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage
With all that said, the results you obtained are mostly false.
__________________
Looking for something?
Visit the
Tutorial Index

Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
78372 (07-12-2017), oltjon (07-12-2017), Simorq (08-12-2017)
  #14  
Old 08-12-2017, 03:22
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 542
Thanks: 617
Thanked 643 Times in 239 Posts
78372 is on a distinguished road
@Everyone

Precompression is buggy, so it's suggested to use it as compressor instead of precompressor+compressor. pZlib+srep+fp8(level8) should be fine if fp8 doesn't mess everything up but looks like cls is fine, normal bugs are caused by fp8 itself.
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
oltjon (08-12-2017)
  #15  
Old 08-12-2017, 05:55
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 343
Thanks: 99
Thanked 376 Times in 200 Posts
doofoo24 is on a distinguished road
:confused:

Quote:
Originally Posted by Razor12911 View Post
With all that said, the results you obtained are mostly false.
it not false here new quick test i done to be sure but instead of using lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 like in the first time i 'm using
fp8mt+srep:m5f:l16:c8:a0+4x4:t2:lzma:a1:mfbt4:d64m :fb273:mc10000:lc8...
you welcome to test it yourself on the game with this setting...
forgot to mention the setting this time for fp8mt
[fp8]
Level=0
ChunkSize=64m

*i will test with the same setting like the first time ChunkSize=512m and srep:m3f:a2 and lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 when i get time lzma with this setting so slow maybe tomorrow...
but i confident of results ...

Last edited by doofoo24; 12-05-2018 at 21:14.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
CLS-PrecompMT (Multi tasking) Razor12911 Conversion Tutorials 66 03-04-2017 07:59



All times are GMT -7. The time now is 12:47.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.
Copyright 2000-2018, FileForums @ https://fileforums.com