Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 07-12-2017, 09:46
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 650
Thanks: 772
Thanked 949 Times in 309 Posts
78372 is on a distinguished road
CLS-FP8MT(multi tasking)

Another cls based on chunks as cls-rz, but this time it's mt.

Nothing to say, just set up cls.ini, you know how to use a cls.

FP8 is slow, even in store mode because it precompresses data and then compresses it, so in level 0 it just precompresses, you get better result using level 0 fp8+srep+lzma rather than srep+lzma.

You can't set up how much threads to use because cls automatically defines it. Usually it uses all threads except one.

Configuring ini file:

There is already an example inside, but this is how it's done.

cls.ini

[fp8]
Level=5
ChunkSize=64m

Enjoy!

Original fp8 homepage in encode
Attached Files
File Type: 7z cls-fp8mt.7z (473.9 KB, 189 views)
__________________
NOT AVAILABLE

Last edited by 78372; 07-12-2017 at 21:56. Reason: added fp8 link in encode
Reply With Quote
The Following 12 Users Say Thank You to 78372 For This Useful Post:
arkantos7 (11-12-2017), danswano (19-12-2017), EzzEldin16 (09-12-2017), KaktoR (07-12-2017), kassane (07-12-2017), mikey26 (07-12-2017), Mini (07-12-2017), oltjon (07-12-2017), Razor12911 (07-12-2017), Sanya288 (14-03-2021), shazzla (07-12-2017), Simorq (07-12-2017)
Sponsored Links
  #2  
Old 07-12-2017, 10:40
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 468 Times in 227 Posts
doofoo24 is on a distinguished road
so did quick test on Inside with fp8mt and without it , fp8mt level 0. the rest of the setting fp8mt+srep:m3f:a2+4x4:lzma:a1:mfbt4:d1m:fb273:mc10 000:lc8
so with fp8mt is 939mb,
and without fp8mt is 995mb..

Last edited by doofoo24; 07-12-2017 at 11:49.
Reply With Quote
  #3  
Old 07-12-2017, 11:12
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,429
Thanks: 1,078
Thanked 7,037 Times in 2,665 Posts
KaktoR is on a distinguished road
Never heard of fp8, any further info for some reading on this?
__________________
Haters gonna hate
Reply With Quote
  #4  
Old 07-12-2017, 11:13
-NORO- -NORO- is offline
Registered User
 
Join Date: May 2017
Location: France
Posts: 42
Thanks: 44
Thanked 12 Times in 11 Posts
-NORO- is on a distinguished road
whats for FP8 ?
Reply With Quote
  #5  
Old 07-12-2017, 11:27
kassane's Avatar
kassane kassane is offline
Registered User
 
Join Date: Nov 2011
Location: Somewhere in the World
Posts: 174
Thanks: 578
Thanked 117 Times in 47 Posts
kassane is on a distinguished road
FP8 (Fast PAQ8) is based paq8px, technically similar to precomp.
__________________
"There are three things that sages fear... The tormented sea, a moonless night and the wrath of a gentleness man." - The fear of the Sages.
Reply With Quote
The Following 2 Users Say Thank You to kassane For This Useful Post:
KaktoR (07-12-2017), Simorq (07-12-2017)
  #6  
Old 07-12-2017, 11:42
oltjon's Avatar
oltjon oltjon is offline
Registered User
 
Join Date: Dec 2013
Location: UNITED STATES OF ALBANIA
Posts: 218
Thanks: 1,132
Thanked 167 Times in 79 Posts
oltjon is on a distinguished road
:man you are crazy
Reply With Quote
  #7  
Old 07-12-2017, 13:20
-NORO- -NORO- is offline
Registered User
 
Join Date: May 2017
Location: France
Posts: 42
Thanks: 44
Thanked 12 Times in 11 Posts
-NORO- is on a distinguished road
what about arc.ini ?
what should it be ?
Reply With Quote
  #8  
Old 07-12-2017, 13:22
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 468 Times in 227 Posts
doofoo24 is on a distinguished road
bug decompression stuck

so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage

Last edited by doofoo24; 12-05-2018 at 22:14.
Reply With Quote
The Following 3 Users Say Thank You to doofoo24 For This Useful Post:
78372 (07-12-2017), oltjon (07-12-2017), Simorq (07-12-2017)
  #9  
Old 07-12-2017, 13:24
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 4,429
Thanks: 1,078
Thanked 7,037 Times in 2,665 Posts
KaktoR is on a distinguished road
does it support stdin/out?
__________________
Haters gonna hate
Reply With Quote
  #10  
Old 07-12-2017, 20:46
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 650
Thanks: 772
Thanked 949 Times in 309 Posts
78372 is on a distinguished road
Quote:
Originally Posted by doofoo24 View Post
so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage
This doesn't look like a cls bug because here everything works fine, but fp8 is crazy if you ask me. And if it isn't working, it would not use that much cpu in idle stat.
Attached Images
File Type: jpg FB_IMG_15127043828983122.jpg (249.9 KB, 263 views)
__________________
NOT AVAILABLE
Reply With Quote
  #11  
Old 07-12-2017, 21:02
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,104 Times in 2,296 Posts
Razor12911 is on a distinguished road
My test:
Code:
FreeArc 0.67 (March 15 2014) updating archive: data.bin
Compressed 1 file, 86,347,072 => 62,944 bytes. Ratio 0.07%
Compression time: cpu 0.17 sec/real 0.61 sec = 28%. Speed 142.70 mB/s
All OK
fp8 is buggy

Code:
Creating archive C:\Users\Zee\Downloads\Compressed\cls-fp8mt\UI.sb.fp8 with 1 file(s)...

File list (16 bytes)
Compressed from 16 to 21 bytes.

1/1  Filename: C:/Users/Zee/Downloads/Compressed/cls-fp8mt/UI.sb (86347072 bytes)
Block segmentation:
 0           | default          |      2728 bytes [0 - 2727]
 1           | zlib             |     42678 bytes [2728 - 45405]
tmpfile: Permission denied
Code:
C:\Users\Zee\Downloads\Compressed\cls-fp8mt>fp8 -d UI.sb.fp8
Extracting ./UI.sb 86347072 ->   2.96%
-Stays like this and in taskmgr looks like that
Attached Images
File Type: png Capture33.PNG (73.3 KB, 251 views)

Last edited by Razor12911; 07-12-2017 at 21:38.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
78372 (07-12-2017), kassane (08-12-2017), Simorq (08-12-2017)
  #12  
Old 07-12-2017, 21:19
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 650
Thanks: 772
Thanked 949 Times in 309 Posts
78372 is on a distinguished road
So it works and it doesn't work

Good, so fp8 bugs made the cls buggy, else it works
__________________
NOT AVAILABLE

Last edited by 78372; 07-12-2017 at 21:32.
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
oltjon (08-12-2017)
  #13  
Old 07-12-2017, 21:39
Razor12911's Avatar
Razor12911 Razor12911 is offline
Noob
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,746
Thanks: 2,141
Thanked 11,104 Times in 2,296 Posts
Razor12911 is on a distinguished road
Quote:
Originally Posted by doofoo24 View Post
so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage
With all that said, the results you obtained are mostly false.
Reply With Quote
The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
78372 (07-12-2017), oltjon (08-12-2017), Simorq (08-12-2017)
  #14  
Old 08-12-2017, 04:22
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 650
Thanks: 772
Thanked 949 Times in 309 Posts
78372 is on a distinguished road
@Everyone

Precompression is buggy, so it's suggested to use it as compressor instead of precompressor+compressor. pZlib+srep+fp8(level8) should be fine if fp8 doesn't mess everything up but looks like cls is fine, normal bugs are caused by fp8 itself.
__________________
NOT AVAILABLE
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
oltjon (08-12-2017)
  #15  
Old 08-12-2017, 06:55
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 408
Thanks: 138
Thanked 468 Times in 227 Posts
doofoo24 is on a distinguished road
:confused:

Quote:
Originally Posted by Razor12911 View Post
With all that said, the results you obtained are mostly false.
it not false here new quick test i done to be sure but instead of using lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 like in the first time i 'm using
fp8mt+srep:m5f:l16:c8:a0+4x4:t2:lzma:a1:mfbt4:d64m :fb273:mc10000:lc8...
you welcome to test it yourself on the game with this setting...
forgot to mention the setting this time for fp8mt
[fp8]
Level=0
ChunkSize=64m

*i will test with the same setting like the first time ChunkSize=512m and srep:m3f:a2 and lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 when i get time lzma with this setting so slow maybe tomorrow...
but i confident of results ...

Last edited by doofoo24; 12-05-2018 at 22:14.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
CLS-PrecompMT (Multi tasking) Razor12911 Conversion Tutorials 70 03-02-2021 02:16



All times are GMT -7. The time now is 11:24.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2025, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com