CLS-FP8MT(multi tasking)

[78372]

Another cls based on chunks as cls-rz, but this time it's mt.

Nothing to say, just set up cls.ini, you know how to use a cls.

FP8 is slow, even in store mode because it precompresses data and then compresses it, so in level 0 it just precompresses, you get better result using level 0 fp8+srep+lzma rather than srep+lzma.

You can't set up how much threads to use because cls automatically defines it. Usually it uses all threads except one.

Configuring ini file:

There is already an example inside, but this is how it's done.

cls.ini

[fp8]
Level=5
ChunkSize=64m

Enjoy!

Original fp8 homepage in encode (https://encode.ru/threads/613-FP8-(-Fast-PAQ8))

[doofoo24]

so did quick test on Inside with fp8mt and without it , fp8mt level 0. the rest of the setting fp8mt+srep:m3f:a2+4x4:lzma:a1:mfbt4:d1m:fb273:mc10 000:lc8
so with fp8mt is 939mb,
and without fp8mt is 995mb..

[KaktoR]

Never heard of fp8, any further info for some reading on this?

[-NORO-]

whats for FP8 ?

[kassane]

FP8 (Fast PAQ8) is based paq8px, technically similar to precomp.

[oltjon]

:man you are crazy :eek::eek::D;)

[-NORO-]

what about arc.ini ?
what should it be ?

[doofoo24]

so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage

[KaktoR]

does it support stdin/out?

[78372]

so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage

This doesn't look like a cls bug because here everything works fine, but fp8 is crazy if you ask me. And if it isn't working, it would not use that much cpu in idle stat.

[Razor12911]

My test:
FreeArc 0.67 (March 15 2014) updating archive: data.bin
Compressed 1 file, 86,347,072 => 62,944 bytes. Ratio 0.07%
Compression time: cpu 0.17 sec/real 0.61 sec = 28%. Speed 142.70 mB/s
All OK

fp8 is buggy

Creating archive C:\Users\Zee\Downloads\Compressed\cls-fp8mt\UI.sb.fp8 with 1 file(s)...

File list (16 bytes)
Compressed from 16 to 21 bytes.

1/1 Filename: C:/Users/Zee/Downloads/Compressed/cls-fp8mt/UI.sb (86347072 bytes)
Block segmentation:
0 | default | 2728 bytes [0 - 2727]
1 | zlib | 42678 bytes [2728 - 45405]
tmpfile: Permission denied

C:\Users\Zee\Downloads\Compressed\cls-fp8mt>fp8 -d UI.sb.fp8
Extracting ./UI.sb 86347072 -> 2.96%

-Stays like this and in taskmgr looks like that

[78372]

So it works and it doesn't work :confused:

Good, so fp8 bugs made the cls buggy, else it works

[Razor12911]

so test it on mass effect 1 with fp8mt+srep+lzma...
Level=0
changing the ChunkSize improve compression
with srep+lzma only 4.03 gb
with fp8mt chunksize 64m i get 3.33gb
with fp8mt chunksize 512m i get 2.92gb

BUT in decompression it use all cpu but stuck ???
ONLY WRITE 1.5GB AND YOU CAN SEE THAT fp8 continue to use all core but the zero disk usage

With all that said, the results you obtained are mostly false.

[78372]

@Everyone

Precompression is buggy, so it's suggested to use it as compressor instead of precompressor+compressor. pZlib+srep+fp8(level8) should be fine if fp8 doesn't mess everything up but looks like cls is fine, normal bugs are caused by fp8 itself.

[doofoo24]

With all that said, the results you obtained are mostly false.

it not false here new quick test i done to be sure but instead of using lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 like in the first time i 'm using
fp8mt+srep:m5f:l16:c8:a0+4x4:t2:lzma:a1:mfbt4:d64m :fb273:mc10000:lc8...
you welcome to test it yourself on the game with this setting...
forgot to mention the setting this time for fp8mt
[fp8]
Level=0
ChunkSize=64m

*i will test with the same setting like the first time ChunkSize=512m and srep:m3f:a2 and lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 when i get time lzma with this setting so slow maybe tomorrow...
but i confident of results ...

[78372]

You can't be sure in that way.

Use only fp8 without cls (configure arc.ini yourself :P ) to test actually

[doofoo24]

so i get error zero byte ???

the setting for arc.ini

[External compressor:fp8]
header = 0
packcmd = fp8 -1 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = fp8 -d $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

i tried different fp8 but the same...

[oltjon]

I use this is fine

[External compressor:fp8]
packcmd = fp8 -8 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = fp8 -d $$arcpackedfile$$.tmp.fp8
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.fp8

[doofoo24]

[External compressor:fp8]
packcmd = fp8 -8 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = fp8 -d $$arcpackedfile$$.tmp.fp8
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.fp8

ain't working on mass effect...