pZLib v3 (Final release) - Page 14

chum · #1 08-05-2017, 09:46

With most games i get ok decompression with CLS+Freearc GUI, but with one game specifically i get errors during decompression like others.

Apparently CLS-pzllib.dll is not respecting the argument -t#p or -t# for decompression, even if i set -t50p it always using total of 7 threads (-t75p). I have 8 threads CPU.

Edit: Ok i find the cause of decompression errors. If i compress that specific game with -t75p then decompression will cause error. But compressing with -t50p give correct decompression without any error. Anyway decompression always using -t75p for cls-pzlib.dll.

FitGirl · #2 09-05-2017, 11:47

Razor, thanks for cls, great update! One question: is it locked to 50p or 75p of available cores? And can it be adjusted like you did it in config for cls-precomp?

Simorq · #3 10-05-2017, 04:27

Mad Max

Code:

pZLibv2:c32m+srep+Lzma2 4.36 GB

Code:

pZLibv3:c256m+srep+Lzma2 6.4 GB

Code:

pZLibv3:x:c32m+srep+Lzma2 4.26 GB

Razor12911 · #4 10-05-2017, 05:01

Quote:

Originally Posted by Simorq

Mad Max

Code:

pZLibv2:c32m+srep+Lzma2 4.36 GB

Code:

pZLibv3:c256m+srep+Lzma2 6.4 GB

Code:

pZLibv3:x:c32m+srep+Lzma2 4.26 GB

That's not surprising.

Mad Mad is compressed using level 1, by default pzlib is level 6, or rather reflate, the moment you place raw2hif_dll.dll, you are disabling internal recompression, so this is what you will get.

ZLibv3:c256m+srep+Lzma2 6.4 GB
because level 6 was used, you didn't set reflating level, which is the -r# option.
Secondly, the option -x, enables both internal recompression to work with reflate. which is why 4.26GB is the best size because unlike reflate, internal recompression works like precomp, trial and error, it will try all levels and pick one that is best.

@Everyone
pzlib does work without raw2hif_dll.dll, only place the library if you know what it does, or how it works or how it is used else you'll just end up with negative ratios.

danswano · #5 14-05-2017, 07:14

Quote:

Originally Posted by Simorq

Mad Max

Code:

pZLibv2:c32m+srep+Lzma2 4.36 GB

Code:

pZLibv3:c256m+srep+Lzma2 6.4 GB

Code:

pZLibv3:x:c32m+srep+Lzma2 4.26 GB

What are your srep/lzma2 parameters you got 4.36GB with?
Please provide .bat and arc.ini parameters.
Thanks.

Simorq · #6 14-05-2017, 12:44

Quote:

Originally Posted by danswano

What are your srep/lzma2 parameters you got 4.36GB with?
Please provide .bat and arc.ini parameters.
Thanks.

pzlib+srep+lzma2 4.26 GB
Arc.ini

Code:

[External compressor:pzlib3]
header = 0
packcmd   = pZLib e -m2 -x -c32m -t25p - -o - <stdin> <stdout>
unpackcmd = pZLib d -t100p - -o - <stdin> <stdout>

[External compressor:pzlib2]
header = 0
packcmd   = pZLib e -m2 -c32m -t25p - -o - <stdin> <stdout>
unpackcmd = pZLib d -t100p - -o - <stdin> <stdout>


[External compressor:srep]
header    = 0
;packcmd   = srep {options} -a1 -m5f -l256 -t8 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
packcmd   = srep {options} -m5f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:lzma2, Lzma2, LZMA2, XZ, xz]
header = 0
packcmd   = 7z a -txz -an -mcrc=0 -m1=lzma2:d25:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=on -mx9 -si -so <stdin> <stdout>
unpackcmd = 7z x -txz -mmt=on -an -y -si -so <stdin> <stdout>

Test pzlib2

Razor12911 · #7 10-05-2017, 07:56

CLS updated

-Added confirguration
-There a few noobs out there, so hif2raw_dll.dll is embedded in cls, it's loaded automatically, no need to place near it near the CLS, at least this could rule out a few errors.

FitGirl · #8 10-05-2017, 12:28

Tested new updated CLS - it works good, but the bug from pzlib.exe still exists - it's impossible to cancel unpacking. Before it was possible to kill pzlib.exe process, now the whole setup must be shut down.

FitGirl · #9 10-05-2017, 12:41

A friend of mine did more tests of cls vs generic pzlib. Decoding speed.

Code:

          |                       t1 |                       t2 |                       t4 |                        t7 |
----------*--------------------------*--------------------------*--------------------------*---------------------------*
pzlib_x86 |  192 sec. / 2613 kB/sec. |  118 sec. / 4249 kB/sec. | 78.3 sec. / 6419 kB/sec. | 61.7 sec.  / 8144 kB/sec. |
pzlib_x64 |  141 sec. / 3556 kB/sec. | 87.5 sec. / 5745 kB/sec. | 57.9 sec. / 8680 kB/sec. | 44.1 sec. / 11386 kB/sec. |
cls-pzlib |  198 sec. / 2537 kB/sec. |  119 sec. / 4223 kB/sec. | 78.3 sec. / 6422 kB/sec. | 61.5 sec.  / 8169 kB/sec. |

enc opts: pzlib:m2

win7_sp1_x64
i7-4700MQ / 8 GB RAM
RAM-Disk

Razor12911 · #10 12-05-2017, 16:37

Quote:

Originally Posted by FitGirl

A friend of mine did more tests of cls vs generic pzlib. Decoding speed.

Code:

          |                       t1 |                       t2 |                       t4 |                        t7 |
----------*--------------------------*--------------------------*--------------------------*---------------------------*
pzlib_x86 |  192 sec. / 2613 kB/sec. |  118 sec. / 4249 kB/sec. | 78.3 sec. / 6419 kB/sec. | 61.7 sec.  / 8144 kB/sec. |
pzlib_x64 |  141 sec. / 3556 kB/sec. | 87.5 sec. / 5745 kB/sec. | 57.9 sec. / 8680 kB/sec. | 44.1 sec. / 11386 kB/sec. |
cls-pzlib |  198 sec. / 2537 kB/sec. |  119 sec. / 4223 kB/sec. | 78.3 sec. / 6422 kB/sec. | 61.5 sec.  / 8169 kB/sec. |

enc opts: pzlib:m2

win7_sp1_x64
i7-4700MQ / 8 GB RAM
RAM-Disk

Well it's not surprising, cls is actually x86, it should produce roughly the same speed as pzlib x86.

Razor12911 · #11 11-05-2017, 21:22

CLS updated

-Cancel bug fixed
-Added multi threading user control example

FitGirl · #12 15-05-2017, 00:22

Razor, thank you for the latest update - now the installer closes properly!
You're a gift to this community!

LuzhinE · #13 04-06-2017, 22:57

With t25p and t75p works well until now free of CRC, before there was that problem to cancel and did not, do not comment because Razor12911 is busy in classes, but now if it works well.

But waiting for an improvement so that the CPU can be used to maximum when compressing t8.

Thank you very much

Razor12911 · #14 05-06-2017, 03:35

Version 3.2 now available

Changes

-Tried to fix crc errors, no idea if they are fixed or not.
-Removed several options because there are just to many for some people to understand what they do.
-Tried to fix decoding termination, in case you want to cancel decoding process, it must now work without killing process, not sure either.
-method setting removed, from now it just searches for deflate streams which is m2 by default.
-by default reflate and zlib are blended.
-special stream option "s" is removed, found a way to process them.

Simorq · #15 05-06-2017, 10:36

Deflate Streams Better.

Code:

Test (Act Of Aggression Reboot Edition Deflate Streams)
pZLib version 2 and 3 Not Support
pZLib2017 Support

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Anno 1701 won't load, just get a blue screen!	Shadow22	General Gaming	5	28-08-2012 12:52
CPU jumps up to 100% now, not before	dav6	Software	11	24-05-2008 03:33
Elder Scrolls IV: Oblivion. WTF FOR ME.	SansMercy	General Gaming	5	07-04-2007 23:05
weird error....	sheykh	PC Games	5	07-05-2006 20:23
Have someone the german final release of WinNT 5 (2000) SP2	luckystar	PC Games	0	15-08-2001 12:11

The Following 3 Users Say Thank You to Simorq For This Useful Post:
oltjon (10-05-2017), romulus_ut3 (10-05-2017), wit (16-05-2017)

The Following 6 Users Say Thank You to Razor12911 For This Useful Post:
78372 (10-05-2017), COPyCAT (21-10-2020), gozarck (10-05-2017), kassane (10-05-2017), oltjon (10-05-2017), Simorq (10-05-2017)

The Following 4 Users Say Thank You to Simorq For This Useful Post:
BLACKFIRE69 (24-09-2019), danswano (15-05-2017), oltjon (14-05-2017), Razor12911 (14-05-2017)

The Following 12 Users Say Thank You to Razor12911 For This Useful Post:
78372 (10-05-2017), arkantos7 (11-05-2017), BLACKFIRE69 (24-09-2019), chum (10-05-2017), danswano (12-05-2017), ffmla (10-05-2017), gozarck (10-05-2017), JustFun (10-05-2017), kassane (10-05-2017), Mini (10-05-2017), oltjon (10-05-2017), Simorq (10-05-2017)

The Following User Says Thank You to FitGirl For This Useful Post:
Virus_Inc (12-05-2017)

The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
romulus_ut3 (13-05-2017), Sarvagya (02-06-2017), Simorq (14-05-2017)

The Following 17 Users Say Thank You to Razor12911 For This Useful Post:
-XCX- (12-05-2017), 78372 (11-05-2017), Abbat (13-05-2017), Andu21 (12-05-2017), chum (12-05-2017), danswano (12-05-2017), gozarck (12-05-2017), JustFun (12-05-2017), KaktoR (12-05-2017), kassane (12-05-2017), Mini (12-05-2017), rambohazard (15-05-2017), Sarvagya (02-06-2017), shazzla (12-05-2017), Simorq (12-05-2017), unarc 125 (11-05-2017), Virus_Inc (12-05-2017)

The Following 2 Users Say Thank You to FitGirl For This Useful Post:
Razor12911 (15-05-2017), Sarvagya (02-06-2017)

The Following 25 Users Say Thank You to Razor12911 For This Useful Post:
78372 (05-06-2017), Abbat (07-06-2017), Andu21 (05-06-2017), arkantos7 (13-06-2017), Chayan Manna (06-06-2017), COPyCAT (10-07-2017), felice2011 (05-06-2017), FitGirl (05-06-2017), Gupta (05-06-2017), KaktoR (05-06-2017), kassane (05-06-2017), Mini (05-06-2017), nik1967 (10-08-2017), oltjon (05-06-2017), Panky (05-06-2017), rambohazard (05-06-2017), romulus_ut3 (08-06-2017), Sarvagya (05-06-2017), shazzla (05-06-2017), Simorq (05-06-2017), Stor31 (10-10-2017), unarc 125 (05-06-2017), vint56 (05-06-2017), Virus_Inc (05-06-2017), wit (06-06-2017)

The Following User Says Thank You to Simorq For This Useful Post:
Razor12911 (05-06-2017)