pZLib v3 (Final release)

[Razor12911]

People make yourselves useful.

I was away for 2 weeks and the only thing razor gets is people telling me the program does not work, CRC errors and etc.

I'm not a repacker guys, I'm just a programmer, I create programs for you guys, and the least you guys can do is upload the file that gives pzlib problems, nothing has been uploaded so far. Firstly I'm on capped net your attachments must be small, can't expect me to download some game so that I can figure out the bug myself yet I don't even use pzlib at all, I simply buy games or just keep them "DP" Direct play, I really don't have time for repacking at all, the effort of repacking can easily be converted to buying another hard drive, anyways. What I'm trying to say is, none of my games do raise any CRC errors, and I'm giving you guys a job to fix it.

Now it must be really difficult to figure out which small file can have bugs well it is simple like it is difficult for me to figure out a bug in several gigabytes of data.

For example. PES2017, game is like 6GB. When I first used pzlib v2, it was buggy and gave CRC errors everytime it comes across dt15_win.cpk, but when you use pzlib on that file alone, the error isn't there. pzlib works with chunks and it keeps its chunks constant so what I did was flush the bug out. Firstly, the game is 6.2GB or so, don't really remember. (Game was crap so I deleted it and only kept the buggy part of it)

Ok so from 6.2GB, I know that the problem lies in dt15_win.cpk, so all I did was remove all files that came after that file and kept everything else and I remained with 1.22 GB because everything after dt15_win.cpk was close to 5GB meaning I'm trapping the bug and making it easy to spot, also making it easy for you guys to upload.

From that 1.22 GB, there was dt00_win.cpk, dt10_win.cpk, dt11_win.cpk, dt12_win.cpk, dt13_win.cpk, all those files were 964 MB, now from what I remember, in the past I created dummy file creator, just make dummy files of those files meaning you'll still have 1.22GB but now the data will be compressible for upload for me to investigate. I ran pzlib on the data with the dummy files, since the bug only lies in dt15_win.cpk, the bug was kept which is good because now the bug is even more trapped.

Remember pzlib works with chunk sizes, by default it's 16mb, so to trap the bug even more, you can start by deleting data from position 0 of the data, keep removing 16mb until the bug is gone, I ended up with 16.8mb of data from 964MB, and the bug was gone, I then readded 16mb to make sure the bug is still there so that I can investigate and find out what was wrong, the final size was 32.8 MB. So from 6.2GB worth of data, I ended up with 32.8MB but the bug was maintained, I then figured out what the problem was, fixed via programming and then added a few touches then made pzlib v3 having thought all the bugs were gone but they weren't.

So in short, you guys should do something roughly like this for the bug to be fixed.

Anyways, I uploaded an example. In the attachment. This file is buggy when used in pzlib v2, but it works in v3 because I did have the game that made pzlib to be buggy and fixed it, I don't have game that makes pzlib v3 buggy which is why it is buggy.

[felice2011]

I do not understand, the file you uploaded works with both the v2 that with v3, compression and decompression OK

[Razor12911]

try default settings.

[External compressorzlib]
header = 0
packcmd = pZLib e -m2 -t2 - -o - <stdin> <stdout>
unpackcmd = pZLib d -t2 - -o - <stdin> <stdout>

[felice2011]

Ok Ok wait...bug found

[Razor12911]

hmm... you don't say...

[felice2011]

pzlibV2

pzlib e -m3 -st50p -t8 -ct8 -c16m -b64k ( OK Comp ... OK Decomp )

pzlib e -m2 -st50p -t8 -ct8 -c16m -b64k ( OK Comp ... Decomp = infinite loop, remains so... )

[Razor12911]

Hehe, -t# controls -st# and -ct#, if you set -t7, st and ct become -st7 and -ct7 automatically. Anyways, it's not an infinite loop. pzlib keeps giving freearc incomplete data or rather damaged data, Freearc wants 32.8MB and pzlib keeps giving it 31.9MB, just for that, Freearc keeps calling pzlib, just check process hacker or task manager, you'll see pzlib is run and terminated over and over again, and when you check output directory, output is there but it keeps increasing endlessly, if there was a file after that dt15_win.cpk, you'll get CRC, but since it's just one file, CRC error is not called which happens to look like an endless loop.

m2 and m3 chunk data differently which is why m3 works and m2 doesn't, however with m3 working, it doesn't mean the problem is solved, m3 has problems of its own.

[felice2011]

woo if I cancel the infinite loop the file becomes more than 1GB...
OK then return to the starting point...
Set in default ini ... we see

[External compressorzlib]
header = 0
packcmd = pZLib e -m2 -t2 - -o - <stdin> <stdout>
unpackcmd = pZLib d -t2 - -o - <stdin> <stdout>

Result.



"dt15_win.cpk" will be your nightmare tonight...

[Razor12911]

Not really my nightmare mate, I don't use program plus bug is fixed in pzlib v3, but some bugs are still there, dt15_win.cpk is just a demonstration of what I had to do to fix the bug caused by it, you guys should do other ones, should be easy enough.

http://fileforums.com/showpost.php?p...3&postcount=77

[Sebazz]

Hi. I try to repack gta v version 1.36, and my question is what is the best method shelwien reflate or pzlib v3? And the recommended parameters ? Thanks

[ZAZA4EVER]

not Use Reflate Level
R6 ... pack output very big size and load on your hdd
R9 ... Has Problems in unpack

[Razor12911]

Originally Posted by ZAZA4EVER

not Use Reflate Level
R6 ... pack output very big size and load on your hdd
R9 ... Has Problems in unpack

this is false.

[ImmortalArc]

1.Best way to compress bf3 game I am ending with 9.30 gb while other people's doing it in 8.80 gb how????
2.what is the best thing after precompsiom of a file like lzma but I want more ratio good. Is there any other??? Is lzma2 is good??
3.how to rebuild games archives for better results?? Like fitgirl?

[-XCX-]

Originally Posted by ImmortalArc

1.Best way to compress bf3 game I am ending with 9.30 gb while other people's doing it in 8.80 gb how????
2.what is the best thing after precompsiom of a file like lzma but I want more ratio good. Is there any other??? Is lzma2 is good??
3.how to rebuild games archives for better results?? Like fitgirl?

Extract the files of bf3 and reimport them then compress them with srep+lzma you may get the good ratio

[ImmortalArc]

Originally Posted by -XCX-

Extract the files of bf3 and reimport them then compress them with srep+lzma you may get the good ratio

What I see in the mechanics temp folder is precomp zlib1 files and they are reaching 8.80gb
If I pzlibv3+srep+lzma then I getting 7.5 gb only in cas.cas files update is 232 mb and 1.47 gb of win32folder And other files 150 mb I am having problems In en.sb ru.sb files???