You should remove -f if you get error while decompression. Remember, the -f switch ia for FASTER verification and not for BETTER verification

Delete it, but still CRC error

packcmd = pZLib e -m1 -t8 - -o - <stdin> <stdout>
http://i.imgur.com/aFnNVlC.jpg

LuzhinE....I do not understand why you are using the files *.CAS with pzlib, files *.CAS no contain stream, tested a sample of files with the game "Mirror's Edge Catalyst"...:confused:

MEC uses LZ4 compression, while earlier games, like BF3 use zlib.

Ahh ok... BF3 I had not tried it yet:)
MEC I'm testing with oodle with different codecs.

Oodle is meh.

Tested on DOOM - Update 5
Ripeados all languages except Spanish, credits and folder mp and palettes

58.8 GB

Use pzlib+srep+lzma

packcmd = pZLib e -m2 -c640m -x -s -r9 -t8 - -o - <stdin> <stdout>

Final size 41 GB

Razor you said it ends in 25-27 GB

+1

DOOM Update 5 Only ENG (Remove MP , SnapMap , mega.pages)
Srep+Lzma2 : 34GB
pzlib Only Work DOOM File
base\gameresources.resources
base\gameresources.patch
pZLib+Srep+Lzma2: 30 GB Unpack Crash (I think the lowlead system)

Pzlib V3H works really good!. Very clever to include reflate libs.
pack and unpack without errors.

If i recompress something without std input output, everything works awesomely, amazingly fast, delivers best ratio and most amazingly restoration always works
but whenever the std input output is used with arc, restoration never works it always gonna struck at 0.0%, i don't get a single file on which it works but without std in-out every thing works and yes crc matches always

Tested on Witcher 3, Grand theft auto 5, Skyrim Legendery edition.

Pro Evolution Soccer 2017 with Argentina commentary

Game Size = 5.54 GB
Rpack Size = 3.55 GB

Installation time 8 minutes

pzlib+srep+lzma2

Hi guys !
i hope someone can help me,because im in trouble with pzlib3 hotfix.
I cant decompress the archive using cls_pzlib.dll. It says :

ERROR: archive data corrupted (decompression fails)

The facts :
PZLib 3 hotfix
FreeArc 0.67 (December 12 2012)

@Compression :

Arc.ini :
[External compressor:pzlib]
packcmd = pzlib e - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

Command:
d:\Trashcan\ISDone_Reflate\pack>arc.exe a -mpzlib d:\Trashcan\ISDone_Reflate\pack\1.arc d:\Trashcan\ISDone_Reflate\pack\autotest.tmd
FreeArc 0.67 (December 12 2012) updating archive: d:\Trashcan\ISDone_Reflate\pack\1.arc
Compressed 1 file, 93,613 => 446,170 bytes. Ratio 476.6%
Compression time: real 0.10 secs. Speed 955 kB/s
All OK

@Decompression:

Arc.ini:
[External compressor:pzlib]
unpackcmd = pzlib d - -o - <stdin> <stdout>

Arc.ini and CLS_pzlib.dll are in the decompression folder.

d:\Trashcan\ISDone_Reflate\unpack>unarc x 1.arc
FreeArc 0.67 unpacker. Extracting archive: 1.arc
Extracting Trashcan\ISDone_Reflate\pack\autotest.tmd (93613 bytes)

ERROR: archive data corrupted (decompression fails)

BUT if i remove the CLS and copy pzlib.exe and its DLL's to the decompression folder... It unpacks !

Am i miss something ? :(

Awesome Work Razor 12911!!
 

This pzlib v3 (so is V2) doesn't work with cls pzlib Dll ....not meant to work with , Razor 12911 didn't program it to use cls Dll... ; )

Hey Razor , Thx again for that impressive tool , awesome work adding reflate functionnality for special zlib headers (optionnal Dll) ... wow ,very fast and great compression ratio

.... but main thing is that I can't unpack at all , always give crc checksum error at some point!

I tried on Shadow Warrior 2 bin files . Pzlib could reflate 12.9 to 22 Gb and then applying srep +lzma I could get a nice 8.4 Gb but decomp ( using ASC v0.0065 ) will always get stuck no matter how I do ... (same with pzlib v2)

I tried both V3 and hotfix, with and without optionnal files, I tried
parameters like :
-m2 -x -r9 -t4 (out of 8 threads for my xeon 3440) with optionnal Dlls
-m2 -c128m -t4
-m2 -c32m -st50
.....all giving roughly same ratio but still unpacking errors (ASC just stops decomp but no error)

Then i tried changing Input/Output settings in arc.in
from: - -0 - <stdin> <stdout>
to - $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp (PrinceGupta recommendation)
....still errors at decomp , ASC stops

Then I tried to remove files on which ASC seems to hang... it always hangs on a new file, eventhough those files could be decomp previously (before I start to remove them)

Does this has something to do with ASC ....???

Then I finally tried to change Srep settings playing between m3f/m5f and even adding -hash=md5 crc checksum.... same results, ASC stops.

I am talking about errors because I am pretty sure that if I use inno script it will send me crc checksum error ....this already happenned to me using pzlib v2 with Skyrim SE and MGSV TPP (ASC stops and Inno gives a crc error)

....and I ve just finished DarkSiders Warmastered Edition .... It wasn't decompressing either (-m2 -c400m -t4, seems to be the best setting to catch all zlibs) ....I tried Srep m5f setting and it now decompress ok with ASC ..... awesome!


BIG thk you anyway for this great christmas Gift !!! we have a new toy to play with!!

I had no information about PZlib V3 was not supported. Thanks,but in this case another problem :
ISDONE :

[External compressor:pzlib]
header = 0
packcmd = pzlib e -v - -o - <stdin> <stdout>
unpackcmd = pzlib d - -o - <stdin> <stdout>

pzlib3hotfix.exe ,both dlls and arc.ini included...
error : unsupported compression method pzlib
unarc.dll returned an error code : -2

i dont understand. :(
and where can i get new information about PZlib ? Is this the only place ?

Did you encode using pzlib v3 along with the 2 optionnal Dlls ... if so you need then in decompression folder and you need to add exctraction commands in INNO....

PZLIB+DLLS at comp and decomp ...otherwise it will give you an error!

your arc.ini is ok for decomp, don't change it ; ) ... but -v at comp is from previous pzlib version ...

you need something like that : packcmd = pZLib e -m2 -x -r9 -t4 - -o - <stdin> <stdout> to use pzlib v3 with dlls
-t4 = 4 cores
-x = ultra setting
-r9 = processing level ( from 1 to 9 ; 0 for automatic)

and for unpacking: unpackcmd = pZLib d -t8 - -o - <stdin> <stdout> (it will use up to 8 cores for decomp if available)

So... then it cant be extracted by the ISArcExtract function ? :o

Is the -f worked ?

yes it can be extracted through ISArcExtract.... just add lines in your inno script to extract needed files before isarcextract starts!

eg: ExtractTemporaryFile('pZLib.exe');
ExtractTemporaryFile('raw2hif_dll.dll');
ExtractTemporaryFile('hif2raw_dll.dll');

-f is for fast verification of files, don't use it with -m2 option ; should only be used with -m1 option

Those files are included and extracted after running the "setup.exe" ! Arc.ini too -->

unsupported compression pzlib. :D

It cant decompress the archive :
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\c1.dat'), ExpandConstant('{app}\'), '', false, '', '', ExpandConstant('{app}'), notPCFonFLY {PCFonFLY}) then break;

WTH ?!


Edit :

if not ISExec(0, 0, 0, ExpandConstant('{tmp}\arc.exe'), ExpandConstant('x -o+ -cfg"{tmp}\arc.ini" -w"{app}" -dp"{app}" "{src}\try.arc"'), ExpandConstant('{tmp}'), '...', False) then break;

Extract successul !

But ISArcExtract would be better....

a picture to illustrate crc checksum error in inno ( ASC stops decompression but doesn't give this error)

I had to setup a test inno installer with existing script of mine for Skyrim SE....

it shows install dir for Skyrim SE but files are from Shadow Warrior 2 ...bin files as described in my previous post !

If I recompress "pc_arch_common.bin" alone it works ok at decomp but as soon as I compress several files together (big and small files mixed together with no sorting option in freearc) .... I have this CRC ERROR

I tried both inno and ASC and same results.... this bug might comes from pzlib
and was already present on V2 .... with a few games type of files! (MGSTPP, Skyrim SE and previous versions, also had this bug on DarkSiders 2 files)

I tried on xeon 3440 + 8Gb Ram, and i5 3570 + 16 Gb ram , fully stable machines ....same results

try this:

if not ISArcExtract ( 0, 100, ExpandConstant('{src}\data.bin'), ExpandConstant('{app}'), '', false, '', ExpandConstant('{tmp}\arc.ini'), ExpandConstant('{app}'), False) then break;

unarc.dll returned an error code : -2
error : unsupported compression method pzlib+srep+delta+lzma....

shazzla What game is trying to compress?

crysis 1

Your system is 64 or 32 bits

x64.

but as i wrote before :
I can unpack the archives using isdone with ISExec.

IsArcExtract doesnt work. And i dont know why..... :/

X64 version
You do not need to add anything else
You can open pZLib.exe directly to read its documentation

https://drive.google.com/open?id=0B6...ldRTWxDSW9uQ2c

I hope you understand, if you get CRC error try changing to -m1 or use reflate for some games

everytings clear as it was before. btw thanks ! :)

Thx again To you Razor!
 

OK... I finally succeeded in compressing Shadow Warrior 2 bin files :cool:

after numerous attempts.. I found "THE SETTING" : ) for this game and no more crc checksum error at decomp ....installation is ok in both ASC and INNO

for that used pzlib x86 (instead of x64) v3H, I had to split games files in 4 parts and I had to get rid of -c# setting and apply :
packcmd = pZLib e -m2 -st50p -ct8 -b1024k - -o - <stdin> <stdout>

I had to "sacrify" size (from 8.4Gb to 8.53Gb) but still I am happy with it !!

Thx again Razor for sharing this fantastic tool , I will never forget to give you the credits for it! ...brilliant work :D

Very Thanks razor For V3 .. but I want Help in install wpi
how add pzlip unpack to wpi setup
i make just cause 3 from 54.5gb to 20.4gb by pzlip+msc+serp+lzma
eng & arabic lang - commnt ... and uppack perfect by the attachment cmd
and check md5 files perfect well ..
i want to add pzlip and command lines to wpi setup
i try it but fail not progress with me installing and not progress
please help and happy new year

i try to add pzlib.exe to wpi but when install progress ~ 2% and stop not make any progress please help ... where the problem in unarc.dll or arc.ini or what? ..
i make again repack make it 16.6gb not 20.4gb ... as well unpack by attachment i uploaded it in previous post and not unpack by wpi

try to write so ( pZLib.exe ) in the script :)

also check your arc.ini
post#71 has the following & used x86 version NOT x64 versions.

simple copy / paste into your arc.ini to see if it helps any, try using pZLib instead of pzlib
don't think it matters any but try as suggested.

add raw2hif_dll.dll , hif2raw_dll.dll and pzlib.exe in your script

Not Solve , Thanks For Reply And Help

Thanks Very Much ... Extract Perfect ... Finally

People make yourselves useful. ;)

I was away for 2 weeks and the only thing razor gets is people telling me the program does not work, CRC errors and etc.

I'm not a repacker guys, I'm just a programmer, I create programs for you guys, and the least you guys can do is upload the file that gives pzlib problems, nothing has been uploaded so far. Firstly I'm on capped net your attachments must be small, can't expect me to download some game so that I can figure out the bug myself yet I don't even use pzlib at all, I simply buy games or just keep them "DP" Direct play, I really don't have time for repacking at all, the effort of repacking can easily be converted to buying another hard drive, anyways. What I'm trying to say is, none of my games do raise any CRC errors, and I'm giving you guys a job to fix it.

Now it must be really difficult to figure out which small file can have bugs well it is simple like it is difficult for me to figure out a bug in several gigabytes of data.

For example. PES2017, game is like 6GB. When I first used pzlib v2, it was buggy and gave CRC errors everytime it comes across dt15_win.cpk, but when you use pzlib on that file alone, the error isn't there. pzlib works with chunks and it keeps its chunks constant so what I did was flush the bug out. Firstly, the game is 6.2GB or so, don't really remember. (Game was crap so I deleted it and only kept the buggy part of it)

Ok so from 6.2GB, I know that the problem lies in dt15_win.cpk, so all I did was remove all files that came after that file and kept everything else and I remained with 1.22 GB because everything after dt15_win.cpk was close to 5GB meaning I'm trapping the bug and making it easy to spot, also making it easy for you guys to upload.

From that 1.22 GB, there was dt00_win.cpk, dt10_win.cpk, dt11_win.cpk, dt12_win.cpk, dt13_win.cpk, all those files were 964 MB, now from what I remember, in the past I created dummy file creator, just make dummy files of those files meaning you'll still have 1.22GB but now the data will be compressible for upload for me to investigate. I ran pzlib on the data with the dummy files, since the bug only lies in dt15_win.cpk, the bug was kept which is good because now the bug is even more trapped.

Remember pzlib works with chunk sizes, by default it's 16mb, so to trap the bug even more, you can start by deleting data from position 0 of the data, keep removing 16mb until the bug is gone, I ended up with 16.8mb of data from 964MB, and the bug was gone, I then readded 16mb to make sure the bug is still there so that I can investigate and find out what was wrong, the final size was 32.8 MB. So from 6.2GB worth of data, I ended up with 32.8MB but the bug was maintained, I then figured out what the problem was, fixed via programming and then added a few touches then made pzlib v3 having thought all the bugs were gone but they weren't.

So in short, you guys should do something roughly like this for the bug to be fixed.

Anyways, I uploaded an example. In the attachment. This file is buggy when used in pzlib v2, but it works in v3 because I did have the game that made pzlib to be buggy and fixed it, I don't have game that makes pzlib v3 buggy which is why it is buggy.

I do not understand, the file you uploaded works with both the v2 that with v3, compression and decompression OK

try default settings.

[External compressor:pzlib]
header = 0
packcmd = pZLib e -m2 -t2 - -o - <stdin> <stdout>
unpackcmd = pZLib d -t2 - -o - <stdin> <stdout>

Ok Ok wait...bug found

hmm... you don't say...