FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Is SRep 3.93A Incompatible with pZLib v3? (https://fileforums.com/showthread.php?t=104475)

Prince4 03-06-2021 11:42

Is SRep 3.93A Incompatible with pZLib v3?
 
I compressed all of my modded games (Work of Several Years :eek:) in to archives because i needed to focus on work and Studies and also wanted some time off.


But the main problem is that now that i want to get back i need to decompress those archives but i'm encountering a Huge problem most of the pZLib+SRep'ed archives are failing at SRep decompression :mad: :


https://i.imgur.com/fAoikz1.jpg


I'm sure it's not the data corruption, because i have other archives in size of 50 Gigs all just comped with SRep+LZMA and they extract just fine, but most of the pZLib'ed files fail at SRep decompression. By most i mean archives that are bigger than 3+ GB, because i only have a file that is 1.6 Gigs and it De-Comped just fine.


This is the command i used to Compress files with pZlib :


Code:

Arc_sep14.exe a -ep1 --dirs -r --archive-comment="%comment%" --workdir=..\_Out\$$work_dir$$\ -mpzlib+srep+lzma:a1:mfbt4:d256m:fb128:mc2000 "..\_Out\Setup-pZ+S+L%1.Rpk" "%dir%\*"
This is the Decompression Command :


Code:

Arc_sep14.exe x -ad "Dir\Setup-3-pZ+S+L.Rpk" -w..\_Out\$$_WorkDir_$$\  -cfg..\Compers\Arc.ini -mpzlib+srep+delta+lzma:a1:mfbt4:d256m:fb128:mc2000
Here's Arc.ini :


Code:

[External compressor:pzlib]
header    = 0
packcmd  = pZLib64 e -m2 -t4 -st4 -ct4 $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp
unpackcmd = pZLib64 d -t50p $$arcpackedfile$$.tmp -o $$arcdatafile$$.tmp

[External compressor:precomp]
header = 0
packcmd  = precomp64 -brute -o$$arcpackedfile$$.tmp  $$arcdatafile$$.tmp
unpackcmd = precomp64 -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:srep]
header = 0
packcmd  = srep64 -m5f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep64 -d -s $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Please if there's anything more that i can put here for info then please let me know, this is years worth of modding data i'm talking about. I really can't afford to lose it. :(

Masquerade 03-06-2021 11:54

Try using cls-srep instead of srep.exe for decompressor.

shazzla 03-06-2021 22:07

Its compatible.
The author of SREP said in a post somewhere,its a bug.
The compressed data is good,but some additional parameter required to decompress in this case...
Sadly i cant say any other thing.

Maybe try add -a0 @ compression and do not touch the computer during SREP.
Its strange ,but for me helped many times.

Prince4 04-06-2021 03:24

Quote:

Originally Posted by Masquerade (Post 492567)
Try using cls-srep instead of srep.exe for decompressor.


I tried one by ProFrager (0.3.3.3) and it also crashes.


Tried this https://www.fileforums.com/showthrea...light=cls-srep but it's giving me this error :( :


https://i.imgur.com/QXP6O91.jpg

Prince4 04-06-2021 05:21

Quote:

Originally Posted by shazzla (Post 492570)
Its compatible.
Maybe try add -a0 @ compression and do not touch the computer during SREP.
Its strange ,but for me helped many times.


Tried Adding that, result is the same. :(

shazzla 04-06-2021 06:12

Another trick,but decreases final compression ratio:
In -m chain ,add (for example) rep:128m :)

-mrep:128m+srep:a8:m5f.....

Rep:128m or rep:128mb i dont remember...:)

Edit: AFAIR rep is internal,no arc.ini required. Its a defined range dedup algo or whatever:)

Prince4 04-06-2021 10:59

Quote:

Originally Posted by shazzla (Post 492577)
Another trick,but decreases final compression ratio:

Wait, is this for Compressing Files? I need to Decompress the data dude.

shazzla 04-06-2021 11:12

Yes ,its for compression. Just to avoid future problems (maybe).

At decompression : as i said ,some additional parameter required to bypass this checksum error.
As the author of SREP said somewhere in a post,the compressed data IS NOT CORRUPTED. Its a bug in SREP.
If i remember correctly,this parameter is some kind of 'ignore crc'...

Edit :

Maybe its :

-hash-

Just add it to your arc.ini/srep section...
Give it a shot or i dont know....

Prince4 05-06-2021 02:30

Quote:

Originally Posted by shazzla (Post 492585)
Its : -hash-

Just add it to your arc.ini/srep section...


OMG, thank you so much Shazzla, it fookin worked. :D

Prince4 05-06-2021 05:12

Quote:

Originally Posted by shazzla (Post 492585)
....


Wait, Shazzla, now i'm getting another Error. This time by FreeArc it self :
https://imgur.com/g6hVhMT.jpg


It worked on files that are small in sizes (1-3) GBs but it's giving me this and this error :


https://imgur.com/g6hVhMT
Code:

ERROR: CRC failed in "Setup-2-pZ+S+L\Content\SeriousSam2017\_addons\_Weapons\the_ultimate_weapon_resource_pack_resource\zz1088316016.gro". File is broken.

On files that are bigger (5-15) GBs. Please don't tell me my data is corrupted :(

shazzla 05-06-2021 05:48

Sadly i have no idea....

Thats why i did unpack/install tests after a conversion...

:( Sad8669 05-06-2021 12:30

Try using an installer script or a different unarc.dll

In my case, it helped me overcome CRC error.

ffmla 05-06-2021 21:07

You may try @ :( Sad8669 advice.
As for freearc,it have some commands
try the following in your decompression chain.
Code:

-baMODE      --BrokenArchive=MODE        deal with badly broken archive using MODE

-kb          --keepbroken                keep broken extracted files


Prince4 06-06-2021 01:31

Quote:

Originally Posted by :( Sad8669 (Post 492617)
Try using an installer script or a different unarc.dll
In my case, it helped me overcome CRC error.


I did try but i don't know why, neither CLS-SRep nor the executable itself are working, the installer just get stuck at specific file size which i believe is that SRep error that i began with, even tho i have -hash-in the Arc.ini of the Installer. Also can you link me the Newest UnArc.dll? Can't seem to find it, all i have is the stuff from 2015 and so. Thanks tho.

Prince4 06-06-2021 02:54

Quote:

Originally Posted by ffmla (Post 492622)
...


Tried Both -kb and -baM didn't work, -kb still gives CRC Error after Srep->pZLib->Zip-Error


-baM Says the Archive isn't a FreeArc one. :(

:( Sad8669 06-06-2021 03:42

If you have a small sample of your data files, i can run some tests in my PC.

Must be in MB's.

I know small files decompresses properly, but still there may be a slight chance.

Prince4 06-06-2021 05:12

Quote:

Originally Posted by :( Sad8669 (Post 492629)
...



Here's a 65 MB File, that is OK.


https://mega.nz/file/ZPgUVLga#hZNaAJ...apGTErG2-olD90

:( Sad8669 06-06-2021 07:53

1 Attachment(s)
Put your data files in this folder "Test" and edit unpack.bat to match your data files with it.

If any error occurs, please report back.

Prince4 06-06-2021 11:34

Quote:

Originally Posted by :( Sad8669 (Post 492633)
If any error occurs, please report back.


1st Time SRep gave that same error so i added "-hash-" and it worked.
Now pZlib is stuck like this Only consuming 43MB Ram and a 3Mb $arctempfile$ :(



https://i.imgur.com/15yxe8P.jpg

Prince4 06-06-2021 12:26

Quote:

Originally Posted by :( Sad8669 (Post 492633)
If any error occurs, please report back.


So another thing is that i killed the executables that were running via Task Manager and managed to Copy pzlib executable to the temp dir but it was still stuck there. Then i copied the temp file and gave it a go with pzlib again and pzlib then decompressed the file without any error, but the output file is still corrupt even tho it's the right size. I tried opening with all the programs 7z, Rar, FArc but all of them said it's corrupted so i think it's SRep is what is giving me the issue. Because i force it to not check the CRC with -hash- and it probably outputs a broken file but i don't know how pzlib still completely decompresses it. :confused:

:( Sad8669 06-06-2021 12:33

Copying the executable to temp directory won't do any good.

Try using a different version of PZLib, since i am short on samples i can't figure out the problem with those bigger archives.

Plus, compare the results of my Test.rar vs your old way of decompressing, i want to know if there is any progress.

And don't get the wrong idea, i am not too good but i think this problem can be dealt with as long as the archives aren't corrupt.

Prince4 06-06-2021 22:30

Quote:

Originally Posted by :( Sad8669 (Post 492641)
....


Can you make me a installer, which has SRep and PZlib extraction in it? My installer is really bugged atm, and doesn't seem to function properly. I'll see if there's anything else that i can do.

:( Sad8669 06-06-2021 23:09

Sure, but lemme know how many data files you got there.

List them or take a screenshot.

shazzla 06-06-2021 23:46

A little information about SREP's checksum error:

https://krinkels.org/threads/oshibka...16/#post-23908

Use google translate!

Prince4 08-06-2021 04:08

Quote:

Originally Posted by :( Sad8669 (Post 492652)
....


You can just make a installer with ISDone that reads a "Setup-1.rpk" file. Please.

:( Sad8669 08-06-2021 07:51

Yeah, i will hook you up with the setup once and i get some free time.

:( Sad8669 09-06-2021 08:57

Okay, so here is the installer. A few points noted.

. Older pZLibv3 would make the installer crash.
. CLS-SREP.dll is used because older one's were giving error.
. I made the installer so it recognises "Setup-1.rpk".
. WPI by Razor12911 and Modified by bunti_04u Used.

Here is the link.

CLS-SREP.dll (86 KB).
pZLib.exe (1990 KB).

Code:

[External compressor:pzlib]
header = 0
unpackcmd = pzlib d -t4 - -o - <stdin> <stdout>

Please report back, if you find any errors.

biotec2k8 09-06-2021 15:17

Pzlib ... I don't have a PzLib on my FreeArc. I'm still missing that.

Would someone please be so kind as to post the Arc.ini entry to compress and decompress?

:( Sad8669 09-06-2021 21:31

pZLib isn't used anymoe, we have better precompressors now such as XTool, OodleRec etc
Thanks to Razor12911.

Prince4 10-06-2021 01:07

Quote:

Originally Posted by :( Sad8669 (Post 492816)
Okay, so here is the installer.
Please report back, if you find any errors.

So it's still giving me CRC Error -12 :(


Now the only thing i can think of is could be be the windows? Because back in 2015 i did a BattleField 4 Repack with Precomp+Srep i compressed and compiled the setup on Windows 8 i guess, and when installing on Windows 10 the setup was failing Precomp decompression but was working on Windows 7. I double checked that. So the last thing i can think of is that. I'll see if can Dual Boot Windows 10 for this, and let you know if there's success.


Thank you so much for your time tho, i really appreciate it.

:( Sad8669 10-06-2021 02:33

That's unfortunate, i prepared the installer based on the sample you sent me, so that's the best i can do on my side. One thing, try installing the sample you sent me with this setup, if it decompresses fine then it's okay, but if it doesn't it has to be some Windows related problem, though i doubt it.

Side Notes : Gamer_2077, if by any chance you are reading this, i still have your problem in mind, it might take a while since i can't spare much time to computer nowadays.

Prince4 10-06-2021 03:36

Quote:

Originally Posted by :( Sad8669 (Post 492826)
One thing, try installing the sample you sent me with this setup, if it decompresses fine then it's okay, but if it doesn't it has to be some Windows related problem, though i doubt it.

Well the sample and the 1-2 Gigs file are decompressing just fine. That means SRep probably fucked up the bigger files. Hope i get them decompressed one day. :|

Prince4 30-10-2022 09:37

I forgot to update my finding here, but I managed to get my data back. All I needed was to use SRep 3.91B because I using 3.93A for decompressioin, I don't remember if I compressed my data with the newer one but the older version seemed to work without any problems. :)


All times are GMT -7. The time now is 04:40.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com