FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   pZLib v3 (Final release) (https://fileforums.com/showthread.php?t=98672)

felice2011 05-01-2017 15:58

pzlibV2

pzlib e -m3 -st50p -t8 -ct8 -c16m -b64k ( OK Comp ... OK Decomp )

pzlib e -m2 -st50p -t8 -ct8 -c16m -b64k ( OK Comp ... Decomp = infinite loop, remains so... )

https://i.imgsafe.org/edd13bfc4f.png

Razor12911 05-01-2017 16:05

Hehe, -t# controls -st# and -ct#, if you set -t7, st and ct become -st7 and -ct7 automatically. Anyways, it's not an infinite loop. pzlib keeps giving freearc incomplete data or rather damaged data, Freearc wants 32.8MB and pzlib keeps giving it 31.9MB, just for that, Freearc keeps calling pzlib, just check process hacker or task manager, you'll see pzlib is run and terminated over and over again, and when you check output directory, output is there but it keeps increasing endlessly, if there was a file after that dt15_win.cpk, you'll get CRC, but since it's just one file, CRC error is not called which happens to look like an endless loop.

m2 and m3 chunk data differently which is why m3 works and m2 doesn't, however with m3 working, it doesn't mean the problem is solved, m3 has problems of its own.

felice2011 05-01-2017 16:15

woo if I cancel the infinite loop the file becomes more than 1GB...:D
OK then return to the starting point...:rolleyes:
Set in default ini ... we see

[External compressorzlib]
header = 0
packcmd = pZLib e -m2 -t2 - -o - <stdin> <stdout>
unpackcmd = pZLib d -t2 - -o - <stdin> <stdout>

Result.

https://i.imgsafe.org/ee303460b5.png

"dt15_win.cpk" will be your nightmare tonight...:rolleyes::o

Razor12911 05-01-2017 16:31

Not really my nightmare mate, I don't use program plus bug is fixed in pzlib v3, but some bugs are still there, dt15_win.cpk is just a demonstration of what I had to do to fix the bug caused by it, you guys should do other ones, should be easy enough.

http://fileforums.com/showpost.php?p...3&postcount=77

Sebazz 06-01-2017 04:00

Hi. I try to repack gta v version 1.36, and my question is what is the best method shelwien reflate or pzlib v3? And the recommended parameters ? Thanks

ZAZA4EVER 06-01-2017 17:32

not Use Reflate Level
R6 ... pack output very big size and load on your hdd
R9 ... Has Problems in unpack

Razor12911 07-01-2017 06:22

Quote:

Originally Posted by ZAZA4EVER (Post 455061)
not Use Reflate Level
R6 ... pack output very big size and load on your hdd
R9 ... Has Problems in unpack

this is false.

ImmortalArc 19-01-2017 02:11

1.Best way to compress bf3 game I am ending with 9.30 gb while other people's doing it in 8.80 gb how????
2.what is the best thing after precompsiom of a file like lzma but I want more ratio good. Is there any other??? Is lzma2 is good??
3.how to rebuild games archives for better results?? Like fitgirl?

-XCX- 19-01-2017 03:20

Quote:

Originally Posted by ImmortalArc (Post 455308)
1.Best way to compress bf3 game I am ending with 9.30 gb while other people's doing it in 8.80 gb how????
2.what is the best thing after precompsiom of a file like lzma but I want more ratio good. Is there any other??? Is lzma2 is good??
3.how to rebuild games archives for better results?? Like fitgirl?

Extract the files of bf3 and reimport them then compress them with srep+lzma you may get the good ratio

ImmortalArc 19-01-2017 03:49

Quote:

Originally Posted by -XCX- (Post 455311)
Extract the files of bf3 and reimport them then compress them with srep+lzma you may get the good ratio

What I see in the mechanics temp folder is precomp zlib1 files and they are reaching 8.80gb
If I pzlibv3+srep+lzma then I getting 7.5 gb only in cas.cas files update is 232 mb and 1.47 gb of win32folder And other files 150 mb I am having problems In en.sb ru.sb files???

doofoo24 25-01-2017 07:17

question for razor about constant speed lzma
 
great tool and great precompmt
i have a question is there a way to get constant speed in decompression when using mpzlib+srep+lzma:a1:mfbt4:d185m:fb273:mc10000:lc8.
i montor the disk usage is about 20 mb/s is there a better way to get 50 or 60 mb/s with the built in lzma not using fastzip or external xz.
i used 4x4:lzma work great it decompress gta 5 in 29 min using I7 6700K 4.7GHZ ON HDD WD BLACK but 4x4:lzma use half of cpu and i limit pzlib to 50%,
i disabled hyper threading to see how it work on I5 and agian try on 2 core 4 thread to see the different...
i try to use zstd with pzlib but i found the raito not great compare to lzma or 4x4:lzma...
so agian is there a middle ground improve lzma speed without using 4x4 only lzma.
thank

editing message
no need to answer i already found it.
i wish you best of luck in your study
yours truly

Razor12911 26-01-2017 15:10

If you're experiencing crc errors with pZLib. Send me a private message in attempt to fix it via Team Viewer.

rinaldo 26-01-2017 15:34

razor precomp046 It was released by schneider, if you .. you can use with pzlib

Razor12911 26-01-2017 15:39

Quote:

Originally Posted by rinaldo (Post 455500)
razor precomp046 It was released by schneider, if you .. you can use with pzlib

Why would I want to use it with pzlib? :confused:

rinaldo 26-01-2017 15:43

Quote:

Originally Posted by Razor12911 (Post 455501)
Why would I want to use it with pzlib? :confused:

because it is not possible :confused:

Razor12911 26-01-2017 15:47

Quote:

Originally Posted by rinaldo (Post 455502)
because it is not possible :confused:

Well pzlib was created as an alternate of precomp. It's not really innovative to create an alternative while still indirectly using the old product, it's hustling backwards.

http://krinkels.org/threads/pzlib_v3...33/#post-29919

Just look at the times yourself.

doofoo24 26-01-2017 21:38

precomp 0.46 ?
i thought precomp 0.46 still in development still needed work like remove temp file which make <stdin> <stdout> work ?
i check on github but nothing only 0.44 and 0.45

doofoo24 26-01-2017 21:49

just a tip after using pzlib+srep+lzma if decompress hang or give an crc try to reinstall visual studio all ver form 2008 to 2015 and see other program use it like intel management engine interface ?
and see in windows features remote differential compression if enable or disable ?
most of the time 8/10 pzlib work like charm.
another way try to use cls-precompmt only with 0.45 ver i didn't encounter any error...

rinaldo 27-01-2017 01:46

Quote:

doofoo24
8 to 10 no good :eek:
Quote:

Razor12911
thanks! very good wok

doofoo24 27-01-2017 01:50

i said 8/10 it mean 80% with m2 i did't try m1
the setting

[External compressor:pzlib]
header = 0
packcmd = pZLib e -m2 -c16m -b256k -t1 - -o - <stdin> <stdout>

agian great tool
thank's razor

Mini 30-01-2017 09:49

Dishonored 2 http://www28.zippyshare.com/v/2OssNi5I/file.html
dont work with pZLib e -m2 -t8 -x -s -r9 - -o - <stdin> <stdout>

reflate work good:(
Razor, any help?

Nizar3003 04-02-2017 16:38

sometimes one or two games could not use pzlib, I tried extract no man sky and could not but other game work fine.

Dansoft 07-02-2017 10:25

PLEASE ANYONE. Can someone please help create for me a compressor having pzlib+srep+lzma or something better? please

felice2011 07-02-2017 10:37

Quote:

Originally Posted by Dansoft (Post 455827)
PLEASE ANYONE. Can someone please help create for me a compressor having pzlib+srep+lzma or something better? please

If you do a search in forum, you don't need no help;)

rinaldo 07-02-2017 12:47

1 Attachment(s)
:rolleyes:

rinaldo 08-02-2017 11:08

1 Attachment(s)
Quote:

Originally Posted by rinaldo (Post 455830)
:rolleyes:

x unpacked

Dansoft 10-02-2017 00:06

Quote:

Originally Posted by felice2011 (Post 455828)
If you do a search in forum, you don't need no help;)

ive tried, could you point me somewhere?

felice2011 10-02-2017 00:51

Quote:

Originally Posted by Dansoft (Post 455827)
PLEASE ANYONE. Can someone please help create for me a compressor having pzlib+srep+lzma or something better? please

Quote:

Originally Posted by felice2011 (Post 455828)
If you do a search in forum, you don't need no help;)

Quote:

Originally Posted by Dansoft (Post 455878)
ive tried, could you point me somewhere?

:eek:

Rinaldo has posted a compressor for your request...:cool:

Here you find another more complete...http://fileforums.com/showthread.php?t=97611

Here you find another more complete of the M&S Kompressor http://fileforums.com/showthread.php?t=98709

But if you want a complete index just go here..http://www.fileforums.com/showthread.php?t=96782....;)

Dansoft 15-02-2017 07:28

Quote:

Originally Posted by rinaldo (Post 455830)
:rolleyes:

while compressing, it just closes. have no idea why

doofoo24 15-02-2017 14:14

on windows 8.1 when i try to use 4x4:lzma with pzlib+srep i get this error many time ?
on windows 10 work great...
any idea...
thank for help
:confused:

TWOELV 16-02-2017 21:21

is pzlib better than the masked data compressor ?

rinaldo 17-02-2017 00:59

Quote:

Originally Posted by TWOELV (Post 456045)
is pzlib better than the masked data compressor ?

no

Chayan Manna 28-02-2017 08:09

Best of best !!!!!!!
 
Realy the best. It is Very fast but same ratio as reflate, most of times better than reflate.
I Used it in "Crysis 2 Maximum Edition" and got better ratio than reflate without any CRC error.
Where Precomp failed and reflate gave CRC error.
Compressed it From 9.19 GB to 6.66 GB with pzlib+srep+delta+lzma.
with reflate decompression time = 32 mins (but at94.7% CRC Check failed)
with pzlibv3 decompression time = 13 mins
Other Precompressor makers must learn from you.
All your projects are best and most usefull.
Keep up the good work.

doofoo24 28-02-2017 10:48

Pzlib v3 does not work on cod black ops 3 / infinite warfare / modern warfare remastered ???
i tried plz4 it work but not the same ratio that i see on the internet some mange to get more ratio ?

Gupta 28-02-2017 21:02

>>Pzlib v3 does not work on cod black ops 3 / infinite warfare / modern warfare remastered ???

because they got lz4 and pzlib is for deflate

>>i tried plz4 it work but not the same ratio that i see on the internet some mange to get more ratio ?
fuc* of* videos
reduce their quailities

doofoo24 04-03-2017 18:19

Quote:

Originally Posted by PrinceGupta2000 (Post 456489)
>>Pzlib v3 does not work on cod black ops 3 / infinite warfare / modern warfare remastered ???

because they got lz4 and pzlib is for deflate

>>i tried plz4 it work but not the same ratio that i see on the internet some mange to get more ratio ?
fuc* of* videos
reduce their quailities

it seems that fitgirl use modified cls-precomp with code of lz4 and use xdelta3....
there is no difference in between this repack and my steam version of cod infinite warfare...

Gupta 04-03-2017 18:30

>> it seems that fitgirl use modified cls-precomp with code of lz4 and use xdelta3....'
May be he made a universal cls for freearc may be working same as Razor's precompMt

doofoo24 04-03-2017 19:19

LZ4io.c - LZ4 File/Stream Interface
https://github.com/mldbai/mldb/blob/...xt/lz4/lz4io.c

MCWRX 05-03-2017 10:02

Hey there. First, thanks Razor for pZlib.

I compressed Mad Max, and when I install it my CPU kinda gets fully loaded for some seconds and setup progress goes on, then CPU load is between 0-1% and setup progress just freezes, and so on. So, I am getting a very bad decompression time. How can I cure this?

COPyCAT 06-03-2017 23:02

2 Attachment(s)
Quote:

Originally Posted by zouzouni (Post 454871)
This pzlib v3 (so is V2) doesn't work with cls pzlib Dll ....not meant to work with , Razor 12911 didn't program it to use cls Dll... ; )

Hey Razor , Thx again for that impressive tool , awesome work adding reflate functionnality for special zlib headers (optionnal Dll) ... wow ,very fast and great compression ratio

.... but main thing is that I can't unpack at all , always give crc checksum error at some point!

I tried on Shadow Warrior 2 bin files . Pzlib could reflate 12.9 to 22 Gb and then applying srep +lzma I could get a nice 8.4 Gb but decomp ( using ASC v0.0065 ) will always get stuck no matter how I do ... (same with pzlib v2)

I tried both V3 and hotfix, with and without optionnal files, I tried
parameters like :
-m2 -x -r9 -t4 (out of 8 threads for my xeon 3440) with optionnal Dlls
-m2 -c128m -t4
-m2 -c32m -st50
.....all giving roughly same ratio but still unpacking errors (ASC just stops decomp but no error)

Then i tried changing Input/Output settings in arc.in
from: - -0 - <stdin> <stdout>
to - $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp (PrinceGupta recommendation)
....still errors at decomp , ASC stops

Then I tried to remove files on which ASC seems to hang... it always hangs on a new file, eventhough those files could be decomp previously (before I start to remove them)

Does this has something to do with ASC ....???

Then I finally tried to change Srep settings playing between m3f/m5f and even adding -hash=md5 crc checksum.... same results, ASC stops.

I am talking about errors because I am pretty sure that if I use inno script it will send me crc checksum error ....this already happenned to me using pzlib v2 with Skyrim SE and MGSV TPP (ASC stops and Inno gives a crc error)

....and I ve just finished DarkSiders Warmastered Edition .... It wasn't decompressing either (-m2 -c400m -t4, seems to be the best setting to catch all zlibs) ....I tried Srep m5f setting and it now decompress ok with ASC ..... awesome!


BIG thk you anyway for this great christmas Gift !!! we have a new toy to play with!!

@zouzouni, Shadow Warrior 2 has UNIQUE special stream on 1 BiG file, wherebout 6 GB single file (pc_arch_common.bin). Those reflate method will not passed the unique special stream and result in error while decompressing. Located wherebout 45% of file streams, try to use batch command reflate & combine with precomp (if precomp fail, then that's the unique stream) to see the address of exact location.

By the way, pZlib v3 was AWESOME!!! Thanks A Lot [RAZOR12911]
Working great on MAD MAX. It gives 12.95% compression ratio and 30 minutes of installation with no checksum error.
OS: Win7 SP1 x64
Pro: AMD FX-8370 (8-core) 4.01 GHz
RAM: 16 GB
HDD: TOSHIBA 500 GB (7200 RPM)
Compresstion time took: 10 hours 27 minutes
Restoration time took: 30 minutes
Condition: game running smooth
Attachment 17614
Attachment 17613
Thank Q. [Razor12911] for Your Time craft/forging the pZlib3 Compressor. for all of us @this forum. SALUTE :) & God Bless You.


All times are GMT -7. The time now is 13:34.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com