pZLib version 2 (Fastest zlib/deflate precompressor)

[Razor12911]

Works on Mad Max, GTAV, DiRT Rally, GRID Autosport and pretty much every game that uses zlib except DOOM.

Benchmarks? Broke my last record of compressing Mad Max in 8 hours and decompressing it in 25 minutes using reflate. pZLib compresses game in 2 hours and decompresses in 19 minutes.

Took me months to create this so do mention Razor if used in your repacks/conversions else just don't use it at all.

Enjoy.

[Razor12911]

Mad Max speed showcase.
pzLib alone reached 70mb/s restoration speed.

[aswadd]

you gave it first to dzrepack team then releasing it here BTW thnx bro :( I got this one 2 days ago :)
I hope you Just release something like the reflate used by dzrepack that you made

[Razor12911]

7 views already in like, 9 minutes and no thanks. Haha, rejoice people. This may be my last project.

@aswadd
this is faster than reflate and delivers the same output.

[aswadd]

7 views already in like, 9 minutes and no thanks. Haha, rejoice people. This may be my last project.

@aswadd
this is faster than reflate and delivers the same output.

Great so why dzteam used reflate instead on this pzlib in pes17 :D

[Razor12911]

Bugs

[aswadd]

what bugs ?
do you mean it doesn't work on pes17 ? so we have to use reflate again

[Razor12911]

No, the program is so inconsistent, it raises CRC errors out of nowhere and when you precompress the game once again, the error is gone, but errors are rare.

[kenzo34]

thank's Razor nice work pefect, your projects are all very useful!
do not stop to amaze us

[Razor12911]

More showcase of Ride 2 and GTAIV Complete Edition

[felice2011]

7 views already in like, 9 minutes and no thanks. Haha, rejoice people. This may be my last project.

lately I have difficulty understanding what you write, let the job is tested to thank.

[Razor12911]

lately I have difficulty understanding what you write, let the job is tested to thank.
I just found it shocking :p, as if people knew I was going to post this.

[felice2011]

I just found it shocking :p, as if people knew I was going to post this.

Personally a some things that you write do not make sense.;)

[Simorq]

Thanks to Razor12911:)

Test
x64q.rpf (2.62GB) reflate+Srep+Lzma (1.14GB)
x64q.rpf (2.62GB) pZLib2+Srep+Lzma (1.14GB)

[Mini]

big thanks!!!

[Simorq]

No Work Act of Aggression - Reboot Edition .dat file

[LuzhinE]

thank you very much

[ChronoCross]

No, the program is so inconsistent, it raises CRC errors out of nowhere and when you precompress the game once again, the error is gone, but errors are rare.
yes, that's the RAM. BTW works really fast.
Offtopic: i don't like to see any "memes" in this forum.

[Chayan Manna]

7 views already in like, 9 minutes and no thanks. Haha, rejoice people. This may be my last project.

@aswadd
this is faster than reflate and delivers the same output.

You are the best. Please don't close your projects. Your projects are the most useful.

[Lucas65]

Thank you very much Razor for pzlib! I tested on this file: x64f.rpf (981mb)

Only Shelwien's reflate in level 4:
Compression:
FreeArc 0.67 (March 15 2014) creating archive: data\datareflate.arc
Compressed 1 file, 1,028,757,504 => 2,304,942,259 bytes. Ratio 224.05%
Compression time: cpu 1.92 sec/real 471.78 sec = 0%. Speed 2.18 mB/s
All OK
Decompression:
FreeArc 0.67 (March 15 2014) extracting archive: datareflate.arc
Extracted 1 file, 2,304,942,259 => 1,028,757,504 bytes. Ratio 224.05%
Extraction time: cpu 6.44 sec/real 205.69 sec = 3%. Speed 5.00 mB/s
All OK

Only pzlib version2:
Compression:
FreeArc 0.67 (March 15 2014) creating archive: data\datapzlib.arc
Compressed 1 file, 1,028,757,504 => 2,226,261,282 bytes. Ratio 216.40%
Compression time: cpu 0.84 sec/real 108.17 sec = 1%. Speed 9.51 mB/s
All OK
Decompression:
FreeArc 0.67 (March 15 2014) extracting archive: datapzlib.arc
Extracted 1 file, 2,226,261,282 => 1,028,757,504 bytes. Ratio 216.40%
Extraction time: cpu 0.92 sec/real 86.33 sec = 1%. Speed 11.92 mB/s
All OK

Reflate maybe find more stream but pzlib much faster!
Thanks again and good work!

[oltjon]

I had problems with file.ttarch2 Telltale Games

does not work

[oltjon]

earn to die 2


C:\Users\oLtJoN\Desktop\reflate_1500>arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate data.arc "pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressing 86 files, 200,374,281 bytes. Processed 54%
Compressing 200,374,281 bytes with reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
Reflate (Free Edition) created by Razor12911
Searching for deflate streams
Splitting streams 91/91
Processing extracted deflate streams
Gathering processed streams
Merging stream 183/183
Removing temporary files

Processed: 44.0 MB/191 MB (23%)
New size: 961 MB instead of 191 MB (503%)

Errorlevel=0
100%

C:\Users\oLtJoN\Desktop\reflate_1500>del /q unpacked\

C:\Users\oLtJoN\Desktop\reflate_1500>arc.exe x -w.\ -dpunpacked\ data.arc
FreeArc 0.67 (March 15 2014) extracting archive: data.arc
Extracting 86 files, 200,374,281 bytes. Processed 0%SSEInv S├ T├ s Extracted 86 files, 1,007,971,708 => 200,374,281 bytes. Ratio 503.04%
Extraction time: cpu 0.73 sec/real 32.87 sec = 2%. Speed 6.10 mB/s
All OK


C:\Users\oLtJoN\Desktop\pZLib_v2>del /q data.arc
Impossibile trovare C:\Users\oLtJoN\Desktop\pZLib_v2\data.arc

C:\Users\oLtJoN\Desktop\pZLib_v2>arc.exe a -ep1 -r -ed -s; -w.\temp -mpzlib data.arc "pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 86 files, 200,374,281 => 577,169,086 bytes. Ratio 288.05%
Compression time: cpu 0.27 sec/real 13.66 sec = 2%. Speed 14.67 mB/s
All OK

C:\Users\oLtJoN\Desktop\pZLib_v2>del /q unpacked\

C:\Users\oLtJoN\Desktop\pZLib_v2>arc.exe x -w.\ -dpunpacked\ data.arc
FreeArc 0.67 (March 15 2014) extracting archive: data.arc
Extracting 86 files, 200,374,281 bytes. Processed 0%SSEInv S├ T├ s Extracted 86 files, 577,169,086 => 200,374,281 bytes. Ratio 288.05%
Extraction time: cpu 0.44 sec/real 6.59 sec = 7%. Speed 30.39 mB/s
All OK

[FitGirl]

Thanks, mate. Will test it and if it's as good as you describe will use it with credits given, ofc.

[FitGirl]

I had problems with file.ttarch2 Telltale Games

does not work
Cause they are encrypted + new games (Batman i.e.) use Oodle, not zlib

[felice2011]

Pzlib_v2 VS ReflateMT...Under-Test *.rpf File:)

Only pzlib_v2


-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 05/11/2016 16:59:09
================================================== ================================================== =========================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

pzlib_v2 981,1°MB 2,07°GB 210,99% 1°File 00:01:07:929 e -m2 -st50p -t8 -ct8 -c32m -b512k -v -o
================================================== ================================================== =========================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Decompressed Archive Completed At -↓- 05/11/2016 17:00:32
================================================== ================================================== =========================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ DECOMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

pzlib_v2 2,07°GB 981,1°MB 47,40% 1°File 00:00:53:81 d -t8 -o
================================================== ================================================== =========================================


Only ReflateMT


-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 05/11/2016 17:10:22
================================================== ================================================== =========================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

reflate 981,1°MB 2,08°GB 212,01% 1°File 00:04:56:956 -process -c9 -t8
================================================== ================================================== =========================================

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Decompressed Archive Completed At -↓- 05/11/2016 17:29:48
================================================== ================================================== =========================================
○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ DECOMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

reflate 2,08°GB 981,1°MB 47,17% 1°File 00:16:08:60 -restore -c9 -t8
================================================== ================================================== =========================================


Excellent compression and decompression speed compared to reflateMT...
I was very pleased, the double embedded option ,"M1 = zlib streams" and "M2 = deflate streams", with the possibility of avoiding the use of "Antiz & Zlib_Jo" for only zlib streams.
As you see here no one does not abandon you, in 7 hours two pages of thanks, of tests and appreciations on yours work.:)
Personally I think it's the best job of zlib...Bravo!!!;)

[Simorq]

Mad Max
Input = 31.9 GB > Pzlib2 = 51.8 GB > Srep = 14 GB > LZMA2 = 9.57 GB

http://uupload.ir/files/2lo5_2016-11-05_211751.jpg

9.57 GB?
http://www.fileforums.com/showpost.php?p=450117&postcount=27

[LuzhinE]

Simorq

all the languages?

[coliotte]

Simorq@




set -c256m


there are big streams and a higher chunk size must be set, but this results in a higher ram usage, 256mb x Threads + 256mb

[Mini]

razor, what think about cls? with her speed will fall?

[coliotte]

razor, what think about cls? with her speed will fall?


According to razor cls is a bad idea because buffer cannot be controlled, pzlib was created to work safe on SSD without damaging them that much with excessive writes.

[LuzhinE]

coliotte

that version did you use to reflate?
PES 2017 DZR
Installation is super fast

[Simorq]

Simorq

all the languages?

No Only EN

[Simorq]

DZ Repack
PES 2017: reflate:m2:l6:t75p:p5:s240+srep+lzma2
Mad Max New Repack (4.2 GB): pzlib+srep+lzma2

[Simorq]

Mad Max
Input = 31.9 GB > Pzlib2 = 51.8 GB > Srep = 14 GB > LZMA2 = 9.57 GB

http://uupload.ir/files/2lo5_2016-11-05_211751.jpg

9.57 GB?
http://www.fileforums.com/showpost.php?p=450117&postcount=27

Mad Max
Input = 31.9 GB > Pzlib2 = 58.8 GB > Srep = 8.65 GB > LZMA2 = 4.27 GB

[External compressor:pzlib]
header = 0
packcmd = pZLib e -m2 -c256m -t8 - -o - <stdin> <stdout>
unpackcmd = pZLib d -t8 - -o - <stdin> <stdout>

http://uupload.ir/files/snzw_2016-11-06_152153.png

Very Good

[AHMED SAMI]

I Test It For Mad Max

From 31 GB To 4.26 GB

Thank You

[LuzhinE]

thank you very much

Simorq

but that version of reflate, PES 2017 is not on the forum, I think it was created to coliotte

[Simorq]

thank you very much

Simorq

but that version of reflate, PES 2017 is not on the forum, I think it was created to coliotte

cls-reflate.dll Level 2

Shelwien's Reflate (http://fileforums.com/showpost.php?p=452175&postcount=1)

[LuzhinE]

if that's the temp folder, I had but not compression parameters

[coliotte]

Why Would You need reflate When You have Pzlib now !

[aswadd]

Why Would You need reflate When You have Pzlib now !

pzlib causes crc errors for pes17 BTW use shelwin reflate (7z & dll file) it works fine for files bigger than 2 GB

[Razor12911]

Thanks, mate. Will test it and if it's as good as you describe will use it with credits given, ofc.

It's not that good, not proud of this, I want more speed while getting same ratio as reflate.

[Amsal]

It's not that good, not proud of this, I want more speed while getting same ratio as reflate.

Hmm then what about gpu usage now? :D

[Razor12911]

An optimized zlib is what is needed, something that CloudFlare uses.

[Razor12911]

-_-

Limit for chunk size people is 2GB, because I don't think there is a deflate stream that is more than 2GB.

Plus chunk size is for detecting streams, someone guy set 1GB chunk size as if there is a game that has a stream that big, how much ram would that need to run the game first of all? The only game that has weird streams is DOOM which is not supported by pZLib v2.

Plus a higher chunk size results in a higher ram usage.

Ram usage is calculated this way approximately.

(Chunk size x Number of scanning threads + ChunkSize) x Inflation ratio

So setting chunk size as 1024m for example using 8 threads and compressing GTAV which inflates to 201%, ram usage will be

(1024 x 8 + 1024) x 2.01 =18524.16 MB, about 18GB ram is needed.

But decompression memory is calculated as

ChunkSize x Inflation ratio

Use ZlibChecker to be sure what chunk size should you really set because chunk size doesn't mean ratio is always better.
http://fileforums.com/showthread.php?t=97657

[aswadd]

@Razor12911 why you are helping us so much like this ?
you make cls / tools / awesome things for free !
do we really deserve ! does thnx enough for you :(

[Grumpy]

@Razor12911 why you are helping us so much like this ?
you make cls / tools / awesome things for free !
do we really deserve ! does thnx enough for you :(

Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

[aswadd]

Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

Lol , but i have a better one I'll send him the great pyramid of Giza to his home Address & don't worry razor you can make him a good home but don't bother the mummy , his room is next to the bathroom :D

[EzzEldin16]

Razor is our master , teacher , mentor
he is an infinte treasure :D

[felice2011]

Razor you can view the process information in the dos window using only Pzlib, do not nothing appears in the latest version during operation.
You can also add a scan of the input file function to quickly detect if the files contain zlib streams or deflate streams or nothing, as the basic function of ZLibChecker.

Example = -qd : quickly detect streams

"pzlib.exe -qd -m1 myfile.ext"

Or

"pzlib.exe -qd -m2 myfile.ext"

Or at least get a result like that as shown in the old pzlib window, only to detect if the files contain streams or not.:D

http://i68.tinypic.com/3483huh.png

that way I think it is very complete, logically if you can and when you have time, I know that these days you're busy with exams ... Thanks

[zouzouni]

Big thank you for this nice piece of coding!

After testing between reflate of yours and this pzlib2, I wonder if this is the unlocked version of your reflate (without the need for -s2000m option in arc) ;)

I get same size (few bytes differences) when using pzlib2 or reflate...

but endeed , compression and decompression is way faster with pzlib2!
no error so far with SkyrimSE, ratio is ... correct...
Thx again Razor!

and ....I already promote your work all around me...you're our Master bro!

[zouzouni]

Big thank you for this nice piece of coding!

After testing between reflate of yours and this pzlib2, I wonder if this is the unlocked version of your reflate (without the need for -s2000m option in arc) ;)

I get same size (few bytes differences) when using pzlib2 or reflate...

but endeed , compression and decompression is way faster with pzlib2!
no error so far with SkyrimSE, ratio is ... correct...
Thx again Razor!

and ....I already promote your work all around me...you're our Master bro!

[ramazan19833]

Help....

pzlib+srep+lzma2



http://i.hizliresim.com/ZY80X0.jpg (http://hizliresim.com/ZY80X0)

[coliotte]

Help....

pzlib+srep+lzma2



http://i.hizliresim.com/ZY80X0.jpg (http://hizliresim.com/ZY80X0)



you could rename [External compressor:7z]

to [External compressor:lzma2]

[ramazan19833]

big thanks!!!

[LuzhinE]

Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

[felice2011]

Help....

pzlib+srep+lzma2

http://i.hizliresim.com/ZY80X0.jpg (http://hizliresim.com/ZY80X0)

you could rename [External compressor:7z]

to [External compressor:lzma2]

Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

@ramazan19833 .... @coliotte ... @LuzhinE ...How can you eat an apple and feel satiated, if in plate the apple there is no ..;)

[aswadd]

Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

Man where is 7z.exe & its dll files !! you Just tell arc to compress using 7z's Lzma2 & basically arc can't find 7z.exe :D

[kenzo34]

hi Razor
possible to update unarc.dll for pzlib v2 please?
perfect unpacking with bat file, but failure on inno setup:
"unarc.dll returned error code 14".

[LuzhinE]

Why Would You need reflate When You have Pzlib now !

coliotte and Simorq

An image says it all

http://i.imgur.com/rmq2SMA.png

any solution coliotte

[ramazan19833]

Help

del /q data.arc
arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate:m2:l6:t75p:p5:s240+srep+lzma2 data.arc "C:\DZ_Games\Pro Evolution Soccer 2017\*"
pause

Eror Srep

http://i.hizliresim.com/A34Evp.jpg (http://hizliresim.com/A34Evp)

[aswadd]

Help

del /q data.arc
arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate:m2:l6:t75p:p5:s240+srep+lzma2 data.arc "C:\DZ_Games\Pro Evolution Soccer 2017\*"
pause

Eror Srep

http://i.hizliresim.com/A34Evp.jpg (http://hizliresim.com/A34Evp)

u're trying to use dzteam reflte parameters :D but you don't have their reflate :D remove the parameters of reflate

[felice2011]

@ramazan19833 ... Choose what you want to use srep.exe or CLS-srep.dll, during the use of the compression, at the same time I do not think get along well.;)

[Simorq]

Attack on Titan Wings of Freedom
LINKDATA Dir Input = 14.8 GB > Pzlib2 = 17.6 GB > Srep = 8.43 > LZMA2 = 3.66 GB

Compressed 10 files, 15,947,914,240 => 3,940,532,496 bytes. Ratio 24.71%
Compression time: cpu 45.03 sec/real 3639.39 sec = 1%. Speed 4.38 mB/s
All OK:D

[LuzhinE]

Someone knows any solution for CRC check

pzlib+srep+lzma2

I also tried with

pzlib+srep+lzma

http://i.imgur.com/RGJTSgZ.png

[Razor12911]

These were the CRC errors I was talking about, sometimes they are there , and sometimes not. Will look for a solution.

[Razor12911]

Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

There you go, would be an interesting sculpture don't you think?

[aswadd]

Wow Razor, but after sculpturing it , I think the Sphinx of Giza will be abandoned place
no one will come to visit it :D except for you ofc

but i don't know , after sculpturing it , it may make some Great Boobs from behind or not :D if he did that I think the Whole Giza will be abandoned place not only the Sphinx

[LuzhinE]

In the new pack of mad max made by coliotte integrates the CRC.

Will be the solution, integrate the CRC?

http://i.imgur.com/b9kvrkR.png

[pakrat2k2]

There you go, would be an interesting sculpture don't you think?

that image is just too funny.

[ChronoCross]

This is very interesting. I have random crash. Sometimes arc.exe and sometime pzlib when i change the default options. Default options detect my cpu and ram for optimal recompression?

[coliotte]

In the new pack of mad max made by coliotte integrates the CRC.

Will be the solution, integrate the CRC?

http://i.imgur.com/b9kvrkR.png

naah i only added That Because IDM keeps damaging the files


.... wait did This repack unpack for you with no problems ?

[LuzhinE]

Not yet compress mad max, I would like you to teach to compress the pes2017

[coliotte]

Not yet compress mad max, I would like you to teach to compress the pes2017

http://2.bp.blogspot.com/_jF4hS9l3o6s/TQI8sqGjLSI/AAAAAAAACfg/1seKZMst5zk/s1600/confusion.jpg

[LuzhinE]

Must be my English is lousy, but I would like you to teach to compress the pes 2017 with reflate, since with pzlib v2 gives error

Also you could be able to have a smaller size for Ryse son of Rome?

[coliotte]

Must be my English is lousy, but I would like you to teach to compress the pes 2017 with reflate, since with pzlib v2 gives error

Also you could be able to have a smaller size for Ryse son of Rome?

Why would you want to use reflate on pes17 when you clearly Could get a batter ratio with precomp

[Amsal]

Why would you want to use reflate on pes17 when you clearly Could get a batter ratio with precomp

Man... They don't have brains, and don't even do a try themself....

[chum]

Nice work Razor. GTA 5 compression/decompression is 100% functional now. The decompression time improved a lot compared to reflate. 100 minutes decompression for the full game 67GB with i7+HDD 7200rpm.

Edited: It was 1h:40min decompression not 140 minutes.

[CAT8K]

hey Razor12911
so Thanks for pZLib
this ver pZLib 64bit i need 32bit some games like Max Payne 3
need windows 32 and sure run in 64 can u put pZLib 32bit?

[Simorq]

Dragons Dogma Dark Arisen + Update3_RePack by SEYTER (pZLib+Srep+Lzma) 6GB

[Simorq]

pZLib can extract files greater than 4GB whether this issue will be fixed Razor1291?

[FitGirl]

Dragons Dogma Dark Arisen + Update3_RePack by SEYTER (pZLib+Srep+Lzma) 6GB
And not a public word about using pZlib, though the author explicitly asked about it. What a shmuck that Seyter is.

[oltjon]

and not only Seyter also dz repack makes repack based on pzlib v2

[Gupta]

and not only Seyter also dz repack makes repack based on pzlib v2

Razor is working with dzrepack

[Amsal]

Razor is working with dzrepack

Lemme correct you, He WAS working with dzrepack.

[Razor12911]

And not a public word about using pZlib, though the author explicitly asked about it. What a shmuck that Seyter is.
some of the reasons i don't release updates or keep things to self, rejoice people...

[FitGirl]

some of the reasons i don't release updates or keep things to self, rejoice people...
Well, not everyone is like him or Corepack, you know :)

[Razor12911]

Well, not everyone is like him or Corepack, you know :)
yea i know, there were probably many friendly iceburgs and then there was this one stubborn iceburg that sank the titanic.

[dixen]

PZLIB+SREP+LZMA
ERROR: Archive structure corrupted (decompression of control block failed)
Waiting for fix:)

[mikey26]

PZLIB+SREP+LZMA

Waiting for fix:)

there is going to be no fix mate.

[dixen]

there is going to be no fix mate.

Hmmmю....Why not?

[mikey26]

Hmmmю....Why not?

cause no1 seems to appreciates his work.once they have what they want you never hear from these so called friends.:mad: .

in this thread how many times can you count guys actually showed what setting worked for them what games they tested ,what other compressors they used in conjuction with pzlib.

all you get is this dont work that dont work fix it.Never anything positive.

[Razor12911]

cause no1 seems to appreciates his work.once they have what they want you never hear from these so called friends.:mad: .

in this thread how many times can you count guys actually showed what setting worked for them what games they tested ,what other compressors they used in conjuction with pzlib.

all you get is this dont work that dont work fix it.Never anything positive.

One word, vultures.
Meanwhile am struggling finding a fix, there isn't a data set uploaded that contains the bug from the users that had problems, let me guess, I have to try all games until I find bug in order to fix it, and let me guess, upload it here...

Already from found me data set that makes pzlib buggy guys so don't bother.

[Gupta]

maybe i m wrong bt i don't think m3 works on any file
tested on Adobe.photoshop.2017.iso , unpacking, process hangs at 1.1%
tested on Gta.V, x64a* to x64h*, after 0.4% of unpacking throws crc error
spend a whole day in compressing gta 5 with it and now its not unpacking

[Razor12911]

m3 is a method that was designed to work with raw2hif_dll.dll, it's disabled for public usage because it wasn't created by me.

[LuzhinE]

Call of Duty Ghosts Spanish All updates are included!

Removed multiplayer

imagefile60.pak
soundfile59.pak
soundfile60.pak
soundfile62.pak

Game size = 25.5 GB
Size of Repack = 19.6 GB
Installation time 60 min

thank you Razor12911

[Razor12911]

Effects of faster verification, -f works best with -m1

[LuzhinE]

Formerly Mad Max, reflate was used to compress the game

Ryse Son Of Rome also use reflate
http://www.fileforums.com/showpost.php?p=447974&postcount=44

I have already tested with pZLib_v2, and final size was 18 GB and gives CRC error when decompressing

Can be compressed to 4.90 GB in future versions of pZLib???

Thank you very much Razor12911

[dixen]

Decompression crc check error - not very good(((

[aswadd]

@Razor ,
Does pzlib uses auto-detect threads if i didn't use -t option ?
I tried on my i3 cpu & it used 50% only when i didn't put -t
so Just to make sure i asks u ..

[aswadd]

Anyone faced a crash "arc.exe has stopped working"
Just edit the settings of pzlib in ur arc.ini like this

packcmd = pzlib e -m1 -t60p $$arcpackedfile$$.tmp -o $$arcdatafile$$.tmp
unpackcmd = pzlib d -t60p - -o - <stdin> <stdout>
datafile = $$arcpackedfile$$.tmp
packedfile = $$arcdatafile$$.tmp

[Razor12911]

Anyone faced a crash "arc.exe has stopped working"
Just edit the settings of pzlib in ur arc.ini like this

dude, its input -o output, not output -o input.
Input should be arcdatafile

autodetect is there but its set to use 50 percent power by default.

[Razor12911]

I already see -t60p set, in order for that to be realistic, you must have a CPU with 25 threads, pzlib will use 15 threads which 60%. If you got 8 threads, pzlib will override your 60% order and opt for 50% because you literary can't use 4 and 8-tenth threads so 8 threads * 60% = 4.8, when this value is rounded off, it's 5. therefore 5/8 = 63%.

[aswadd]

dude, its input -o output, not output -o input.
Input should be arcdatafile

autodetect is there but its set to use 50 percent power by default.

yes dude u're right , but didn't u notice that i reversed it in this section
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

:D still the same

& thnx for the illustration of cpu usage .

[-XCX-]

Can anyone make this please like this

https://postimg.org/image/dr5sjiz7j/

I mean to say. It color creates when you touch install button in WPI Please Help ME Please
Like This


If you don't understand you can download this one please help me
http://fileforums.com/showthread.php?t=98100

THanks In Advance

[unarc 125]

I used plzlib on bf3 data files compression goes well but while decompression I got this terrible smile faces in CMD and then I tried again then I got CRC error where is the problem??
I used method -m1 -f and others default.

Edit----------------------------++++++++++

Others getting this error too bug ok but what is this horrible faces in CMD looks to weird.

[aswadd]

@unarc 125
- what u see in arc is a bug in arc itself it often happen to me , too . all u have to do is reboot ur windows \ move the data archive \ rename it and sometimes leave it for some time then this error will disappear :D but u don't have to delete the archive file & make it again

- for bf3 cas files .. better no to use any pre-compressor the difference will only around 50~100 mb so it's better with srep+lzma

[aswadd]

@unarc 125
i forgot to tell u something ; I faced many times arc errors & corrupt archives in my windows 7 , this problem disappeared in my windows 8.1 . i don't know why :D but seems w8.1 is an arc friendly .

[Simorq]

Batman Arkham Knight 52.0 GB TO 31.0 GB Pzlib+Srep+Lzma2:D
Unpacking, Process Hangs at 1.6% :(
http://uupload.ir/files/njo2_c.png
http://uupload.ir/files/qczd_d.png

[Razor12911]

Batman Arkham Knight 52.0 GB TO 31.0 GB Pzlib+Srep+Lzma2:D
Unpacking, Process Hangs at 1.6% :(
http://uupload.ir/files/njo2_c.png
http://uupload.ir/files/qczd_d.png
Good, try uploading a data set from that game that make pzlib buggy.

[Mini]

.tfc - no problem
.upk = Process Hangs

[Razor12911]

I don't have this game so telling me that upk has problems isn't going to fix the bug.

[Mini]

18 gigabytes of .upk
it is unknown on what bug

[LuzhinE]

Sniper Elite 3 Spanish

Repack size: 11.5 GB

Installation time: 11 min

[ImmortalArc]

Help me people with few question......

1. What's the difference between pzlib plz4 and reflate why in some games pzlib can't find good zlib streams as reflate.
2. I used lzma it consumes my 90% of my CPU power but when I extract it it caused me 90% copy uses again but when I used lzma 4x4 or causes 100% cpu with good results speed when I extracted it it causes me only 50% cpu uses why??
3. How to extract password protected archive without password which I don't know. Compressed with freearc
4. How to decompress data without using to much memory and CPU I want to keep memory usage about 1-2 g and 50%of cpu usage lc and id dirty up the compression.
5 what is Delta is it good to use?
6. It's the any latest version of srep. Is there any latest version of lzma and it's there any best alternative of lzma with good things.

[LuzhinE]

Simorq

Try using cls-srep.dll to decompress using unpack

[FitGirl]

1. plz4 searches for lz4 streams, while pzlib/reflate -for deflate/zlib streams. reflate has better detector, than public pzlib. private pzlib probably have the same detection ratio as reflate

2. Because compression is heavier in LZMA. 4x4 utilize FOUR LZMA (de)compressors at the same time, but hurt compression ratio, cause compressed data is divided by blocks

3. You can't

4. Use lower dictionary settings for LZMA/srep

5. For certain types of data, it's not recommended by default

6. srep wasn't updated for years. There are better algos than LZMA in terms of general compression or compression ratio, but it's universal

[artag]

Question:

how to set threads if i have a 4 core cpu?

pzlib:m1:st4:ct4:t4 or pzlib:m1:st1:ct1:t2
or just pzlib:m1:t4

Thanks Razor!

[Amsal]

Question:

how to set threads if i have a 4 core cpu?

pzlib:m1:st4:ct4:t4 or pzlib:m1:st1:ct1:t2
or just pzlib:m1:t4

Thanks Razor!

pzlib:m1:t4
This automatically set st and ct as 4 also.

[artag]

pzlib:m1:t4
This automatically set st and ct as 4 also.

mmm, does that means that both process are happening at the same time on the 4 cores? Is not that slow?

since i have a 4 core procesor should i set st2/ct2 to make it faster or that is just nonsense?

thanks!

(i haven't tested yet pzlib, that's why i'm asking how to make it work as fast
as possible)

[artag]

one more thing: i was testing it and it was unable to depack the files from Castlevania lord of shadows 2.
I tested without any piping on compression and decompression and it stucks on one of the
files of the game:
Data00.packed
I used pzlib:m1:t4 for compression

[Gupta]

one more thing: i was testing it...

pzlib:m1:t4

this will only work if ur arc.ini settings are like this
packcmd = bin\pzlib e {option} - -o - <stdin> <stdout>

i recommend for using this version instead
http://fileforums.com/showthread.php?t=98672

[Prince4]

**QUOTE**

So yeah fixes??

Error: Stream Read Error

in both Inno and .bat (cmd)

Any help i was repacking Tomb Raider : Underworld, but i had to use precomp :(

[ImmortalArc]

1. plz4 searches for lz4 streams, while pzlib/reflate -for deflate/zlib streams. reflate has better detector, than public pzlib. private pzlib probably have the same detection ratio as reflate

2. Because compression is heavier in LZMA. 4x4 utilize FOUR LZMA (de)compressors at the same time, but hurt compression ratio, cause compressed data is divided by blocks

3. You can't

4. Use lower dictionary settings for LZMA/srep

5. For certain types of data, it's not recommended by default

6. srep wasn't updated for years. There are better algos than LZMA in terms of general compression or compression ratio, but it's universal
Thanks
How do you know that you should rebuild archive and how you do that how you open them.
Can you tell which algo is better than lzma which you are using now??