FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   pZLib version 2 (Fastest zlib/deflate precompressor) (https://fileforums.com/showthread.php?t=98486)

Razor12911 06-11-2016 22:59

Quote:

Originally Posted by FitGirl (Post 453565)
Thanks, mate. Will test it and if it's as good as you describe will use it with credits given, ofc.

It's not that good, not proud of this, I want more speed while getting same ratio as reflate.

Amsal 07-11-2016 00:25

Quote:

Originally Posted by Razor12911 (Post 453640)
It's not that good, not proud of this, I want more speed while getting same ratio as reflate.

Hmm then what about gpu usage now? :D

Razor12911 07-11-2016 00:32

An optimized zlib is what is needed, something that CloudFlare uses.

Razor12911 07-11-2016 01:53

-_-

Limit for chunk size people is 2GB, because I don't think there is a deflate stream that is more than 2GB.

Plus chunk size is for detecting streams, someone guy set 1GB chunk size as if there is a game that has a stream that big, how much ram would that need to run the game first of all? The only game that has weird streams is DOOM which is not supported by pZLib v2.

Plus a higher chunk size results in a higher ram usage.

Ram usage is calculated this way approximately.

(Chunk size x Number of scanning threads + ChunkSize) x Inflation ratio

So setting chunk size as 1024m for example using 8 threads and compressing GTAV which inflates to 201%, ram usage will be

(1024 x 8 + 1024) x 2.01 =18524.16 MB, about 18GB ram is needed.

But decompression memory is calculated as

ChunkSize x Inflation ratio

Use ZlibChecker to be sure what chunk size should you really set because chunk size doesn't mean ratio is always better.
http://fileforums.com/showthread.php?t=97657

aswadd 07-11-2016 02:11

@Razor12911 why you are helping us so much like this ?
you make cls / tools / awesome things for free !
do we really deserve ! does thnx enough for you :(

Grumpy 07-11-2016 02:30

Quote:

Originally Posted by aswadd (Post 453646)
@Razor12911 why you are helping us so much like this ?
you make cls / tools / awesome things for free !
do we really deserve ! does thnx enough for you :(

Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

aswadd 07-11-2016 03:00

Quote:

Originally Posted by Grumpy (Post 453649)
Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

Lol , but i have a better one I'll send him the great pyramid of Giza to his home Address & don't worry razor you can make him a good home but don't bother the mummy , his room is next to the bathroom :D

EzzEldin16 07-11-2016 11:16

Razor is our master , teacher , mentor
he is an infinte treasure :D

felice2011 07-11-2016 12:54

Razor you can view the process information in the dos window using only Pzlib, do not nothing appears in the latest version during operation.
You can also add a scan of the input file function to quickly detect if the files contain zlib streams or deflate streams or nothing, as the basic function of ZLibChecker.

Example = -qd : quickly detect streams

"pzlib.exe -qd -m1 myfile.ext"

Or

"pzlib.exe -qd -m2 myfile.ext"

Or at least get a result like that as shown in the old pzlib window, only to detect if the files contain streams or not.:D

http://i68.tinypic.com/3483huh.png

that way I think it is very complete, logically if you can and when you have time, I know that these days you're busy with exams ... Thanks

zouzouni 07-11-2016 14:12

Big thank you for this nice piece of coding!

After testing between reflate of yours and this pzlib2, I wonder if this is the unlocked version of your reflate (without the need for -s2000m option in arc) ;)

I get same size (few bytes differences) when using pzlib2 or reflate...

but endeed , compression and decompression is way faster with pzlib2!
no error so far with SkyrimSE, ratio is ... correct...
Thx again Razor!

and ....I already promote your work all around me...you're our Master bro!

zouzouni 07-11-2016 14:26

Big thank you for this nice piece of coding!

After testing between reflate of yours and this pzlib2, I wonder if this is the unlocked version of your reflate (without the need for -s2000m option in arc) ;)

I get same size (few bytes differences) when using pzlib2 or reflate...

but endeed , compression and decompression is way faster with pzlib2!
no error so far with SkyrimSE, ratio is ... correct...
Thx again Razor!

and ....I already promote your work all around me...you're our Master bro!

ramazan19833 07-11-2016 17:47

Help....

pzlib+srep+lzma2



http://i.hizliresim.com/ZY80X0.jpg

coliotte 07-11-2016 18:00

Quote:

Originally Posted by ramazan19833 (Post 453678)
Help....

pzlib+srep+lzma2



http://i.hizliresim.com/ZY80X0.jpg



you could rename [External compressor:7z]

to [External compressor:lzma2]

ramazan19833 07-11-2016 18:06

big thanks!!!

LuzhinE 07-11-2016 18:14

Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

felice2011 07-11-2016 23:27

Quote:

Originally Posted by ramazan19833 (Post 453678)
Help....

pzlib+srep+lzma2

http://i.hizliresim.com/ZY80X0.jpg

Quote:

Originally Posted by coliotte (Post 453679)
you could rename [External compressor:7z]

to [External compressor:lzma2]

Quote:

Originally Posted by LuzhinE (Post 453681)
Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

@ramazan19833 .... @coliotte ... @LuzhinE ...How can you eat an apple and feel satiated, if in plate the apple there is no ..;)

aswadd 08-11-2016 01:13

Quote:

Originally Posted by LuzhinE (Post 453681)
Colette does not work for me by changing the name

http://i.imgur.com/5YuqBqh.png

Man where is 7z.exe & its dll files !! you Just tell arc to compress using 7z's Lzma2 & basically arc can't find 7z.exe :D

kenzo34 08-11-2016 03:57

hi Razor
possible to update unarc.dll for pzlib v2 please?
perfect unpacking with bat file, but failure on inno setup:
"unarc.dll returned error code 14".

LuzhinE 08-11-2016 09:31

Quote:

Originally Posted by coliotte (Post 453622)
Why Would You need reflate When You have Pzlib now !

coliotte and Simorq

An image says it all

http://i.imgur.com/rmq2SMA.png

any solution coliotte

ramazan19833 08-11-2016 12:44

Help

del /q data.arc
arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate:m2:l6:t75p:p5:s240+srep+lzma2 data.arc "C:\DZ_Games\Pro Evolution Soccer 2017\*"
pause

Eror Srep

http://i.hizliresim.com/A34Evp.jpg

aswadd 08-11-2016 13:21

Quote:

Originally Posted by ramazan19833 (Post 453703)
Help

del /q data.arc
arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate:m2:l6:t75p:p5:s240+srep+lzma2 data.arc "C:\DZ_Games\Pro Evolution Soccer 2017\*"
pause

Eror Srep

http://i.hizliresim.com/A34Evp.jpg

u're trying to use dzteam reflte parameters :D but you don't have their reflate :D remove the parameters of reflate

felice2011 08-11-2016 13:27

@ramazan19833 ... Choose what you want to use srep.exe or CLS-srep.dll, during the use of the compression, at the same time I do not think get along well.;)

Simorq 08-11-2016 14:18

Attack on Titan Wings of Freedom
LINKDATA Dir Input = 14.8 GB > Pzlib2 = 17.6 GB > Srep = 8.43 > LZMA2 = 3.66 GB

Code:

Compressed 10 files, 15,947,914,240 => 3,940,532,496 bytes. Ratio 24.71%
Compression time: cpu 45.03 sec/real 3639.39 sec = 1%. Speed 4.38 mB/s
All OK

:D

LuzhinE 08-11-2016 14:24

Someone knows any solution for CRC check

pzlib+srep+lzma2

I also tried with

pzlib+srep+lzma

http://i.imgur.com/RGJTSgZ.png

Razor12911 08-11-2016 22:43

These were the CRC errors I was talking about, sometimes they are there , and sometimes not. Will look for a solution.

Razor12911 08-11-2016 23:49

1 Attachment(s)
Quote:

Originally Posted by Grumpy (Post 453649)
Razor, could you please post 'aswadd' a detailed photo of yourself ... as it seems he would like to Re-Sculpture The Great Sphinx of Giza in your honor. ;)

There you go, would be an interesting sculpture don't you think?

aswadd 09-11-2016 06:48

Wow Razor, but after sculpturing it , I think the Sphinx of Giza will be abandoned place
no one will come to visit it :D except for you ofc

but i don't know , after sculpturing it , it may make some Great Boobs from behind or not :D if he did that I think the Whole Giza will be abandoned place not only the Sphinx

LuzhinE 09-11-2016 06:55

In the new pack of mad max made by coliotte integrates the CRC.

Will be the solution, integrate the CRC?

http://i.imgur.com/b9kvrkR.png

pakrat2k2 09-11-2016 08:40

Quote:

Originally Posted by Razor12911 (Post 453729)
There you go, would be an interesting sculpture don't you think?

that image is just too funny.

ChronoCross 09-11-2016 11:35

This is very interesting. I have random crash. Sometimes arc.exe and sometime pzlib when i change the default options. Default options detect my cpu and ram for optimal recompression?

coliotte 09-11-2016 16:33

Quote:

Originally Posted by LuzhinE (Post 453740)
In the new pack of mad max made by coliotte integrates the CRC.

Will be the solution, integrate the CRC?

http://i.imgur.com/b9kvrkR.png

naah i only added That Because IDM keeps damaging the files


.... wait did This repack unpack for you with no problems ?

LuzhinE 09-11-2016 17:30

Not yet compress mad max, I would like you to teach to compress the pes2017

coliotte 09-11-2016 19:18

Quote:

Originally Posted by LuzhinE (Post 453759)
Not yet compress mad max, I would like you to teach to compress the pes2017

http://2.bp.blogspot.com/_jF4hS9l3o6.../confusion.jpg

LuzhinE 09-11-2016 19:32

Must be my English is lousy, but I would like you to teach to compress the pes 2017 with reflate, since with pzlib v2 gives error

Also you could be able to have a smaller size for Ryse son of Rome?

coliotte 10-11-2016 10:11

Quote:

Originally Posted by LuzhinE (Post 453764)
Must be my English is lousy, but I would like you to teach to compress the pes 2017 with reflate, since with pzlib v2 gives error

Also you could be able to have a smaller size for Ryse son of Rome?

Why would you want to use reflate on pes17 when you clearly Could get a batter ratio with precomp

Amsal 10-11-2016 19:10

Quote:

Originally Posted by coliotte (Post 453782)
Why would you want to use reflate on pes17 when you clearly Could get a batter ratio with precomp

Man... They don't have brains, and don't even do a try themself....

chum 17-11-2016 05:13

Nice work Razor. GTA 5 compression/decompression is 100% functional now. The decompression time improved a lot compared to reflate. 100 minutes decompression for the full game 67GB with i7+HDD 7200rpm.

Edited: It was 1h:40min decompression not 140 minutes.

CAT8K 21-11-2016 15:31

hey Razor12911
so Thanks for pZLib
this ver pZLib 64bit i need 32bit some games like Max Payne 3
need windows 32 and sure run in 64 can u put pZLib 32bit?

Simorq 22-11-2016 06:15

Dragons Dogma Dark Arisen + Update3_RePack by SEYTER (pZLib+Srep+Lzma) 6GB

Simorq 22-11-2016 06:17

pZLib can extract files greater than 4GB whether this issue will be fixed Razor1291?


All times are GMT -7. The time now is 17:05.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com