FileForums - pZLib version 2 (Fastest zlib/deflate precompressor)

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - pZLib version 2 (Fastest zlib/deflate precompressor) (https://fileforums.com/showthread.php?t=98486)

No Work Act of Aggression - Reboot Edition .dat file

Quote:

Originally Posted by Razor12911 (Post 453530)

No, the program is so inconsistent, it raises CRC errors out of nowhere and when you precompress the game once again, the error is gone, but errors are rare.

yes, that's the RAM. BTW works really fast.
Offtopic: i don't like to see any "memes" in this forum.

Please don't stop.

Quote:

Originally Posted by Razor12911 (Post 453526)

7 views already in like, 9 minutes and no thanks. Haha, rejoice people. This may be my last project.

@aswadd
this is faster than reflate and delivers the same output.

You are the best. Please don't close your projects. Your projects are the most useful.

Thank you very much Razor for pzlib! I tested on this file: x64f.rpf (981mb)

Only Shelwien's reflate in level 4:
Compression:
FreeArc 0.67 (March 15 2014) creating archive: data\datareflate.arc
Compressed 1 file, 1,028,757,504 => 2,304,942,259 bytes. Ratio 224.05%
Compression time: cpu 1.92 sec/real 471.78 sec = 0%. Speed 2.18 mB/s
All OK
Decompression:
FreeArc 0.67 (March 15 2014) extracting archive: datareflate.arc
Extracted 1 file, 2,304,942,259 => 1,028,757,504 bytes. Ratio 224.05%
Extraction time: cpu 6.44 sec/real 205.69 sec = 3%. Speed 5.00 mB/s
All OK

Only pzlib version2:
Compression:
FreeArc 0.67 (March 15 2014) creating archive: data\datapzlib.arc
Compressed 1 file, 1,028,757,504 => 2,226,261,282 bytes. Ratio 216.40%
Compression time: cpu 0.84 sec/real 108.17 sec = 1%. Speed 9.51 mB/s
All OK
Decompression:
FreeArc 0.67 (March 15 2014) extracting archive: datapzlib.arc
Extracted 1 file, 2,226,261,282 => 1,028,757,504 bytes. Ratio 216.40%
Extraction time: cpu 0.92 sec/real 86.33 sec = 1%. Speed 11.92 mB/s
All OK

Reflate maybe find more stream but pzlib much faster!
Thanks again and good work!

I had problems with file.ttarch2 Telltale Games

does not work

earn to die 2

Code:

C:\Users\oLtJoN\Desktop\reflate_1500>arc.exe a -ep1 -r -ed -w.\temp -s4096m -mreflate data.arc "pack\*"

FreeArc 0.67 (March 15 2014) creating archive: data.arc

Compressing 86 files, 200,374,281 bytes. Processed  54%

Compressing 200,374,281 bytes with reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Reflate (Free Edition) created by Razor12911

Searching for deflate streams

Splitting streams 91/91

Processing extracted deflate streams

Gathering processed streams

Merging stream 183/183

Removing temporary files



Processed: 44.0 MB/191 MB (23%)

New size: 961 MB instead of 191 MB (503%)



Errorlevel=0

100%

Code:

C:\Users\oLtJoN\Desktop\reflate_1500>del /q unpacked\



C:\Users\oLtJoN\Desktop\reflate_1500>arc.exe x -w.\ -dpunpacked\ data.arc

FreeArc 0.67 (March 15 2014) extracting archive: data.arc

Extracting 86 files, 200,374,281 bytes. Processed   0%SSEInv             S├             T├             s          Extracted 86 files, 1,007,971,708 => 200,374,281 bytes. Ratio 503.04%

Extraction time: cpu 0.73 sec/real 32.87 sec = 2%. Speed 6.10 mB/s

All OK

Code:

C:\Users\oLtJoN\Desktop\pZLib_v2>del /q data.arc

Impossibile trovare C:\Users\oLtJoN\Desktop\pZLib_v2\data.arc



C:\Users\oLtJoN\Desktop\pZLib_v2>arc.exe a -ep1 -r -ed -s; -w.\temp -mpzlib data.arc "pack\*"

FreeArc 0.67 (March 15 2014) creating archive: data.arc

Compressed 86 files, 200,374,281 => 577,169,086 bytes. Ratio 288.05%

Compression time: cpu 0.27 sec/real 13.66 sec = 2%. Speed 14.67 mB/s

All OK

Code:

C:\Users\oLtJoN\Desktop\pZLib_v2>del /q unpacked\



C:\Users\oLtJoN\Desktop\pZLib_v2>arc.exe x -w.\ -dpunpacked\ data.arc

FreeArc 0.67 (March 15 2014) extracting archive: data.arc

Extracting 86 files, 200,374,281 bytes. Processed   0%SSEInv             S├             T├             s          Extracted 86 files, 577,169,086 => 200,374,281 bytes. Ratio 288.05%

Extraction time: cpu 0.44 sec/real 6.59 sec = 7%. Speed 30.39 mB/s

All OK

Thanks, mate. Will test it and if it's as good as you describe will use it with credits given, ofc.

Quote:

Originally Posted by oltjon (Post 453563)

I had problems with file.ttarch2 Telltale Games

does not work

Cause they are encrypted + new games (Batman i.e.) use Oodle, not zlib

Pzlib_v2 VS ReflateMT...Under-Test *.rpf File:)

Only pzlib_v2

Code:

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 05/11/2016 16:59:09

=============================================================================================================================================

 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○



        pzlib_v2         981,1°MB           2,07°GB       210,99%               1°File    00:01:07:929   e -m2 -st50p -t8 -ct8 -c32m -b512k -v -o 

=============================================================================================================================================



-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Decompressed Archive Completed At -↓- 05/11/2016 17:00:32

=============================================================================================================================================

 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ DECOMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○



        pzlib_v2          2,07°GB          981,1°MB        47,40%               1°File       00:00:53:81                           d -t8 -o 

=============================================================================================================================================

Only ReflateMT

Code:

-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Compressed Archive Completed At -↓- 05/11/2016 17:10:22

=============================================================================================================================================

 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ COMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○



         reflate         981,1°MB           2,08°GB       212,01%               1°File    00:04:56:956                  -process -c9 -t8  

=============================================================================================================================================



-↓- [ CMD Bench.Test.Info v0.0.6c ] -↓- Decompressed Archive Completed At -↓- 05/11/2016 17:29:48

=============================================================================================================================================

 ○ [ ALGORITHM ] ○ [ INPUT SIZE ] ○ [ OUTPUT SIZE ] ○ [ RATIO.% ] ○ [ ARCHIVED FILES ] ○ [ DECOMP.TIME ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○



         reflate          2,08°GB          981,1°MB        47,17%               1°File       00:16:08:60                  -restore -c9 -t8  

=============================================================================================================================================

Excellent compression and decompression speed compared to reflateMT...
I was very pleased, the double embedded option ,"M1 = zlib streams" and "M2 = deflate streams", with the possibility of avoiding the use of "Antiz & Zlib_Jo" for only zlib streams.
As you see here no one does not abandon you, in 7 hours two pages of thanks, of tests and appreciations on yours work.:)
Personally I think it's the best job of zlib...Bravo!!!;)

Mad Max
Input = 31.9 GB > Pzlib2 = 51.8 GB > Srep = 14 GB > LZMA2 = 9.57 GB

http://uupload.ir/files/2lo5_2016-11-05_211751.jpg

9.57 GB?
http://www.fileforums.com/showpost.p...7&postcount=27

Simorq

all the languages?

Simorq@

set -c256m

there are big streams and a higher chunk size must be set, but this results in a higher ram usage, 256mb x Threads + 256mb

razor, what think about cls? with her speed will fall?

Quote:

Originally Posted by Mini (Post 453580)

razor, what think about cls? with her speed will fall?

According to razor cls is a bad idea because buffer cannot be controlled, pzlib was created to work safe on SSD without damaging them that much with excessive writes.