FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   PZlib (Alternative to Precomp) (https://fileforums.com/showthread.php?t=97888)

Gupta 19-09-2016 16:42

Quote:

Originally Posted by aswadd (Post 451851)
I got another problem Arc crash when trying pzlib on
Need for speed MW 2012 :( while other pre-compressors didn't make arc crash
http://i.imgur.com/bgaNOkF.png

this are the things which are already discussed in the forum

use
Code:

[External compressor:pzlib]
header = 0
packcmd = pzlib e -v $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp
unpackcmd = pzlib d - -o - <stdin> <stdout>


chum 19-09-2016 18:55

Quote:

Originally Posted by Razor12911 (Post 451847)
Guys, I said this in the beginning of the thread, you must add -v if you're getting CRC errors.

-v is just verification, it just makes sure that the streams that were found match CRC when being restored, it permutes some streams which is why you get a better size without verification than when it's turned on.

The problem Razor is than using -v for Shadow of mordor cause the output data1.arc come same size of input folder files. Input folder files size=16.5Gb, data1.arc=16.5GB with -v added. Without -v data1.arc compress fine to 5GB but then unpack just give CRC error.

Razor12911 20-09-2016 16:16

yea, it means the data could be recompressed but CRC could not be maintained.

~MAK~ 20-09-2016 19:53

Quote:

Originally Posted by Razor12911 (Post 451897)
yea, it means the data could be recompressed but CRC could not be maintained.

Then is it possible that you make 2 version of pzlib, first one is your this already released one, and second one will have this idea if possible while compression and decompression there should not be any CRC checks and later we could patch that file with xdelta to make it md5 perfect :)

Razor12911 20-09-2016 20:16

Haha, that will not work. The difference is too much, it isn't just a few bytes that differ but the whole thing. Tried xdelta, it isn't going to help, instead it will make diff files almost the same size as original sometimes even more than which cannot be compressed further then end up with negative ratio, end up with ratio more than 100% even after compression.

~MAK~ 20-09-2016 20:23

Quote:

Originally Posted by Razor12911 (Post 451906)
Haha, that will not work. The difference is too much, it isn't just a few bytes that differ but the whole thing. Tried xdelta, it isn't going to help, instead it will make diff files almost the same size as original sometimes even more than which cannot be compressed further then end up with negative ratio, end up with ratio more than 100% even after compression.

hahaha, I already expected that :P . Anyways Nice to meet you

Razor12911 20-09-2016 20:24

Nice to meet you too.

ChronoCross 06-10-2016 09:04

Testing pzlib pipe downloaded from encode.ru.
7z tar pzlib e - - srep 7z lzma
compression good
decompression fail stuck in 39% i need to add -v option?

Razor12911 06-10-2016 09:32

-v doesn't exist, it's a new program I'm creating, somehow it gets stuck. really frustrating.

Razor12911 16-12-2016 06:31

Source uploaded

Prince4 30-12-2016 06:11

Did anyone fixed the
HTML Code:

ERROR: Stream read error
that felice showed no matter what version i use its the same :(

Viper645 09-03-2017 06:01

Quote:

Originally Posted by Razor12911 (Post 448876)
The effect of "-l" option.

Then what is the use of l5 and l7 ? to make the compression slower? :p

Razor12911 14-03-2017 11:09

Quote:

Originally Posted by Viper645 (Post 456944)
Then what is the use of l5 and l7 ? to make the compression slower? :p

http://fileforums.com/showpost.php?p=448876&postcount=7

:p

78372 25-08-2017 00:43

1 Attachment(s)
pZlib 1300

Removed. You don't need it, you won't get it

Simorq 25-08-2017 05:17

pZlib with large files 10GB problem.

Code:

C:\Users\Administrator\Downloads\Compressed\UA Pro\UltraARC 2801 R3>arc a -ep1 -r -ed -dses -s; -di -i2 -wE:\FFOutput\New folder\ArcTmp -n@CfgTmp\List1.txt -mMMC E:\FFOutput\New folder\Data1.Bin -dpE:\Program Files\Hellblade Senuas Sacrifice\HellbladeGame\Content\Paks
FreeArc 0.67 (March 15 2014) Using additional options: --logfile=_Compression.log
Creating archive: E:\FFOutput\New folder\Data1.Bin using pZLib1
Memory for compression 0b, decompression 0b, cache 16mb
Compressed 1 file, 17,325,579,914 => 26,739,971,247 bytes. Ratio 154.34% 
Compression time: cpu 34.61 sec/real 3033.32 sec = 1%. Speed 5.71 mB/s
All OK

Extract
http://uupload.ir/files/suf6_bug.png

78372 25-08-2017 05:20

May be because of stdio error?

Simorq 25-08-2017 05:33

Quote:

Originally Posted by 78372 (Post 461958)
May be because of stdio error?

Well, I'll do another test with pZLib and report it

Simorq 25-08-2017 06:49

where is the problem?
Direct use of pZLib is no problem.
But in FreeARC, when it decoded, it would give Disk Full.

http://uupload.ir/files/vvcr_hellbla...editor.pak.jpg

78372 25-08-2017 07:33

Weird, will check tomorrow

78372 26-08-2017 05:30

Try compressing with arcdatafile and arcoacked file, and decompress with stdio and ISDone. Then report back please.

-NORO- 26-08-2017 05:49

I tried pzlib 1300 with 17.7 gb files , decompression stuck at 6 or 10 % :confused:
Used stdin/stdout
PS: precompression is really slow compared to pzlib v3 .

Gupta 26-08-2017 06:07

i don't understand what is the whole point of having another variant, its just a waste of testing time
about speed, i will rather prefer stability

i mean you already have ztool,pzlibv3, reflate,precomp
posting another scoped variant just create headaches for novices, others will never bother download this even,
of course, in respect to razor's work, it just adds a unworking program to his name, headaches for novices

felice2011 26-08-2017 06:27

The only way to avoid any problems is to use it under the mask, pzlib still suffers from severe bugs. Used with support FA during scanning and compression of the files, if some files do not contain streams, pzlib generates an error Inside not reported, but compression of the archive seems to be successful. At decompression we get the classic errors detected from pzlib.;)

-NORO- 26-08-2017 09:31

Quote:

Originally Posted by PrinceGupta2000 (Post 461991)
i don't understand what is the whole point of having another variant, its just a waste of testing time
about speed, i will rather prefer stability

i mean you already have ztool,pzlibv3, reflate,precomp
posting another scoped variant just create headaches for novices, others will never bother download this even,
of course, in respect to razor's work, it just adds a unworking program to his name, headaches for novices

While you prefer stability others do prefer speed ,btw ztool doesnt give same ratio as pzlib do.
If he continues to work on it , it will be an improved version of pzlib.

Chayan Manna 26-08-2017 09:37

Quote:

Originally Posted by -NORO- (Post 462000)
btw ztool doesnt give same ratio as pzlib do.

Yeah, ZTool gives better ratio than pZLib.

-NORO- 26-08-2017 10:11

Quote:

Originally Posted by Chayan Manna (Post 462002)
Yeah, ZTool gives better ratio than pZLib.

I meant the contrary it has worst ratio :confused:
I tried few times with mutliple games pzlib and ztool
pzlib gave better ratio , weird

Gupta 26-08-2017 10:37

Does pzlib is able to restore them back?

Chayan Manna 26-08-2017 10:51

Quote:

Originally Posted by -NORO- (Post 462005)
I meant the contrary it has worst ratio :confused:
I tried few times with mutliple games pzlib and ztool
pzlib gave better ratio , weird

No, ZTool gave better ratio at every game file I have tested, that's why Razor12911 made it private.
Unlike pZLib the parameter "-x" is not for the ultimate settings in ZTool. To gain the best ratio from ZTool the parameter is different. And ZTool is also Faster & more stable than pZLib.

-NORO- 26-08-2017 11:28

Quote:

Originally Posted by Chayan Manna (Post 462007)
No, ZTool gave better ratio at every game file I have tested, that's why Razor12911 made it private.
Unlike pZLib the parameter "-x" is not for the ultimate settings in ZTool. To gain the best ratio from ZTool the parameter is different. And ZTool is also Faster & more stable than pZLib.

Ohh i didnt test it with ultimate settings parameter , i know it is really faster and stable.

78372 04-09-2017 07:49

Quote:

Originally Posted by Chayan Manna (Post 462002)
Yeah, ZTool gives better ratio than pZLib.

Do ya know why ztool gives more ratio than pzlib?
Because ztool uses reflate libs even when detecting zlib streams(m1)

A week ago I tested with a 1GB file from jc2. pZlib 1350 gave 2.13GB and ztool gave 2.2GB.
Ofc pzlib 1350 was faster, while giving a smaller ratio.The 2.2GB file became 610mb after processing by srep, and 2.13GB by pzlib became 536mb. So it's proved that ztool uses reflate, which causes better ratio.

-NORO- 05-09-2017 14:10

Quote:

Originally Posted by 78372 (Post 462150)
Do ya know why ztool gives more ratio than pzlib?
Because ztool uses reflate libs even when detecting zlib streams(m1)

A week ago I tested with a 1GB file from jc2. pZlib 1350 gave 2.13GB and ztool gave 2.2GB.
Ofc pzlib 1350 was faster, while giving a smaller ratio.The 2.2GB file became 610mb after processing by srep, and 2.13GB by pzlib became 536mb. So it's proved that ztool uses reflate, which causes better ratio.

Did you update pzlib 1350 ?
I had decompression errors with 17 gb files

78372 05-09-2017 19:11

Yep, but you have pzlib v3, use that :)
ztool is faster than pzlib 1350 in most cases. Very few games are processed faster(about 2x) by pzlib 1350

linggar17x 28-09-2017 07:08

i get error crc when decompression..
How to solve?

78372 28-09-2017 08:35

Read the whole thread, you will find your answer

GBT repack 05-10-2017 05:33

What is the best compression rate now?
Seeking to share
thinks

MMBDON 07-12-2017 05:57

Plz Help to decompress data!
 
Can anybody help me, how to solve decompression problem with pzlib compressed data. I have already compressed some files of max payne 3 with pzlib v3. Compressed ratio became 44.9% from 6.78 GB - 3.05 GB. But when i'm decompressing this compressed file with WPI by including pzlib, some files were not extracting. I don't know why? I using compression method as, pzlib3+srep+delta+exe2+lzma2:ultra:a1:mfbt4:d518m: fb273:mc10000:lc8.
Please help me......

shazzla 08-12-2017 03:10

Do not use stdio @compression !

Kitsune1982 10-12-2017 18:20

hi guys. i am using razor12911's IC 3020 UA2008R2 modification, and i am having some problems with pzlib. the game i am trying to compress, syberia 1, has zlib streams inside the cmo folder in the root folder of the installed game, but when i try to install my repack after using pzlib on the folder with the zlib streams, the data/cmo folder, i keep getting a 'unarc returned an error error code -11 decompression fails - archive is corrupted' error and i know it has zlib streams because i scanned the folder with zlib checker. any ideas whats going on?

the cmo folder is only 95 mb but i want to get the hang of using pzlib.
please post back, i am frustrated and dont know why its not working.
ive tried using pzlib by itself which results in a larger file and pzlib with lzma both using UltraArc 2800 R2 and get the error code -11 with the second attempt.
any feedback will really help. thanks.

-Kitsune

Andu21 11-12-2017 07:02

If you are using -f option remove it also try compressing from file to file instead of stdio.

Kitsune1982 12-12-2017 13:06

hi guys, thanks for helping me with my pzlib question. i am still having issues so i thought i would post my arc.ini info here to further assist you all in helping me resolve my issue.

- arc.ini from F:\UA2800R2\Resources

My Method:
tor = srep+exe+exe2+delta+dict

Example (; = Disable)
;tor = /$File=srep+Lzma2/$Deflate=pzlib+srep+lzma:176mb:normal:bt4:273:mc10 00000000:lc8
;tor = precompmt+srep+lzma2
;tor = antiz+srep+nanozip

[External compressor:pzlib]
header = 0
packcmd = pZLib\pZLib e {options} -c128m -t75p - -o - $$arcdatafile$$.tmp -o - <stdout>
unpackcmd = pZLib\pZLib d {options} -t25p - -o - <stdin> <stdout>


[External compressor:pzlibv2]
header = 0
packcmd = pZLib v2\pZLib e -m3 -r6 {options} -c32m -t25p - -o - $$arcdatafile$$.tmp -o - <stdout>
unpackcmd = pZLib v2\pZLib d {options} -t100p - -o - <stdin> <stdout>

arc.ini from C:\Installer Creator 3.0\include

[External compressor:precomp]
header = 0
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:srep,srep64]
header = 0
unpackcmd = srep {options} -d -s - - <stdin> <stdout>

[External compressor:pzlib]
header = 0
unpackcmd = pzlib d - -o - <stdin> <stdout>

[External compressor:lzma2,lz77,xz]
header = 0
unpackcmd = 7z x -txz -an -y -si -so <stdin> <stdout>

[External compressor:zstd]
unpackcmd = zstd -d -f <stdin> <stdout>

please take a look at my arc.ini files and tell me if i did anything wrong there. also i have raw2hif.dll hif2raw.dll pzlib.exe and cls-reflate.exe in my IC 3100 include folder. i know i could use CIU instead but i like the style of this app and its similar in design just a bit older. let me know if i need to change anything in either of the arc.ini files.. thanks!

-Kitsune


All times are GMT -7. The time now is 01:57.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com