pLZ4 (LZ4 Precompressor) - Test

[Razor12911]

Some program I was working on before exam time, this took a day to make, what I noticed is sometimes it gives good ratio and sometimes it doesn't, will properly work on it once I'm free.

Tested on a few Frostbite 3 games such as Battlefield 4, Need For Speed Rivals, also works on Infinity Ward games such as COD MW Remastered or Infinite Warfare, however sometimes you get negative ratio when pLZ4 because of different LZ4 settings and public release version and because of xdelta but like I said, it still needs some work.

[JRD!]

UltraFast

[-XCX-]

working great for me bro

[Mini]

what level to use for Infinite Warfare? I receive negative ratio :(

thx razor, wait reflate ^^

[coliotte]

thx razor, wait reflate ^^

Edit by Grumpy Do not post pics unless game or installer related .... we dont need memes here, leave that crap for social media

[Razor12911]

Gosh... Guys, pLZ4 is a precompressor, you are suppose to apply srep and lzma afterwards, oh wow... I released pzlib, I'm guess you used that without srep and lzma.....

[Mini]

plz4 + srep + lzma = negative ratio !

[Razor12911]

well besides that, there are a couple of people who ran plz4 as it is.

[LuzhinE]

Tested in Battlefield 3 ES and US
Original size 12GB

plz4+srep+lzma = 10GB = Decompression in 25 minutes
pzlib+srep+lzma = 8.80GB (pzlib_1210) = Decompression in 25 minutes
pzlib+srep+lzma = 9.15GB (pZLib_v2) = Decompression in 15 minutes


Both take the same time of decompression, But pzlib compresses a couple of gigas more

[FitGirl]

Tested in Battlefield 3 ES and US
Original size 12GB

plz4+srep+lzma = 10GB
pzlib+srep+lzma = 8.80GB (pzlib_1210)


Both take the same time of decompression, But pzlib compresses a couple of gigas more
Well, BF3 didn't use LZ4 compression at all, afair :)

[ChronoCross]

sorry i don´t understand, plz4 detect lz4 streams or what?.
in that case we need an lz4 streams detector(i guess... for detect what games we can use plz4 for save time.)

[LuzhinE]

Tested in Call of Duty Ghosts does not compress anything

[Razor12911]

guys the tool is not ready, it decompresses lz4 streams meaning when you apply lzma, you get better ratio, right now, the tool doesn't do what it is suppose to.
Any game from ea using frostbite 3 engine is lz4 compressed, this is why precomp, pzlib, reflate are not going to work, bf3 is frostbite 2, frostbite 2 engine used zlib, which is why pzlib works, bf4 is frostbite 3, pzlib doesn't work, plz4 should.
Grim dawn, street fighter v, codiw, codmwr are just some games that are lz4 compressed, game developers are ditching zlib to reduce loading times because lz4 decompresses much faster than zlib.

[felice2011]

Call of Duty Ghosts or the latest Infinite Warfare, does not contain any stream, pzlib has no effect, the best compression ratio with Infinite Warfare and 90% by performing tests on files *.pak & *.sabl, are not able to go down as well, with a good speed and compression rate only with "ulz".

[ChronoCross]

Ok thanks!. So frosbite engine 3 got it. What if those lz package are encripted?.

[Razor12911]

COD Ghosts has zlib streams.

[LuzhinE]

I'll try it

[felice2011]

Hey Razor CoD Infinite Warfare has similar files "image28.pak" it contains no streams.:confused: ... I have difficulty getting a good compression ratio with this game.:mad:
I tested pLZ4 .... is normal with files that do not contain streams you get the error :

Errorlevel=-1

ERROR: general (de)compression error in pLZ4

[ImmortalArc]

It's crashing again and again what to do?????
Arc.exe stopped working?????

[Razor12911]

How are you guys getting all these errors?

[LuzhinE]

Tested in a few files of Call of Duty Modern Warfare Remastered

58 files with a total of 10.3 GB, once compressed leaves it in 9.41 GB

http://i.imgur.com/jo3iXWu.png

It does not compress almost anything and it takes a lot of decompression waiting for the final version

thank you Razor12911

[ZakirAhmad]

I tried it on a file from farcry primal, drop and scan for lz4 showed inflation ratio of above 600% while i got only 132%...

[doofoo24]

hey razor
what do you think of this file cls-precomp and xdelta with lz4 code used by fitgirl

[Razor12911]

Nothing special really and cls-precomp.dll is lz4.exe just renamed.

[L0v3craft]

Thank you Razor for this tool.

Guys I'm doing some test on a file from "HITMAN":

chunk0.rpkg

Size: 7.31GB

I drag n drop it on DS4LZ4 scanner and it shows this:

https://s16.postimg.org/g4s0exykh/Immagine.png (https://s16.postimg.org/9ebj5ibet/Immagine.png)

But when I go to make the compression: plz4+srep+delta+4x4:lzma:max

I get the same result of: srep+delta+4x4:lzma:max

How is possible ? Anyone can help me ?

[ZakirAhmad]

first: plz4 is a test version, so nothing special can be expected...
2nd... it is only inflation ratio 103%, if u want to get something from pzlib which is by the way is final version, u should at least have an inflamation ratio of 200%...

[L0v3craft]

first: plz4 is a test version, so nothing special can be expected...
2nd... it is only inflation ratio 103%, if u want to get something from pzlib which is by the way is final version, u should at least have an inflamation ratio of 200%...

Thanks for your reply, btw that file(and other files of the game) doesn't have zlib/deflate streams. I get bigger size only with DS4LZ4 scanner.

So pzlib is useless with the files of Hitman. Doesn't exists some other precompressor for files with lz4 streams ? I already seen repack of hitman ~22GB. How is possible to compress the game ~61.5GB and to get 22GB of compressed archives ? :confused: Some repacker got some special lz4 precompressor that there is not on this forum ?

[ZakirAhmad]

L0v3craft: Well Bro I dont have that game so I might not help properly...
have u used drop aand scan for zlib by razor... it offers various function like force detection, headerless streams and adjusting chunk...
set hederless stream detecion setting on and try to drop a file on it from Hitman, If it shows detected streams, then precomp in slow mode will not help...
use pzlib by razor with setting -m2, -c256m and try from "r# 1-9", the one level which produces best inflation in comparable to ds4pzlib use that one...
Best of Luck

[L0v3craft]

L0v3craft: Well Bro I dont have that game so I might not help properly...
have u used drop aand scan for zlib by razor... it offers various function like force detection, headerless streams and adjusting chunk...
set hederless stream detecion setting on and try to drop a file on it from Hitman, If it shows detected streams, then precomp in slow mode will not help...
use pzlib by razor with setting -m2, -c256m and try from "r# 1-9", the one level which produces best inflation in comparable to ds4pzlib use that one...
Best of Luck

Ok I got ~22GB without any precompressor ;)

[ImmortalArc]

Ok I got ~22GB without any precompressor ;)

How ????
Can you explain???

[zouzouni]

How ????
Can you explain???

...he's just using simple lzma compression or srep+lzma (srep being a precompressor to me but so essential nowadays, that it is induced in common compressor builds up by most people)

Thx Razor for dev of new projects like this ... and people , don't expect so much from a beta tool ; ) just give it some time to bloom and shine ....like pzlib which is a great tool !!

[Mini]

pLZ4 version 1.2 is created by Razor12911

Usage:
plz4 [command] [options] inputfile -o outputfile
inputfile/outputfile can be specified as "-" for stdin/stdout

Commands:
d: restores lz4 blocks

Standard options:
-m#: detection method
1, detects lz4 blocks
2, detects lz4 blocks from FB3 Games
-l#: lz4 compression (default 0)
-n#: block size (default 64k)
-o: specifies i/o, [input] -o [output]
-c#: chunk size (default 64m)
-b#: buffer size (default 256k)

Examples:
plz4 e -m2 -l0 myfile.ext -o myfile.pz
plz4 e -m1 -l9 -n32k myfile.ext -o -
plz4 d myfile.ext -o myfile.pz
plz4 d - -o -

WAIT! :p

[ZakirAhmad]

where can i download v1.2

[mikey26]

there is no v1.2

@Mini stop posting nonsense.if it does not exist dont post things like that as it confuses some users.

[Mini]

v1.2 - private
http://sendfile.su/1321036
(only decompressor)

i am wait Razor and release public version.

[ZakirAhmad]

v1.2 - private
http://sendfile.su/1321036
(only decompressor)

i am wait Razor and release public version.

have u got compressor too.

[Mini]

I have no compressor.

[helpmeplz]

I have no compressor.

fromm wheree you got that!!???

[zoroX]

fromm wheree you got that!!???

from this setup -
http://www63.zippyshare.com/v/vt7i8O1L/file.html

which can be found in X.X.X.
NO WAREZ, includes names, groups, images etc
READ THE RULES !!

[zoroX]

NO WAREZ, includes names, groups, images etc
READ THE RULES !!

its funny how you guys have CODEX installer script as sticky topic which DOES includes a WAREZ GROUP "NAME".

[ZakirAhmad]

@-XCX-
where from u got plz4a.exe

[008black]

There are plz4 streams in GTA v audio but compression fails how to fix

[FitGirl]

There are plz4 streams in GTA v audio but compression fails how to fix
False detection. GTA5 doesn't use LZ4 compression at all.

[008black]

False detection. GTA5 doesn't use LZ4 compression at all.

Thanks

[chum]

Is there a way to inflate Watch Dogs 2 with Plz4? For me it only increasing 1Gb of total size which dont give me any better ratio than encoding without it.

[zouzouni]

Razor12911 won't care much as he's joined Reality Repack group .... don't expect plz4 to be updated ....in fact it is updated to plz4 v2 but it won't be released to public, never ever !

It belongs to him and to Reality now ...this had to happen at some point. Nevertheless he did so much for this community that we can't blame him for that ....big endless respect to the great man that hepled us so much with such genius/genuin work

[Jiva newstone]

razor any source for cls plugin for making own

[poker2332]

Hello, I would like to thank for this beautiful program.
But I would need to know the best way to get a good compression ratio.
I am currently doing a repack of BF4 in its multiplayer version.
This is my arc.ini

[External compressor:pLZ4]
header = 0
packcmd = pLZ4 e -l9 -t8 -st75p -ct16 -c150m - -o - <stdin> <stdout>
unpackcmd = pLZ4 d -t8 - -o - <stdin> <stdout

[External compressor:7z]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d150m:fb=273:mf=bt4:mc=100000000:lc=4:lp= 0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = 7z x -txz -an -y -si -so <stdin> <stdout>

[External compressor:srep]
header = 0
packcmd = srep {options} -m5f -d1g -a1 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep {options} -d -s - - <stdin> <stdout>

Is it possible to get a better compression ratio?

-↓- [ CMD Bench.Test.Info v0.6.9c ] -↓- Compressed Archive Completed At -↓- 24/06/2017 7:22:11
================================================== ================================================== ================================================== =============================
○ [ ALGORITHM ] ○ [ IN SIZE SPLIT N°1 ] ○ [ OUT SIZE SPLIT N°1 ] ○ [ RATIO.% SPLIT N°1 ] ○ [ SET FILES SPLIT N°1 ] ○ [ COMP.TIME SPLIT N°1 ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc 4,15°GB 3,63°GB 87,47% 39°Files 01:59:01:803 a -ma9 -ds -lc1024 -ld1024 -ep-- -di -i2 -ed -r -w"temp" -mpLZ4+msc+srep+7z
================================================== ================================================== ================================================== =============================

-↓- [ CMD Bench.Test.Info v0.6.9c ] -↓- Compressed Archive Completed At -↓- 24/06/2017 9:24:24
================================================== ================================================== ================================================== =============================
○ [ ALGORITHM ] ○ [ IN SIZE SPLIT N°2 ] ○ [ OUT SIZE SPLIT N°2 ] ○ [ RATIO.% SPLIT N°2 ] ○ [ SET FILES SPLIT N°2 ] ○ [ COMP.TIME SPLIT N°2 ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc 4,19°GB 3,56°GB 84,96% 4°Files 02:02:13:776 a -ma9 -ds -lc1024 -ld1024 -ep-- -di -i2 -ed -r -w"temp" -mpLZ4+msc+srep+7z
================================================== ================================================== ================================================== =============================

-↓- [ CMD Bench.Test.Info v0.6.9c ] -↓- Compressed Archive Completed At -↓- 24/06/2017 11:15:53
================================================== ================================================== ================================================== =============================
○ [ ALGORITHM ] ○ [ IN SIZE SPLIT N°3 ] ○ [ OUT SIZE SPLIT N°3 ] ○ [ RATIO.% SPLIT N°3 ] ○ [ SET FILES SPLIT N°3 ] ○ [ COMP.TIME SPLIT N°3 ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc 4,01°GB 3,41°GB 85,04% 4°Files 01:51:28:87 a -ma9 -ds -lc1024 -ld1024 -ep-- -di -i2 -ed -r -w"temp" -mpLZ4+msc+srep+7z
================================================== ================================================== ================================================== =============================

-↓- [ CMD Bench.Test.Info v0.6.9c ] -↓- Compressed Archive Completed At -↓- 24/06/2017 13:40:27
================================================== ================================================== ================================================== =============================
○ [ ALGORITHM ] ○ [ IN SIZE SPLIT N°4 ] ○ [ OUT SIZE SPLIT N°4 ] ○ [ RATIO.% SPLIT N°4 ] ○ [ SET FILES SPLIT N°4 ] ○ [ COMP.TIME SPLIT N°4 ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc 4,10°GB 3,55°GB 86,59% 4°Files 02:24:35:214 a -ma9 -ds -lc1024 -ld1024 -ep-- -di -i2 -ed -r -w"temp" -mpLZ4+msc+srep+7z
================================================== ================================================== ================================================== =============================

-↓- [ CMD Bench.Test.Info v0.6.9c ] -↓- Compressed Archive Completed At -↓- 24/06/2017 15:54:32
================================================== ================================================== ================================================== =============================
○ [ ALGORITHM ] ○ [ IN SIZE SPLIT N°5 ] ○ [ OUT SIZE SPLIT N°5 ] ○ [ RATIO.% SPLIT N°5 ] ○ [ SET FILES SPLIT N°5 ] ○ [ COMP.TIME SPLIT N°5 ] ○ [ SYNTAX - OPTIONS - ARGUMENTS ] ○

Arc 4,00°GB 3,46°GB 86,50% 4°Files 02:14:04:624 a -ma9 -ds -lc1024 -ld1024 -ep-- -di -i2 -ed -r -w"temp" -mpLZ4+msc+srep+7z
================================================== ================================================== ================================================== =============================