FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   pLZ4 (LZ4 Precompressor) - Test (https://fileforums.com/showthread.php?t=98526)

Razor12911 12-11-2016 15:37

pLZ4 (LZ4 Precompressor) - Test
 
1 Attachment(s)
Some program I was working on before exam time, this took a day to make, what I noticed is sometimes it gives good ratio and sometimes it doesn't, will properly work on it once I'm free.

Tested on a few Frostbite 3 games such as Battlefield 4, Need For Speed Rivals, also works on Infinity Ward games such as COD MW Remastered or Infinite Warfare, however sometimes you get negative ratio when pLZ4 because of different LZ4 settings and public release version and because of xdelta but like I said, it still needs some work.

JRD! 12-11-2016 18:41

UltraFast

-XCX- 12-11-2016 20:24

working great for me bro

Mini 13-11-2016 07:28

what level to use for Infinite Warfare? I receive negative ratio :(

thx razor, wait reflate ^^

coliotte 14-11-2016 15:23

Quote:

Originally Posted by Mini (Post 453857)
thx razor, wait reflate ^^

Edit by Grumpy Do not post pics unless game or installer related .... we dont need memes here, leave that crap for social media

Razor12911 28-11-2016 11:42

Gosh... Guys, pLZ4 is a precompressor, you are suppose to apply srep and lzma afterwards, oh wow... I released pzlib, I'm guess you used that without srep and lzma.....

Mini 28-11-2016 12:19

plz4 + srep + lzma = negative ratio !

Razor12911 28-11-2016 12:40

well besides that, there are a couple of people who ran plz4 as it is.

LuzhinE 29-11-2016 11:29

Tested in Battlefield 3 ES and US
Original size 12GB

plz4+srep+lzma = 10GB = Decompression in 25 minutes
pzlib+srep+lzma = 8.80GB (pzlib_1210) = Decompression in 25 minutes
pzlib+srep+lzma = 9.15GB (pZLib_v2) = Decompression in 15 minutes


Both take the same time of decompression, But pzlib compresses a couple of gigas more

FitGirl 29-11-2016 18:22

Quote:

Originally Posted by LuzhinE (Post 454106)
Tested in Battlefield 3 ES and US
Original size 12GB

plz4+srep+lzma = 10GB
pzlib+srep+lzma = 8.80GB (pzlib_1210)


Both take the same time of decompression, But pzlib compresses a couple of gigas more

Well, BF3 didn't use LZ4 compression at all, afair :)

ChronoCross 29-11-2016 19:01

sorry i donīt understand, plz4 detect lz4 streams or what?.
in that case we need an lz4 streams detector(i guess... for detect what games we can use plz4 for save time.)

LuzhinE 30-11-2016 08:54

Tested in Call of Duty Ghosts does not compress anything

Razor12911 30-11-2016 09:04

guys the tool is not ready, it decompresses lz4 streams meaning when you apply lzma, you get better ratio, right now, the tool doesn't do what it is suppose to.
Any game from ea using frostbite 3 engine is lz4 compressed, this is why precomp, pzlib, reflate are not going to work, bf3 is frostbite 2, frostbite 2 engine used zlib, which is why pzlib works, bf4 is frostbite 3, pzlib doesn't work, plz4 should.
Grim dawn, street fighter v, codiw, codmwr are just some games that are lz4 compressed, game developers are ditching zlib to reduce loading times because lz4 decompresses much faster than zlib.

felice2011 30-11-2016 09:21

Call of Duty Ghosts or the latest Infinite Warfare, does not contain any stream, pzlib has no effect, the best compression ratio with Infinite Warfare and 90% by performing tests on files *.pak & *.sabl, are not able to go down as well, with a good speed and compression rate only with "ulz".

ChronoCross 30-11-2016 10:17

Ok thanks!. So frosbite engine 3 got it. What if those lz package are encripted?.

Razor12911 30-11-2016 16:27

1 Attachment(s)
COD Ghosts has zlib streams.

LuzhinE 30-11-2016 21:29

I'll try it

felice2011 01-12-2016 00:05

Hey Razor CoD Infinite Warfare has similar files "image28.pak" it contains no streams.:confused: ... I have difficulty getting a good compression ratio with this game.:mad:
I tested pLZ4 .... is normal with files that do not contain streams you get the error :
Code:

Errorlevel=-1

ERROR: general (de)compression error in pLZ4


ImmortalArc 02-12-2016 12:41

It's crashing again and again what to do?????
Arc.exe stopped working?????

Razor12911 02-12-2016 23:32

How are you guys getting all these errors?

LuzhinE 03-12-2016 13:13

Tested in a few files of Call of Duty Modern Warfare Remastered

58 files with a total of 10.3 GB, once compressed leaves it in 9.41 GB

http://i.imgur.com/jo3iXWu.png

It does not compress almost anything and it takes a lot of decompression waiting for the final version

thank you Razor12911

ZakirAhmad 11-03-2017 02:29

I tried it on a file from farcry primal, drop and scan for lz4 showed inflation ratio of above 600% while i got only 132%...

doofoo24 14-03-2017 11:14

hey razor
what do you think of this file cls-precomp and xdelta with lz4 code used by fitgirl

Razor12911 14-03-2017 11:37

Nothing special really and cls-precomp.dll is lz4.exe just renamed.

L0v3craft 15-03-2017 08:33

Thank you Razor for this tool.

Guys I'm doing some test on a file from "HITMAN":

chunk0.rpkg

Size: 7.31GB

I drag n drop it on DS4LZ4 scanner and it shows this:

https://s16.postimg.org/g4s0exykh/Immagine.png

But when I go to make the compression: plz4+srep+delta+4x4:lzma:max

I get the same result of: srep+delta+4x4:lzma:max

How is possible ? Anyone can help me ?

ZakirAhmad 15-03-2017 09:02

first: plz4 is a test version, so nothing special can be expected...
2nd... it is only inflation ratio 103%, if u want to get something from pzlib which is by the way is final version, u should at least have an inflamation ratio of 200%...

L0v3craft 15-03-2017 09:24

Quote:

Originally Posted by ZakirAhmad (Post 457165)
first: plz4 is a test version, so nothing special can be expected...
2nd... it is only inflation ratio 103%, if u want to get something from pzlib which is by the way is final version, u should at least have an inflamation ratio of 200%...

Thanks for your reply, btw that file(and other files of the game) doesn't have zlib/deflate streams. I get bigger size only with DS4LZ4 scanner.

So pzlib is useless with the files of Hitman. Doesn't exists some other precompressor for files with lz4 streams ? I already seen repack of hitman ~22GB. How is possible to compress the game ~61.5GB and to get 22GB of compressed archives ? :confused: Some repacker got some special lz4 precompressor that there is not on this forum ?

ZakirAhmad 15-03-2017 10:13

L0v3craft: Well Bro I dont have that game so I might not help properly...
have u used drop aand scan for zlib by razor... it offers various function like force detection, headerless streams and adjusting chunk...
set hederless stream detecion setting on and try to drop a file on it from Hitman, If it shows detected streams, then precomp in slow mode will not help...
use pzlib by razor with setting -m2, -c256m and try from "r# 1-9", the one level which produces best inflation in comparable to ds4pzlib use that one...
Best of Luck

L0v3craft 15-03-2017 11:26

Quote:

Originally Posted by ZakirAhmad (Post 457169)
L0v3craft: Well Bro I dont have that game so I might not help properly...
have u used drop aand scan for zlib by razor... it offers various function like force detection, headerless streams and adjusting chunk...
set hederless stream detecion setting on and try to drop a file on it from Hitman, If it shows detected streams, then precomp in slow mode will not help...
use pzlib by razor with setting -m2, -c256m and try from "r# 1-9", the one level which produces best inflation in comparable to ds4pzlib use that one...
Best of Luck

Ok I got ~22GB without any precompressor ;)

ImmortalArc 15-03-2017 18:31

Quote:

Originally Posted by L0v3craft (Post 457173)
Ok I got ~22GB without any precompressor ;)

How ????
Can you explain???

zouzouni 16-03-2017 14:39

Simple Lzma comp
 
Quote:

Originally Posted by ImmortalArc (Post 457185)
How ????
Can you explain???

...he's just using simple lzma compression or srep+lzma (srep being a precompressor to me but so essential nowadays, that it is induced in common compressor builds up by most people)

Thx Razor for dev of new projects like this ... and people , don't expect so much from a beta tool ; ) just give it some time to bloom and shine ....like pzlib which is a great tool !!

Mini 28-03-2017 11:40

pLZ4 version 1.2 is created by Razor12911

Usage:
plz4 [command] [options] inputfile -o outputfile
inputfile/outputfile can be specified as "-" for stdin/stdout

Commands:
d: restores lz4 blocks

Standard options:
-m#: detection method
1, detects lz4 blocks
2, detects lz4 blocks from FB3 Games
-l#: lz4 compression (default 0)
-n#: block size (default 64k)
-o: specifies i/o, [input] -o [output]
-c#: chunk size (default 64m)
-b#: buffer size (default 256k)

Examples:
plz4 e -m2 -l0 myfile.ext -o myfile.pz
plz4 e -m1 -l9 -n32k myfile.ext -o -
plz4 d myfile.ext -o myfile.pz
plz4 d - -o -

WAIT! :p

ZakirAhmad 28-03-2017 20:24

where can i download v1.2
 
where can i download v1.2

mikey26 28-03-2017 21:10

there is no v1.2

@Mini stop posting nonsense.if it does not exist dont post things like that as it confuses some users.

Mini 29-03-2017 02:38

v1.2 - private
http://sendfile.su/1321036
(only decompressor)

i am wait Razor and release public version.

ZakirAhmad 29-03-2017 07:45

why u have only decimpressor?
 
Quote:

Originally Posted by Mini (Post 457509)
v1.2 - private
http://sendfile.su/1321036
(only decompressor)

i am wait Razor and release public version.

have u got compressor too.

Mini 29-03-2017 07:59

I have no compressor.

helpmeplz 29-03-2017 08:01

Quote:

Originally Posted by Mini (Post 457518)
I have no compressor.

fromm wheree you got that!!???

zoroX 29-03-2017 10:34

Quote:

Originally Posted by helpmeplz (Post 457519)
fromm wheree you got that!!???

from this setup -
Code:

http://www63.zippyshare.com/v/vt7i8O1L/file.html
which can be found in X.X.X.
NO WAREZ, includes names, groups, images etc
READ THE RULES !!

zoroX 30-03-2017 04:11

Quote:

Originally Posted by pakrat2k2
NO WAREZ, includes names, groups, images etc
READ THE RULES !!

its funny how you guys have CODEX installer script as sticky topic which DOES includes a WAREZ GROUP "NAME".


All times are GMT -7. The time now is 10:25.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com