without zlibwapi.dll
CRC OK
The Ratio increased by 80%

Most likely the problem is from zlibwapi.dll.
In ZTool, the zlibwapi.dll file does not work.

Maybe you were using 32bit zlibwapi.dll ?

no

ZSTD stream from fifa17

link

What do you mean, the problem is more likely from that dll? :confused:

Update available

Changes

- fixed zlib precompression crc issues // sort of
- Added EA Frostbite 3 lz4 and zstd stream precompression support
- Fixed overall chunk size 2GB limit

Roadmap

- Add Ubisoft game support for Anvil, Dunia and Unreal Engines
- Add support for FIFA 17 and FIFA 18 zstd streams
- Naruto series (Maybe)

@Razor12911 are you planning on adding support for other games like COD advanced warfare/infinite warfare/WWII/modern warfare remastered, and other game's like wolfenstein new order & the old blood :o

what about MEA zstd stream support? I could upload example if you wish

thanks for your great work, as always :)

will it work on MEA last time i tried with ztool with libzstd it did'nt work like i get final size 35.4gb, i tired with different files from c***p*** (libgcc_s_dw2-1.dll/zstdx86.dll/ztool 32bit) i get 30.4gb ?
i will tried to use xtool

here are samples from mea
https://www113.zippyshare.com/v/FW2kmxOo/file.html

does battlefield hardline have lz4 ?

I have the game, I downloaded the game just to run zstd tests and all seems good, go for it. I have not played it though, piece of shit pc :(

yes

games I want to reduce size

Need for Speed™ Payback Frostbite 3 (LZ4)
Battlefield 1 Frostbite 3 (LZ4)
Battlefield 4 Frostbite 2 (LZ4)
Battlefield 3 Frostbite (LZ4)

XTool 0.3 ,ZTool in the version how to use it in the best way
Can you show me a few examples?
Frostbite games made with game engine
Compressing game files in the best way

Cool, keep going. compare both precompressed and compressed size between ztool and xtool because if all is good, I no longer touch the codec but will move to the next.

i am trying MEA but always carsh...
packcmd = XTool e:precomp:c32mb,t100p:zstd - - <stdin> <stdout> :confused:

ok it will take while to compress both game...

test xtool v3
battlefield hardline 36.8gb to 49gb to size 22.8 GB (24,436,696,587 bytes)
mirror edge catalyst 23gb to 29gb to 16.5 GB (17,814,184,692 bytes)

test ztool 0.19.8
battlefield hardline 36.8gb to 51.3gb with srep:m3f:a2+lolz:d64m size 22.7 GB (24,436,517,587 bytes)
mirror edge catalyst 23gb to 29.5gb with srep:m3f:a2+lolz:d64m size 16.5 GB (17,796,182,115 bytes)

*i used the same liblz4 from xtool v3 with ztool...
seems that the ratio with ztool better with about couple of mb...
decompression no crc error...

the arc.ini setting

[External compressor:xprecomp]
header = 0
packcmd = XTool e:precomp:c32mb,t100p:lz4 - - <stdin> <stdout>

[External compressor:plz4]
header = 0
packcmd = ztool e:plz4:t100p - <stdin> $$arcpackedfile$$.tmp

Great work Bro
 

Tried it on a file from Mass effect andromida.

ztools pzstd expanded it to 174.85%
xtools expanded it to 177.14%
ztool with v parameter 177.27%(since this produces result without varification, hence can b used for comparison. jusk like we use DS4Zlib before precompression.)

extraction is also successifully

After treating the output with srep + lzma

ztool 20.38%
xtool 20.21%

is it possible to provide v parameter with xtool, it might come handy for comparison.

@Razor12911
i will repack need for speed payback with it the lz4 on ztool froze on a certain file i am hoping this does not if it does i will give you the sample

apon using the x86 version it had an error that
libgcc_s_dw2-1.dll
was missing
so i found it and put it in the same folder no problem since
file included below for anyone who has had the same problem

Sometimes xtool give arc.exe has stopped working...
But after two to 3 tries, it works on the file.

well it is still a work in progress afterall :D

well it happens, if the data to be processed contains a mixture of files say dlls, exes, txt etc.
it was alse problem of ztool.

That's why i don't mix them alltogether.

Everytime u cant separate files in different graops. suppose u separated files containing zlib streams in a folder. suppose some file is included in that folder which doesnt contain zlib streams. the precompression might fail because of that single file. theoritically, a file without streams should not crash ztool. There is something wrong somewhere which is causing the error.

Hm, i can always seperate them in groups.

i always use 3 data files i'd rather fix one fine than an entire game
for example if there is only something wrong with file 2 then i do not have to worry about 1 and 3
for example
batman arkham asylum
only lzo files in folder 1
folder 2 the bink videos
folder 3 the game executables redists etc the small stuff

Great i will try. Thanks

@KaktoR: if their is a tool for grouping files in folders, can u post it.

FA bug with stdio, not related to xtool.

Razor12911 will you give support to Unity engine as well?

http://uupload.ir/files/ccf_2018-05-11_204149.png

--cache=0
stdin without crash:D

Update available

Changes

- added unity engine (5.x.x) lz4hc stream precompression support
- updated zlib precompression scanner
- improved reflate level detector for zip and png input

@Razor12911 damn mate, I cant wait to see what are you going to do with xTool, as soon as I think that you are finished you include something new, huge thx and respect!!!

How to know what unity version a game is using?

^Unity Studio.

https://pcgamingwiki.com/wiki/Engine:Unity

https://pcgamingwiki.com/wiki/Life_I...fore_the_Storm

Great work as always.

Can u please add support for unreal engine, Titanfall 2.

Sure, buy lzopro for me :)
http://www.oberhumer.com/products/lzo-professional/

I will if i can.

- Add Ubisoft game support for Anvil, Dunia and Unreal Engines
- Add support for FIFA 17 and FIFA 18 zstd streams
- Naruto series (Maybe)

Hi! Razor12911

you can add the above properties very soon

in a very short time you are doing a lot of other great features and great work and you are very supportive to the games with many game engines I am very happy with the new xtool tool every work you do is followed with great curiosity Thank you for everything

NeedForSpeedPayback size 13.5gb with xtool...
ztool stuck...
seems that lz4 only work on ea games for now,
tried on COD game's and gear of war 4 no luck...

Hi bro, for lzo maybe that might interest you:
https://github.com/synopse/mORMot/bl...ter/SynLZO.pas