XTool - Successor of ZTool

[elit]

Originally Posted by Razor12911

Update available
In terms of the Dunia engine, I advise that you use the latest liblz4.dll to avoid some streams being skipped due to their major difference, this could be because even I myself am not sure if I used the correct parameters for recompression, if you have an idea of what is used, please comment. (I used lz4hc, level 9)

I dont know if you want to go this route, but the way I did my tests when developing lz4 packer for "Raiders of the Broken Planet" game was that I used both original and self-modified quickbms script for unpacking game archive first. I unpacked thus twice - for each.

In modified script only difference was that I disabled decompression by taking out "comtype" command and used "log" instead of "clog" to dump files raw & compressed.

So I had both compressed and decompressed individual files from archive. Then it was only matter of finding right/best cmp settings through hex editor and binary comparison(first on few files and then all) to get best setting. And even wrong(but close) settings were still compatible with 80%+ of all archive.

[ShivShubh]

Originally Posted by elit

I dont know if you want to go this route, but the way I did my tests when developing lz4 packer for "Raiders of the Broken Planet" game was that I used both original and self-modified quickbms script for unpacking game archive first. I unpacked thus twice - for each.

In modified script only difference was that I disabled decompression by taking out "comtype" command and used "log" instead of "clog" to dump files raw & compressed.

So I had both compressed and decompressed individual files from archive. Then it was only matter of finding right/best cmp settings through hex editor and binary comparison(first on few files and then all) to get best setting. And even wrong(but close) settings were still compatible with 80%+ of all archive.

So by saying all that what were you trying to say by this "I dont know if you want to go this route" ? That Razor should find the correct parameters ? I don't think he has that much of an interest in far cry 5 or wants to waste time doing all that.

[KaktoR]

Oh, this updates come out like a machine gun.

Thank you rezor

[Razor12911]

Originally Posted by doofoo24

any idea of xtool parameters for lz4hc

packcmd = ???



and what game to test lz4hc ???

Levels are set by program

[doofoo24]

and what game's to test lz4
run on YookaLaylee with v and the same nothing as xtool v4 ???
did you test on any unity games ?

[Razor12911]

Originally Posted by doofoo24

and what game's to test lz4
run on YookaLaylee with v and the same nothing as xtool v4 ???
did you test on any unity games ?

XTool works on none of the unity games I have but I was sent samples to work on the tool and was told not all Unity Games are compressed therefore, perhaps the game you're testing it on are not compressed or do not follow the headers which are read by the tool.

[doofoo24]

ok i will test on other unity game's and report...
any future support for COD GAMES : Warfare Remastered , Advanced Warfare , Infinite Warfare . WWII

[Perykles]

Mr. Razor12911,

There is a problem of CRC with these files of "Trials Evolution Gold Edition"
"data.pak" and "data_tex.pak"
I use the xtool version 0.5
I tested with version 0.6 but the files are not deflated !
The files being small I give you a link with "FA_Example" in pack directory of xtool 0.5

https://transfernow.net/5679c22198j4

Thank you for your hard work on pzlib, xtool and the other tools.

[Simorq]

Originally Posted by Perykles

Mr. Razor12911,

There is a problem of CRC with these files of "Trials Evolution Gold Edition"
"data.pak" and "data_tex.pak"
I use the xtool version 0.5
I tested with version 0.6 but the files are not deflated !
The files being small I give you a link with "FA_Example" in pack directory of xtool 0.5

https://transfernow.net/5679c22198j4

Thank you for your hard work on pzlib, xtool and the other tools.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe erecomp:t25p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>
unpackcmd = xtool.exe drecomp:t1 - - <stdin> <stdout>

t1 Only CRC is OK

[KaktoR]

Originally Posted by Simorq

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe erecomp:t25p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>
unpackcmd = xtool.exe drecomp:t1 - - <stdin> <stdout>

t1 Only CRC is OK

Yep t1 is CRC good. But veeeeeery sloooow

I've tested on another file, 2.6GB, unpacking was about 15min

[darkwolves]

I've tested on another file, 2.6GB, unpacking was about 15min

i suppose it depends on the game mine was set to t4 on arkham knight it worked just fine

[Razor12911]

I currently have no leads on the header structure of those games quite yet.

[Razor12911]

Originally Posted by doofoo24

seems to crash on cuphead...

try isolating the issue then upload result, I'm not planning on downloading the game just to see what's really wrong. Some of us are on caps

[Simorq]

XTool 0.4 Zlib

Creating archive: Warriors All-Stars.Bin.001 using xprecomp:c32mb,zlib+srep:m3f+lolz:d64:mc1023:tt2+diskspan:4096mb:4096mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 342 files, 23,626,897,455 => 4,294,967,331 bytes. Ratio 18.18%  
Compression time: cpu 1869.13 sec/real 13768.85 sec = 14%. Speed 1.72 mB/s
All OK

Testing Archive: Warriors All-Stars.Bin.001
WARNING: CRC failed in "LINKDATA.BIN". File is broken.
WARNING: CRC failed in "KTSLXA2C.dll". File is broken.
WARNING: CRC failed in "steam_api64.dll". File is broken.
WARNING: CRC failed in "KTSLXA27.dll". File is broken.
WARNING: CRC failed in "KTSLXA29.dll". File is broken.
WARNING: CRC failed in "Config.exe". File is broken.
WARNING: CRC failed in "Star_US.exe". File is broken.
WARNING: CRC failed in "Star_KR.exe". File is broken.
WARNING: CRC failed in "Star_JP.exe". File is broken.
WARNING: CRC failed in "Star_TW.exe". File is broken.
WARNING: CRC failed in "Star_.ico". File is broken.
WARNING: CRC failed in "LINKDATA.IDX". File is broken.
WARNING: CRC failed in "steam_emu.ini". File is broken.
Tested 342 files, 4,294,967,331 => 23,626,897,455 bytes. Ratio 18.18%      
Testing time: cpu 45.33 sec/real 657.06 sec = 7%. Speed 35.96 mB/s
There were 13 warning(s)

[Razor12911]

Originally Posted by Simorq

XTool 0.4 Zlib

Creating archive: Warriors All-Stars.Bin.001 using xprecomp:c32mb,zlib+srep:m3f+lolz:d64:mc1023:tt2+diskspan:4096mb:4096mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 342 files, 23,626,897,455 => 4,294,967,331 bytes. Ratio 18.18%  
Compression time: cpu 1869.13 sec/real 13768.85 sec = 14%. Speed 1.72 mB/s
All OK

Testing Archive: Warriors All-Stars.Bin.001
WARNING: CRC failed in "LINKDATA.BIN". File is broken.
WARNING: CRC failed in "KTSLXA2C.dll". File is broken.
WARNING: CRC failed in "steam_api64.dll". File is broken.
WARNING: CRC failed in "KTSLXA27.dll". File is broken.
WARNING: CRC failed in "KTSLXA29.dll". File is broken.
WARNING: CRC failed in "Config.exe". File is broken.
WARNING: CRC failed in "Star_US.exe". File is broken.
WARNING: CRC failed in "Star_KR.exe". File is broken.
WARNING: CRC failed in "Star_JP.exe". File is broken.
WARNING: CRC failed in "Star_TW.exe". File is broken.
WARNING: CRC failed in "Star_.ico". File is broken.
WARNING: CRC failed in "LINKDATA.IDX". File is broken.
WARNING: CRC failed in "steam_emu.ini". File is broken.
Tested 342 files, 4,294,967,331 => 23,626,897,455 bytes. Ratio 18.18%      
Testing time: cpu 45.33 sec/real 657.06 sec = 7%. Speed 35.96 mB/s
There were 13 warning(s)

Try isolating error