XTool 2020 (Plugins)

[kuyhaa]

Originally Posted by Masquerade

TT Isle Of Man Ride on the Edge 3 [LZ4F]

• Extract the contents of the attached archive and use -mTTIoM3.
• TTIoM3.xtl can be discarded for decoding, but lz4.exe, xtool.ini and xdelta3_dll.dll must be present.

xtool precomp -mTTIoM3 -c128mb -t8 -df20p "WIN32\PKG\CHUNK_0"

XTool is created by Razor12911

Streams: 19100 / 19112
Time: 00:11:36 (CPU 00:03:19)

Size: 8.23 GB >> 13.4 GB

not work, what's wrong ?

[KaktoR]

Pretty sure you have to use a lz4 library aswell.

[Masquerade]

Originally Posted by KaktoR

Pretty sure you have to use a lz4 library aswell.

LZ4 precompression is handled by lz4.exe in this case, plugged in via xtool.ini.

@kuyhaa
Are you trying an updated version? The database was created for the release version of the game.

[kuyhaa]

Originally Posted by Masquerade

@kuyhaa
Are you trying an updated version? The database was created for the release version of the game.

i'm using TT Isle Of Man Ride on the Edge 3 update v20230511

if use lz4f:l10

Streams: 5575 / 20181
Time: 00:00:32 (CPU 00:13:10)

Size: 8.23 GB >> 9.73 GB

[Masquerade]

In that case, you will need to make a new database.

You will need VGMToolbox, which you can download here.

Copy this text and save it as PPKG.XML inside the "plugins\AdvancedCutter" folder.

Open the tool and go to Misc Tools ---> Extraction Tools ---> Generic ---> Advanced Cutter / Offset Finder.

In the presets drop down box, select PPKG from the list and then click "Load".

Then, drag the three PKG files into the drag'n'drop box to the left of the preset box.

After all the streams have been extracted, rename the extracted folders to remove the _CUT suffix.

To generate the database, just open a command prompt window in the folder containing the pkg files and do:

for %f in (*.PKG) do xtool generate -c128mb -t100p -mlz4f "%~nf" "%f" TTIoM3.xtl

Now you can delete the folders from VGMToolbox.

[Masquerade]

Divinity: Original Sin [Enhanced Edition]

• Extract contents of attached archive and use -mDivinity -df20p.
• Divinity.xtl can be discarded for decoding, but liblz4.dll and xdelta3_dll.dll must be present.

Divinity: Original Sin 2 [Definitive Edition]

• Extract contents of attached archive and use -mDivinity2 -df20p.
• Divinity2.xtl can be discarded for decoding, but liblz4.dll and xdelta3_dll.dll must be present.

[kuyhaa]

Originally Posted by Masquerade

In that case, you will need to make a new database.

You will need VGMToolbox, which you can download here.

Copy this text and save it as PPKG.XML inside the "plugins\AdvancedCutter" folder.

Open the tool and go to Misc Tools ---> Extraction Tools ---> Generic ---> Advanced Cutter / Offset Finder.

In the presets drop down box, select PPKG from the list and then click "Load".

Then, drag the three PKG files into the drag'n'drop box to the left of the preset box.

After all the streams have been extracted, rename the extracted folders to remove the _CUT suffix.

To generate the database, just open a command prompt window in the folder containing the pkg files and do:

for %f in (*.PKG) do xtool generate -c128mb -t100p -mlz4f "%~nf" "%f" TTIoM3.xtl

Now you can delete the folders from VGMToolbox.

works, thanks

Streams: 19102 / 19113
Time: 00:02:28 (CPU 00:00:55)

Size: 8.23 GB >> 13.4 GB

[soulfit15]

looks like a bug in xtool GUI with unreal plugin

XTool is created by Razor12911

Streams: 1430889 / 1675133
Time: 00:21:48 (CPU 00:16:56)

Size: 5.25 GB >> 5.03 GB

unpacking a game with ue5:key and it gets stuck "used the -d1" and cpu keeps spooling at 16%

[KaktoR]

Letting you know here that the playstation archive plugin doesn't work with xtool 0.7.2(HF) on decompression step.

It works with xtool 0.7.1

[Masquerade]

[Proof of Concept / Work In Progress] Yakuza SLLZ v1

This is a little project I've been working on in an attempt to implement the SLLZ algorithm found in Yakuza games as an XTool plugin. The code used for compression and decompression was written by Kaplas80. The attempt was to make it into a standalone executable. I wanted to share it here despite being unfinished. Requires .NET Framework v4.8.

There are a few problems with the plugin in its current state. Decompression of sllz streams seems to work completely fine. However, compression is slow and is missing the 2x 4 bytes of header information containing the compressed size and decompressed size (because for some reason Visual Studio insists on this being 8 byte rather than 4 byte arrays). They are filled as 00 bytes instead for the time being. The compressor is also bugged in other ways when I tested on samples from Yakuza Kiwami. Reading and writing to stdin/stdout hasn't been added yet so it's even slower since data needs to be extracted to disk.

Here's some information about this algorithm from its header:

First 4 bytes, Magic: SLLZ
Next byte, endianness: 00 (little)
Next byte, version: 01 or 02 (compression version - v2 is zlib I think)
Next 2 bytes is header size (from what I've seen, always 0x1000 because the header is always 16 bytes in my findings)
Next 4 bytes is decompressed size.
Next 4 bytes is compressed size.

Total: 16 bytes

[Stream1]
Name=yakuza
Codec=sllz
BigEndian=0
Signature=0x5A4C4C53
Structure=Signature(4),Endianness(1),Version(1),HeaderSize(2),CSize(4),DSize(4),Stream
StreamOffset=-16
CompressedSize=CSize
DecompressedSize=DSize

xtool precomp -myakuza -df20p -c128mb -t12 hact.par
XTool is created by Razor12911

Streams: 873 / 3397
Time: 00:11:34 (CPU 00:00:17)

Size: 398 MB >> 404 MB

I will probably drop this project for a bit and return to it sometime in the future

[dixen]

Witcher 3: Complete

Used xtool v0.7.3 hotfix

-mzlib+reflate

Streams: 2786 / 2786
Time: 00:01:17 (CPU 00:04:24)
Duplicates: 300 (1.58 MB) [1.80 MB >> 19.1 MB]
Srep decompression memory: 3.00 MB [6.34 MB*]

Size: 508 MB >> 658 MB >> 638 MB >> 607 MB >> 400 MB

100%
Errorlevel=0

Compressed 1 file, 532,191,280 => 419,520,814 bytes. Ratio 78.83%
Compression time: cpu 0.53 sec/real 79.37 sec = 1%. Speed 6.71 mB/s
All OK

-mw3+zlib+reflate

Streams: 3490 / 3854
Time: 00:01:35 (CPU 00:05:40)
Duplicates: 476 (2.20 MB) [3.18 MB >> 226 MB]
Srep decompression memory: 7.00 MB [23.1 MB*]

Size: 508 MB >> 1.12 GB >> 916 MB >> 814 MB >> 303 MB

100%
Errorlevel=0

Compressed 1 file, 532,191,280 => 318,049,218 bytes. Ratio 59.76%
Compression time: cpu 0.47 sec/real 97.06 sec = 0%. Speed 5.48 mB/s
All OK

Needed libliz4.dll (v1.9.3) and doboz.dll near xtool.exe

[Razor12911]

Plugin update available

Changes

- Improved stream detection in unreal engine plugin's ue5 codec (ucas/utoc format)

Notes

I just wished the format of unreal engine file system would stop changing because it's a headache trying to write one library that supports all current and future games and even this plugin has a caveat, mainly the first and last stream left behind and not decrypted because if I tried to grab them using the current method that would mean false positives, I've left R9 just in case R10's detection is worse but good luck.

pakchunk0optional-Windows.ucas (I don't know what game is this but it was a sample I was sent a while ago)

Unreal Engine ucas database maker doesn't work on this file... because they changed they format...

-mue5:k0xCD353CBF6E250AF8ADF4B2B0F79649A27D2BC743AB0AAAEB202DEF7A7C19B2DB+kraken -d1

R9

Tested 1 file, 437,937,960 => 290,461,744 bytes. Ratio 150.77%
Testing time: cpu 0.19 sec/real 11.54 sec = 2%. Speed 25.17 mB/s

R10

Tested 1 file, 578,518,003 => 290,461,744 bytes. Ratio 199.17%
Testing time: cpu 0.25 sec/real 16.30 sec = 2%. Speed 17.82 mB/s

[Masquerade]

The Legend of Heroes Trails into Reverie

• Extract the below archive into XTool folder and use -mReverie.
• This database is for assets.pka. The other pkg files are not compressed.
• Requires liblz4.dll. I included one that gave a good ratio.
• You can discard Reverie.xtl for decoding, but liblz4.dll must be retained.

This database took 13 hours to generate

[Razor12911]

Plugin update available

Changes

- Improved stream detection in unreal engine plugin's ue5 codec (ucas/utoc format)

Notes

Using ue5 codec even on pak files yielded streams which should not have been detected meaning ratio is affected one way or another and this release tackles false positive detections.

[Razor12911]

Plugin update available

Changes

- ue3 codec no longer requires m# parameter to work
- ue3 codec supports lzopro streams (requires lzopro executable plugin)
- ue4 codec speed improvement
- ue4 codec improved detection
- ue5 codec minor bug fixes

Notes

This update is primarily made for the next xtool release (0.7.7) but it should work fine for older versions.

Link