XTool 2020 (Plugins) - Page 17

Cesar82 · #1 10-03-2022, 19:23

Quote:

Originally Posted by Razor12911

Endianess can be confusing at times...

try this

Thanks.
It worked perfectly now for ME Andromeda.

Masquerade · #2 12-03-2022, 02:29

Distant Worlds 2

This game uses very weak LZ4 compression on the bundle files, don't expect a HUGE ratio increase
Extract contents of the attached archive and use -mDistantWorlds2.
Requires liblz4.dll, I included one that gives a good ratio.
You can discard DistantWorlds2.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

Code:

xtool precomp -mDistantWorlds2 -c64mb -t12 Dhayut.16fded53a296c46dd06a09d8bd780324.bundle

Streams: 21 / 21
Time: 00:00:01 (CPU 00:00:00)

Size: 11.2 MB >> 14.8 MB

Masquerade · #3 07-06-2022, 09:41

Updated Orcs Must Die! 3 LZ4HC database to game version v1.2.0.2 / Build 8601683.

Masquerade · #4 06-06-2023, 06:29

Orcs Must Die! 3 database updated for game version Build 11248349 / v1.2.1.0 (June 5th 2023).

Razor12911 · #5 14-03-2022, 14:45

WWE 2K22 research information

Straight away I'll say working on this game has been a headache especially since there is no information online so I'll post some information if someone wants to continue to work on it but doesn't know where to start.

This game is heavily obfuscated/encrypted. The header structed is encrypted, the data itself is encrypted. They used weak xor encryption which is weak but the catch is these keys are different for each stream/block that's encrypted, they are generated based on a generated hash to produce a 256 byte key.

Since I had no idea how to decrypt the header to get these hash values, I just hijacked the exe by injecting code then to be able to obtain decrypted headers which has a structure that looks like this

Code:

type
  PWWEStruct = ^TWWEStruct;

  TWWEStruct = record
    Position, Hash: Int64; {not sure if Hash is 32-bit or 64-bit}
    StreamIndex, CSize, Format, DSize, Unk1, FileIndex: Int32; {FileIndex = bakedfile##.cak}
  end;

As for compression that was used, they used Hydra which comes from oodle library hence you see oo2core_9_win64.dll set to level 6. So if you plan on decompressing all the streams, it's important that you know the decompressed stream size as Hydra streams can either be Kraken, Mermaid/Selkie or Leviathan in terms of their format (Leviathan streams cannot be processed directly by xtool properly if decompressed size is unknown)

The attachment contains decrypted headers for the first 15GB.

Code:

[0] Performing scan from block 0000000000000000 to 0000000000003E87 (16008)
[0] Actual hydra stream found at 0000000000000000 (16008 >> 71384)

[0] Processing streams on block 0000000000000000 to 0000000000003E87 (16008)
[0] Processed hydra stream at 0000000000000000 (16008 >> 71384 >> 16008) using l6,c0,t256 successfully

KaktoR · #6 21-03-2022, 07:33

Me and Cesar took the opportunity and tested some plugins if they are still working.

Ubisoft Dunia 2 (use xtool 0.3.21 with dunia2_db_R3)

Code:

Far Cry 3
Compressed 2 files, 192,353,931 => 445,118,379 bytes. Ratio 231.41%
Compression time: cpu 0.23 sec/real 11.42 sec = 2%. Speed 16.84 mB/s
All OK

Extracted 2 files, 445,118,379 => 192,353,931 bytes. Ratio 231.41%
Extraction time: cpu 0.41 sec/real 10.08 sec = 4%. Speed 19.07 mB/s
All OK


Far Cry 3 Blood Dragon
Compressed 2 files, 187,181,236 => 381,569,184 bytes. Ratio 203.85%
Compression time: cpu 0.20 sec/real 10.27 sec = 2%. Speed 18.23 mB/s
All OK

Extracted 2 files, 381,569,184 => 187,181,236 bytes. Ratio 203.85%
Extraction time: cpu 0.33 sec/real 8.39 sec = 4%. Speed 22.31 mB/s
All OK


Far Cry 4
Compressed 2 files, 128,161,319 => 304,134,437 bytes. Ratio 237.31%
Compression time: cpu 0.17 sec/real 8.37 sec = 2%. Speed 15.32 mB/s
All OK

Extracted 2 files, 304,134,437 => 128,161,319 bytes. Ratio 237.31%
Extraction time: cpu 0.27 sec/real 8.47 sec = 3%. Speed 15.14 mB/s
All OK


Far Cry 6
Compressed 2 files, 1,018,689,920 => 1,616,466,970 bytes. Ratio 158.68%
Compression time: cpu 0.53 sec/real 15.48 sec = 3%. Speed 65.80 mB/s
All OK

Extracted 2 files, 1,616,466,970 => 1,018,689,920 bytes. Ratio 158.68%
Extraction time: cpu 0.84 sec/real 7.57 sec = 11%. Speed 134.64 mB/s
All OK

Not working: FC5, FCND, WD2
Not tested: FCP (probably same modified lz4 as WD2)

Cyberpunk 2077

Code:

xtool 0.3.21
Compressed 1 file, 200,130,560 => 414,058,350 bytes. Ratio 206.89%
Compression time: cpu 0.25 sec/real 33.74 sec = 1%. Speed 5.93 mB/s
All OK

Extracted 1 file, 414,058,350 => 200,130,560 bytes. Ratio 206.89%
Extraction time: cpu 0.45 sec/real 6.38 sec = 7%. Speed 31.37 mB/s
All OK


xtool 0.4.5
Compressed 1 file, 200,130,560 => 421,178,833 bytes. Ratio 210.45%
Compression time: cpu 0.17 sec/real 30.60 sec = 1%. Speed 6.54 mB/s
All OK

Extracted 1 file, 421,178,833 => 200,130,560 bytes. Ratio 210.45%
Extraction time: cpu 0.45 sec/real 6.46 sec = 7%. Speed 30.96 mB/s
All OK

Unravel 1 + 2 (use xtool 0.3.21)

Code:

Compressed 1 file, 209,006,308 => 412,014,267 bytes. Ratio 197.13%
Compression time: cpu 0.23 sec/real 8.15 sec = 3%. Speed 25.64 mB/s
All OK

Extracted 1 file, 412,014,267 => 209,006,308 bytes. Ratio 197.13%
Extraction time: cpu 0.34 sec/real 2.33 sec = 15%. Speed 89.87 mB/s
All OK

Deathloop (xtool 0.4.5 or 0.3.21 does not matter, both are working)

Code:

Compressed 1 file, 370,332,059 => 538,901,543 bytes. Ratio 145.52%
Compression time: cpu 0.36 sec/real 31.35 sec = 1%. Speed 11.81 mB/s
All OK

Extracted 1 file, 538,901,543 => 370,332,059 bytes. Ratio 145.52%
Extraction time: cpu 0.70 sec/real 31.04 sec = 2%. Speed 11.93 mB/s
All OK

Haemimont Engine (test from "Surviving Mars", xtool 0.4.5 or 0.3.21 does not matter, both are working)

Code:

Compressed 1 file, 117,390,334 => 183,791,889 bytes. Ratio 156.56%
Compression time: cpu 0.11 sec/real 1.79 sec = 6%. Speed 65.52 mB/s
All OK

Extracted 1 file, 183,791,889 => 117,390,334 bytes. Ratio 156.56%
Extraction time: cpu 0.31 sec/real 1.22 sec = 26%. Speed 95.85 mB/s
All OK

Not working: Hitman 3, Bethesda (at least for Skyrim AE version, SE could still work), Saints Row 3 Remaster. Other plugins not tested due to lacking samples.

Razor12911 · #7 23-03-2022, 20:58

Quote:

Originally Posted by KaktoR

Not working: Hitman 3, Bethesda (at least for Skyrim AE version, SE could still work), Saints Row 3 Remaster.

-mxtool:SR3Remaster

Code:

Compressed 1 file, 6,970,632 => 15,132,802 bytes. Ratio 217.09%
Compression time: cpu 0.00 sec/real 1.16 sec = 0%. Speed 6.01 mB/s

Razor12911 · #8 22-03-2022, 14:55

Plugins Updated

Changes

- Updated Unreal Engine plugin

Razor12911 · #9 23-03-2022, 20:54

lz4x

Supported games

Unravel games and to be used by QuickBMS scripts...

Results

Unravel "kits\Unravel.kit.0"

Code:

Compressed 1 file, 209,006,308 => 411,939,814 bytes. Ratio 197.09%
Compression time: cpu 0.23 sec/real 5.90 sec = 4%. Speed 35.40 mB/s

Razor12911 · #10 23-03-2022, 21:28

Crilayla

Supported games

To be used by QuickBMS scripts...

Results

Metal Gear Rising: Revengeance "data106.cpk"

Code:

Compressed 1 file, 104,629,360 => 322,219,345 bytes. Ratio 307.96%
Compression time: cpu 0.16 sec/real 41.44 sec = 0%. Speed 2.52 mB/s

infovs · #11 06-04-2022, 05:59

Quote:

Originally Posted by Razor12911

Crilayla
Supported games To be used by QuickBMS scripts...
Metal Gear Rising: Revengeance "data106.cpk"

Maybe I'm doing someting wrong...but how can I use this on, for example, Dragon Ball Xenoverse 2 .cpk files?
Using -mxtool:crilayla works without error but does not expand at all. dbxv2.xlt generated with bms2xtl using cpk.bms script works (using -mxtool:dbxv2) and .cpk IS expanded. But I don't see how to use this external cpk_R1 plugin, nothing is expanded with crilayla.exe, crilayla.dll and xtool.ini in xtool path (I'm using xtool.ini from latest xtool, section name [crilayla]), maybe I'm missing something?
Thanks in advance,
regards

Masquerade · #12 24-03-2022, 10:20

WRC10 [LZ4F]

A lot of streams are left behind with this method, but if you do not want to extract and decompress each stream before building a decompressed brick of data that you recompress and patch this is a good alternative.
Extract contents of the attached archive and use -mWRC10.
Requires liblz4.dll, I included one that gives a good ratio.
You can discard WRC10.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

Code:

Compressing CHUNK_14.PKG

Compressing 529,863,949 bytes with xtool precomp -mWRC10 -c256mb -t4 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

XTool is created by Razor12911

Streams: 537/757
Time: 00:00:14 (00:00:35)
Memory: 522 MB (522 MB)

100%
Errorlevel=0

Compressed 1 file, 529,863,949 => 743,838,469 bytes. Ratio 140.38%
Compression time: cpu 0.61 sec/real 37.86 sec = 2%. Speed 14.00 mB/s
All OK

Edison007 · #13 28-03-2022, 03:32

Age of Empires III: Definitive Edition LZ4 plugin
https://krinkels.org/threads/age-of-...s-iii-de.4777/

Masquerade · #14 07-04-2022, 14:29

Orcs Must Die! 3 [LZ4HC]

Extract contents of the attached archive and use -mOMD3.
Requires liblz4.dll, I included one that gives a good ratio.
You can discard OMD3.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

Code:

xtool precomp -mOMD3 -c128mb pakchunk42-WindowsNoEditor.pak pakchunk42-WindowsNoEditor.xt_out

XTool is created by Razor12911

Streams: 1892/1892
Time: 00:00:03 (00:00:07)
Memory: 204 MB (204 MB)

KaktoR · #15 19-04-2022, 10:08

^
This also works with pcars2 and pcars3 (same bms script).

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
XTool 2020 (Main Project)	Razor12911	Conversion Tutorials	713	01-06-2026 23:52
XTool - Successor of ZTool	Razor12911	Conversion Tutorials	584	22-04-2023 18:16
[Dev]XTool	Razor12911	Conversion Tutorials	180	23-10-2020 06:26
XTool 2019 (Plugins)	Razor12911	Conversion Tutorials	50	16-05-2020 06:14

The Following 4 Users Say Thank You to Cesar82 For This Useful Post:
Gehrman (11-03-2022), GTX590 (18-03-2022), mausschieber (11-03-2022), Razor12911 (10-03-2022)

The Following 4 Users Say Thank You to Masquerade For This Useful Post:
dixen (12-03-2022), Gehrman (13-03-2022), Razor12911 (03-05-2022), ScOOt3r (12-03-2022)

The Following 3 Users Say Thank You to Masquerade For This Useful Post:
Gehrman (07-06-2022), L0v3craft (07-06-2022), ScOOt3r (07-06-2022)

The Following User Says Thank You to Masquerade For This Useful Post:
Razor12911 (08-06-2023)

The Following 7 Users Say Thank You to Razor12911 For This Useful Post:
:( Sad8669 (14-03-2022), anotherLostAccount (20-04-2022), Gehrman (15-03-2022), GTX590 (18-03-2022), L33THAK0R (14-03-2022), ScOOt3r (14-03-2022), Wanterlude (17-03-2022)

The Following 5 Users Say Thank You to KaktoR For This Useful Post:
:( Sad8669 (21-03-2022), Cesar82 (21-03-2022), Gehrman (22-03-2022), mausschieber (21-03-2022), Razor12911 (22-03-2022)

The Following 2 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (24-03-2022), Gehrman (23-03-2022)

The Following User Says Thank You to Razor12911 For This Useful Post:
Gehrman (22-03-2022)

The Following 4 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (23-03-2022), elit (17-06-2022), Gehrman (23-03-2022), Masquerade (19-04-2022)

The Following User Says Thank You to infovs For This Useful Post:
L0v3craft (24-10-2022)

The Following 2 Users Say Thank You to Masquerade For This Useful Post:
Gehrman (24-03-2022), Razor12911 (28-03-2022)

The Following 6 Users Say Thank You to Edison007 For This Useful Post:
dixen (28-03-2022), Gehrman (28-03-2022), KaktoR (28-03-2022), L0v3craft (30-03-2022), Masquerade (28-03-2022), Razor12911 (28-03-2022)

The Following 6 Users Say Thank You to Masquerade For This Useful Post:
Gehrman (08-04-2022), KaktoR (08-04-2022), kingkaos (13-04-2022), L0v3craft (11-04-2022), Razor12911 (09-04-2022), ScOOt3r (07-06-2022)