Distant Worlds 2

• This game uses very weak LZ4 compression on the bundle files, don't expect a HUGE ratio increase :)
• Extract contents of the attached archive and use -mDistantWorlds2.
• Requires liblz4.dll, I included one that gives a good ratio.
• You can discard DistantWorlds2.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

WWE 2K22 research information

Straight away I'll say working on this game has been a headache especially since there is no information online so I'll post some information if someone wants to continue to work on it but doesn't know where to start.

This game is heavily obfuscated/encrypted. The header structed is encrypted, the data itself is encrypted. They used weak xor encryption which is weak but the catch is these keys are different for each stream/block that's encrypted, they are generated based on a generated hash to produce a 256 byte key.

Since I had no idea how to decrypt the header to get these hash values, I just hijacked the exe by injecting code then to be able to obtain decrypted headers which has a structure that looks like this

As for compression that was used, they used Hydra which comes from oodle library hence you see oo2core_9_win64.dll set to level 6. So if you plan on decompressing all the streams, it's important that you know the decompressed stream size as Hydra streams can either be Kraken, Mermaid/Selkie or Leviathan in terms of their format (Leviathan streams cannot be processed directly by xtool properly if decompressed size is unknown)

The attachment contains decrypted headers for the first 15GB.

Me and Cesar took the opportunity and tested some plugins if they are still working.

Ubisoft Dunia 2 (use xtool 0.3.21 with dunia2_db_R3)
Not working: FC5, FCND, WD2
Not tested: FCP (probably same modified lz4 as WD2)


Cyberpunk 2077

Unravel 1 + 2 (use xtool 0.3.21)

Deathloop (xtool 0.4.5 or 0.3.21 does not matter, both are working)

Haemimont Engine (test from "Surviving Mars", xtool 0.4.5 or 0.3.21 does not matter, both are working)
Not working: Hitman 3, Bethesda (at least for Skyrim AE version, SE could still work), Saints Row 3 Remaster. Other plugins not tested due to lacking samples.

Plugins Updated

Changes

- Updated Unreal Engine plugin

lz4x

Supported games

Unravel games and to be used by QuickBMS scripts...

Results

Unravel "kits\Unravel.kit.0"

-mxtool:SR3Remaster

Crilayla

Supported games

To be used by QuickBMS scripts...

Results

Metal Gear Rising: Revengeance "data106.cpk"

WRC10 [LZ4F]

• A lot of streams are left behind with this method, but if you do not want to extract and decompress each stream before building a decompressed brick of data that you recompress and patch this is a good alternative.
• Extract contents of the attached archive and use -mWRC10.
• Requires liblz4.dll, I included one that gives a good ratio.
• You can discard WRC10.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

Age of Empires III: Definitive Edition LZ4 plugin
https://krinkels.org/threads/age-of-...s-iii-de.4777/

Maybe I'm doing someting wrong...but how can I use this on, for example, Dragon Ball Xenoverse 2 .cpk files?
Using -mxtool:crilayla works without error but does not expand at all. dbxv2.xlt generated with bms2xtl using cpk.bms script works (using -mxtool:dbxv2) and .cpk IS expanded. But I don't see how to use this external cpk_R1 plugin, nothing is expanded with crilayla.exe, crilayla.dll and xtool.ini in xtool path (I'm using xtool.ini from latest xtool, section name [crilayla]), maybe I'm missing something?
Thanks in advance,
regards

Orcs Must Die! 3 [LZ4HC]

• Extract contents of the attached archive and use -mOMD3.
• Requires liblz4.dll, I included one that gives a good ratio.
• You can discard OMD3.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

I'd like to point out that this game has streams that decompress to 500MB+ each, the largest I've seen is around 870MB which is above the threshold xtool sets to ensure decoding memory doesn't get out of hand and because of this, when xtool decodes it will mostly use 1 thread regardless of the number of threads the user has set which means slow installation times if you planned on repacking this game. It's not a bug, it's how xtool was designed and how the game developers decided to make their game use large streams.

I'm leaving this information here in case people in futruee start complaining about slow installation times for this game when they use xtool. Oodle precompressor side protect does not have this memory threshold so you can use that however be sure to use the libraries attached in deathloop oo2core 7 and 8 are required, oo2core 7 is the one that passes some commands to the original library because not only did they use large streams they used non standard compression settings so good luck :)

cpk doesn't work by itself it has to be used by another plugin and in this case, a database in which you would create using bms2xtl.

Project CARS [RC4 + XCompress]

• Extract contents of the attached archive and use -mPCARS.
• You must use -d1 because this game has two layers to the bff file, the first layer is rc4 encryption and the second is compressed data.
• You can discard the PCARS.XTL file and the key files for decoding, but you must have:
  • xtool.ini
  • xcompress.exe
  • xcompress.dll
• You must use the following configuration for the XCompress codec for XTool (thanks Razor12911 for explaining this to me):
  
  Code:

  ---

  [xmemcompress]
Encode=xcompress.exe d -window=131072 -partition=524288 <library>
Decode=xcompress.exe e -window=131072 -partition=524288 <library>

  ---

^
This also works with pcars2 and pcars3 (same bms script).

PCARS 2 & 3 use Oodle Kraken, not xcompress.

Sorry, I wanted to write "same bms script" lol. For some reason I wrote something different

Edit: Corrected my post

Automobilista 2 [RC4 + ZLIB]

• Extract contents of the attached archive and use -mautomobilista2.
• You must use -d1 because this game has two layers to the bff file, the first layer is rc4 encryption and the second is compressed data.
• You can discard the Automobilista2.xtl file and the key files for decoding, but you must keep the zlib/reflate libraries.

[31/12/22] [Updated to game version v1.4.5.2]

Super Robot Wars 30 [DECRYPTION ONLY] [Blowfish]

• Extract contents of the attached archive and use -mSRW30.
• You can discard the SRW30.XTL file and the key file for decoding, but you must keep the following:
  • quickbms.exe
  • xtool.ini
• After decrypting, you need to add crilayla precompressor. This XTool database does not do any precompression. I am using crilayla precompressor from XTool v0.12 which is also attached below.
• Some streams may be missing from the database due to some stream extraction issue with CriPakTools but most streams, especially the big ones, will definitely be detected.
• WARNING! VERY slow :D

Ultra Age [v2] [Oodle]

• Extract the contents of the below archive and use -mUltraAge.
• Requires oo2core_*_win64.dll, I included one in the archive.
• You can discard the UltraAge.xtl for decoding, but you must retain the oodle core.
• v2: I made a mistake in first database with the oodle codec. v2 database is correct.

Project CARS 3 [RC4 + Kraken]

• Extract contents of the attached archive and use -mPCARS3
• You must use -d1 because this game has two layers to the bff file, the first layer is rc4 encryption and the second is compressed data.
• You can discard the PCARS3.XTL file and the key files for decoding, but you must keep the oodle library.

DIRT 5 [LZ4]

• Extract the contents of the attached archive and use -mdirt5.
• liblz4.dll is required, I included one for you.
• You can discard dirt5.xtl for decoding, but you must retain the same liblz4.dll you used for precompression.
• Thanks to Razor12911 and spiritovod!

Castle Of Illusion [LZ4HC]

• Extract contents of attached archive and use -mcastleofillusion
• liblz4.dll is required. I included one that gives a good ratio.
• This game uses LZ4HC at level 9.
• You can discard castleofillusion.xtl for decoding, but you most retain the same liblz4 library you used for encoding.

Test Drive: Ferrari Racing Legends [RC4 + XCompress]

• Extract contents of the attached archive and use -mTDFRL.
• You must use -d1 because this game has two layers to the bff file, the first layer is rc4 encryption and the second is compressed data.
• You can discard the TDFRL.XTL file and the key files for decoding, but you must have:
  • xtool.ini
  • xcompress.exe
  • xcompress.dll

Is there any location to download old version of plugins and database makers?
For example, I want to try old version of dunia database maker R3 with xtool 0.3.21.. Because I can't make latest (R5) version to work with FC6 and latest xtool 0.5.3. Yes, I have everything, not new at this at all, successfully created database fc6.xtl, have tried different versions of liblz4.dll with it, tried -d1 in arc.ini, all in same dir, etc etc, no error with -mxtool:fc6 but it simply does not expand. I'm grateful to anyone with any advice on this, maybe I'm missing something.
P.S. btw, there are only _few_ old versions of plugins at "older releases" xtool link.. and none of database maker old releases.

Doesn't expand because xtool and/or the database maker are bugged. If you create the database only on one .dat file (you must include the same .fat) xtool is going to work. It doesn't work if you create the database on all game files. I have reported this problem to razor already.

Updated Orcs Must Die! 3 LZ4HC database to game version v1.2.0.2 / Build 8601683.

doboz Plugin for XTool

Just a very simple way of adding the ability to precompress streams compressed using doboz algorithm with XTool.

You cannot use this on its own, just like xmemcompress plugin. It's designed to be used with BMS2XTL.

Particularly, the Witcher 3 - which uses a fun compression cоcktail of many algos, one of which is doboz.

Thanks to Attila T. Afra who's doboz compressor is used here. I found this on the wayback machine when looking for potential source code I could compile.

Hmm. It's interesting, thank you
By the way, does anyone know what algorithm the *.str files use in Dead Space 2?

Redout 2 [Leviathan]

• Extract the contents of the attached archive and use -mredout2.
• Requires oo2core_*_win64.dll - I included one that gives a good ratio.
• You can delete redout2.xtl for decoding but you must retain the same oodle core used for precompression.

Finally I figured out bms->xtool. Was wondering why it doesn't work with:
alone, then created xtl using bms2xtl and it did work. The fact that this tool can generate library from the script.. its mind blowing and incredible how much talent this guy have.

I have a question @razor, does this(quickbms method) have any constrains like internal codecs? For example chunk size 'c', does it exist in this realm too or not?

Chunk size exists here as well, sorry for late reply. Been busy :)

King Arthur Knight's Tale

Supported games
King Arthur Knight's Tale (requires oo2core_9_win64.dll)

Usage
Place kakt.dll near xtool.exe along with required libraries and use -mkakt

Notes

The library is required when encoding.

Oodle supremacy strikes again: Making repacking obsolete since 2018

UE4 plugin (R6) don't work with Street Fighter V

Sample?

https://drive.google.com/file/d/180T...ew?usp=sharing

Key

Spiderman Remastered

Supported games
Spiderman Remastered (requires liblz4.dll)

Usage
Place spidey.dll near xtool.exe along with required libraries and use -mspidey

Notes

The library is required when encoding.

Might as well compress the game as is, lz4 in fast mode is used.
Tested on small samples provided.

Edit: Hotfix uploaded

Thanks, here is a quick comparison

Saints Row 2022

Supported games
Saints Row 2022 (requires liblz4.dll, xdelta_dll.dll)
Saints Row Boss Factory (requires liblz4.dll, xdelta_dll.dll)

Usage
Place sr22.dll near xtool.exe along with required libraries and use -msr22

Notes

The library is required when encoding.

Results

Plugin update available

Changes

- Fixed issues in unity engine plugin from being able to process multiple streams in the same chunk
- Added feature to allow user to enforce method used.

Notes

Unity plugin was heavily flawed because of a tiny coding mistake on my part, fixed the issue thanks to help of Masquerade and KaktoR.
It was also brought to my attention that newer unity games use level 12 instead of level 10 lz4hc and as such, the user will need to specify the compression algorithm to use including level because that's the only way xdelta works.

What does this mean for novices? If using -munity does not give you desired results, you can enforce the method like this:
-munity,lz4 (this will set the method to lz4, I was given a sample that required this)
-munity,lz4hc,l12 (this will set the method to lz4hc and use level 12, this is for newer unity games)
-munity,lz4hc,l10 (this will set the method to lz4hc and use level 10, this is for older unity games)

You can use verbose mode to see results and always remember than lz4hc compresses better than lz4. You can then play around with the two methods and the levels of lz4hc until you come close to the original size.

Here are some games which I could process without any errors and maxed out stream detection

Cult of the Lamb -> lz4hc,l12 (lz4 library 1.8.2 - 1.9.3)
Final Fantasy Pixel Remaster (all 6 games) -> lz4hc,l12
V Rising -> lz4 (lz4 library 1.8.0)
Starship Troopers Terran Command -> lz4hc,l12 (lz4 library 1.9.3 on some small bundle files, not worth in my opinion)
Outward -> lz4hc,l12 (lz4 library 1.8.2 - 1.9.3)