XTool 2020 (Plugins) [Archive]

Razor12911

11-10-2020, 23:45

Configuration based
Age of Empires III: Definitive Edition (https://fileforums.com/showpost.php?p=496301&postcount=249)
Cyberpunk 2077 (https://fileforums.com/showpost.php?p=489349&postcount=13)
Deathloop (https://fileforums.com/showpost.php?p=494134&postcount=216)
EA Frostbite Engine (https://fileforums.com/showpost.php?p=488282&postcount=2)
Saints Row The Third Remastered (https://fileforums.com/showpost.php?p=488547&postcount=3)

Library based
Anvil Engine (https://fileforums.com/showpost.php?p=498193&postcount=286)
Bethesda (https://fileforums.com/showpost.php?p=490258&postcount=87)
CryEngine (https://fileforums.com/showpost.php?p=493470&postcount=188)
Haemimont Engine (https://fileforums.com/showpost.php?p=492318&postcount=104)
Hitman (https://fileforums.com/showpost.php?p=489983&postcount=48)
King Arthur Knight's Tale (https://fileforums.com/showpost.php?p=497337&postcount=272)
Madness Engine (https://fileforums.com/showpost.php?p=492646&postcount=131)
Spiderman Remastered (https://fileforums.com/showpost.php?p=497947&postcount=276)
Unity Engine (https://fileforums.com/showpost.php?p=492619&postcount=124)
Unreal Engine (https://fileforums.com/showpost.php?p=489801&postcount=25)

Database 'based'
Automobilista 2 (https://fileforums.com/showpost.php?p=496610&postcount=257)
Castle Of Illusion (https://fileforums.com/showpost.php?p=496719&postcount=262)
Dirt 5 (https://fileforums.com/showpost.php?p=496681&postcount=261)
Distant Worlds 2 (https://fileforums.com/showpost.php?p=496188&postcount=241)
Orcs Must Die! 3 (https://fileforums.com/showpost.php?p=496456&postcount=251)
Project Cars (https://fileforums.com/showpost.php?p=496546&postcount=253)
Project Cars 3 (https://fileforums.com/showpost.php?p=496654&postcount=260)
Redout 2 (https://fileforums.com/showpost.php?p=497264&postcount=269)
Scarlet Nexus (https://fileforums.com/showpost.php?p=493013&postcount=166)
Super Robot Wars 30 (https://fileforums.com/showpost.php?p=496619&postcount=258)
Test Drive: Ferrari Racing Legends (https://fileforums.com/showpost.php?p=496758&postcount=263)
Ubisoft Dunia 2 Engine (https://fileforums.com/showpost.php?p=488686&postcount=4)
Unravel 1 & 2 (https://fileforums.com/showpost.php?p=492750&postcount=137)
Ultra Age (https://fileforums.com/showpost.php?p=496633&postcount=259)
WRC10 (https://fileforums.com/showpost.php?p=496278&postcount=248)

Executable based
crilayla (https://fileforums.com/showpost.php?p=496275&postcount=248)
Doboz (https://fileforums.com/showpost.php?p=497188&postcount=267)
lz4x (https://fileforums.com/showpost.php?p=496272&postcount=246)
xmemcompress (https://fileforums.com/showpost.php?p=495860&postcount=237)

Notes

*.ini and *.xtl files can be discarded when decoding, they will no be longer needed.
*.dll are required both encoding and decoding

Razor12911

11-10-2020, 23:49

EA Frostbite Engine

Supported games
Dragon Age Inquisition (requires zlibwapi.dll)
FIFA 18, FIFA 19, FIFA 20, FIFA 21, FIFA 22 (require oo2core_#_win64.dll)
NFS Rivals, NFS 2015, NFS Payback (requires liblz4.dll)
Mirror's Edge Catalyst (requires liblz4.dll)
Battlefield 4, Battlefield 1, Battlefield Hardline, Battlefield V (requires liblz4.dll)
Battlefield 2042 Open-Beta (require oo2core_#_win64.dll)
Mass Effect Andromeda, Star Wars Battlefront II, Star Wars Squardon (requires libzstd.dll)
NFS Heat (require oo2core_#_win64.dll)

Usage
Place frostbite3.ini near xtool.exe along with required libraries and use -mfrostbite3.

Razor12911

23-10-2020, 12:50

Saints Row The Third Remastered

Supported games
Saints Row The Third Remastered (requires liblz4.dll)

Usage
Place SR3Remaster.ini near xtool.exe along with required libraries and use -msr3remaster.

Changelog

R1
- Initial release

Razor12911

29-10-2020, 12:46

Ubisoft Dunia 2 Engine

Supported games

Far Cry 3, Far Cry 4 (requires lzo2.dll)
Far Cry 5, Far Cry New Dawn, Far Cry 6 (requires liblz4.dll)
Far Cry Primal, Watch Dog II, Watch Dogs Legion (requires liblz4.dll and libdunia.dll)
The Crew 2 (requires require oo2core_5_win64.dll from game)
Watch Dogs (supported via bms2xtl, use script)

Usage

Generate your own database using this tool (https://fileforums.com/showpost.php?p=492876&postcount=6)

dixen

29-10-2020, 13:54

igepatch.dat
ige.dat
common.dat
patchshadersobj.dat
shadersobj.dat
farcry5_hd.dat

Pack

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 6 files, 839,426,147 => 1,357,590,096 bytes. Ratio 161.73%
Compression time: cpu 1.00 sec/real 30.00 sec = 3%. Speed 27.98 mB/s
All OK

Unpack

Extracted 6 files, 1,357,590,096 => 839,426,147 bytes. Ratio 161.73%
Extraction time: cpu 1.50 sec/real 9.81 sec = 15%. Speed 85.61 mB/s
All OK

Tested without *.fat
Thank you Razor)))

Razor12911

29-10-2020, 22:03

Added The Crew 2 support

Comparison between precompressors + settings:

oo2reck
Compressed 1 file, 391,671,788 => 391,671,888 bytes. Ratio 100.00%
Compression time: cpu 0.48 sec/real 689.66 sec = 0%. Speed 0.57 mB/s

xtool 2020 -mkraken
Compressed 1 file, 391,671,788 => 841,628,084 bytes. Ratio 214.88%
Compression time: cpu 0.47 sec/real 116.43 sec = 0%. Speed 3.36 mB/s

xtool 2020 -mkraken:l5
Compressed 1 file, 391,671,788 => 914,783,523 bytes. Ratio 233.56%
Compression time: cpu 0.55 sec/real 72.32 sec = 1%. Speed 5.42 mB/s

xtool 2020 -mthecrew2
Compressed 1 file, 391,671,788 => 955,848,857 bytes. Ratio 244.04%
Compression time: cpu 0.47 sec/real 85.36 sec = 1%. Speed 4.59 mB/s

dixen

30-10-2020, 03:12

Early rejoiced...
Patch.dat

DELZOREC - 8.3 gb > 11 gb
XTOOL with .xtl db - 8.3 gb > 8.5 gb
Dedup on or off - no matter

Sorry i'm stupid)) It try on R3...R4 all fine

Razor12911

30-10-2020, 14:02

Sorry i'm stupid)) It try on R3...R4 all fine
Actually there is a problem :)

It happens when you are multi threading (there is something I miscalculated), it will be fixed in the next release. Thanks for spotting it ;)

Edit: test 2010_R5

dixen

30-10-2020, 23:59

Edit: test 2010_R5

Thanks but it tomorrow only

Razor12911

10-11-2020, 19:05

Added Far Cry Primal, Watch Dogs 2, Watch Dogs Legion support

Some results

Far Cry Primal
Compressed 1 file, 3,416,769,501 => 4,524,578,126 bytes. Ratio 132.42%
Compression time: cpu 3.77 sec/real 61.22 sec = 6%. Speed 55.81 mB/s

Watch Dogs 2
Compressed 1 file, 3,039,636,135 => 4,508,552,634 bytes. Ratio 148.33%
Compression time: cpu 3.66 sec/real 102.82 sec = 4%. Speed 29.56 mB/s

Watch Dogs Legion
Compressed 1 file, 2,204,038,964 => 4,946,250,236 bytes. Ratio 224.42%
Compression time: cpu 2.72 sec/real 101.29 sec = 3%. Speed 21.76 mB/s

Notes
This is highly dependent on the temporary libdunia codec xtool just received. I haven't done a proper job so this is what you can get for now. :(

Thank ProFrager, FitGirl and ZAZA4EVER

elit

04-12-2020, 14:45

Yes, this is pretty much what I meant back in 2018: https://fileforums.com/showpost.php?p=471409&postcount=296

elit

05-12-2020, 09:16

Now that I think about it, this could be also a way to make xtool codec-universal. Imagine this:
You would expose certain functions name calls as an open specification - similar to what FA does with CLS, like say:
_int64 compress(_int64 ...)
_int64 decompress(_int64 ...)
Next, xtool would always scan for an universal dll name, like custom_cmp.dll or whatever. On the command line, something like "customcodec" would be possible to type as a codec name, which would call for the interested functions from the library.

People would create those dlls on their demand from existing quickbms code amd implement those function names in them, for example copy lzss or yaz0 codec from quickbms source and make a dll with those above functions as a bridge.

Xtool would load custom dll and use those function calls to call the codec. Thogether with custom scripts, one could inflate almost anything now and would make the tool useful to the long future and tor many more current and future codecs and games, even if you cease to work on it one day. Same as FA is still so used today because of its universal container aspect and more.

Razor12911

10-12-2020, 22:24

Cyberpunk 2077

Supported games
Cyberpunk 2077 (requires oo2ext_7_win64.dll)

Usage
Place cp2077.ini near xtool.exe along with required libraries and use -mcp2077

comparison (basegame_4_animation.archive)

oo2reck
Compressed 1 file, 1,062,289,408 => 1,642,925,099 bytes. Ratio 154.66%
Compression time: cpu 1.22 sec/real 510.06 sec = 0%. Speed 2.08 mB/s

xtool 2020 -mkraken
Compressed 1 file, 1,062,289,408 => 1,625,753,845 bytes. Ratio 153.04%
Compression time: cpu 1.14 sec/real 78.62 sec = 1%. Speed 13.51 mB/s

xtool 2020 -mcp2077
Compressed 1 file, 1,062,289,408 => 2,399,648,730 bytes. Ratio 225.89%
Compression time: cpu 1.23 sec/real 32.01 sec = 4%. Speed 33.19 mB/s

Snake288

03-01-2021, 10:50

Cyberpunk 2077 about compression please, I want to get help.

KaktoR control the compression method
getting the error seen in the picture
disk full error my disk free space is close to 650 gb
the computer system information you can see in my picture gipi strong

https://i.imgyukle.com/2020/12/26/aSbuGj.jpg (https://imgyukle.com/i/aSbuGj)
https://i.imgyukle.com/2020/12/26/aSbS58.jpg (https://imgyukle.com/i/aSbS58)

mausschieber

03-01-2021, 11:50

Snake288

03-01-2021, 11:54

C:\Games\Cyberpunk 2077 game Samsung 960 evo 512 gb m2 installed

mausschieber

03-01-2021, 11:57

C:\Games\Cyberpunk 2077 game Samsung 960 evo 512 gb m2 installed

I think M2 is not supported, but I don't know exactly. try to install on a different drive

Snake288

03-01-2021, 12:04

7 Days I Tried Different Method Of Trying To Compress This Game

oo2reck7+srep_new+NLolz I get an error when installing compressed

I've tried them all, I'm getting the same error again

https://i.imgyukle.com/2020/12/30/acYWHH.jpg

https://i.imgyukle.com/2020/12/31/agYNyh.jpg

https://i.imgyukle.com/2020/12/31/agYpm1.jpg

Razor12911

03-01-2021, 22:37

decompress via command line and don't use stdio, I'm interested in the error xtool reports.

Edit: I would understand if you got crc error or if any of other decoding processes terminated but they are still running from the task manager and still working so I would assume the issue is with diskspan or something else. Try recompressing the game without diskspan and then report if the error still persists.

Snake288

04-01-2021, 07:49

Cyberpunk 2077 about compression please, I want to get help.

Razor12911 control the compression method
getting the error seen in the picture
disk full error my disk free space is close to 650 gb
the computer system information you can see in my picture gipi strong

https://i.imgyukle.com/2020/12/26/aSbuGj.jpg (https://imgyukle.com/i/aSbuGj)
https://i.imgyukle.com/2020/12/26/aSbS58.jpg (https://imgyukle.com/i/aSbS58)

Ele

04-01-2021, 08:00

Razor12911

04-01-2021, 20:16

Snake288

05-01-2021, 08:11

Razor12911
how is it done ? test without using stdio do you know an example ?

Ele

05-01-2021, 09:15

Razor12911
how is it done ? test without using stdio do you know an example ?

I guess ???

[External compressor:xtool]
header = 0
unpackcmd = xtool.exe decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Razor12911

08-01-2021, 20:09

Unreal Engine

Codecs available

ue3
Use on unreal engine 3 games

This codec works without parameters.
ue4
Use on unreal engine 4/5 games with *.pak file extension

Parameters available:
k#... - to specify decryption key if game is encrypted

You can also directly specify what compression algorithm was used to help xtool with detection and speed up the process.
Algorithms available:
zlib, lz4, lz4hc, lzna, kraken, mermaid, selkie, hydra, leviathan

Example:
-ue4:k0x014AEC0148FBDEE9640633AAB67521AAB4E1083A98F 76FF33DDCF78DAD05BE66+kraken -d1

ue5
Use on unreal engine 4/5 games with *.utoc/*.ucas format

Parameters available:
k#... - to specify decryption key if game is encrypted

Example:
-mue5:k0x48AE8311350417BDC50A440FCD0E98B2FA6BCEAE3E DA8D0E24881F205E6C4540+zlib -d1

L0v3craft

09-01-2021, 05:16

Unreal Engine

How this can work without chunk size and block size? It uses the same chunk size of zlib? And about the block size?

Razor12911

09-01-2021, 08:37

chunk size corresponds to -c parameter used in xtool.

Edit: You don't really need to set high values for chunk size because unlike ue4dt, the chunks when split actually cut off some data from being decrypted but in xtool this rarely happens.

Cesar82

09-01-2021, 17:38

@Razor12911, sorry for so many questions, but I'm trying to understand how XTool works.

1) The "liblz4.dll" library of the "Ubisoft Dunia 2 Engine" plugins files (Far Cry Primal, Watch Dogs 2, Watch Dogs Legion) (136 Kb), and different from the "liblz4.dll" library shared with XTool (439 Kb).
Only the "Far Cry 5" plugin use "liblz4.dll" library is the same hash (439 Kb).
Can I use the library in the "_libraries" folder (439 Kb) for all plugins?
2) Do I understand correctly that it is not necessary to include the "* .ini" and "* .xtl" files of the plugins to decompress with XTool.
As an example, if you use the "EA Frostbite Engine" plugin it is not necessary to add anything with XTool to decompress compatible games.
This is correct?
3) Are all plugins compatible with XTool 0.31?
4) Unreal Engine plugin is it not necessary to put "0x" before the key?
5) XTool already has support for methods "LZ4" and "ZSTD" (has the libraries in the folder "_libraries")?

Razor12911

09-01-2021, 17:57

1) Short answer, no. Far Cry Primal, Watch Dogs 2 and Watch Dogs Legion use modified lz4 because the devs thought this was a good idea. Far Cry 5 use the normal version along with New Dawn.

2) Yes, *.ini and *.xtl files are no longer needed after compressing. But the libraries they come with are needed.

3) Yes, apart from Far Cry Primal, Watch Dogs 2, Watch Dogs Legion as these three require libdunia which was removed before and I'm currently busy making a plugin version of it.

4) you can add 0x, $ or # which symbolizes Hexadecimal or just remove it, Up to you. Xtool will check if 0x exists before the key and if it does, it will remove it and if it doesn't, it will convert the key to binary so it uses it on decryption function.

5) "XTool already has support for methods", well the answer is yes and also no. XTool does support these methods yes, but you can't use -mlz4 on a lz4 compressed game and expect xtool to precompress it because scanning for lz4 streams is almost impossible but these "plugins", *.xtl, *.ini and *.dll are the ones that help lz4 by telling it where to find the streams. As for zstd, -mzstd works because scanning for zstd is easier.

You just need to wait for me to update the documentation so you know how to write your own plugin to be able to add support to a game that xtool doesn't have native support for.

Cesar82

09-01-2021, 20:21

@Razor12911, I confused the liblz4.dll libraries with the version I use with the old XTool.
The "Far Cry 5" plugin uses "liblz4.dll" library is the same as the library that came with the old XTool (439 Kb).
The library in the folder "_Libraries" of XTool 2020 is larger and has 494 KB (506,742 bytes).
Sorry for more question.
1) Can I use the library in the "_Libraries" folder of XTool 2020 (494 KB) with the Far cry 5 plugin?
P.S: I'm asking so many questions because I want to include support for all of your XTool plugins in DiskSpan_GUI.
I'm asking so many questions because I want to include support for all of your XTool plugins in DiskSpan_GUI.
As I mentioned before, plugins / library files will be copied before compression and deleted after compressing.
As there are variations of the libraries I would like to be able to use it for all methods (except where it is not possible).
I will wait for the XTool documentation to understand it better.
Thanks!

Razor12911

09-01-2021, 21:19

You do realize that almost each time lz4 is updated on github it compresses data a bit differently? This "bit differently" is why xtool from the beginning allows users to change the library however they want so they pick whichever one gives the best result. When it comes to lz4, there is no universal dll for all games so if you want to add support, you must tell the user to always add the libraries that come with plugins to the DiskSpan_GUI folder.

The lz4 library I ship in xtool is v1.8.3 which is the commonly used library, some games use an older and some use a newer but nonetheless if the streams cannot be restored correctly, xdelta is applied.

If the user uses the incorrect liblz4.dll, xtool tries to use xdelta on the streams and if the user chose the wrong one or does not use the one that comes with a plugin, you end up with negative ratio. Where using a precompressor just gives worse result.

This is seen here (https://fileforums.com/showpost.php?p=488991&postcount=237), although I am not sure how this situation in particular happened...

Edit: The same is true with zstd, each update causes xtool to use xdelta to try to salvage some streams. Zlib would also be using the same method of xdelta but other libraries such as reflate and preflate exist that handle streams that zlib can't and when it comes to the situation of lz4, there is no such tool.

Cesar82

10-01-2021, 09:11

@Razor12911, could you tell me if the FIFA plugin (EA_Frostbite_Engine) is not yet functional?
It only has a link to FIFA21, but the example was a little confusing and has several filesand a larger XTool (Maybe it was rewritten especially for this game).
I didn't understand where this part of the method came from? -mfrostbite3+zstd.dict:l19
If the plugin is ready, it could post an example with the other previous fifa using XTool 0.31?
How is it determined which section [Stream#] will be used for each game? In frostbite3.ini has 3 commented sections that are for FIFA games
If you want, let me know that I remove my posts from this topic of yours so that I don't have irrelevant content.

I tried to do some tests here, but it seems that XTool has an AI. Even with a lack of plugin libraries, XTool compresses too (no errors were shown), and the extraction was done normally. (It seems that for lack of DLL files, XTool changes the method to avoid errors).
You're the guy, congratulations on the great job.

Razor12911

10-01-2021, 11:16

FIFA is a special case like Far Cry Primal, Watch Dogs 2/Legion, they encrypted the game and used two algorithms, kraken/leviathan + zstd, the zstd used has dictionary. So even before we begin. You have to use FIFA 19 Cas Decryption Tool (https://fileforums.com/showthread.php?t=102461) and then use xtool (I think for FIFA 19 and FIFA 20). As for the method "zstd.dict:l19", it's more or less the same as libdunia situation where I added a temporary codec internally and then remove it, however the xtool with the temporary codec can still be found here (https://fileforums.com/showpost.php?p=488596&postcount=1969)

I added these methods because of the scene, I thought they have made a breakthrough in bypassing the latest iteration of Denuvo so I added several methods quickly but as you can see right now, these games are still uncracked so I remove the methods and then slowly put them back via plugin support now that I have made xtool accept them.

@Razor12911I tried to do some tests here, but it seems that XTool has an AI. Even with a lack of plugin libraries, XTool compresses too (no errors were shown), and the extraction was done normally. (It seems that for lack of DLL files, XTool changes the method to avoid errors).
You're the guy, congratulations on the great job.

Of course checks are made to see if a library can be initialized or not. I'm not sure if you checked the source code included in Unreal Engine (https://fileforums.com/showpost.php?p=489801&postcount=25) plugin

28724

Here the plugin checks if a user has given a key and necessary parameters and if nothing is given then using -mue4 then the plugin will be unavailable.

If for example you are just trying to use frostbite3.ini, it has 5 different streams to be detected, if you have liblz4.dll, xtool will search for all 5 different streams but when it tries to add the streams that were found and finds that some libraries are missing, these streams are discarded so that xtool continues working and not raise an error.

Edit:

[Stream1]
// DAInquisition
Name=zlib
Codec=zlib:l98
BigEndian=1
Signature=0x0270
Structure=Dict(1),DSize(3),Signature(2),CSize(2),Z LibHdr(2),Stream
StreamOffset=0
CompressedSize=CSize - 6
DecompressedSize=DSize
Condition1=DSize > CSize
Condition2=CSize > 64
Condition3=CSize <= 262144
Condition4=Dict=0
Condition5=ZLibHdr = 0x78DA

[Stream2]
// BF4-BFV, NFS2015-NFSHeat, MECatalyst
Name=lz4
Codec=lz4
BigEndian=1
Signature=0x0970
Structure=Dict(1),DSize(3),Signature(2),CSize(2),S tream
StreamOffset=0
CompressedSize=CSize
DecompressedSize=DSize
Condition1=DSize > CSize
Condition2=CSize > 64
Condition3=CSize <= 262144
Condition4=Dict = 0

[Stream3]
// MEAndromeda
Name=zstd
Codec=zstd:l19
BigEndian=1
Signature=0x0F70
Structure=Dict(1),DSize(3),Signature(2),CSize(2),Z StdHdr(4),Stream
StreamOffset=-4
CompressedSize=CSize
DecompressedSize=DSize
Condition1=DSize > CSize
Condition2=CSize > 64
Condition3=CSize <= 262144
Condition4=Dict = 0
Condition5=ZStdHdr = 0x28B52FFD

[Stream4]
// FIFA 18-20
Name=kraken
Codec=kraken:l8:t128
BigEndian=1
Signature=0x1970
Structure=Dict(1),DSize(3),Signature(2),CSize(2),O odleHdr(2),Stream
StreamOffset=-2
CompressedSize=CSize
DecompressedSize=DSize
Condition1=DSize > CSize
Condition2=CSize > 64
Condition3=CSize <= 262144
Condition4=Dict = 0
Condition5=OodleHdr = 0x8C06

[Stream5]
// FIFA 21
Name=leviathan
Codec=leviathan:l8:t128
BigEndian=1
Signature=0x1970
Structure=Dict(1),DSize(3),Signature(2),CSize(2),O odleHdr(2),Stream
StreamOffset=-2
CompressedSize=CSize
DecompressedSize=DSize
Condition1=DSize > CSize
Condition2=CSize > 64
Condition3=CSize <= 262144
Condition4=Dict = 0
Condition5=OodleHdr = 0x8C0C

Alternatively, when using -mfrostbite3 method, you can use it this way -mfrostbite3:zstd, xtool will check what Streams are called "zstd" as they have names, Stream3 is the one that is called zstd, so it will only search using information from Stream3. Same as -mfrostbite3:zstd:zlib, where Stream1 and Stream3 are the ones that are searched. However if no parameter is given, -mfrostbite3, all 5 streams are searched.

Razor12911

10-01-2021, 11:40

To properly explain how xtool behaves. The plugins I post here should be considered "external" plugins, there are also plugins in xtool called "internal" plugins. These are just common compressors used in games, zlib, lz4, lzo and etc. Since some internal plugins have issues detecting streams by themselves, lz4 as an example. What normally happens is, the external plugins I post here give information to the internal plugins. Telling them exactly how the streams are found and where to look for them. So if you use a plugin like frostbite3 and don't add zlibwapi.dll, liblz4.dll and etc. Basically no libraries whatsoever. When the external plugins give information to the internal ones. They will refuse to accept streams or any of the information as they didn't initialize because of missing libraries therefore no error is given however the ratio is affected. You can try it now yourself, use any of the plugins without the required libraries, xtool will just give a result of 100% ratio and no error. Encoding is never a problem, the problem starts when you are decoding, if you used something when encoding but it's missing when decoding. XTool will give you an error telling you a certain method was not found.

Edit:

This is what I told this person here (https://fileforums.com/showpost.php?p=489695&postcount=18), to run xtool without stdio so that I can see the error message that xtool gives.

Here's an example, I used zlib method when encoding and then I removed zlibwapi.dll and then tried to decode.

Cesar82

10-01-2021, 12:38

@Razor12911, now I understand about the sections [Stream#], the method must be used the value obtained in the key Name=.
The link to the temporary codec is not accessible.
I haven't looked at the Unreal Engine source code (I'll see).
run xtool without stdio.
I don't know if only I don't understand. You could explain that.
Check your inbox.
Thanks!

Razor12911

13-01-2021, 10:31

Plugins Updated

Changes

- Updated The Crew 2 to support latest update
- Updated Far Cry Primal, Watch Dogs 2 and Watch Dogs Legion

patricktech

13-01-2021, 16:17

Nice

HunterEmrah

13-01-2021, 20:04

Cyberpunk 2077 about compression please, I want to get help.
i have the same problem when compressing cyberpunk 2077 with cb2077 plugin, it gives error in random progress percent (1.2%, 1.5%, 1.7%)

F:\Games\Cyberpunk 2077\pack\pak>arc a -s; -dsgerpn -lc- -di -hppassword -cfg"C:\Program Files (x86)\FreeArc\bin\xtool2020\arc.ini" -wF:\Temp -mxtool+srep+lzma2 ..\data1.bin * -r
FreeArc 0.67 (March 15 2014) Creating archive: ..\data1.bin using xtool+srep+lzma2
Memory for compression 0b, decompression 0b, cache 1mb
Compressing 16 files, 57,137,917,952 bytes. Processed 1.7%
ERROR: write error (disk full?) in compression algorithm xtool

arc.ini
[External compressor:xtool]
header = 0
packcmd = XTool.exe precomp -mcp2077 -c128mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = XTool.exe decode -t100p - - <stdin> <stdout>

[External compressor:srep]
header = 0
packcmd = srep -m3f -a1 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d -mem2048mb - - <stdin> <stdout>

[External compressor:lzma2]
header = 0
packcmd = 7z_fa a -txz -an -mcrc=0 -mx9 -m0=lzma2:a=1:d=350m:mf=bt4:fb=273:mc=4294967295:lc =4:lp=0:pb=2 -mmt=3 -si -so <stdin> <stdout>
unpackcmd = 7z_fa x -txz -an -y -si -so <stdin> <stdout>

There is no problem when compressing files separately (tried only these files: basegame_4_animation.archive, lang_en_voice.archive, lang_ru_voice.archive), but I get this error when I compress all ".archive" files at the same time (except what I mentioned before).

also tried without <stdin> <stdout> but it's stuck on %100 after arc.exe compressing files in to one archive.

Razor12911

13-01-2021, 21:44

[External compressor:xtool]
header = 0
packcmd = XTool.exe precomp -mcp2077 -c128mb -t100p --dbase $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = XTool.exe decode -t100p - - <stdin> <stdout>

Try using these settings and what are your system specs?

Also if there are errors that xtool reports, I want to see the error message.

hwang4

13-01-2021, 23:30

HunterEmrah
"i have the same problem when compressing cyberpunk 2077 with cb2077 plugin, it gives error in random progress percent (1.2%, 1.5%, 1.7%)"

Decreasing "thread usage" may help ! (t90p worked for me)!

HunterEmrah

14-01-2021, 09:58

what are your system specs?

i5-10500 6c12t, 16 GB DDR4 3200MHz, HDD. ok will try later and share result. thanks!

Cesar82

20-01-2021, 15:26

@Razo12911, is it not possible for you to include the "crilayla" method to XTool 2020 (x64) via plugin?

Razor12911

21-01-2021, 16:36

Plugins Updated

Changes

- Updated Frostbite 3 plugin

@Cesar82

It is possible, I plan to do so in future.

Cesar82

21-01-2021, 19:22

@Razor12911, thanks for updates.

1) I did a Frostbite3 plugin test with a sample of the MEAndromeda game.
Using the libzstd.dll library (1,042,500 bytes) that is included with XTool 0.3.2 does not work.
It only works if you use the library that came with the old XTool (627,903 bytes).
It also works with ZTool's libzstd.dll (412,160 bytes) and also with ZSTDRec's precompressor ibzstd.dll (3,647,423 bytes).
It should not work with the library in the _libraries folder of the "xtool_0.3.2.7z" file (1,042,500 bytes)?

2) Could you give me the exact names of the "oo2core_#_win64.dll" libraries required by the frostbite3 plugin for games: FIFA 18, FIFA 19, FIFA 20, FIFA 21, NFS Heat ?
P.S: If anyone has the game library (from game), please send it with game name to me to include in DiskSpan_GUI.

I attached my sample test of MEAndromeda with the plugin Frostbite3.

Razor12911

21-01-2021, 19:50

Cesar82

21-01-2021, 20:27

1) https://fileforums.com/showpost.php?p=489815&postcount=31

The library include is from the latest zstd build, 2020. Mass Effect Andromeda came out in 2017. If you read what I said regarding lz4 that it also applies to zstd, you'll know why the old library works and the new one doesn't.

2) https://fileforums.com/attachment.php?attachmentid=28782

I attached the libraries from the games.

Thank you for the informations.
So that must be why I tested it with StarWarsBF2 (zstd) and it didn't inflate either.
Is only libzstd.dll and liblz4.dll necessary for a compatible version? (does not have a version that usually works in all games)
Thanks for the libraries!

Razor12911

21-01-2021, 20:36

Oodle experiences the same thing, as an example oo2core_6_win64.dll from FIFA 19 game doesn't inflate good as the one you find from WWE 2K19 I think. (Which means the developers compressed the game using a different dll and then shipped the game with another dll)

oo2core_6_win64.dll has variants on its own, you just need to check the change log, oo = denotes oodle, 2 denotes version 2, that 6 is the sub version. When checking the change log. You have something like 2.6.#.

From the change log, there was 2.6.0, 2.6.1, 2.6.2, 2.6.3.

Things to check in the change log is things related to better compression or improved speed.
"Mermaid, Kraken & Leviathan decompress faster by 5-10%" as an example.

These improvements are what affect xtool from being able to precompress streams because the recompressed stream is much different from before.

You can find the change log here.

http://www.radgametools.com/oodlehist.htm

Mostly the library that comes with game usually works though.

Razor12911

22-01-2021, 02:25

Hitman

Supported games
Hitman 3

Usage
Place hitman.dll near xtool.exe along with required libraries and use -mhitman3

Notes

The library is required both encoding and decoding.

The game will be decrypted and precompressed in one go but you have to use -d1 parameter.

The method to use -mhitman3+lz4

liblz4.dll is required

Edit:

Information useful for plugin's completion is taken from here:
https://zenhax.com/viewtopic.php?f=9&t=14768

KaktoR

22-01-2021, 02:50

Ok, so what I'm doing wrong here? :D

https://i.imgur.com/00dMlc7.png

Razor12911

22-01-2021, 03:05

Was busy debugging something, must have forgotten to remove the code. Hotfix uploaded in main project thread.

KaktoR

22-01-2021, 03:14

Thanks, now it works.

Test for MEA

Using libzstd.dll v1.1.4

XTool -mfrostbite3:zstd
Compressed 1 file, 533,887,818 => 632,100,466 bytes. Ratio 118.40%
Compression time: cpu 0.45 sec/real 5.78 sec = 8%. Speed 92.32 mB/s

Extracted 1 file, 632,100,466 => 533,887,818 bytes. Ratio 118.40%
Extraction time: cpu 0.42 sec/real 5.23 sec = 8%. Speed 102.08 mB/s

zstdrec
Compressed 1 file, 533,887,818 => 632,155,533 bytes. Ratio 118.41%
Compression time: cpu 0.50 sec/real 9.24 sec = 5%. Speed 57.81 mB/s

Extracted 1 file, 632,155,533 => 533,887,818 bytes. Ratio 118.41%
Extraction time: cpu 0.45 sec/real 5.24 sec = 9%. Speed 101.89 mB/s

I will do some more tests :)

----

MEA
Using libzstd.dll v1.1.4

XTool -mfrostbite3:zstd
Compressed 1 file, 533,887,818 => 632,100,466 bytes. Ratio 118.40%
Compression time: cpu 0.45 sec/real 5.78 sec = 8%. Speed 92.32 mB/s

Extracted 1 file, 632,100,466 => 533,887,818 bytes. Ratio 118.40%
Extraction time: cpu 0.42 sec/real 5.23 sec = 8%. Speed 102.08 mB/s

-mzstd
Compressed 1 file, 533,887,818 => 632,853,711 bytes. Ratio 118.54%
Compression time: cpu 0.47 sec/real 6.28 sec = 7%. Speed 84.97 mB/s

Extracted 1 file, 632,853,711 => 533,887,818 bytes. Ratio 118.54%
Extraction time: cpu 0.38 sec/real 4.75 sec = 8%. Speed 112.43 mB/s

----

Tests with SWBF2

Using libzstd.dll v1.3.2 (v1.3.3 does not work)

xtool -mzstd
Compressed 1 file, 6,923,743 => 8,226,010 bytes. Ratio 118.81%
Compression time: cpu 0.02 sec/real 1.63 sec = 1%. Speed 4.24 mB/s

Extracted 1 file, 8,226,010 => 6,923,743 bytes. Ratio 118.81%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 11.04 mB/s

libzstd v1.3.0 (zstd v1.3.1 does not have a library inside the archive on github for some reason)
Compressed 1 file, 6,923,743 => 9,238,179 bytes. Ratio 133.43%
Compression time: cpu 0.00 sec/real 1.14 sec = 0%. Speed 6.05 mB/s

Extracted 1 file, 9,238,179 => 6,923,743 bytes. Ratio 133.43%
Extraction time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 11.24 mB/s

zstdrec
Compressed 1 file, 6,923,743 => 9,237,137 bytes. Ratio 133.41%
Compression time: cpu 0.02 sec/real 0.56 sec = 3%. Speed 12.45 mB/s

Extracted 1 file, 9,237,137 => 6,923,743 bytes. Ratio 133.41%
Extraction time: cpu 0.02 sec/real 0.21 sec = 7%. Speed 32.30 mB/s

Edit: Link for libraries - https://github.com/facebook/zstd/releases

Razor12911

22-01-2021, 03:19

could also test -mzstd ;) and compare the results. two ways you can process MEA.
using frostbite plugin or using the internal codec.

compare the size and speed, then decide which is best.

dixen

22-01-2021, 04:34

UE4 plugin DON'T WORK with xtool_0.3.3

I try decompress pakchunk51-WindowsNoEditor_0_P.pak (Borderlands 3 without DENUVO release) and

XTool 0.3.3 (with unreal.dll)

Compressed 1 file, 18,898,278 => 18,898,657 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 2.23 sec = 2%. Speed 8.49 mB/s
All OK

ue4dt+xtool 0.3.3

Compressed 1 file, 18,898,278 => 37,209,593 bytes. Ratio 196.89%
Compression time: cpu 0.03 sec/real 2.57 sec = 1%. Speed 7.35 mB/s
All OK

NOTE.
Xtool settings -mzlib+ue4:m1:k115EE4F8C625C792F37A503308048E79726E 512F0BF8D2AD7C4C87BC5947CBA7

Razor12911

22-01-2021, 04:43

did you use -d1?

dixen

22-01-2021, 04:49

did you use -d1?

Yeap..

Compressed 1 file, 18,898,278 => 18,981,829 bytes. Ratio 100.44%
Compression time: cpu 0.02 sec/real 1.19 sec = 1%. Speed 15.86 mB/s
All OK

packcmd = xtool.exe precomp -mue4:m1:k115EE4F8C625C792F37A503308048E79726E512F0 BF8D2AD7C4C87BC5947CBA7+zlib+preflate -c128mb -t100p -d1 --dbase - - <stdin> <stdout>

Razor12911

22-01-2021, 04:49

sample?

dixen

22-01-2021, 04:59

sample?

http://sendfile.su/1592675

Razor12911

22-01-2021, 05:17

try 0.3.4

dixen

22-01-2021, 05:23

try 0.3.4

That's better)

Compressed 1 file, 18,898,278 => 25,297,361 bytes. Ratio 133.86%
Compression time: cpu 0.00 sec/real 2.24 sec = 0%. Speed 8.44 mB/s
All OK

But ue4dt - Ratio 196.89%

Razor12911

22-01-2021, 05:52

am I missing something? run this test

KaktoR

22-01-2021, 06:46

I think he made a mistake somewhere.

My result is 133.86% too, no matter what ue4dt/xtool version I use.

Snake288

22-01-2021, 09:04

Hello
Razor12911
Mortal Kombat 11 XTool 2020 Plugins is it available ?

Razor12911

22-01-2021, 09:17

The old xtool had support for mk11, lzna was used.

https://fileforums.com/showpost.php?p=481383&postcount=484

But if you want me to make a plugin, you'll have to provide a sample.

dixen

22-01-2021, 09:50

f you want me to make a plugin, you'll have to provide a sample.

This two *.PSF & two *.XXX files

http://sendfile.su/1592724

Snake288

22-01-2021, 10:44

Hello
Razor12911
Are Mortal Kombat 11 XTool 2020 plugins available?

It had support for the old XTool mk11, lzna was used.

https://fileforums.com/showpost.php?...&postcount=484

Hello
Razor12911
Are Mortal Kombat 11 XTool 2020 plugins available?

It had support for the old XTool mk11, lzna was used.

Merhaba
Razor12911

These Sample Files Hopefully Help

Mortal Kombat 11-Sample Files : Mortal Kombat 11-Sample Files.7z - 252.0 MB (https://dosya.co/075hzq8ugizz/Mortal_Kombat_11-Sample_Files.7z.html)

Cesar82

22-01-2021, 11:06

am I missing something? run this test
Here the unreal plugin tool and ue4dt show similar results, but the plugin is a little faster in 5 out of 5 tests.
P.S: CPU 4 cores and 8 Threads
https://i.imgur.com/2y2Y6zq.png

Decompression:

ue4dt
FreeArc 0.67 (March 15 2014) extracting archive: data1.arc
Extracted 1 file, 25,296,846 => 18,898,278 bytes. Ratio 133.86%
Extraction time: cpu 0.06 sec/real 0.65 sec = 10%. Speed 28.86 mB/s

unreal plugin
FreeArc 0.67 (March 15 2014) extracting archive: data2.arc
Extracted 1 file, 25,297,425 => 18,898,278 bytes. Ratio 133.86%
Extraction time: cpu 0.03 sec/real 0.58 sec = 5%. Speed 32.63 mB/s

Cesar82

22-01-2021, 14:57

I wonder if I can use the unreal plugin this way?
Will I not lose any parameters (-m or -k)?

Borderlands 3 test ue4 plugin

arc.ini
[External compressor:xtool_ue4]
header = 0
packcmd = XTool.exe precomp -mzlib+ue4{:option} -c32mb -t100p -d1 --dbase - - <stdin> <stdout>
unpackcmd = XTool.exe decode -t100p - - <stdin> <stdout>

pack.bat commanline
arc.exe a -ep1 -r -ed -s; -w.\temp -m"xtool_ue4:m1:k0x115EE4F8C625C792F37A503308048E7972 6E512F0BF8D2AD7C4C87BC5947CBA7" data.arc "pack\*"

For this test (Borderlands 3) it worked perfectly.
I tested it using other options like ue4:{option}, ue4:{options}, ue4{: options} but it didn't work.
- if use ue4:{options} or ue4:{option} not inflate (Ratio 100.00%).
- If use ue4{options} or ue4{option} or ue4{: options} show error message, ERROR: write error (disk full?) in compression algorithm...
I want to know if when a game needs the -m2 parameter it will work (maybe -m1 is the default). Using {option} implies that you will put only one parameter.
If someone can explain the differences between the 4 types of use of {:options} with arc.exe please share the information.
Thanks!

Razor12911

23-01-2021, 00:20

infovs

23-01-2021, 02:15

If someone can explain the differences between the 4 types of use of {:options} with arc.exe please share the information.
Thanks!

{option} in arc.ini will pass parameters as is, {options} will add - (minus) sign to parameters..so if your command line contains, for example,
arc create -mxtool+srep:m3f+lolz
you are in fact passing srep -m3f
Sad is that this is not explained anywhere, had to test it on my own to figure it out.
So your arc.ini should probably should contain
-mzlib+ue4:{option}
but in command line it should be (without quotes!)
-mxtool_ue4:m1:k0x115EE4......

With all that said, I'm not sure if your command line will work (can't test it) because this + sign in xtool combining codecs syntax is conflicting with arc syntax of combining codecs so there is a chance it can fail because of that. Change to, for example, & sign with ResourceEditor and try it with that if it fails.

Also, not sure if 0x is needed or optional before key, would like to know preferred way - with or without 0x , Razor12911?

Cesar82

23-01-2021, 02:31

{option} win arc.ini will pass parameters as is, {options} will add - (minus) sign to parameters..so if your command line contains, for example,
arc create -mxtool+srep:m3f+lolz
you are in fact passing srep -m3f
Sad is that this is not explained anywhere, had to test it on my own to figure it out.
So your arc.ini should probably should contain
-mzlib+ue4:{option}
but in command line it should be (without quotes!)
-mxtool_ue4:m1:k0x115EE4......

With all that said, I'm not sure if your command line will work (can't test it) because this + sign in xtool combining codecs syntax is conflicting with arc syntax of combining codecs so there is a chance it can fail because of that. Change to, for example, & sign with ResourceEditor and try it with that if it fails.

Also, not sure if 0x is needed or optional before key, would like to know preferred way - with or without 0x , Razor12911?

as I already mentioned above if using ":" before "{option}" does not work (-mzlib+ue4:{option}). It only works if you use {: option}.
I will not pass the "+" character on the command line as parrametter.
The 0x character is optional for the ureal plugin, but for the uedt tool I think it is necessary to use 0x. As DiskSpan_GUI uses the same code for both (unreal plugin and uedt) so I always decided to enter 0x on the command line.
With quotes in the method it works perfectly, in the input directory -dp"directory" it is necessary to remove "" from the end if it is in quotes.

infovs

23-01-2021, 02:57

as I already mentioned above if using ":" before "{option}" does not work (-mzlib+ue4:{option}). It only works if you use {: option}.
I will not pass the "+" character on the command line as parrametter.
The 0x character is optional for the ureal plugin, but for the uedt tool I think it is necessary to use 0x. As DiskSpan_GUI uses the same code for both (unreal plugin and uedt) so I always decided to enter 0x on the command line.
With quotes in the method it works perfectly, in the input directory -dp"directory" it is necessary to remove "" from the end if it is in quotes.

As I mentioned - I was not testing this, just saying..depending on program sometimes {:option} is needed, sometimes :{option} will work.
As for quotes, I meant "no quotes for -m parameter". Of course you need quotes with -dp etc. So your command line should be
arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool_ue4:m1:k115EE4F8C625C792F37A503308048E79726 E512F0BF8D2AD7C4C87BC5947CBA7 data1.arc "pack\*"
Yes, it is possible it works with " after -m but I think it is not preferred syntax.
And arc.ini probably should be (or maybe :{option} or {option})
[External compressor:xtool_ue4]
header = 0
packcmd = xtool.exe precomp -mzlib+ue4{:option} -d1 -c128mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

Syntax is correct, if it is not working it is because of how xtool/arc handles + sign in arc.ini so unless you change combining codecs sign with ResourceEditor it will never work correctly.

KaktoR

23-01-2021, 05:01

Plugins Updated

Changes

- Updated Hitman plugin

Tests

chunk2.rpkg
Compressed 1 file, 464,824,761 => 494,266,572 bytes. Ratio 106.33%
Compression time: cpu 0.59 sec/real 3.83 sec = 15%. Speed 121.23 mB/s

arc.ini
[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mhitman3+lz4 -d1 -c32mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

Maybe sample doesn't have a lot of streams...

Compressed 103 files, 59,074,904,235 => 59,722,953,857 bytes. Ratio 101.10%
Compression time: cpu 76.63 sec/real 1530.57 sec = 5%. Speed 38.60 mB/s
All OK

:(

chunk3.rpkg
Compressed 1 file, 1,397,636,053 => 1,557,661,362 bytes. Ratio 111.45%
Compression time: cpu 1.34 sec/real 16.36 sec = 8%. Speed 85.40 mB/s
All OK

Masquerade

23-01-2021, 06:24

Chunk10.rpkg

@Razor12911 - use the newest liblz4 - it gets better ratio:

Newest liblz4 (v1.9.3):
Compressed 1 file, 1,329,894,358 => 1,435,849,840 bytes. Ratio 107.97%
Compression time: cpu 1.42 sec/real 31.24 sec = 5%. Speed 42.58 mB/s
All OK

Old liblz4 (comes with xtool):
Compressed 1 file, 1,329,894,358 => 1,424,410,961 bytes. Ratio 107.11%
Compression time: cpu 1.25 sec/real 29.12 sec = 4%. Speed 45.68 mB/s
All OK

yasitha

23-01-2021, 13:52

Hi Razor12911!

I get only 101% for all files in Hitman 3
why?

Can you fix it!

Masquerade

24-01-2021, 01:00

yasitha
The files do not contain many streams.

yasitha

24-01-2021, 05:05

yasitha
The files do not contain many streams.

yes i know.. I figured.
We don't get any good size after compressing..

Razor12911

24-01-2021, 07:57

Plugin updated

Changes

Added Unreal Engine 3 support to Unreal Engine plugin for lzna compressed games (Mortal Kombat 11)

Tests

GEARASSETS_CYR_ScriptAssets.PSF
Compressed 1 file, 47,922,080 => 145,786,020 bytes. Ratio 304.21%
Compression time: cpu 0.05 sec/real 14.56 sec = 0%. Speed 3.29 mB/s

Tested 1 file, 145,786,020 => 47,922,080 bytes. Ratio 304.21%
Testing time: cpu 0.06 sec/real 13.97 sec = 0%. Speed 3.43 mB/s

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mue3 -c32mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

oo2core_5_win64.dll required from game.

dixen

24-01-2021, 10:31

MK 11

PORTALMODE_SCRIPTASSETS.XXX

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 110,033,110 => 183,953,957 bytes. Ratio 167.18%
Compression time: cpu 0.11 sec/real 24.48 sec = 0%. Speed 4.50 mB/s
All OK

Extracted 1 file, 183,953,957 => 110,033,110 bytes. Ratio 167.18%
Extraction time: cpu 0.09 sec/real 21.87 sec = 0%. Speed 5.03 mB/s
All OK

Great Work! Thanks Razor))

dixen

24-01-2021, 11:53

I think he made a mistake somewhere.

I don't think so..

Some tests

XTool 0.3.6 with ue.dll

Compressed 1 file, 416,062,694 => 446,732,701 bytes. Ratio 107.37%
Compression time: cpu 0.48 sec/real 6.18 sec = 8%. Speed 67.31 mB/s
All OK

ue4dt+xtool 0.3.6

Compressed 1 file, 416,062,694 => 494,797,151 bytes. Ratio 118.92%
Compression time: cpu 0.45 sec/real 7.54 sec = 6%. Speed 55.21 mB/s
All OK

NOTE.
ue4dt.exe data release 23.11.2019
MD5 - FFCF35D32A416C0599601C44200B776C

Cesar82

26-01-2021, 14:16

Answering my own previous question, if the parameter -m2 would be passed normally using {:option} as a parameter of the XTool 2020 (ue4 plugin), which was in doubt because it had only tested with Borderlands 3 that uses -m1.
The answer is yes, it worked perfectly, look at the results.
Rune II sample Rune-WindowsServer.pak

xtool_zlib = XTool 2020 -mzlib
xtool_ue4 = XTool 2020 -mzlib+ue4

Test 01 = srep+lzma2
Compressed 1 file, 1,494,084,687 => 1,181,272,582 bytes. Ratio 79.06%
Compression time: cpu 1.80 sec/real 110.29 sec = 2%. Speed 13.55 mB/s

Test 02 = ue4dt+srep+lzma2
Compressed 1 file, 1,494,084,687 => 619,066,054 bytes. Ratio 41.43%
Compression time: cpu 1.72 sec/real 338.60 sec = 1%. Speed 4.41 mB/s

Test 03 = ue4dt+xtool_zlib+srep+lzma2
Compressed 1 file, 1,494,084,687 => 618,955,970 bytes. Ratio 41.43%
Compression time: cpu 2.06 sec/real 348.92 sec = 1%. Speed 4.28 mB/s

Test 04 = xtool_ue4(-mzlib+ue4)+srep+lzma2
DiskSpan_GUI method = xtool_ue4:m2:k0x5DD20432F2AD810071033FC3F925FFDFD6 47514524D0A0D222E17D76BAF57BFD+srep_new+lzma2
xtool_ue4 = Arc.ini setting
packcmd = "XTool.exe" precomp -mzlib+ue4{:option} -c32mb -t100p -d1 --dbase - - <stdin> <stdout>

Compressed 1 file, 1,494,084,687 => 545,149,382 bytes. Ratio 36.49%
Compression time: cpu 1.84 sec/real 179.33 sec = 1%. Speed 8.33 mB/s

Razor12911

27-01-2021, 23:49

Plugin updated

Changes

- updated watch dogs 2, watch dogs legion and far cry primal to support new library structure (other plugins not affected)

@Cesar82
Well I did say I did receive a sample where m2 needed to be created, there are several other variants of this unreal engine structure that xtool doesn't support so there could even be m3, m4 in future...

@dixen
sample? also send the ue4dt that gave different output.

Razor12911

31-01-2021, 03:45

Plugin updated

Changes

- Updated unreal engine plugin

That's better)

Compressed 1 file, 18,898,278 => 25,297,361 bytes. Ratio 133.86%
Compression time: cpu 0.00 sec/real 2.24 sec = 0%. Speed 8.44 mB/s
All OK

But ue4dt - Ratio 196.89%

Now

Compressed 1 file, 18,898,278 => 37,188,708 bytes. Ratio 196.78%
Compression time: cpu 0.02 sec/real 2.59 sec = 1%. Speed 7.31 mB/s

Snake288

31-01-2021, 04:05

Hello
Razor12911
XTool 2020 (Plugins) hitman_R2Plugin updated will come ?

Snake288

31-01-2021, 04:09

Hello
Razor12911
Hitman 3 (R2) and Mortal Mombat 11Unreal Engine 3 (lzna) can I get full detailed information about how the method of use should be?

Hitman 3 and Mortal Mombat 11 DiskSpan_GUI
how can you use compression for these two games

Cesar82

31-01-2021, 06:40

Comparison between the #POST (https://www.fileforums.com/showpost.php?p=489998&postcount=60) test with XTool 0.34 and previous Unreal.dll (R1) vs new version XTool 0.38 and Unreal.dll (R3).
There was a big increase in Ratio but the speed dropped a lot.
https://i.imgur.com/JPREWOc.png

Razor12911

03-02-2021, 13:07

Razor12911

04-02-2021, 00:57

Bethesda

Supported games
The Elder Scrolls V: Skyrim (requires liblz4.dll)

Usage
Place bsa.dll near xtool.exe along with required libraries and use -mskyrim

Notes

The library is required both encoding and decoding.

Some results
Skyrim - Textures0.bsa
Compressed 1 file, 655,189,115 => 1,436,500,795 bytes. Ratio 219.25%
Compression time: cpu 0.69 sec/real 15.58 sec = 4%. Speed 42.06 mB/s

Tested 1 file, 1,436,500,795 => 655,189,115 bytes. Ratio 219.25%
Testing time: cpu 0.69 sec/real 7.27 sec = 9%. Speed 90.11 mB/s

As requested

KaktoR

04-02-2021, 02:22

I uploaded the files "Skyrim - Meshes0.bsa" and "Skyrim - Meshes1.bsa".

Skyrim - Meshes0.bsa

Compressed 1 file, 1,152,069,673 => 2,097,275,557 bytes. Ratio 182.04%
Compression time: cpu 0.89 sec/real 23.95 sec = 4%. Speed 48.11 mB/s

arc.exe: wclose: invalid argument (Bad file descriptor) in "Skyrim - Meshes0.bsa". File is broken.

Skyrim - Meshes1.bsa (file is broken in a second test below)

Compressed 1 file, 373,427,426 => 531,939,990 bytes. Ratio 142.45%
Compression time: cpu 0.31 sec/real 4.42 sec = 7%. Speed 84.56 mB/s

Extracted 1 file, 531,939,990 => 373,427,426 bytes. Ratio 142.45%
Extraction time: cpu 0.23 sec/real 3.27 sec = 7%. Speed 114.20 mB/s

Skyrim - Textures1.bsa

Compressed 1 file, 1,509,673,333 => 1,719,892,975 bytes. Ratio 113.92%
Compression time: cpu 1.31 sec/real 7.74 sec = 17%. Speed 195.12 mB/s

Extracted 1 file, 1,719,892,975 => 1,509,673,333 bytes. Ratio 113.92%
Extraction time: cpu 1.33 sec/real 6.50 sec = 20%. Speed 232.39 mB/s

Skyrim - Textures0.bsa - Skyrim - Textures8.bsa

Compressed 9 files, 7,723,871,672 => 13,214,174,974 bytes. Ratio 171.08%
Compression time: cpu 10.33 sec/real 218.30 sec = 5%. Speed 35.38 mB/s

Extracted 9 files, 13,214,174,974 => 7,723,871,672 bytes. Ratio 171.08%
Extraction time: cpu 6.92 sec/real 201.31 sec = 3%. Speed 38.37 mB/s

---------------------------------------------------------

Same issue as Hitman 3 below

Whole Data folder (w/o sound/voice files)

Compressed 21 files, 10,231,828,591 => 13,367,393,717 bytes. Ratio 130.65%
Compression time: cpu 12.72 sec/real 277.62 sec = 5%. Speed 36.85 mB/s

WARNING: CRC failed in "Skyrim - Meshes1.bsa". File is broken.
Extracted 21 files, 13,367,393,717 => 10,231,828,591 bytes. Ratio 130.65%
Extraction time: cpu 9.47 sec/real 257.90 sec = 4%. Speed 39.67 mB/s
There were 2 warning(s)

---------------------------------------------------------

Whole Data folder (w/o sound/voice files) but with solid = 0 setting

Compressed 21 files, 10,231,828,591 => 16,825,853,659 bytes. Ratio 164.45%
Compression time: cpu 13.20 sec/real 303.24 sec = 4%. Speed 33.74 mB/s

Extracting 21 files, 10,231,828,591 bytes. Processed 13.0%WARNING: CRC failed in "Skyrim - Meshes0.bsa". File is broken
Extracted 21 files, 16,825,853,659 => 10,231,828,591 bytes. Ratio 164.45%
Extraction time: cpu 10.31 sec/real 258.47 sec = 4%. Speed 39.59 mB/s
There were 1 warning(s)

NOTE: Strangely enough that this time the file "Skyrim - Meshes1.bsa" does not give out a CRC error :confused:

---------------------------------------------------------

I even tested some mod files :D

RaceMenu.bsa (Link (https://www.nexusmods.com/skyrimspecialedition/mods/19080))

Compressed 1 file, 16,587,136 => 35,407,224 bytes. Ratio 213.46%
Compression time: cpu 0.02 sec/real 9.90 sec = 0%. Speed 1.67 mB/s

WARNING: CRC failed in "RaceMenu.bsa". File is broken.
Extracted 1 file, 35,407,224 => 16,587,136 bytes. Ratio 213.46%
Extraction time: cpu 0.02 sec/real 0.63 sec = 2%. Speed 26.21 mB/s
There were 1 warning(s)

icepenguinworldmapclassic - textures.bsa (Link (https://www.nexusmods.com/skyrimspecialedition/mods/5804))

Compressed 1 file, 5,980,021 => 11,931,955 bytes. Ratio 199.53%
Compression time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 9.69 mB/s

Extracted 1 file, 11,931,955 => 5,980,021 bytes. Ratio 199.53%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 9.45 mB/s

Vivid WeathersSE - Textures.bsa (Link (https://www.nexusmods.com/skyrimspecialedition/mods/2187))

Compressed 1 file, 113,654,441 => 185,505,136 bytes. Ratio 163.22%
Compression time: cpu 0.11 sec/real 2.72 sec = 4%. Speed 41.83 mB/s

WARNING: CRC failed in "Vivid WeathersSE - Textures.bsa". File is broken.
Extracted 1 file, 185,505,136 => 113,654,441 bytes. Ratio 163.22%
Extraction time: cpu 0.06 sec/real 1.65 sec = 4%. Speed 68.70 mB/s
There were 1 warning(s)

SkyUI_SE.bsa (Link (https://www.nexusmods.com/skyrimspecialedition/mods/12604))

Compressed 1 file, 1,234,711 => 1,444,829 bytes. Ratio 117.02%
Compression time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 2.00 mB/s

Extracted 1 file, 1,444,829 => 1,234,711 bytes. Ratio 117.02%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 1.95 mB/s

Unofficial Skyrim Special Edition Patch - Textures.bsa (Link (https://www.nexusmods.com/skyrimspecialedition/mods/266))

Compressed 1 file, 73,019,853 => 171,264,577 bytes. Ratio 234.55%
Compression time: cpu 0.08 sec/real 6.24 sec = 1%. Speed 11.70 mB/s

Extracted 1 file, 171,264,577 => 73,019,853 bytes. Ratio 234.55%
Extraction time: cpu 0.05 sec/real 1.14 sec = 4%. Speed 64.05 mB/s

Razor12911

04-02-2021, 17:45

bug seems to be caused by --dbase parameter.

Skyrim - Meshes0.bsa
Compressed 1 file, 1,152,069,673 => 2,097,540,496 bytes. Ratio 182.07%
Compression time: cpu 1.31 sec/real 20.21 sec = 6%. Speed 57.02 mB/s

Tested 1 file, 2,097,540,496 => 1,152,069,673 bytes. Ratio 182.07%
Testing time: cpu 0.56 sec/real 15.51 sec = 4%. Speed 74.30 mB/s

More xtool updates... :(

Snake288

06-02-2021, 23:02

Razor12911

10-02-2021, 19:55

Hello
Razor12911
Square Enix and Crystal Dynamics
Marvel's Avengers XTool 2020 Plugins is it possible ?
a tool made for the game is available
this link https://forum.xentax.com/viewtopic.php?f=16&t=22556 deneyin

from game-related sample files
https://dosya.co/zt3ccmll4z0o/Marvel's_Avengers.7z.html

I tried to make this plugin but without the source code of the tool for decryption, I have no idea what algorithm is used or how it is used. :(

doofoo24

11-02-2021, 19:00

run quick test on all files for FCP 19.4GB TO 21.7GB ???
should be more no ?
will try to run on file at time to see what the max :confused:

infovs

24-03-2021, 06:38

frostbite3_R3 plugin is broken for Dragon Age Inquisition (don't know if previous versions worked correctly). Tried different versions of zlibwapi.dll, same thing.
It will compress perfectly, no errors whatsoever. But during unpacking of some specific files, for example Update\Patch\Data\cas_01.cas
it will generate " File is broken/Bad file descriptor" error. Always.

Interesting, if packed with xtool:zlib it will compress pretty much the same and decompression will work. But, as I said, xtool:frostbite3 will work at compression but it will fail when decompressing on specific files.

L0v3craft

27-04-2021, 03:35

@Razor12911

Hi. I tested your plugin of Hitman 3. There is some bug.

I tried to precompress individually these two files:

chunk0.rpkg -> 13.5GB - 14.2GB

chunk1.rpkg -> 4.99GB - 5.26GB

But precompressing both I got -> 18.5GB -> 19.1GB

there are 565MB of difference. So there is some bug when your plugin must work on more than one file?

dixen

27-04-2021, 12:15

UE3 plugin no decrypt *.ushaderbytecode inside .pak in last version Borderlands 3..Fix it please)

Sample https://drive.google.com/file/d/1wZf9dXBjLupdyNNJW18f7jU1l06ZJcDI/view?usp=sharing

XTool+UE3 plugin

Compressed 1 file, 494,122,454 => 650,780,026 bytes. Ratio 131.70%
Compression time: cpu 3.36 sec/real 10.83 sec = 31%. Speed 45.64 mB/s
All OK

Unpacked pakchunk0-WindowsNoEditor_13_P.pak

Compressed 1 file, 660,352,331 => 1,975,504,578 bytes. Ratio 299.16%
Compression time: cpu 0.59 sec/real 103.97 sec = 1%. Speed 6.35 mB/s
All OK
----------------------------------------------------------------------------------------------------------
UPD 29.04
With parameters -d2 -c256mb - All fine))

Compressed 1 file, 494,122,454 => 1,825,965,002 bytes. Ratio 369.54%
Compression time: cpu 0.42 sec/real 282.55 sec = 0%. Speed 1.75 mB/s
All OK

Tested 1 file, 1,825,965,002 => 494,122,454 bytes. Ratio 369.54%
Testing time: cpu 0.44 sec/real 72.28 sec = 1%. Speed 6.84 mB/s
All OK

:( Sad8669

11-05-2021, 15:29

HITMAN 3 and FIFA 20 confirmed. I have yet to test the XTool Razor provided but for the old one its confirmed. Watch Dogs Legion was the least tested one so it needs some more tests.

HITMAN 3
Updated by Razor12911, will post a method soon.

FIFA 20 Razor provided a test tool for this one, as soon as i get free i am going to test it out.

Razor12911

14-05-2021, 02:48

Try this on FIFA 20

Game devs decided to use very high compression settings, all I can say is gg :) to the developers and be ready to suffer from long precompression/restoration times on this one.
From this thread (https://fileforums.com/showthread.php?p=477581)

Am I missing something with the final archive size where diskspan was used? Disk spanning isn't a feature that came originally with Freearc but was added via CLS, the data being given to Freearc by the CLS is incomplete and the rest is stored in the other split archives... which Freearc doesn't know about.

:( Sad8669

14-05-2021, 04:15

1.Thanks for your concern Razor. As for using CDT on FIFA 20 please have a look at this post (https://fileforums.com/showpost.php?p=491229&postcount=2232) and this one (https://fileforums.com/showpost.php?p=491440&postcount=2275).

2.Let Watch Dogs : Legion out of this matter for now. Needs some good old testing, will update soon.

3.I have FIFA 20 in .bin files and it needs to be decompressed so i will test it out as soon as my compression for the other title is done.

Finishing Words : I am sorry for any trouble caused by my choice of words or lack of experience.

Razor12911

15-05-2021, 23:18

Mass Effect Legendary Edition

Try it out

Game\ME3\BioGame\CookedPCConsole\Lighting4.tfc
Tested 1 file, 327,483,989 => 81,387,688 bytes. Ratio 402.38%
Testing time: cpu 0.06 sec/real 8.29 sec = 1%. Speed 9.82 mB/s

KaktoR

16-05-2021, 01:20

Seems to work

Compressed 1 file, 28,150,079 => 135,425,943 bytes. Ratio 481.09%
Compression time: cpu 0.02 sec/real 2.17 sec = 1%. Speed 12.94 mB/s
All OK

Extracted 1 file, 135,425,943 => 28,150,079 bytes. Ratio 481.09%
Extraction time: cpu 0.02 sec/real 1.66 sec = 1%. Speed 17.01 mB/s
All OK

Razor12911

18-05-2021, 00:56

Days Gone

This is not a plugin but modification of existing libraries

Note: Both oo2core_7_win64.dll and oo2core_8_win64.dll are needed for both encoding and decoding.

Two ways you can use this. You can use the oodle side project (https://fileforums.com/showthread.php?t=102453) or xtool (https://fileforums.com/showthread.php?t=102832)

I recommend using oodle precompressor side project (oo2reck) but if you are using xtool, use the method -mkraken

belknap_alwaysloaded.pak
Tested 1 file, 98,440,499 => 35,301,114 bytes. Ratio 278.86%
Testing time: cpu 0.03 sec/real 1.06 sec = 3%. Speed 33.35 mB/s

Masquerade

18-05-2021, 02:47

@Razor12911

Can you share a comparison with oodlrec vs xtool? Thanks!

Masquerade

19-05-2021, 00:12

Days Gone Oodle Test:

oodlerec:
Compressed 34 files, 90,551,309 => 238,975,172 bytes. Ratio 263.91%
Compression time: cpu 0.11 sec/real 59.50 sec = 0%. Speed 1.52 mB/s
All OK
xtool:
Compressed 34 files, 90,551,309 => 231,535,165 bytes. Ratio 255.69%
Compression time: cpu 0.13 sec/real 28.77 sec = 0%. Speed 3.15 mB/s
All OK

Razor12911

23-05-2021, 02:56

Haemimont Engine

Supported games
Haemimont Games

Usage
Place hpk.dll near xtool.exe along with required libraries and use -mhpk

Notes

The library is required both encoding and decoding.

liblz4.dll is required

Razor12911

23-05-2021, 02:57

Plugin updated

Changes

- Updated all plugins to support xtool v0.3.10+

Cesar82

23-05-2021, 03:30

Plugin updated

Changes

- Updated all plugins to support xtool v0.3.10+

Thanks for all the changes to XTool.
I will test the new version as soon as possible.
These latest plugins are not linked to the first post like Haemimont Engine (maybe it is intensive).
You could list the updated plugins. Among them I found: Unreal Engine R4, Bethesda R2, Ubisoft Dunia 2 Engine (Far Cry primal R4, Watch Dogs 2 R4, Watch Dogs Legion R4). If any others have been updated please inform.

EDIT: Just to report. Kaspersky Internet Security (KIS) antivirus captured the XTool.exe executable (32 bits) as a false positive in previous versions of XTool, but not anymore.

Razor12911

23-05-2021, 03:33

You could list the updated plugins.

Lazy af, was even lazy to post 0.3.10, 0.3.11...

Among them I found: Unreal Engine R4, Bethesda R2, Ubisoft Dunia 2 Engine (Far Cry primal R4, Watch Dogs 2 R4, Watch Dogs Legion R4). If any others have been updated please inform.

Your findings are correct.

Cesar82

23-05-2021, 05:20

dixen

23-05-2021, 11:45

@Razor12911, I was testing it with a sample Borderlands 3 file and for some reason it doesn't seem to work with xtool 0.3.12 and Unreal Engine R4.
I don't know if it is the Unreal plugin that doesn't work (maybe it has changed some option).

With XTool 0.3.9 and Unreal Engine plugin R3 it works.
But if you replace the plugin Unreal.dll R3 with what is in the file attached in this post from Mass Effect Legendary Edition (https://www.fileforums.com/showpost.php?p=492002&postcount=99) it also does not work for Borderlands 3.
Maybe there is something wrong with the Unreal Engine plugin or I need a different configuration now.
Attached is my test (if possible analyze).
Hmm..

ue4+xtool 0.3.9

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 2,128,753,187 => 3,479,722,376 bytes. Ratio 163.46%
Compression time: cpu 1.63 sec/real 50.41 sec = 3%. Speed 42.23 mB/s
All OK

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool_ue4:m1:k115EE4F8C625C792F37A503308048E79726 E512F0BF8D2AD7C4C87BC5947CBA7 data.arc "pack\*"
------------------------------------------------------------------------------------------------------------------------------------

cls-ue4 plugin by shegorat + xtool v0.3.12

Compressing 1 file, 2,128,753,187 bytes. Processed 0.0%
Use key for game 'Borderlands 3'
Init encryption key: 115EE4F8C625C792F37A503308048E79726E512F0BF8D2AD7C 4C87BC5947CBA7
Total encrypted UE records 2624/2640
Compressed 1 file, 2,128,753,187 => 3,962,925,560 bytes. Ratio 186.16%
Compression time: cpu 13.47 sec/real 37.17 sec = 36%. Speed 57.28 mB/s
All OK

kast1450

23-05-2021, 14:55

Is there any way to get https://fileforums.com/showpost.php?p=482064 working with XTool 2020? I already tried putting the DLL next to XTool.exe and using -munity with no success.

Mortal Lord

24-05-2021, 00:59

Bethesda plugin test.

File: "Skyrim - Meshes0.bsa" 1.07 GB

XTool 0.3.12
0.3.12 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.11 sec/real 15.13 sec = 7%. Speed 76.14 mB/s
All OK
0.3.12 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.14 sec/real 51.15 sec = 2%. Speed 22.52 mB/s
All OK

XTool 0.3.11
0.3.11 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.20 sec/real 34.85 sec = 3%. Speed 33.06 mB/s
All OK
0.3.11 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.11 sec/real 39.01 sec = 3%. Speed 29.53 mB/s
All OK

XTool 0.3.10
0.3.10 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.53 sec/real 47.32 sec = 3%. Speed 24.35 mB/s
All OK
0.3.10 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%
Compression time: cpu 1.50 sec/real 81.44 sec = 2%. Speed 14.15 mB/s
All OK

XTool 0.3.9
0.3.9 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 2,097,540,112 bytes. Ratio 182.07%
Compression time: cpu 1.52 sec/real 83.80 sec = 2%. Speed 13.75 mB/s
All OK
0.3.9 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,152,069,673 => 1,152,069,900 bytes. Ratio 100.00%
Compression time: cpu 1.31 sec/real 43.55 sec = 3%. Speed 26.46 mB/s
All OK

Unpack

0.3.9 BSA R1

Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Extracting archive: OutPut\Skyrim-Bsa.arc
Extracted 1 file, 2,097,540,112 => 1,152,069,673 bytes. Ratio 182.07%
Extraction time: cpu 1.16 sec/real 50.86 sec = 2%. Speed 22.65 mB/s
All OK
0.3.9 BSA R2

Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Extracting archive: OutPut\Skyrim-Bsa.arc
Extracted 1 file, 1,152,069,900 => 1,152,069,673 bytes. Ratio 100.00%
Extraction time: cpu 1.17 sec/real 9.60 sec = 12%. Speed 119.97 mB/s
All OK

File: "Skyrim - Textures0.bsa" 624 MB

XTool 0.3.9
0.3.9 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 655,189,115 => 1,436,500,603 bytes. Ratio 219.25%
Compression time: cpu 1.14 sec/real 58.85 sec = 2%. Speed 11.13 mB/s
All OK
0.3.9 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 655,189,115 => 1,205,435,049 bytes. Ratio 183.98%
Compression time: cpu 0.78 sec/real 46.99 sec = 2%. Speed 13.94 mB/s
All OK

Unpack

0.3.9 BSA R1

Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Extracting archive: OutPut\Skyrim-Bsa.arc
Extracted 1 file, 1,436,500,603 => 655,189,115 bytes. Ratio 219.25%
Extraction time: cpu 0.86 sec/real 29.05 sec = 3%. Speed 22.55 mB/s
All OK

0.3.9 BSA R2

Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Extracting archive: OutPut\Skyrim-Bsa.arc
Extracted 1 file, 1,205,435,049 => 655,189,115 bytes. Ratio 183.98%
Extraction time: cpu 1.00 sec/real 23.96 sec = 4%. Speed 27.34 mB/s
All OK

File: "Skyrim - Textures1.bsa" 1.40 GB

XTool 0.3.9
0.3.9 BSA R1
Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,509,673,333 => 1,719,892,975 bytes. Ratio 113.92%
Compression time: cpu 1.95 sec/real 36.01 sec = 5%. Speed 41.92 mB/s
All OK
0.3.9 BSA R2

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim
Compressed 1 file, 1,509,673,333 => 1,509,673,560 bytes. Ratio 100.00%
Compression time: cpu 1.44 sec/real 24.72 sec = 6%. Speed 61.07 mB/s
All OK

Unpack

0.3.9 BSA R1

Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked
FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log
Extracting archive: OutPut\Skyrim-Bsa.arc
Extracted 1 file, 1,719,892,975 => 1,509,673,333 bytes. Ratio 113.92%
Extraction time: cpu 1.17 sec/real 21.93 sec = 5%. Speed 68.85 mB/s
All OK

:confused:

L0v3craft

24-05-2021, 12:05

@Razor12911

Please can you fix your plugin for Hitman 3 when you have the time? Thanks anyway.

Razor12911

24-05-2021, 14:35

Plugin(s) updated

Changes

- Updated Hitman plugin

Notes

Other plugins require an update to work with 0.3.13

The hitman plugin now works but something you have to know is the game may be encrypted and compressed but only about 10% give or take is packed in this manner and this means that the inflation ratio or the final gains will not be a lot. I had to download the whole game just to see what was wrong with the previous plugin and here's a benchmark that shows what I am talking about

chunk8.rpkg:
2.08 GB (2,239,549,275 bytes) >> 2.22 GB (2,390,705,974 bytes)

2.08 GB (2,239,549,275 bytes) >> 1.76 GB (1,891,802,867 bytes) (srep+lzma)
2.08 GB (2,239,549,275 bytes) >> 1.67 GB (1,797,884,353 bytes) (xtool+srep+lzma)

The plugin is based on this source from github: https://github.com/LennardF1989/HitmanExtractor
- also produces the same results.

Most streams are packed as they are (not compressed), some are just encrypted and then some are both encrypted and compressed. The encryption and compression used is very weak in terms of obfuscating data for compression hence the gains will not be much.

Is there any way to get https://fileforums.com/showpost.php?p=482064 working with XTool 2020? I already tried putting the DLL next to XTool.exe and using -munity with no success.

Wait for a revised version that works with the new xtool.

:( Sad8669

25-05-2021, 00:44

Everyone, who is going to use Hitman 3 plugin. Make sure you use d1 in your arc.ini.

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp { -moption} -c32mb -t100p -d1 --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:hitman3:lz4 data.arc "pack\Test"
pause

Hitman 3 - Precompression

liblz4 (207 KB)
Compressed 1 file, 2,239,549,275 => 2,285,305,379 bytes. Ratio 102.04%
Compression time: cpu 3.31 sec/real 25.06 sec = 13%. Speed 89.36 mB/s
All OK

liblz4 (137 KB)
Compressed 1 file, 2,239,549,275 => 2,254,774,932 bytes. Ratio 100.68%
Compression time: cpu 3.39 sec/real 62.87 sec = 5%. Speed 35.62 mB/s
All OK

liblz4 (495 KB)
Compressed 1 file, 2,239,549,275 => 2,390,688,467 bytes. Ratio 106.75%
Compression time: cpu 3.25 sec/real 24.08 sec = 13%. Speed 92.99 mB/s
All OK

liblz4 (439 KB)
Compressed 1 file, 2,239,549,275 => 2,263,062,723 bytes. Ratio 101.05%
Compression time: cpu 3.11 sec/real 87.07 sec = 4%. Speed 25.72 mB/s
All OK

dixen

25-05-2021, 01:49

Razor, what about plugin for FarCry 3?)

:( Sad8669

25-05-2021, 02:48

Hitman 3 - Final

Compressed 101 files, 59,074,232,232 => 59,770,071,273 bytes. Ratio 101.18%
Compression time: cpu 76.09 sec/real 1113.95 sec = 7%. Speed 53.03 mB/s
All OK

Initial Size : 55.0 GB
Precompressed Size : 55.6 GB

Side Notes : I know this game is already compressed to its limit since it contains 3 titles and has a size of 55 GB, but is it normal that i am only seeing a 600 MB gain?

dixen

25-05-2021, 05:27

Something wrong...

MK11 *.xxx

XTool v0.3.13 + Last plugin ue3

Compressed 1 file, 115,900,882 => 115,970,146 bytes. Ratio 100.06%
Compression time: cpu 0.09 sec/real 0.55 sec = 17%. Speed 209.54 mB/s
All OK

XTool v0.3.9 + Last plugin ue3

Compressed 1 file, 115,900,882 => 168,842,435 bytes. Ratio 145.68%
Compression time: cpu 0.13 sec/real 9.29 sec = 1%. Speed 12.47 mB/s
All OK

:( Sad8669

25-05-2021, 06:07

@dixen

I think these plugins still require an update for 0.3.13 version.

Mentioned by Razor above.

:( Sad8669

25-05-2021, 07:36

55.0 GB to 47.4 GB [SREP+4X4:LZMA]
55.0 GB to 47.0 GB [XTool+SREP+4X4:LZMA]

Compressed 1 file, 59,770,073,069 => 50,552,525,489 bytes. Ratio 84.58%
Compression time: cpu 456.05 sec/real 14875.74 sec = 3%. Speed 4.02 mB/s
All OK

@Razor12911, is this fine? i mean i got 101.16% ratio on Precompression.

Razor12911

25-05-2021, 10:22

Drag and drop one of the rpkg files on test.bat, an output folder named "output should be created, wait till finish.

Run the same file using the method hitman3+lz4 on xtool, compare the results.

Razor, what about plugin for FarCry 3?)

common.dat + common.fat, + all .fat files samples needed for this.

dixen

26-05-2021, 06:00

common.dat + common.fat, + all .fat files samples needed for this.https://drive.google.com/file/d/18IvFFbrLooeGFbGDbeCERb6NEwEB7hMF/view?usp=sharing

KaktoR

26-05-2021, 07:24

common.dat + common.fat, + all .fat files samples needed for this.

All of them here
https://drive.google.com/drive/folders/1efQmFV_eriGiSgra-YR8QZ_a9QERnmpa?usp=sharing

HunterEmrah

02-06-2021, 06:57

Drag and drop one of the rpkg files on test.bat, an output folder named "output should be created, wait till finish.

F:\Games\Hitman 3\pack\test>HitmanExtractor extract "F:\Games\Hitman 3\pack\test\chunk0patch1.rpkg" output
Building file entry list...
System.IO.EndOfStreamException: Unable to read beyond the end of the stream.
at System.IO.BinaryReader.FillBuffer(Int32 numBytes)
at System.IO.BinaryReader.ReadUInt32()
at HitmanExtractor.Program.BuildFileEntryList(BinaryR eader binaryReader) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 154
at HitmanExtractor.Program.HandleArguments(String[] args) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 76
at HitmanExtractor.Program.Main(String[] args) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 50

F:\Games\Hitman 3\pack\test>pause
Press any key to continue . . .

chunk0patch1.rpkg is not extracting, but chunk2.rpkg extracted successfully.

Same with hitman3+lz4

chunk0patch1.rpkg ratio %100
chunk2.rpkg ratio %106

Razor12911

05-06-2021, 17:15

Unity Engine

Usage
Place unity.dll near xtool.exe along with required libraries and use -munity

Notes

The library is required both encoding and decoding.

liblz4.dll is required

Razor12911

05-06-2021, 20:01

Plugin updated

Changes

Updated Unreal Engine to support Xtool 0.3.16+
Unreal Engine 4 codec (ue4) no longer requires method parameter to work (m1 and m2), only specify the key.

L33THAK0R

06-06-2021, 09:30

Unity Engine

Usage
Place unity.dll near xtool.exe along with required libraries and use -munity

Notes

The library is required both encoding and decoding.

liblz4.dll is required

__________________

Other plugins still require an update

Thank you so much for this tool! I'm not too familiar with the Unity engine so forgive me if this is a silly question but are the applications of this tool, engine-version-specific or case-by-case?

So far I've only had luck using this tool on the title "Outward", with other titles (Aragami, Cat Quest, Beholder) reporting back with failed decompression messages despite detecting streams and experimenting with "preflate" and "reflate". Interestingly enough the "Outward" compression only seemed to proceed when neither "preflate" nor "reflate" were used.

Cesar82

06-06-2021, 11:53

Could someone please let me know what to use in the parameter if I want to use the frostbite3 plugin specifically for a game.

Assuming I use something like this:

arc.ini
[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp { -option} -c32mb -t100p --dbase --dedup - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

pack.bat
arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:mfrostbite3,? data2.arc "..\pack\*"
I wanted to directly pass the parameter to each game supported by frostbite3, but I don't know if I should use the name of the section ([Streeam#]) of the frostbite3 .ini file or the value of the key "Name=" of the corresponding section.

If it is the value of the key "Name=" it would be more or less these commands. Is this the correct way to use it?

Battlefield 4 xtool:c32mb:mfrostbite3,lz4
Battlefield Hardline xtool:c32mb:mfrostbite3,?
Battlefield 1 xtool:c32mb:mfrostbite3,lz4
Battlefield V xtool:c32mb:mfrostbite3,lz4
Dragon Age Inquisition xtool:c32mb:mfrostbite3,zlib
FIFA 18 xtool:c32mb:mfrostbite3,fifa18
FIFA 19 xtool:c32mb:mfrostbite3,fifa19
FIFA 20 xtool:c32mb:mfrostbite3,fifa20
FIFA 21 xtool:c32mb:mfrostbite3,fifa21
Mass Effect Andromeda xtool:c32mb:mfrostbite3,zstd
Mirror's Edge Catalyst xtool:c32mb:mfrostbite3,lz4
Need for Speed Rivals xtool:c32mb:mfrostbite3,lz4
Need for Speed (2015) xtool:c32mb:mfrostbite3,lz4
Need for Speed Payback xtool:c32mb:mfrostbite3,lz4
Need for Speed Heat xtool:c32mb:mfrostbite3,nfsheat

For Battlefield Hardline I didn't find information in the frostbite3.ini file of which method to use, but as informed in the #post (https://fileforums.com/showpost.php?p=488282&postcount=2) it requires the LZ4 library so it is possibly the same as its brothers BF.

@Razor12911, I was wondering if I can use a fake parameter (number) along with XTool (If it will be discarded, or if it can cause errors). This additional parameter will only be for DiskSpan_GUI to know which library should be copied along with XTool before compressing.
Example to copy oo2core_4_win64.dll I would use: xtool:mkraken:4;

Razor12911

06-06-2021, 12:37

using -mfrostbite3 makes xtool search for all streams [Stream#], # = All entries.

But if you specify -mfrostbite3:zlib as an example, since the stream entries can have names, it will only target those streams.

If it is the value of the key "Name=" it would be more or less these commands. Is this the correct way to use it?

Battlefield 4 xtool:c32mb:mfrostbite3,lz4
Battlefield Hardline xtool:c32mb:mfrostbite3,?
Battlefield 1 xtool:c32mb:mfrostbite3,lz4
Battlefield V xtool:c32mb:mfrostbite3,lz4
Dragon Age Inquisition xtool:c32mb:mfrostbite3,zlib
FIFA 18 xtool:c32mb:mfrostbite3,fifa18
FIFA 19 xtool:c32mb:mfrostbite3,fifa19
FIFA 20 xtool:c32mb:mfrostbite3,fifa20
FIFA 21 xtool:c32mb:mfrostbite3,fifa21
Mass Effect Andromeda xtool:c32mb:mfrostbite3,zstd
Mirror's Edge Catalyst xtool:c32mb:mfrostbite3,lz4
Need for Speed Rivals xtool:c32mb:mfrostbite3,lz4
Need for Speed (2015) xtool:c32mb:mfrostbite3,lz4
Need for Speed Payback xtool:c32mb:mfrostbite3,lz4
Need for Speed Heat xtool:c32mb:mfrostbite3,nfsheat

For Battlefield Hardline I didn't find information in the frostbite3.ini file of which method to use, but as informed in the #post (https://fileforums.com/showpost.php?p=488282&postcount=2) it requires the LZ4 library so it is possibly the same as its brothers BF.

Yes this is correct, BF4 - BFV means from battlefield 4 to the release of battlefield V, in between Battlefield Hardline and Battlefield 1 came out so these use the same method (lz4)

@Razor12911, I was wondering if I can use a fake parameter (number) along with XTool (If it will be discarded, or if it can cause errors). This additional parameter will only be for DiskSpan_GUI to know which library should be copied along with XTool before compressing.
Example to copy oo2core_4_win64.dll I would use: xtool:mkraken:4;
Yes, you can put fake parameters, they won't affect xtool in anyway.

Cesar82

06-06-2021, 12:45

using -mfrostbite3 makes xtool search for all streams [Stream#], # = All entries.

But if you specify -mfrostbite3:zlib as an example, since the stream entries can have names, it will only target those streams..

But for these games I will have better gain if I process all steams or even ratio if I use only the specific type mentioned in the previous post (Maybe some game file has other stream types).

P.S: I tested the ue4 plugin (new version) and it seems to be working perfectly with the Borderlands 3 sample.

Razor12911

06-06-2021, 12:50

The problem isn't about ratio, the ratio you will get is the same. The problem is speed will be affected because of 10 different types of streams for xtool to look for when only one stream type exists, furthermore I don't know if I have uploaded the updated frostbite3 plugin here on the forum or on the mega link (I tend to first run tests before uploading here) but if you haven't you can check it here (https://mega.nz/folder/YqJE0DjJ#1NwnUFtROhboTV-uhR-HGQ)

In the configuration there is a note I left inside
"// FIFA 20 and NFS Heat streams are detected the same, use -mfrostbite3:fifa20 or -mfrostbite3:nfsheat to be specific"

This is the 2nd problem, basically these games are detected the same way but the compression settings used are different so being specific will produce better result.

Razor12911

06-06-2021, 12:57

Cesar82

06-06-2021, 20:01

I don't know if I have uploaded the updated frostbite3 plugin here on the forum or on the mega link (I tend to first run tests before uploading here) but if you haven't you can check it here (https://mega.nz/folder/YqJE0DjJ#1NwnUFtROhboTV-uhR-HGQ)

If the frostbite3 link plugin is newer, it contains 2 extra files: fifa_dict and fifa_key.

The file "fifa_dict" from what I could see is used in the [Stream9] section and from what I understand XTool doesn't have dictionary support yet and you left commented out the [Stream9] section (maybe for that reason).

The file "fifa_key" is only mentioned in the [Stream5] section referring to FIFA 19.

The file "fifa_key" only needed next to XTool if using Xtool:mfifa19?
Are these files necessary to be together from XTool in decompression?

Masquerade

06-06-2021, 23:48

Test for the madness plugin:

Compressed 13 files, 114,276,277 => 1,328,849,308 bytes. Ratio 1162.84%
Compression time: cpu 0.19 sec/real 61.78 sec = 0%. Speed 1.85 mB/s
All OK

Perfect. :D

Razor12911

06-06-2021, 23:51

F:\Games\Hitman 3\pack\test>HitmanExtractor extract "F:\Games\Hitman 3\pack\test\chunk0patch1.rpkg" output
Building file entry list...
System.IO.EndOfStreamException: Unable to read beyond the end of the stream.
at System.IO.BinaryReader.FillBuffer(Int32 numBytes)
at System.IO.BinaryReader.ReadUInt32()
at HitmanExtractor.Program.BuildFileEntryList(BinaryR eader binaryReader) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 154
at HitmanExtractor.Program.HandleArguments(String[] args) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 76
at HitmanExtractor.Program.Main(String[] args) in C:\Users\Lennard\source\repos\HitmanExtractor\Src\ HitmanExtractor\Program.cs:line 50

F:\Games\Hitman 3\pack\test>pause
Press any key to continue . . .

chunk0patch1.rpkg is not extracting, but chunk2.rpkg extracted successfully.

Same with hitman3+lz4

chunk0patch1.rpkg ratio %100
chunk2.rpkg ratio %106

perhaps that could be the reason the plugin I made is also producing weird results because its also based on the same program

If the frostbite3 link plugin is newer, it contains 2 extra files: fifa_dict and fifa_key.

The file "fifa_dict" from what I could see is used in the [Stream9] section and from what I understand XTool doesn't have dictionary support yet and you left commented out the [Stream9] section (maybe for that reason).

The file "fifa_key" is only mentioned in the [Stream5] section referring to FIFA 19.

The file "fifa_key" only needed next to XTool if using Xtool:mfifa19?
Are these files necessary to be together from XTool in decompression?

fifa_key/fifa_dict in xtool are considered resource files and they are embedded along with the processed data meaning, if you use frostbite plugin, all its information (ini and its resources) are no longer needed for decompression.

Cesar82

07-06-2021, 08:27

fifa_key/fifa_dict in xtool are considered resource files and they are embedded along with the processed data meaning, if you use frostbite plugin, all its information (ini and its resources) are no longer needed for decompression.
The explanation was a bit technical.
I couldn't understand if only one of them needs to be with xtool, or both, or not.
Thanks!

Razor12911

07-06-2021, 09:53

as I mentioned before, if you never specify what codecs (or streams) to be used from a plugin, they are all enabled so this means all the files are required to be present but if they are missing, like missing key or dictionary then that codec will be disabled, for example only fifa games require key and if the key is nowhere to be found then the key that corresponds to a particular stream will be disabled, otherwise everything else will work as they don't require the files. As for decompression, none of these files are required to be present.

Razor12911

07-06-2021, 22:49

Unravel 1 & 2

Instructions
Use Bms2Xtl on attached script to generate database and also make use of lz4x plugin for precompression.

Example
bms2xtl unravel.bms "D:\Games\SteamLibrary\steamapps\common\Unravel\kit s\Unravel.kit" unravel.xtl

Notes

Both lz4x.exe and liblz4.dll are required for both encoding and decoding.

Masquerade

08-06-2021, 10:03

@Razor12911 How to decompress Unreal.dll method on xtool v18?

[External compressor:mele]
header = 0
unpackcmd = xtool decode -t100p - - <stdin> <stdout>

FreeArc 0.67 (March 15 2014) extracting archive: output.MSQ
Extracting 21 files, 7,781,670 bytes. Processed 1%
ERROR: general (de)compression error in mele

Unreal.dll is with xtool.exe...

Hopefully there is a fix without me needing to remake my archive all over again.

https://anonfiles.com/36M4c703uc/

Here is a sample archive. It's compressed with just mele method:

[External compressor: mele]
header = 0
packcmd = "xtool.exe" precomp -mue3:m2 -c256mb -t12 - - <stdin> <stdout>

:( Sad8669

08-06-2021, 10:08

Unravel???!! Damn just when i deleted the game :(.

Here the ones i did before i deleted them.

Unravel (https://fileforums.com/showpost.php?p=491774&postcount=2328)
Unravel 2 (https://fileforums.com/showpost.php?p=491887&postcount=2357)

The XZLib and precomp_mtx were used because it was giving like 100.02% or 100.01%, doesn't make a difference but i need to make every single MB count xD.
I once saw on QuickBMS web that Unravel contains LZ4 streams.

Razor12911

08-06-2021, 10:14

@Masquerade

You do realize your archives are obfuscated? Can't open because of FA protect.

Compressed 1 file, 81,387,688 => 327,483,945 bytes. Ratio 402.38%
Compression time: cpu 0.08 sec/real 9.71 sec = 1%. Speed 8.38 mB/s

Tested 1 file, 327,483,945 => 81,387,688 bytes. Ratio 402.38%
Testing time: cpu 0.03 sec/real 7.93 sec = 0%. Speed 10.27 mB/s

used 0.3.18, I haven't touched oodle nor the 2nd method of ue4 for this game since 0.3.13

Masquerade

08-06-2021, 10:26

@Masquerade

You do realize your archives are obfuscated? Can't open because of FA protect

Apologies, I thought I uploaded a clean archive.

Are the --dbase and --dedup parts required? I don't have those in my packcmd and the archive will not decompress.

Razor12911

08-06-2021, 10:32

no they are not, I just put the plugin near xtool after unpacking without really checking what command lines were used and it just works, and to confirm. I removed both --dedup and --dbase and still works.

Maybe send an archive without protection and I'll check

Masquerade

08-06-2021, 10:34

Razor12911

08-06-2021, 10:50

Guys guys, make sure that if there were any libraries used during compression that they are also present during decompression.

I was being specific that only database files (xtl) and configuration files (ini) are the ones that can be discarded. ;)

Cesar82

08-06-2021, 12:37

I did some tests with the Unravel plugin.
These ratio results are normal (only inflate) for Unravel game?
https://i.imgur.com/TDFSH0T.png

For Unravel Two I always get the same error below 1% precompression:
I'm trying to compress the entire game folder.
PS: The files needed for precompression are together from XTool.
https://i.imgur.com/P4EmYVP.png

I tried to replicate the test with only .bat file but it didn't compress.
I attached the test using the .bat file I used.
https://i.imgur.com/JIi11yL.png

If anyone knows what I did wrong, let me know.

Edit:
he results obtained for the final game "Unravel" were:
Method: xtool:c32mb:munravel1+srep_new+4x4:b128mb:lzma:ult ra:128m:bt4:fb273:lc8:mc1000000
Input size: 3,37 GB
Output size: 2,30 GB
Conversion time: 00:09:28
Decompression time: 00:01:09

----------------------------------------------------------------------------------------------------------------------------------------
Creating Data1a-01.bin file, Please Wait...
----------------------------------------------------------------------------------------------------------------------------------------
FreeArc 0.67 (March 15 2014) creating archive: .\Conversion_Output\Data1a-01.bin
Compressing 89 files, 3,621,043,995 bytes. Processed 10.2%
Compressing 5,245,671,359 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
10.2%SREP 3.93a beta (October 11, 2014): input size 5002 mb, memory used 315 mb, -m3f -l512 -c512 -a0/0 -hash=vmac -b8mb
100%: 5,245,671,359 -> 4,131,911,575: 78.77%. Cpu 64 mb/s (77.781 sec), real 59 mb/s (85.472 sec) = 91%. Remains 00:00
Decompression memory is 119 mb. 607,687 matches = 9,722,992 bytes = 0.24% of file
Errorlevel=0
Compressed 89 files, 3,621,043,995 => 2,474,832,435 bytes. Ratio 68.35%
Compression time: cpu 5.52 sec/real 565.58 sec = 1%. Speed 6.40 mB/s
All OK

----------------------------------------------------------------------------------------------------------------------------------------
Extracting Data1a-01.bin file, Please Wait...
----------------------------------------------------------------------------------------------------------------------------------------
FreeArc 0.67 (March 15 2014) extracting archive: .\Conversion_Output\DVD\Data1a-01.bin
Extracting 89 files, 3,621,043,995 bytes. Processed 99.6%
Extracted 89 files, 2,474,832,435 => 3,621,043,995 bytes. Ratio 68.35%
Extraction time: cpu 212.53 sec/real 68.45 sec = 311%. Speed 52.90 mB/s
All OK

doofoo24

08-06-2021, 13:57

quick test
unravel 1
3.17gb to 4.68gb using munravel1 -c64mb without --dedup
then srep+lolz from 4.68gb to 2.04gb nothing rip include trial exe
srep:m3f:d1g:a2+lolz:mt4:mtt1:d128:fba4096:mc1023: pc4:gm20:dtb1:x2

unravel 2
6.76gb to 10.1gb using munravel2 -c32mb without --dedup
then srep+lolz from 10.1gb to 3.5gb...
srep:m3f:d1g:a2+lolz:mt4:mtt1:d128:fba4096:mc1023: pc4:gm20:dtb1:x2

decompress without error...

Cesar82

08-06-2021, 15:33

@Razor12911, about my previous post, I would like to inform you that the plugin is working with UnravelTwo just installed the game.
What happened was that I had the game installed on my system and with a PT-BR (tribogamer) translation applied.
The translation modifies 2 files in the D3D11kits folder (Data.kit and Data.kit.0).
I only tested including files in a "Pack" folder and there were no errors when compressing the "Data.kit" file.
Another file from the "D3D11\V" folder (0A6917B6) gives errors when compressing if I remove "Data.kit.0" from the game folder (this 0A6917B6 file has not been modified).
If I remove both files "0A6917B6" and "Data.kit.0" from the game folder no errors occur.
If you want to do some future checking in the plugin HERE (https://mega.nz/file/4Y5FFarQ#SXH8__WDBprr0A9RfazofV2EMJw7ow0DaZfbypbnh Pk) is the sample of files changed by the translation and also the file "0A6917B6" (original file that had errors when it was in the folder).
PS: Unravel 1 also had the PT-BR translation applied and the plugin worked perfectly with modified files.

Unravel Two Precompression Result (Originals Files):
Method: xtool:c32mb:munravel2
Input size: 7,05 GB
Output size: 10,41 GB (Ratio 147.66%)
Conversion time: 00:06:37

biotec2k8

13-06-2021, 14:40

I Cannot Pack Unravell 1 with the Given BAT File...Anyone Another Bat that Goes on?

Razor12911

14-06-2021, 00:22

I Cannot Pack Unravell 1 with the Given BAT File...Anyone Another Bat that Goes on?

Make sure you have the updated xtool along with the required libraries and the game files should be original.

Razor, what about plugin for FarCry 3?)

https://fileforums.com/showpost.php?p=492876&postcount=6

Upload the xtl files produced.

dixen

14-06-2021, 03:20

common.dat: 2634 stream(s)
ige.dat: 6952 stream(s)
patch.dat: 421 stream(s)
shadersobj.dat: 33430 stream(s)
mp_dlc1.dat: 15842 stream(s)
mp_dlc1_menus.dat: 50 stream(s)
multicommon.dat: 105147 stream(s)
But...FC3_main.fat - don't work..

Compressed 20 files, 7,065,329,260 => 9,449,481,150 bytes. Ratio 133.74%
Compression time: cpu 13.34 sec/real 824.47 sec = 2%. Speed 8.57 mB/s
All OK

Razor12911

14-06-2021, 03:37

hotfix uploaded

dixen

14-06-2021, 04:23

FC3_main

Compressed 2 files, 3,499,695,209 => 4,595,201,476 bytes. Ratio 131.30%
Compression time: cpu 7.44 sec/real 744.41 sec = 1%. Speed 4.70 mB/s
All OK

Razor12911

14-06-2021, 04:44

FC3_main

Total: 1518029141 >> 2678774947

1.41GB compressed streams found and inflated to 2.49GB, not sure if I missed a few. Confirm size with DELZORec

L0v3craft

21-06-2021, 00:55

Plugin updated

Changes

Updated Unreal Engine to support Xtool 0.3.16+
Unreal Engine 4 codec (ue4) no longer requires method parameter to work (m1 and m2), only specify the key.

Tested on Samurai Shodown and doesn't work, xtool doesn't precompress. Maybe the plugin was not able to decrypt the pak.

Tested xtool 0.3.9 + unrealengine_R3 and works.

Cesar82

24-06-2021, 11:04

@Razor12911
1) Do you have any forecast when we will have all the plugins updated and working with the current version of XTool?
I ask because when I have everyone I will share a new version of DiskSpan_GUI.

2) I would also like to know if you can use the parameters mixed with xtool.
See the example below where <key> will be the decryption key for the unreal engine 4 game.
The blue part is the default part, the other parts are always inserted in the first parameter according to whether the checkbox is checked or not in DiskSpan_GUI.
xtool:mzlib:mreflate:c32mb:d1:mue4,k<key>

3) The method presets in the XTool.ini file still work as before in the current XTool version, or must be converted to the current mode by separating the parameters with commas.
Thanks!

L0v3craft

24-06-2021, 23:06

@Razor12911

Hi. Please can you check the new format files "ucas" (unreal) from the game "SCARLET NEXUS" ?

https://drive.google.com/file/d/1DweZAdOxLrJ4jC1RhFouQ9BN2ck8uwZ2/view?usp=sharing

The encryption key is:

0x48AE8311350417BDC50A440FCD0E98B2FA6BCEAE3EDA8D0E 24881F205E6C4540

maybe you can make some decryptor. Thanks.

Razor12911

24-06-2021, 23:12

9GB lel, The first 100MB of the file should be fine.

L0v3craft

24-06-2021, 23:57

9GB lel, The first 100MB of the file should be fine.

Ok i changed the link ;)

Razor12911

25-06-2021, 01:50

Plugin(s) updated

Changes

- Updated Frostbite 3 engine plugin to add support for encrypted streams (FIFA 20, not sure if support is properly added, don't have game..)
- Updated bethesda and hitman plugin to support xtool v0.3.20+

@Cesar82

1) Uploaded some updates, I couldn't upload more after this because I think I broke the forum. It doesn't allow me to edit this post (https://fileforums.com/showpost.php?p=488686&postcount=4)so I couldn't make changes.
Each time I press Go Advanced for better edit, I get sent to the home page.

2) This usage is correct, as long as in arc.ini the option part looks like this { -option}

3) I have removed this feature as I replaced it with the feature in your 2nd question.

@L0v3craft

wtf is this format? XD

I'll look at it when I have more time, I'm a bit busy lately.

Cesar82

25-06-2021, 02:14

- Updated bethesda and hitman plugin to support xtool v0.3.20+

The bethesda (https://fileforums.com/showpost.php?p=490258&postcount=87) and hitman (https://fileforums.com/showpost.php?p=489983&postcount=48) plugin posts still continue with the old version.

1) Uploaded some updates, I couldn't upload more after this because I think I broke the forum. It doesn't allow me to edit this post (https://fileforums.com/showpost.php?p=488686&postcount=4)so I couldn't make changes.
Each time I press Go Advanced for better edit, I get sent to the home page.

This happened to me a few days ago.
Whenever I tried to send a PM response to a specific user I was redirected to the main page.
Then I tested sending to other users and it was working.
I sent another message with different content to the same user and the message sent normally.
Was necessary to change the content removing quotes from the question I was answering and the message sent.

Razor12911

25-06-2021, 02:15

Grumpy

25-06-2021, 06:53

@Cesar82

I guess everything got glitched, reuploaded :D

Attachments for this post (https://fileforums.com/showpost.php?p=488686&postcount=4) as it's currently glitched and I can't make changes to it.

@admin/mod please check what the problem is :o

Just so I understand exactly what you want to do, do you want the attachments in 'THIS' post (Post #161) to be moved to Post #4?

Cesar82

25-06-2021, 08:34

@Cesar82

I guess everything got glitched, reuploaded :D

Attachments for this post (https://fileforums.com/showpost.php?p=488686&postcount=4) as it's currently glitched and I can't make changes to it.

@admin/mod please check what the problem is :o

Thanks for the updates.
1) Is there still another plugin "Ubisoft Dunia 2 Engine" to be updated, or with these post files all plugins are already working with XTool 0.3.20+?
2) These plugins are new plugins for "Far Cry 3 R1" and "Far Cry 4 R1" and
how should they be used (-mfc3 and -mfc4)?
3) This plugin "tc2" is "The Crew 2 R3" (Before "The Crew 2" was always with full name in the zip, so the doubt)?
4) Which library LZ4 (or other) should be used together with fc3 and fc4? The same liblz4.dll version used with the fc5 plugin?

L0v3craft

25-06-2021, 09:54

The encryption key given for the UCAS files is incorrect, they key is for the PAK files (this is a UE4 game). The UCAS key will be different.

The key is the same for both pak and ucas.

Hexagon123

25-06-2021, 17:23

The encryption key given for the UCAS files is incorrect, they key is for the PAK files (this is a UE4 game). The UCAS key will be different.

This format is also seen in Fortnite?

Razor12911

26-06-2021, 00:23

Scarlet Nexus

Usage
Place scarletnexus.xtl and scarletnexus.key near xtool.exe along with required libraries and use -mscarletnexus+zlib (can replace with reflate or preflate)

Notes

You can discard xtl and key file when decoding
-d1 is required

__________________

@Grumpy

Not necessarily, there was something wrong with that post and I wanted you to check what was wrong with it because it didn't allow edits at all, but thanks to Cesar's advice about deleting all the contents and start afresh fixed the issue.

@Cesar82

1) There is still more to be updated
2) Yes, they should be used like that
3) When it comes to xtl/ini files, they can be renamed to whatever you please just know that for them to be used in xtool, the name has to match. The same cannot be said with dlls, dlls can be renamed too but the internal codec name does not change.
4) Far Cry 3 and Far Cry 4 both require lzo2.dll, doesn't matter which version. As lzo isn't like lz4 whereby data compressed with different version also differs.

Grumpy

26-06-2021, 05:27

@Grumpy

Not necessarily, there was something wrong with that post and I wanted you to check what was wrong with it because it didn't allow edits at all, but thanks to Cesar's advice about deleting all the contents and start afresh fixed the issue.

Ahh he is a man of many talents. :)

I couldn't see an issue with why you couldn't edit the post, must have just been some type of glitch

L0v3craft

26-06-2021, 09:02

Scarlet Nexus

Usage
Place scarletnexus.xtl and scarletnexus.key near xtool.exe along with required libraries and use -mscarletnexus+zlib (can replace with reflate or preflate)

Notes

You can discard xtl and key file when decoding
-d1 is required

Thanks! However I have generated the two files using the "Unreal Engine ucas Database maker" + XTool 0.3.21 and these commands:

xtool.exe precomp -mscarletnexus+zlib+reflate -d1 -c128mb -t100p --dbase $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

XTool has precompressed all the ucas files (10.0GB) to 14.2GB. Someone said to me that all the ucas files unpacked are 22GB or so. So XTool is not detecting all the streams?

Razor12911

26-06-2021, 09:15

Plugin(s) updated

Changes

- Remade Scarlet Nexus plugin using unreal_db_R2

pakchunk29-WindowsNoEditor.ucas

R1
Compressed 1 file, 355,386,352 => 493,475,542 bytes. Ratio 138.86%
Compression time: cpu 0.45 sec/real 182.46 sec = 0%. Speed 1.95 mB/s

R2
Compressed 1 file, 355,386,352 => 784,570,925 bytes. Ratio 220.77%
Compression time: cpu 0.58 sec/real 76.31 sec = 1%. Speed 4.66 mB/s

ScarletNexus\Content\Paks\*
Compressed 250 files, 17,638,403,034 => 28,178,138,151 bytes. Ratio 159.75%
Compression time: cpu 22.95 sec/real 3084.21 sec = 1%. Speed 5.72 mB/s

L0v3craft

26-06-2021, 09:49

Plugin(s) updated

Changes

- Remade Scarlet Nexus plugin using unreal_db_R2

Now precompressed from 10GB to 22.3GB. Thank you very much :)

DODI

26-06-2021, 18:22

Plugin(s) updated

Changes

- Remade Scarlet Nexus plugin using unreal_db_R2

Precompressed well (29 GB) and decompress was fast (5 mnins)

Thanks

dixen

27-06-2021, 11:11

XTool 0.3.21 + ScarletNexus db R2

17 607 628 673 > 29,065,967,205

biotec2k8

28-06-2021, 01:08

The Fitgirl Repack uses IDW Tools and AES for the reconstruction.

Is it possible with the database files to get better game compression?

mixtro

10-07-2021, 04:00

I attempted to use the unity plugin for the game "The Fall". 0/0 streams, file comes out the same size.

Will test other unity games and report back.

Edit:
Unless I am using the plugin incorrectly but I will write down what I used to attempt to precompress the game:
xtool version 0.3.21
liblz4.dll and unity.dll are right next to xtool.exe.

The Fall

xtool precomp -munity+preflate -c32mb -t100p-1 -d1 --dbase --dedup "packed\data.arc" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:06 (00:00:26)
Memory: 128 MB (128 MB)

xtool precomp -munity -c32mb -t100p-1 -d1 --dbase --dedup "packed\data.arc" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:03 (00:00:06)
Memory: 128 MB (128 MB)

xtool precomp -munity -c32mb -t100p-1 -d1 --dbase --dedup "game_files\TheFall_Data\level6" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:00 (00:00:00)
Memory: 128 MB (128 MB)

xtool precomp -munity -c32mb -t100p-1 --dbase --dedup "game_files\TheFall_Data\level6" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:00 (00:00:00)
Memory: 128 MB (128 MB)

xtool precomp -munity -c32mb -t100p-1 "game_files\TheFall_Data\level6" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:00 (00:00:00)
Memory: 128 MB (128 MB)

xtool precomp -munity+reflate -c32mb -t100p-1 "packed\data.arc" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:00:05 (00:00:25)
Memory: 128 MB (128 MB)

Greenhell:
xtool precomp -munity

xtool precomp -munity "Green Hell\GH_Data\resources.resource" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:06:59 (00:00:14)
Memory: 128 MB (128 MB)

Input file: resources.resource (2,666,519,775 bytes)
Output file: packed.xt (2,666,519,775 bytes)

Entire game stored inside arc file (no compression) (no exe, dll etc only unity files)

xtool precomp -munity "packed\data.arc" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:03:19 (00:00:30)
Memory: 128 MB (128 MB)
input file: data.arc 5.65 GB (6,075,222,393 bytes)
output file: packed.xt 5.65 GB (6,075,228,288 bytes)

xtool precomp -munity+lz4hc "packed\data.arc" packed.xt
XTool is created by Razor12911

Streams: 0/0
Time: 00:03:27 (00:00:31)
Memory: 128 MB (128 MB)

Am I testing this correctly?

Masquerade

10-07-2021, 07:49

mixtro
The games you mentioned - "The Fall", "Green Hell" do not contain files that are compressed by lz4. The unity plugin is for things like Unity Asset Bundles and Data.unity3d files which are compressed.

Files such as .resource, *.assets and .resS are 99% of the time uncompressed.

mixtro

10-07-2021, 13:41

Thank you for letting me know this. My heart rests at ease. But do you know which unity games are compressed with lz4?

Masquerade

10-07-2021, 14:21

Thank you for letting me know this. My heart rests at ease. But do you know which unity games are compressed with lz4?

I know XTool works with Minute Of Islands. Games with data.unity3d such as Skul The Hero Slayer are also compressed but XTool doesn't support such versions of unity yet.

Hoping Razor12911 will and add more support to the plugin :)

KaktoR

10-07-2021, 14:44

Madness Engine

Games supported
Automobilista 2
Project Cars 1?? (someone test this plugin on this game and if it's not working, please upload a few samples)
Project Cars 2 (wait for R2)
Project Cars 3 (since bdt is buggy on this game, you can use this as an alternative) [also wait for R2]

Usage
Place madness.dll near xtool.exe along with required libraries and use -mmadness

Notes

This only decrypts streams, you have to involve zlib method and set depth to 1

zlibwapi.dll is required

Does not work with PCars 1

Samples (https://drive.google.com/file/d/1wBaNBuqcR4SjsvvTznIPCA-bA2fWx5AF/view?usp=sharing) / Some more samples (https://drive.google.com/file/d/13i8KBskeye_jJUusFrMG5r7DMA-7e6sg/view?usp=sharing)

Harsh ojha

10-07-2021, 20:06

Precompressed well (29 GB) and decompress was fast (5 mnins)

Thanks

dodi repack is here
nice 😅

Carldric Clement

10-07-2021, 20:53

Nothing could change when I'm using the latest of XTool v0.3.21. Try to repack the games "Saiko no Sutoka"
.assets, .resS, and .resource

using -munity with the plugin unity.dll and lz4.dll next to xtool.exe

Compressed 18 files, 621,696,943 => 621,697,130 bytes. Ratio 100.00%
Compression time: cpu 0.80 sec/real 14.58 sec = 5%. Speed 42.65 mB/s
All OK

:(

Masquerade

11-07-2021, 01:33

.assets, .resS, and .resource

https://www.fileforums.com/showpost.php?p=493191&postcount=175

Even look at game on SteamDB, you can see it compresses to under 200mb with Steam compression alone:
. https://steamdb.info/depot/1546861/

Carldric Clement

11-07-2021, 23:01

https://www.fileforums.com/showpost.php?p=493191&postcount=175

Even look at game on SteamDB, you can see it compresses to under 200mb with Steam compression alone:
. https://steamdb.info/depot/1546861/

I figure it out myself. Only works with unity asset bundle. Try repack with Broforce to using -munity with unity plugin next to xtool

Compressed 192 files, 478,851,648 => 879,219,222 bytes. Ratio 100.64%
Compression time: cpu 0.58 sec/real 32.47 sec = 2%. Speed 14.75 mB/s

somehow it works a little bit. :D

:( Sad8669

22-07-2021, 10:05

@Razor12911

Any chances that you will work on WDL?

GFS won't detect any streams, but the plugin actually works.
The problem is that only two files are able to be precompressed, which is barely a 2 GB gain.

L0v3craft

23-07-2021, 09:17

@Razor12911

Hi. Please can you take a look at the new game "Orcs Must Die! 3" ? It uses Unreal Engine and the pak files are compressed with LZ4. XTool doesn't work.

Sample 1
https://drive.google.com/file/d/1KlE5rLaVugr4t-t_FefUEH46Fzw2MuIu/view?usp=sharing

Sample 2
https://drive.google.com/file/d/18i9wbdCNQ0a0nUUDx9Aydzp4J3h0ofw5/view?usp=sharing

infovs

24-07-2021, 03:19

Scarlet Nexus R2 plugin does not work on latest build of the game (build 6979246, 7 July 2021). Tested multiple times - it works on original release but does not work on all .pak .ucas files from latest.
(obvious when tested with same file Razor12911 used for example, pakchunk29-WindowsNoEditor.ucas, it will expand on original release as expected. Same file from latest build will not expand at all)

Razor12911

24-07-2021, 07:41

infovs

24-07-2021, 11:30

https://fileforums.com/showpost.php?p=493012&postcount=14
generate a new database file and use that

It works, thanks :) (I saw that Database Maker before but thought it is only for testing or something like that... :o )

Razor12911

28-07-2021, 19:40

CryEngine

Games supported
Crysis 3 (for now)

Usage
Place cryengine.dll and the ced file (cryengine database) near xtool.exe along with required libraries and use -mcrysis3

Notes
This only decrypts streams, you have to involve zlib method and set depth to 1 (I recommend the method -mcrysis3+zlib+preflate)
zlibwapi.dll (preflate_dll.dll optional) is required
Credits to these guys here (https://forum.xentax.com/viewtopic.php?f=10&t=9818)

Some tests
C3\ObjectsWeap.pak
Tested 1 file, 1,048,043,508 => 531,745,904 bytes. Ratio 197.09%
Testing time: cpu 0.42 sec/real 15.69 sec = 3%. Speed 33.90 mB/s
C3\Textures.pak
Tested 1 file, 972,835,170 => 600,518,988 bytes. Ratio 162.00%
Testing time: cpu 0.41 sec/real 14.68 sec = 3%. Speed 40.91 mB/s

Announcement

This is the last release in a long time as I have become extremely busy with stuff going on in my life and have very little time if any to continue with the development of this project, this plugin itself took about 4 days to do, not because it was difficult but I barely have time. I have tried my best to make xtool open as possible to the community for anyone of you to continue its development by creating additional plugins for it. I will only update the documentation so you can educate yourselves and only upload the necessary tools that will also assist some of you to making your very own plugin.

Sorry members of ff :(

L33THAK0R

28-07-2021, 20:28

CryEngineGames supported
Crysis 3 (for now)

This is incredible! It'll be very interesting to see if this CryEngine method can be applied to other titles utilising different versions of CryEngine!

dixen

29-07-2021, 03:07

Test Crysis3 plugin

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressing 262 files, 11,667,584,710 bytes. Processed 100.0%
ERROR: general (de)compression error in xtool

Streams: 105099/105099
Time: 00:00:15 (00:01:51)
Memory: 149 MB (149 MB)

100.0%EAccessViolation: Access violation at address 00000000029E3574 in module 'cryengine.dll'. Read of address 0000000000000008

UPD.
with -d1 -c256m - no errors

KaktoR

29-07-2021, 06:35

Grumpy

30-07-2021, 01:04

And good luck with all what's ongoing onto your live atm and hope to see you back sometime next year maybe :cool:

Yes agree,

@Razor12911
all the best and take care, thanks for everything you have done and do. Go live life for awhile whilst you are young enough to enjoy it ;)

infovs

30-07-2021, 04:40

Thank you Razor12911 for everything, hope that at least you'll have time to read some posts occasionally to point us in right direction in using your tools.
Regards

P.S. if you ever get some time for advice, I still can't figure out if I'm doing something wrong...can't use xtool 0.3.21 + unreal.dll R5 on StreetFighter5.. :confused:
https://www.fileforums.com/showpost.php?p=493223&postcount=394

HunterEmrah

30-07-2021, 17:03

When I use the xtool:zstd method for "Star Wars Battlefront 2", I get an "archive corrupt" error when extracting the archive. When using the frostbite3 plugin with the xtool:frostbite3:zstd method, the compression stays at 0% and there was no progress even though I waited all day, but the processor is constantly running around 70%. When I try it on an 800 megabyte .cas file, there is no problem. When I start compressing the 20 gigabyte Patch folder, it stays at 0.1% and does not progress.

Can someone with knowledge on the subject help?

https://i5.imageban.ru/out/2021/07/31/237ce18b218d3ba305ce1172ff93d94d.png

Using latest xtool and libraries.

arc.ini
[External compressor:xtool]
header = 0
packcmd = xtool2020\xtool.exe precomp { -moption} -c32mb -t100p --dbase --dedup - - <stdin> <stdout>
unpackcmd = xtool2020\xtool.exe decode -t100p - - <stdin> <stdout>

pack.bat
arc a -s; -dsgerpn -lc- -di -hp13213 -cfg"C:\Program Files (x86)\FreeArc\bin\arc.ini" -wD:\Temp -mxtool:frostbite3:zstd+srep:m3f:l512:m512+4x4:b64m b:lzma:ultra:64m:bt4:fb273:lc8:mc1000000 ..\data1.bin * -r

https://i6.imageban.ru/out/2021/07/31/59d0ea5964c173e4b81263a9c0b2137f.png

:( Sad8669

30-07-2021, 22:06

Try using older version of XTool or zstd.

Try these threads (https://fileforums.com/showpost.php?p=492097&postcount=2409) here (https://fileforums.com/showpost.php?p=493165&postcount=2468).

KaktoR

31-07-2021, 04:05

According to your screenshots you are not using latest version of xtool.

Try without --dbase --dedup

HunterEmrah

31-07-2021, 09:05

According to your screenshots you are not using latest version of xtool.

Try without --dbase --dedup

now it's definitely latest version, trying without --dbase --dedup, nothing changed.

[External compressor:xtool]
header = 0
packcmd = xtool2020\xtool.exe precomp { -moption} -c32mb -t100p - - <stdin> <stdout>
unpackcmd = xtool2020\xtool.exe decode -t100p - - <stdin> <stdout>

https://i2.imageban.ru/out/2021/07/31/debe800042957d5c462afa3a4b5724cc.png

KaktoR

31-07-2021, 12:23

now it's definitely latest version, trying without --dbase --dedup, nothing changed.

[External compressor:xtool]
header = 0
packcmd = xtool2020\xtool.exe precomp { -moption} -c32mb -t100p - - <stdin> <stdout>
unpackcmd = xtool2020\xtool.exe decode -t100p - - <stdin> <stdout>

https://i2.imageban.ru/out/2021/07/31/debe800042957d5c462afa3a4b5724cc.png

I don't know, works fine here

https://i.imgur.com/rKoANLN.png

Maybe it's because of your arc settings

HunterEmrah

31-07-2021, 12:40

I don't know, works fine here

https://i.imgur.com/rKoANLN.png

Maybe it's because of your arc settings

you are using only zstd, try it with frostbite3 plugin. zstd gives error when extracting.

KaktoR

31-07-2021, 12:53

https://i.imgur.com/TujGmba.png

Works

Edit: Stucks at 4%. I guess you have to edit frostbite3.ini then.

HunterEmrah

31-07-2021, 14:22

Edit: Stucks at 4%. I guess you have to edit frostbite3.ini then.

what exactly needs to be changed?

HunterEmrah

31-07-2021, 22:19

xtool_2012_R2 + frostbite3.ini is ok.

-mzstd

you are using only the xtool+zstd

Usage
Place frostbite3.ini near xtool.exe along with required libraries and use -mfrostbite3.

Cesar82

01-08-2021, 20:25

Could someone let me know if any of these Razor12911 tools "Unreal Engine ucas Database maker (https://www.fileforums.com/showpost.php?p=493012&postcount=14)" or "Dunia-Disrupt Engine Database maker (https://www.fileforums.com/showpost.php?p=492876&postcount=6)" generate the *.xtl file for plugin "Unravel" 1 and 2?
Or is there any tool to generate the plugin *.xtl file for this games.

@Razor12911, the file ".ced" (cryengine database) in CryEngine plugin is it necessary to be with XTool during decompression?

PsYcHo_RaGE

01-08-2021, 22:19

@HunterEmrah The problem is zstd is slow

It does compress it but after taking a huge amount of time
It's not actually stuck, it looks stuck (DON'T PANIC :D)

We've done tests on Ryzen 32 threaded CPU
It did take us 8 hours to complete the XTool precompression, can take less if you configure the chunk size and -t param perfectly.
And then ofc more for srep and lolz

KaktoR

01-08-2021, 23:33

I took the opprtunity to make a test last night with SWBF2 + zstd codec.

Settings used: xtool:zstd+srep:m3f+4x4:lzma

Took about 6 hours, unpacking gave error on srep :rolleyes:

PsYcHo_RaGE

02-08-2021, 01:09

I took the opprtunity to make a test last night with SWBF2 + zstd codec.

Settings used: xtool:zstd+srep:m3f+4x4:lzma

Took about 6 hours, unpacking gave error on srep :rolleyes:

Try xtool:frostbite3 plugin(zstd)+srep:m3f:l512+lzma2 or lzma

:( Sad8669

02-08-2021, 10:50

Reminds me of using GrittiBanzli on CB4, that shit took 25 hours to precompress and ended up giving an error xD.

While using reflate, it took less than an hour.

KaktoR

02-08-2021, 11:07

Try xtool:frostbite3 plugin(zstd)+srep:m3f:l512+lzma2 or lzma

Nah, I have better things to do as waiting a whole day for some compression and block my machine from doing anything other then compressing stuff :p

PsYcHo_RaGE

02-08-2021, 23:51

Nah, I have better things to do as waiting a whole day for some compression and block my machine from doing anything other then compressing stuff :p

lol :D

Edit-1: Normal ZSTD Codec works fine on Star Wars Battlefront 2 but not the frostbite3 plugin, looks stuck (Is stuck honestly) but is using CPU and RAM normally even if you keep it like that for 3-5 days :D.

Tested on Ryzen 32 Threaded and Intel i9 16 Threaded CPU

Edit-2: ZSTD is buggy :D

crachlow

02-09-2021, 12:49

Hello Razor12911. Please tell an inexperienced user where the keys for UE4 games are taken?

KaktoR

02-09-2021, 13:42

From the shipping exe file

elit

08-09-2021, 08:05

In Pathfinder Kingmaker, there is a folder called Bundles, containing among other unity files with *_bundle ending but without extension. These are about 16.6gb.

I can inflate them using latest xtool(with unity.dll from here) and liblz4.dll from ztool(~65kb), however I have to set solid = 0 in arc.ini for xtool. With solid ON it stop inflating at around 800mb into, giving only 17.4gb. I don't know if it's bug or unity files are supposed to work without solid. Otherwise it work fine, just wanted to mention it.
(On side note, punity will not work with that liblz4.dll, give exception loading it.)

Now I am thinking its maybe better to turn off solid for most precompressors and engines I use, such as crilayla, unreal, unity, anvil, kraken, zstd... also mp3, ogg, jpg etc.. except deflate? It seems too flaky and I don't have time to test manually every time 10+gb of data whether it inflated correctly everything or stopped at some point. I know this problem existed for long time.
Anyone with experience, for precomp tools alone solid turned off should not have much impact on final size right?

Masquerade

08-09-2021, 11:13

elit
The only precompressor I have seen that works better in non-solid mode is the unity one. The rest is fine to run normally.

elit

09-09-2021, 08:19

Thank you, I also just found that it's not even viable option after all.
When doing something like xtool:munity+srep+lzma where xtool is set to solid = 0, FA will pass that upstream. That is srep and lzma will also be applied to each file individually before joining archive.

I found out after wasting hours compressing, so now I am doing those files through batch script before packing with FA. I found using ppx2 to parallel xtool(with -t1) for each file instead of doing "tar" through FA with single xtool and -t100p give significant speed boost as well.

Razor12911

28-09-2021, 02:20

Plugin(s) updated

Changes

- Added support for FIFA 22 in Frostbite 3 plugin

Notes

Some streams are left behind. :rolleyes:

Just like FIFA 21 wasn't worth it, FIFA 22 is also not worth it.

Tested 1 file, 233,182,965 => 103,625,666 bytes. Ratio 225.02%
Testing time: cpu 0.14 sec/real 179.17 sec = 0%. Speed 0.58 mB/s

They keep increasing compression, I guess as a form of differentiating FIFA 20 from FIFA 21 from FIFA 22 because it's the same game...

Razor12911

28-09-2021, 02:23

Deathloop

Usage
Place deathloop.ini near xtool.exe along with required libraries and use -mdeathloop

Notes

The configuration file can be discarded after encoding.

oo2core_7_win64.dll and oo2core_8_win64.dll are required

Cesar82

28-09-2021, 09:12

Thank you very much for the updates.
Always surprising us with good news...

I look forward to you having time again and if possible bring us some working plugin for the marvels avengers game.
If you are going to try to develop plugin for avengers and need samples let me know that I will upload them, but they (are 4 GB files each).

Razor12911

06-10-2021, 15:39

Plugin(s) updated

Changes

- Added support for Battlefield 2042 (based on Open-Beta files) in Frostbite 3 plugin

Notes

The final release of game might have different compression settings. (Make adjustments where necessary)

Battlefield 2042 Open Beta\Data\Win32\installation\levelsinstallpackage\ cas_01.cas:
Tested 1 file, 405,732,037 => 204,049,188 bytes. Ratio 198.84%
Testing time: cpu 0.20 sec/real 91.37 sec = 0%. Speed 2.23 mB/s

@Cesar82

The tools that are currently available are closed source so unless if there are other methods that I don't know about regarding decryption of Avengers game, perhaps you could make a plugin yourself. (Make it your first xtool plugin) :)

ZAZA4EVER

13-10-2021, 15:52

Farcry 6 plugin

Usage
Place fc6.xtl near xtool.exe along with required libraries and use -mfc6

Notes

The plugin file can be discarded after encoding.
liblz4 is required
plugin made by Dunia/Disrupt Engine Database maker from here (https://www.fileforums.com/showpost.php?p=494295&postcount=16)
Thanks to Razor

Files list of plugin
common.dat
common.fat
fctber_disk.dat
fctber_disk.fat
fctber_dlc.dat
fctber_dlc.fat
fctworlds.dat
fctworlds.fat
installpkg.dat
installpkg.fat

Plugin tested

Compressed 10 files, 38,471,392,432 => 55,786,073,159 bytes. Ratio 145.01%
Compression time: cpu 72.53 sec/real 1936.74 sec = 4%. Speed 19.86 mB/s
All OK

use Xtool V_0.3.21 and liblz4

daveyrob

20-10-2021, 04:04

does anybody know why i cant get the bethesda plugin to work with skyrim? maybe it needs updating or something? it encodes just fine using the r3 version posted earlier with latest xtool but it fails to decode, the command line error is EThredException: error in the method 'skyrim'

i tried the bsa.dll from mega aswell but that fails to do anything, i also tryed multiple versions of xtool with no luck, would somebody kindly help me out??

KaktoR

20-10-2021, 04:14

Because the plugin is broken again.

It worked on a specific xtool version, but I don't remember which of them.

daveyrob

20-10-2021, 04:22

Because the plugin is broken again.

It worked on a specific xtool version, but I don't remember which of them.

ahh thank you , glad to know i wasnt doing something wrong, i did notice the r2 bsa.dll was tested on an early post with xtool 0.3.9 but it seems r3 does not work with it, neither did the others i tried, i dont see any links to the r2 bsa either :(

Cesar82

20-10-2021, 04:52

This attachment combination works, but you cannot use the latest versions of XTool with it.

daveyrob

20-10-2021, 05:26

This attachment combination works, but you cannot use the latest versions of XTool with it.

thank you both, appreciate it :)

Masquerade

28-10-2021, 07:23

Scarlet Nexus: Updated Database for v1.04

This database is for game version v1.04 / Steam Build 7458866.
Created using Database Maker thanks to Razor12911.
Follow the guidance in this post for how to use: https://fileforums.com/showpost.php?p=493013&postcount=166

Test on a small sample:
Compressed 8 files, 23,979,472 => 48,613,558 bytes. Ratio 202.73%
Compression time: cpu 0.05 sec/real 11.41 sec = 0%. Speed 2.10 mB/s
All OK

L0v3craft

03-01-2022, 18:16

prince55

03-01-2022, 22:27

:( Sad8669

04-01-2022, 03:48

I digged into WDL once, found out that videos.dat contains bink files both HD+4K and they can ripped using HEX. I looked quite into it and realized that it can be reduced to as low as 15~18 GB. Alot of .wem files too, for which Masquerade made a seperate thread.

It would take weeks ofcourse, just to prepare the xdelta patches for each file since BPK compressor ain't coming along very well.

All of these without using XTool.

Razor12911

04-01-2022, 12:46

WDL supported database maker please or updated .xtl :)

as with most of these games, I am either lacking samples or lacking in source materials to even make a plugin for them.

https://fileforums.com/showpost.php?p=492876&postcount=6

Use this to generate your own database file then use the files in the attachment for precompression, change the liblz4.dll depending on whichever gives better result.

Side note, this is incomplete. (More samples needed for completion)

Use 0.3.21 or earlier, there is a bug in 0.3.22 that prevents search plugins from working and shall be fixed in the next update

prince55

04-01-2022, 15:55

as with most of these games, I am either lacking samples or lacking in source materials to even make a plugin for them.

https://fileforums.com/showpost.php?p=492876&postcount=6

Use this to generate your own database file then use the files in the attachment for precompression, change the liblz4.dll depending on whichever gives better result.

Side note, this is incomplete. (More samples needed for completion)

Use 0.3.21 or earlier, there is a bug in 0.3.22 that prevents search plugins from working and shall be fixed in the next update
Streams in Only 23 files detected , some other big files (as london.dat) isn't detected
I used Xtool 0.3.21 with attached dlls in precompress and decompress
only shadersobj.dat expands well
but faced error in decompress :(

Razor12911

07-01-2022, 06:31

@Razor12911 please can you release an updated plugin for Watch Dogs Legion? I tried with this (https://www.fileforums.com/showpost.php?p=492876&postcount=6) and with different xtool versions but precompression doesn't work.

After several tests, I've come to the conclusion that precompression on this game is not worth it and here's why:

1. Weak compression is used and a strong compression algorithm does still work on the compressed data
2. A custom lz4 variant was used for the compression of this game meaning the public lz4 decompressor does not work.
3. I did get lz4 decompressor from ProFrager once before, it works on most streams but some get left behind as decompression just straight up fails, worse at times it corrupts the memory buffer causing xtool to crash.
4. All streams that are decompressed will have xdelta diff files contributing to negative ratio worsening the compression ratio you would have gotten otherwise.

So I decided to no longer work on this game as it seems to be a pain in the ass to only gain 1gb (probably at best), not worth the trouble, sorry :(

Snake288

07-01-2022, 06:47

Watch Dogs Legion hi how do I do the compression process

Masquerade

09-02-2022, 08:17

Scarlet Nexus: Updated Database for v1.07

This database is for game version v1.07 / Steam Build 7988311.
Created using Database Maker thanks to Razor12911.
Follow the guidance in this post for how to use: https://fileforums.com/showpost.php?p=493013&postcount=166

Compressing pakchunk47-WindowsNoEditor.ucas
Compressed 1 file, 82,772,046 => 219,071,436 bytes. Ratio 264.67%
Compression time: cpu 0.13 sec/real 38.91 sec = 0%. Speed 2.13 mB/s
All OK

mausschieber

09-02-2022, 09:27

Scarlet Nexus: Updated Database for v1.07

[LIST]
This database is for game version v1.07 / Steam Build 7988311.
Created using Database Maker thanks to Razor12911.
Follow the guidance in this post for how to use: https://fileforums.com/showpost.php?...&postcount=166

the how to use link do not work

KaktoR

09-02-2022, 09:39

https://fileforums.com/showpost.php?p=493013&postcount=166

Razor12911

16-02-2022, 22:36

xmemcompress

Supported games

To be used by QuickBMS scripts...

Razor12911

10-03-2022, 08:16

Frostbite 3 Configuration updated

Changes

Updated to support xtool 0.4.4+

Cesar82

10-03-2022, 18:14

Frostbite 3 Configuration updated

Changes

Updated to support xtool 0.4.4+
I tested it with samples of the ME Andromeda game (cas_08.cas) using the library libzstd.dll v1.2.0 together with XTool 0.3.11 (Before changing parse parameters) and it worked fine (Ratio 171.10%).
XTool 0.4.5 (with libzstd.dll v1.2.0) no does not inflate the precompressed file (Ratio 100.0%).

Pack.bat
arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:c32mb:mfrostbite3,zstd data.arc "pack\*"

Arc.ini
[External compressor:xtool]
header = 0
default = -c64mb -t100p
packcmd = "xtool.exe" precomp { -option} --dbase - - <stdin> <stdout>
unpackcmd = "xtool.exe" decode -t100p - - <stdin> <stdout>

Files near XTool.exe
frostbite3.ini
libzstd.dll (v1.2.0)

Razor12911

10-03-2022, 18:58

Endianess can be confusing at times... :) try this

Cesar82

10-03-2022, 19:23

Endianess can be confusing at times... :) try this
Thanks.
It worked perfectly now for ME Andromeda.

Masquerade

12-03-2022, 02:29

Distant Worlds 2

This game uses very weak LZ4 compression on the bundle files, don't expect a HUGE ratio increase :)
Extract contents of the attached archive and use -mDistantWorlds2.
Requires liblz4.dll, I included one that gives a good ratio.
You can discard DistantWorlds2.xtl for decoding, however you will still need the same liblz4.dll you used for encoding.

xtool precomp -mDistantWorlds2 -c64mb -t12 Dhayut.16fded53a296c46dd06a09d8bd780324.bundle

Streams: 21 / 21
Time: 00:00:01 (CPU 00:00:00)

Size: 11.2 MB >> 14.8 MB

Razor12911

14-03-2022, 14:45

WWE 2K22 research information

Straight away I'll say working on this game has been a headache especially since there is no information online so I'll post some information if someone wants to continue to work on it but doesn't know where to start.

This game is heavily obfuscated/encrypted. The header structed is encrypted, the data itself is encrypted. They used weak xor encryption which is weak but the catch is these keys are different for each stream/block that's encrypted, they are generated based on a generated hash to produce a 256 byte key.

Since I had no idea how to decrypt the header to get these hash values, I just hijacked the exe by injecting code then to be able to obtain decrypted headers which has a structure that looks like this

type
PWWEStruct = ^TWWEStruct;

TWWEStruct = record
Position, Hash: Int64; {not sure if Hash is 32-bit or 64-bit}
StreamIndex, CSize, Format, DSize, Unk1, FileIndex: Int32; {FileIndex = bakedfile##.cak}
end;

As for compression that was used, they used Hydra which comes from oodle library hence you see oo2core_9_win64.dll set to level 6. So if you plan on decompressing all the streams, it's important that you know the decompressed stream size as Hydra streams can either be Kraken, Mermaid/Selkie or Leviathan in terms of their format (Leviathan streams cannot be processed directly by xtool properly if decompressed size is unknown)

The attachment contains decrypted headers for the first 15GB.

[0] Performing scan from block 0000000000000000 to 0000000000003E87 (16008)
[0] Actual hydra stream found at 0000000000000000 (16008 >> 71384)

[0] Processing streams on block 0000000000000000 to 0000000000003E87 (16008)
[0] Processed hydra stream at 0000000000000000 (16008 >> 71384 >> 16008) using l6,c0,t256 successfully

KaktoR

21-03-2022, 07:33

Me and Cesar took the opportunity and tested some plugins if they are still working.

Ubisoft Dunia 2 (use xtool 0.3.21 with dunia2_db_R3)
Far Cry 3
Compressed 2 files, 192,353,931 => 445,118,379 bytes. Ratio 231.41%
Compression time: cpu 0.23 sec/real 11.42 sec = 2%. Speed 16.84 mB/s
All OK

Extracted 2 files, 445,118,379 => 192,353,931 bytes. Ratio 231.41%
Extraction time: cpu 0.41 sec/real 10.08 sec = 4%. Speed 19.07 mB/s
All OK

Far Cry 3 Blood Dragon
Compressed 2 files, 187,181,236 => 381,569,184 bytes. Ratio 203.85%
Compression time: cpu 0.20 sec/real 10.27 sec = 2%. Speed 18.23 mB/s
All OK

Extracted 2 files, 381,569,184 => 187,181,236 bytes. Ratio 203.85%
Extraction time: cpu 0.33 sec/real 8.39 sec = 4%. Speed 22.31 mB/s
All OK

Far Cry 4
Compressed 2 files, 128,161,319 => 304,134,437 bytes. Ratio 237.31%
Compression time: cpu 0.17 sec/real 8.37 sec = 2%. Speed 15.32 mB/s
All OK

Extracted 2 files, 304,134,437 => 128,161,319 bytes. Ratio 237.31%
Extraction time: cpu 0.27 sec/real 8.47 sec = 3%. Speed 15.14 mB/s
All OK

Far Cry 6
Compressed 2 files, 1,018,689,920 => 1,616,466,970 bytes. Ratio 158.68%
Compression time: cpu 0.53 sec/real 15.48 sec = 3%. Speed 65.80 mB/s
All OK

Extracted 2 files, 1,616,466,970 => 1,018,689,920 bytes. Ratio 158.68%
Extraction time: cpu 0.84 sec/real 7.57 sec = 11%. Speed 134.64 mB/s
All OK

Not working: FC5, FCND, WD2
Not tested: FCP (probably same modified lz4 as WD2)

Cyberpunk 2077
xtool 0.3.21
Compressed 1 file, 200,130,560 => 414,058,350 bytes. Ratio 206.89%
Compression time: cpu 0.25 sec/real 33.74 sec = 1%. Speed 5.93 mB/s
All OK

Extracted 1 file, 414,058,350 => 200,130,560 bytes. Ratio 206.89%
Extraction time: cpu 0.45 sec/real 6.38 sec = 7%. Speed 31.37 mB/s
All OK

xtool 0.4.5
Compressed 1 file, 200,130,560 => 421,178,833 bytes. Ratio 210.45%
Compression time: cpu 0.17 sec/real 30.60 sec = 1%. Speed 6.54 mB/s
All OK

Extracted 1 file, 421,178,833 => 200,130,560 bytes. Ratio 210.45%
Extraction time: cpu 0.45 sec/real 6.46 sec = 7%. Speed 30.96 mB/s
All OK

Unravel 1 + 2 (use xtool 0.3.21)
Compressed 1 file, 209,006,308 => 412,014,267 bytes. Ratio 197.13%
Compression time: cpu 0.23 sec/real 8.15 sec = 3%. Speed 25.64 mB/s
All OK

Extracted 1 file, 412,014,267 => 209,006,308 bytes. Ratio 197.13%
Extraction time: cpu 0.34 sec/real 2.33 sec = 15%. Speed 89.87 mB/s
All OK

Deathloop (xtool 0.4.5 or 0.3.21 does not matter, both are working)
Compressed 1 file, 370,332,059 => 538,901,543 bytes. Ratio 145.52%
Compression time: cpu 0.36 sec/real 31.35 sec = 1%. Speed 11.81 mB/s
All OK

Extracted 1 file, 538,901,543 => 370,332,059 bytes. Ratio 145.52%
Extraction time: cpu 0.70 sec/real 31.04 sec = 2%. Speed 11.93 mB/s
All OK

Haemimont Engine (test from "Surviving Mars", xtool 0.4.5 or 0.3.21 does not matter, both are working)
Compressed 1 file, 117,390,334 => 183,791,889 bytes. Ratio 156.56%
Compression time: cpu 0.11 sec/real 1.79 sec = 6%. Speed 65.52 mB/s
All OK

Extracted 1 file, 183,791,889 => 117,390,334 bytes. Ratio 156.56%
Extraction time: cpu 0.31 sec/real 1.22 sec = 26%. Speed 95.85 mB/s
All OK

Not working: Hitman 3, Bethesda (at least for Skyrim AE version, SE could still work), Saints Row 3 Remaster. Other plugins not tested due to lacking samples.