FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   XTool 2020 (Plugins) (https://fileforums.com/showthread.php?t=103876)

emadmoner 17-08-2022 08:41

Quote:

Originally Posted by Razor12911 (Post 497947)
Spiderman Remastered

Supported games
Spiderman Remastered (requires liblz4.dll)

Edit: Hotfix uploaded

Thanks for quick hotfix, compress & decompress work perfect

KaktoR 18-08-2022 07:46

Quote:

Originally Posted by Razor12911 (Post 497966)
Saints Row 2022?

Supported games
Saints Row Boss Factory (requires liblz4.dll, xdelta_dll.dll)

Usage
Place sr22.dll near xtool.exe along with required libraries and use -msr22

Notes

The library is required when encoding.

The development team behind Saints Row released a "game" titled, Saints Row Boss Factory which can be downloaded from Epic Games and it showcases character customisations the game has to offer for people to tryout before the actual game releases. I got the game with the intentions of looking at the game files to create a plugin for Saints Row 2022. This should work with the final release game if nothing changes.

Source code is uploaded if there are any changes.

Results
Code:

Tested 1 file, 1,917,017,391 => 1,181,753,626 bytes. Ratio 162.22%
Testing time: cpu 0.97 sec/real 23.70 sec = 4%. Speed 49.86 mB/s


Which lz4 library is required for this?

Razor12911 18-08-2022 10:45

1 Attachment(s)
@KaktoR

liblz4 1.9.2

Plugin update available

Changes

- Fixed issues pointed out by dixen in Unreal Engine plugin (hopefully)

Hexagon123 23-08-2022 00:10

Nickelodeon Kart Racers 2: Grand Prix (2020) [Snappy]
 
1 Attachment(s)
  • Extract contents of the attached archive and use -mNKR2GP --diff=70p.
  • You can discard the NKR2GP.XTL file for decoding, but you must keep the following:
    • quickbms.exe
    • xtool.ini

Tested with Gameplay.apf, 16,511,216 bytes
Code:

XTool is created by Razor12911

Streams: 622/622
Time: 00:02:18 (00:00:03)
Memory: 175 MB (175 MB)


Masquerade 23-08-2022 06:54

Quote:

Originally Posted by Razor12911 (Post 497966)
Saints Row 2022

Working great, thanks Razor!

Code:

Compressing engine.vpp_pc
Compressed 1 file, 62,748,440 => 217,935,308 bytes. Ratio 347.32%
Compression time: cpu 0.19 sec/real 15.81 sec = 1%. Speed 3.97 mB/s
All OK


Razor12911 05-09-2022 02:19

1 Attachment(s)
Anvil Engine

Usage
Place anvil.dll near xtool.exe along with required libraries and use -manvil

Notes

The library is required both encoding and decoding.

lzo2.dll or oo2core_#_win64.dll is required

Results on AC Valhalla

-manvil
Code:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 1,103,790,080 => 1,978,050,029 bytes. Ratio 179.21%
Compression time: cpu 1.03 sec/real 74.01 sec = 1%. Speed 14.91 mB/s
All OK

-moo2recm
Code:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 1,103,790,080 => 1,776,145,142 bytes. Ratio 160.91%
Compression time: cpu 1.33 sec/real 387.05 sec = 0%. Speed 2.85 mB/s
All OK

Special thanks to KaktoR for running tests

Razor12911 05-09-2022 10:35

Plugin update available

Changes

- Unreal Engine plugin can directly report streams to xtool

Notes

The plugin's original purpose was to decrypt streams so you could get better results however I've decided to extend functionality to allow the user to specify what compression algorithm was used on unreal engine titles even if they are not encrypted so you get similar result as if you were to use unreal tournament 4 script via Bms2Xtl.

Why? Well Xtool's oodle scanner in particular is still lackluster (needs improvements) and at times it will hang for no reason and take too long while still producing underwhelming results.

So instead of normal use of specifying key for decryption -mue4,k0x... you directly specify what algorithm was used, for example, -mue4,kraken

Unreal Engine headers change a lot so I've tried as best I can to mitigate differences between games, just yesterday I noticed a new header structure used in the Back 4 Blood game and I tried to make it so that the user does not specify parameters even they don't know when to use.

Results tests on some Star Wars Jedi Fallen Order

-mmermaid
Code:

Compressed 7 files, 126,201,498 => 286,909,553 bytes. Ratio 227.34%
Compression time: cpu 0.16 sec/real 259.98 sec = 0%. Speed 0.49 mB/s

// it stalled in the threads doing who knows what :D

-mue4,mermaid
Code:

Compressed 7 files, 126,201,498 => 312,346,042 bytes. Ratio 247.50%
Compression time: cpu 0.20 sec/real 21.70 sec = 1%. Speed 5.82 mB/s


dixen 06-09-2022 01:15

Quote:

Originally Posted by Razor12911 (Post 498193)
Anvil Engine

Thanks but on old AC games (Brotherhood) didn't worked


Code:

[0] Confirmed lzo1c stream at 000000000987747B (19327 >> 20919)
[0] Confirmed lzo1c stream at 0000000009948DB3 (26919 >> 29102)
[0] Processing streams on block 0000000008000000 to 00000000099B7FFF (26968064)
[0] Processing lzo1c stream at 000000000987747B (19327 >> 20919 >> 19036) using v999 has failed
[0] - Patching stream at 000000000987747B (19327 >> 19036) [6046] has failed
[0] Processing lzo1c stream at 0000000009948DB3 (26919 >> 29102 >> 23998) using v999 has failed
[0] - Patching stream at 0000000009948DB3 (26919 >> 23998) [4788] has failed

Streams: 0/10
Time: 00:00:00 (00:00:00)
Memory: 128 MB (128 MB)


Errorlevel=0

Compressed 1 file, 161,185,792 => 161,185,867 bytes. Ratio 100.00%
Compression time: cpu 0.11 sec/real 0.92 sec = 12%. Speed 174.85 mB/s
All OK


KaktoR 06-09-2022 01:17

Quote:

Originally Posted by dixen (Post 498209)
Thanks but on old AC games (Brotherhood) didn't worked

It works

DataPC_LGS306_CloacaMaxima.forge
Code:

Compressed 1 file, 46,104,576 => 87,396,705 bytes. Ratio 189.56%
Compression time: cpu 0.00 sec/real 3.92 sec = 0%. Speed 11.76 mB/s
All OK

Extracted 1 file, 87,396,705 => 46,104,576 bytes. Ratio 189.56%
Extraction time: cpu 0.03 sec/real 1.81 sec = 2%. Speed 25.47 mB/s
All OK

Code:

[0] Processed lzo1x stream at 0000000002BE7A8A (26409 >> 32768 >> 26409) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BEE1B7 (7873 >> 9323 >> 7873) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF0280 (134 >> 150 >> 134) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF0504 (335 >> 578 >> 335) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF0851 (1283 >> 1990 >> 1283) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF0F52 (1164 >> 1858 >> 1164) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF15DC (505 >> 800 >> 505) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF19D3 (290 >> 476 >> 290) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF1CF3 (2030 >> 3180 >> 2030) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF26DF (505 >> 798 >> 505) using l8:v999 successfully
[0] Processed lzo1x stream at 0000000002BF2AD6 (660 >> 1018 >> 660) using l8:v999 successfully

Streams: 2465/2465
Time: 00:00:22 (00:00:07)
Memory: 153 MB (153 MB)

The only game it does not work is AC1 because of lzo pro codec used (maybe AC Rogue aswell, not sure).

dixen 06-09-2022 01:34

Quote:

Originally Posted by KaktoR (Post 498210)
It works

Then it's strange..
Which version lzo2.dll are you using?

KaktoR 06-09-2022 01:40

It comes with xtool (crc32 E75ADC9C)

However I have to correct myself.

Here are tests for all older AC games

Code:

AC1 - Works
AC2 - Not work
Brotherhood - Works
Revelations - Works
AC3 - Works
AC3Remastered - Not work
Black Flag - Not work
Liberation HD - Not work
Rogue - Not work
Unity - Works
Syndicate - Works


dixen 06-09-2022 01:53

Quote:

Originally Posted by KaktoR (Post 498212)
It comes with xtool (crc32 E75ADC9C)

Same version..but ..

Code:

Streams: 0/21
Time: 00:00:01 (00:00:01)
Memory: 128 MB (128 MB)


Errorlevel=0

Compressed 1 file, 429,260,800 => 429,261,035 bytes. Ratio 100.00%
Compression time: cpu 0.44 sec/real 2.70 sec = 16%. Speed 158.80 mB/s
All OK

:confused:

KaktoR 06-09-2022 01:56

The library requires msvc2005 and/or 2010, not sure.

Code:

xtool.exe precomp -manvil -c16mb -t100p --verbose  - - < %1 > %1.out

Razor12911 06-09-2022 02:41

Quote:

Originally Posted by dixen (Post 498209)
Thanks but on old AC games (Brotherhood) didn't worked


Code:

[0] Confirmed lzo1c stream at 000000000987747B (19327 >> 20919)
[0] Confirmed lzo1c stream at 0000000009948DB3 (26919 >> 29102)
[0] Processing streams on block 0000000008000000 to 00000000099B7FFF (26968064)
[0] Processing lzo1c stream at 000000000987747B (19327 >> 20919 >> 19036) using v999 has failed
[0] - Patching stream at 000000000987747B (19327 >> 19036) [6046] has failed
[0] Processing lzo1c stream at 0000000009948DB3 (26919 >> 29102 >> 23998) using v999 has failed
[0] - Patching stream at 0000000009948DB3 (26919 >> 23998) [4788] has failed

Streams: 0/10
Time: 00:00:00 (00:00:00)
Memory: 128 MB (128 MB)


Errorlevel=0

Compressed 1 file, 161,185,792 => 161,185,867 bytes. Ratio 100.00%
Compression time: cpu 0.11 sec/real 0.92 sec = 12%. Speed 174.85 mB/s
All OK


could you upload sample

Masquerade 06-09-2022 02:46

Testing on a sample from Ghost Recon Wildlands and there does appear to be a bug because the streams supposedly all decompress to the same size:

https://paste.ec/raw/8DaeUwyt#yx7kpE...ntunJcRRVMJXzx

Sample: https://www103.zippyshare.com/v/wrkDJuYX/file.html

Code:

XTool is created by Razor12911

Streams: 0/1358
Time: 00:00:03 (00:00:24)
Memory: 128 MB (128 MB)

XTool v0.6.3 with xdelta library injected. anvil.dll and lzo2.dll present.

dixen 06-09-2022 03:06

Quote:

Originally Posted by Razor12911 (Post 498215)
could you upload sample

https://pixeldrain.com/u/62Ra44jU

Razor12911 06-09-2022 04:57

Plugin update available

Changes

- Added support for lzopro streams

@Masquerade
Code:

Compressed 1 file, 114,556,928 => 138,193,577 bytes. Ratio 120.63%
Compression time: cpu 0.08 sec/real 1.72 sec = 5%. Speed 66.71 mB/s

@dixen
Code:

Compressed 1 file, 229,605,376 => 380,281,233 bytes. Ratio 165.62%
Compression time: cpu 0.17 sec/real 8.43 sec = 2%. Speed 27.23 mB/s


Cesar82 06-09-2022 08:02

Quote:

Originally Posted by Razor12911 (Post 498225)
Plugin update available

Changes

- Added support for lzopro streams

@Masquerade
Code:

Compressed 1 file, 114,556,928 => 138,193,577 bytes. Ratio 120.63%
Compression time: cpu 0.08 sec/real 1.72 sec = 5%. Speed 66.71 mB/s

@dixen
Code:

Compressed 1 file, 229,605,376 => 380,281,233 bytes. Ratio 165.62%
Compression time: cpu 0.17 sec/real 8.43 sec = 2%. Speed 27.23 mB/s


Which plugin was updated? The Anvil plugin?

KaktoR 06-09-2022 08:04

Quote:

Originally Posted by Cesar82 (Post 498235)
Which plugin was updated? The Anvil plugin?

Yes

Mini 10-09-2022 17:51

Razor12911, please make plugin for Evolution Engine (The Darkness II, Dark Sector, Star Trek)
http://aluigi.altervista.org/bms/darkness2.bms

example:
F.Texture.cache + F.Texture.toc (2.13 GB)

unpacked files size 4.17 GB

Razor12911 11-09-2022 03:46

try using this

Mini 11-09-2022 06:42

Razor12911
I already tried it didn't work

Quote:

Compressing 34 files of 6,515,860,623 bytes: 0.00 sec
Using xtool_reflate+srep:m3f:a2:l256
Memory for compression 0b, decompression 0b
Compressing 0 bytes with xtool.exe precomp -mdarkness+zlib -d1 -c128mb -t100p --diff=1p - -
XTool is created by Razor12911

Streams: 61/317
Time: 00:00:25 (00:02:37)
Memory: 128 MB (128 MB)

100.0%
Errorlevel=0

Compressing 6,515,864,879 bytes with srep64 -m3f -a2 -l256 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
and quickbms does not unpack all files, this program is better https://forum.xentax.com/viewtopic.php?f=17&t=13701 / https://github.com/IcarusXSEC/WF-Evolution-Unpack (+ source)

game files
https://www4.zippyshare.com/v/VXvFa9CU/file.html

dixen 12-09-2022 00:52

Quote:

Originally Posted by Mini (Post 498286)

This is NOT ZLIB. in darkness.bms write
Quote:

comtype evolution

KaktoR 12-09-2022 01:11

Quote:

Originally Posted by Masquerade (Post 497188)
doboz Plugin for XTool

Just a very simple way of adding the ability to precompress streams compressed using doboz algorithm with XTool.

You cannot use this on its own, just like xmemcompress plugin. It's designed to be used with BMS2XTL.

Particularly, the Witcher 3 - which uses a fun compression cоcktail of many algos, one of which is doboz.

Thanks to Attila T. Afra who's doboz compressor is used here. I found this on the wayback machine when looking for potential source code I could compile.

Thanks for this. Maybe someone else may find the info usefull.

Like Masquerade said, you have to use it with xtl db (use bms2xtl for this with witcher3.bms script and add lz4=lz4hc to bms2xtl.ini). You have to make the xtl file out of *.bundle files. The script is not compatible with *.cache files for some reason, but it should regarding script info and zenhax forum, but for me it does not work on *.cache files.

For lz4hc use level9. This is the peak for *.bundle files. Some mod files use level3 however.

Code:

-mxtool:witcher3:zlib:lz4hc,l9
https://i.imgur.com/hLR8zwe.png

Mini 12-09-2022 10:04

Quote:

Originally Posted by dixen (Post 498294)
This is NOT ZLIB. in darkness.bms write

how to recompress files? try it ;)

Razor12911 13-09-2022 02:09

@Mini
I don't see any re-encode/compress function in any of these sources.

Mini 13-09-2022 06:35

Razor12911
can you help with this engine? maybe I did something wrong with bms2xtl

http://aluigi.altervista.org/papers/quickbms.txt

evolution, aka lzf or lzfx

i try:

Quote:

[cpk,snappy,rfpk,evolution,lzf,lzfx]
// http://aluigi.altervista.org/papers/quickbms.txt
Encode=quickbms.exe -s "comtype <codec>; clog <fileout> 0 <insize> <outsize>" "" <filein>
Decode=quickbms.exe -s "comtype <codec>_COMPRESS; clog <fileout> 0 <insize> <outsize>" "" <filein>
precompression not working :(

dixen 04-10-2022 15:38

Shadow Of War (GOG Version, NON-UltraHD Content)

Test file presentations.arch06

Code:

Compressed 1 file, 1,310,943,354 => 2,382,102,100 bytes. Ratio 181.71%
Compression time: cpu 1.33 sec/real 83.72 sec = 2%. Speed 15.66 mB/s
All OK

sow.xtl db
https://www50.zippyshare.com/v/cUU4UIeq/file.html

Note.
You need oo2core_5_win64.dll from game folder.
Recommended version XTool - 0.53 (or 0.65 if 0.53 stuck process)

panker1992 05-10-2022 11:42

Quote:

Originally Posted by dixen (Post 498608)
Shadow Of War (GOG Version, NON-UltraHD Content)

Test file presentations.arch06

Code:

Compressed 1 file, 1,310,943,354 => 2,382,102,100 bytes. Ratio 181.71%
Compression time: cpu 1.33 sec/real 83.72 sec = 2%. Speed 15.66 mB/s
All OK

sow.xtl db
https://www50.zippyshare.com/v/cUU4UIeq/file.html

Note.
You need oo2core_5_win64.dll from game folder.
Recommended version XTool - 0.53 (or 0.65 if 0.53 stuck process)

I have been unable to generate a database that works, can you post how you made one ?

Masquerade 05-10-2022 11:54

Quote:

Originally Posted by panker1992 (Post 498620)
I have been unable to generate a database that works, can you post how you made one ?

bms2xtl

http://aluigi.altervista.org/bms/shadow_of_mordor.bms

Masquerade 08-10-2022 12:13

1 Attachment(s)
Asterigos: Curse of the Stars
  • Place asterigos.xtl and asterigos.key in the same folder as XTool, use "-masterigos+preflate -d1".

Snake288 09-10-2022 00:39

Hello Masquerade

Asterigos: Curse of the Stars
Place asterigos.xtl and asterigos.key in the same folder as XTool, use "-masterigos+preflate -d1".

File : Asterigos.7z

Asterigos: Curse of the Stars is the mask of the XTool 2020 (Add-ons) game published by Asterigos.7z file
DiskSpan GUI can I get help with adding?

Wanterlude 09-10-2022 06:04

Quote:

Originally Posted by Snake288 (Post 498681)
Hello Masquerade

Asterigos: Curse of the Stars
Place asterigos.xtl and asterigos.key in the same folder as XTool, use "-masterigos+preflate -d1".

File : Asterigos.7z

Asterigos: Curse of the Stars is the mask of the XTool 2020 (Add-ons) game published by Asterigos.7z file
DiskSpan GUI can I get help with adding?

DiskSpan Gui
Code:

xtool:masterigos:mpreflate:d1
Where is xtool located? (DiskSpan Gui)
Code:

COMPRESSOR\Resources\PRE\XTool_2020
Place asterigos.xtl and asterigos.key from the archive to XTool_2020 folder

Masquerade 16-10-2022 02:58

1 Attachment(s)
Nickelodeon Kart Racers 3 [Kraken]
  • Place NickelodeonKart3.xtl in the same folder as XTool, use "-mNickelodeonKart3". Requires oodle library for compression + decompression, but database can be discarded.
Code:

Compressing pakchunk49-WindowsNoEditor.pak, 40,495,553 bytes

XTool is created by Razor12911

Streams: 2089/2131
Time: 00:00:12 (00:00:47)
Memory: 317 MB (317 MB)

Compressed 1 file, 40,495,553 => 208,378,061 bytes. Ratio 514.57%
Compression time: cpu 0.13 sec/real 22.64 sec = 1%. Speed 1.79 mB/s
All OK


Razor12911 20-10-2022 18:07

Plugin update available

Changes

- Added support for file version 8 in unity engine plugin???

Notes

R3 attachment is left on main post just in case if I've made a blunder.

Plugin was updated in response to this post

Code:

Compressed 1 file, 60,357,834 => 327,942,992 bytes. Ratio 543.33%
Compression time: cpu 0.06 sec/real 8.31 sec = 1%. Speed 7.26 mB/s


Hexagon123 20-10-2022 18:35

1 Attachment(s)
The game, Super Monkey Ball: Banana Mania (2021) uses LZ4 or LZ4HC? doesn't seem to work with XTool, this seems bugged.

Uses version 7.

Use [xtool precomp -munity,lz4hc,l12] with the liblz4.dll (1.9.3)

KaktoR 21-10-2022 01:03

Quote:

Originally Posted by Razor12911 (Post 498814)
Plugin update available

Changes

- Added support for file version 8 in unity engine plugin???

Notes

R3 attachment is left on main post just in case if I've made a blunder.

Plugin was updated in response to this post

Code:

Compressed 1 file, 60,357,834 => 327,942,992 bytes. Ratio 543.33%
Compression time: cpu 0.06 sec/real 8.31 sec = 1%. Speed 7.26 mB/s


Thanks

Code:

Compressed 137 files, 22,499,636,299 => 30,533,946,304 bytes. Ratio 135.71%
Compression time: cpu 9.66 sec/real 669.32 sec = 1%. Speed 33.62 mB/s
All OK

Extracted 137 files, 30,533,946,304 => 22,499,636,299 bytes. Ratio 135.71%
Extraction time: cpu 18.73 sec/real 549.49 sec = 3%. Speed 40.95 mB/s
All OK

Streams: 175306/175306
Time: 00:16:32 (00:12:17)
Memory: 270 MB (270 MB)


Razor12911 21-10-2022 01:29

Plugin update available

Changes

- improved header decoder in unity plugin

Notes

bg_smb1_masters
Code:

Compressed 1 file, 6,273,468 => 14,834,634 bytes. Ratio 236.47%
Compression time: cpu 0.00 sec/real 1.07 sec = 0%. Speed 5.84 mB/s


Razor12911 27-10-2022 17:26

1 Attachment(s)
Boycott 3

Supported games
Bayonetta 3 Switch (requires oo2core_9_win64.dll)

Usage
Place bn3.dll near xtool.exe along with required libraries and use -mbn3

Notes

A newer oodle library may be required for some streams (either 2.9.7 or 2.9.8)

Results

-mkraken
Code:

Compressed 1 file, 127,450,048 => 177,590,706 bytes. Ratio 139.34%
Compression time: cpu 0.17 sec/real 49.27 sec = 0%. Speed 2.59 mB/s

-mbn3
Code:

Compressed 1 file, 127,450,048 => 180,417,265 bytes. Ratio 141.56%
Compression time: cpu 0.16 sec/real 21.33 sec = 1%. Speed 5.97 mB/s


Mini 16-11-2022 16:09

hello Razor12911, can you help with this engine?
https://fileforums.com/showpost.php?...&postcount=307


All times are GMT -7. The time now is 23:21.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com