FileForums - XTool 2020 (Plugins)

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - XTool 2020 (Plugins) (https://fileforums.com/showthread.php?t=103876)

Quote:

Originally Posted by Razor12911 (Post 492319)

Plugin updated

Changes

- Updated all plugins to support xtool v0.3.10+

Thanks for all the changes to XTool.
I will test the new version as soon as possible.
These latest plugins are not linked to the first post like Haemimont Engine (maybe it is intensive).
You could list the updated plugins. Among them I found: Unreal Engine R4, Bethesda R2, Ubisoft Dunia 2 Engine (Far Cry primal R4, Watch Dogs 2 R4, Watch Dogs Legion R4). If any others have been updated please inform.

EDIT: Just to report. Kaspersky Internet Security (KIS) antivirus captured the XTool.exe executable (32 bits) as a false positive in previous versions of XTool, but not anymore.

Quote:

Originally Posted by Cesar82 (Post 492324)

You could list the updated plugins.

Lazy af, was even lazy to post 0.3.10, 0.3.11...

Quote:

Originally Posted by Cesar82 (Post 492324)

Among them I found: Unreal Engine R4, Bethesda R2, Ubisoft Dunia 2 Engine (Far Cry primal R4, Watch Dogs 2 R4, Watch Dogs Legion R4). If any others have been updated please inform.

Your findings are correct.

@Razor12911, I was testing it with a sample Borderlands 3 file and for some reason it doesn't seem to work with xtool 0.3.12 and Unreal Engine R4.
I don't know if it is the Unreal plugin that doesn't work (maybe it has changed some option).

With XTool 0.3.9 and Unreal Engine plugin R3 it works.
But if you replace the plugin Unreal.dll R3 with what is in the file attached in this post from Mass Effect Legendary Edition it also does not work for Borderlands 3.
Maybe there is something wrong with the Unreal Engine plugin or I need a different configuration now.
Attached is my test (if possible analyze).

Quote:

Originally Posted by Cesar82 (Post 492331)

Hmm..

ue4+xtool 0.3.9

Quote:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 2,128,753,187 => 3,479,722,376 bytes. Ratio 163.46%
Compression time: cpu 1.63 sec/real 50.41 sec = 3%. Speed 42.23 mB/s
All OK

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool_ue4:m1:k115EE4F8C625C792F37A503308048E79726E512F0BF8D2AD7 C4C87BC5947CBA7 data.arc "pack\*"
------------------------------------------------------------------------------------------------------------------------------------

cls-ue4 plugin by shegorat + xtool v0.3.12

Quote:

Compressing 1 file, 2,128,753,187 bytes. Processed 0.0%
Use key for game 'Borderlands 3'
Init encryption key: 115EE4F8C625C792F37A503308048E79726E512F0BF8D2AD7C 4C87BC5947CBA7
Total encrypted UE records 2624/2640
Compressed 1 file, 2,128,753,187 => 3,962,925,560 bytes. Ratio 186.16%
Compression time: cpu 13.47 sec/real 37.17 sec = 36%. Speed 57.28 mB/s
All OK

Is there any way to get https://fileforums.com/showpost.php?p=482064 working with XTool 2020? I already tried putting the DLL next to XTool.exe and using -munity with no success.

Bethesda Plugin Test

Bethesda plugin test.

File: "Skyrim - Meshes0.bsa" 1.07 GB

XTool 0.3.12

Code:

0.3.12 BSA R1



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.11 sec/real 15.13 sec = 7%. Speed 76.14 mB/s

All OK

Code:

0.3.12 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.14 sec/real 51.15 sec = 2%. Speed 22.52 mB/s

All OK

XTool 0.3.11

Code:

0.3.11 BSA R1



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.20 sec/real 34.85 sec = 3%. Speed 33.06 mB/s

All OK

Code:

0.3.11 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.11 sec/real 39.01 sec = 3%. Speed 29.53 mB/s

All OK

XTool 0.3.10

Code:

0.3.10 BSA R1



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.53 sec/real 47.32 sec = 3%. Speed 24.35 mB/s

All OK

Code:

0.3.10 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,905 bytes. Ratio 100.00%     

Compression time: cpu 1.50 sec/real 81.44 sec = 2%. Speed 14.15 mB/s

All OK

XTool 0.3.9

Code:

0.3.9 BSA R1



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 2,097,540,112 bytes. Ratio 182.07%     

Compression time: cpu 1.52 sec/real 83.80 sec = 2%. Speed 13.75 mB/s

All OK

Code:

0.3.9 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,152,069,673 => 1,152,069,900 bytes. Ratio 100.00%     

Compression time: cpu 1.31 sec/real 43.55 sec = 3%. Speed 26.46 mB/s

All OK

Unpack

Code:

0.3.9 BSA R1



Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Extracting archive: OutPut\Skyrim-Bsa.arc

Extracted 1 file, 2,097,540,112 => 1,152,069,673 bytes. Ratio 182.07%      

Extraction time: cpu 1.16 sec/real 50.86 sec = 2%. Speed 22.65 mB/s

All OK

Code:

0.3.9 BSA R2



Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Extracting archive: OutPut\Skyrim-Bsa.arc

Extracted 1 file, 1,152,069,900 => 1,152,069,673 bytes. Ratio 100.00%      

Extraction time: cpu 1.17 sec/real 9.60 sec = 12%. Speed 119.97 mB/s

All OK

File: "Skyrim - Textures0.bsa" 624 MB

XTool 0.3.9

Code:

0.3.9 BSA R1



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 655,189,115 => 1,436,500,603 bytes. Ratio 219.25%       

Compression time: cpu 1.14 sec/real 58.85 sec = 2%. Speed 11.13 mB/s

All OK

Code:

0.3.9 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 655,189,115 => 1,205,435,049 bytes. Ratio 183.98%       

Compression time: cpu 0.78 sec/real 46.99 sec = 2%. Speed 13.94 mB/s

All OK

Unpack

Code:

0.3.9 BSA R1



Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Extracting archive: OutPut\Skyrim-Bsa.arc

Extracted 1 file, 1,436,500,603 => 655,189,115 bytes. Ratio 219.25%        

Extraction time: cpu 0.86 sec/real 29.05 sec = 3%. Speed 22.55 mB/s

All OK

Code:

0.3.9 BSA R2



Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Extracting archive: OutPut\Skyrim-Bsa.arc

Extracted 1 file, 1,205,435,049 => 655,189,115 bytes. Ratio 183.98%        

Extraction time: cpu 1.00 sec/real 23.96 sec = 4%. Speed 27.34 mB/s

All OK

File: "Skyrim - Textures1.bsa" 1.40 GB

XTool 0.3.9

Code:

0.3.9 BSA R1

Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,509,673,333 => 1,719,892,975 bytes. Ratio 113.92%     

Compression time: cpu 1.95 sec/real 36.01 sec = 5%. Speed 41.92 mB/s

All OK

Code:

0.3.9 BSA R2



Arc a -i2 -ep1 -r -ed -s; -di -w.\Temp -m=xtool_skyrim OutPut\Skyrim-Bsa.arc Input\*

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Creating archive: OutPut\Skyrim-Bsa.arc using xtool_skyrim

Compressed 1 file, 1,509,673,333 => 1,509,673,560 bytes. Ratio 100.00%     

Compression time: cpu 1.44 sec/real 24.72 sec = 6%. Speed 61.07 mB/s

All OK

Unpack

Code:

0.3.9 BSA R1



Arc x --logfile=_UnPack.log OutPut\*.arc -dp.\UnPacked

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=_Pack.log

Extracting archive: OutPut\Skyrim-Bsa.arc

Extracted 1 file, 1,719,892,975 => 1,509,673,333 bytes. Ratio 113.92%      

Extraction time: cpu 1.17 sec/real 21.93 sec = 5%. Speed 68.85 mB/s

All OK

:confused:

@Razor12911

Please can you fix your plugin for Hitman 3 when you have the time? Thanks anyway.

Plugin(s) updated

Changes

- Updated Hitman plugin

Notes

Other plugins require an update to work with 0.3.13

The hitman plugin now works but something you have to know is the game may be encrypted and compressed but only about 10% give or take is packed in this manner and this means that the inflation ratio or the final gains will not be a lot. I had to download the whole game just to see what was wrong with the previous plugin and here's a benchmark that shows what I am talking about

chunk8.rpkg:
2.08 GB (2,239,549,275 bytes) >> 2.22 GB (2,390,705,974 bytes)

2.08 GB (2,239,549,275 bytes) >> 1.76 GB (1,891,802,867 bytes) (srep+lzma)
2.08 GB (2,239,549,275 bytes) >> 1.67 GB (1,797,884,353 bytes) (xtool+srep+lzma)

The plugin is based on this source from github: https://github.com/LennardF1989/HitmanExtractor
- also produces the same results.

Most streams are packed as they are (not compressed), some are just encrypted and then some are both encrypted and compressed. The encryption and compression used is very weak in terms of obfuscating data for compression hence the gains will not be much.

Quote:

Originally Posted by kast1450 (Post 492337)

Is there any way to get https://fileforums.com/showpost.php?p=482064 working with XTool 2020? I already tried putting the DLL next to XTool.exe and using -munity with no success.

Wait for a revised version that works with the new xtool.

Everyone, who is going to use Hitman 3 plugin. Make sure you use d1 in your arc.ini.

Code:

[External compressor:xtool]

header    = 0

packcmd   = xtool.exe precomp { -moption} -c32mb -t100p -d1 --dbase - - <stdin> <stdout>

unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

Code:

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:hitman3:lz4 data.arc "pack\Test"

pause

Hitman 3 - Precompression

Code:

liblz4 (207 KB)

Compressed 1 file, 2,239,549,275 => 2,285,305,379 bytes. Ratio 102.04%

Compression time: cpu 3.31 sec/real 25.06 sec = 13%. Speed 89.36 mB/s

All OK



liblz4 (137 KB)

Compressed 1 file, 2,239,549,275 => 2,254,774,932 bytes. Ratio 100.68%

Compression time: cpu 3.39 sec/real 62.87 sec = 5%. Speed 35.62 mB/s

All OK



liblz4 (495 KB)

Compressed 1 file, 2,239,549,275 => 2,390,688,467 bytes. Ratio 106.75%

Compression time: cpu 3.25 sec/real 24.08 sec = 13%. Speed 92.99 mB/s

All OK



liblz4 (439 KB)

Compressed 1 file, 2,239,549,275 => 2,263,062,723 bytes. Ratio 101.05%

Compression time: cpu 3.11 sec/real 87.07 sec = 4%. Speed 25.72 mB/s

All OK

Razor, what about plugin for FarCry 3?)

Hitman 3 - Final

Code:

Compressed 101 files, 59,074,232,232 => 59,770,071,273 bytes. Ratio 101.18%

Compression time: cpu 76.09 sec/real 1113.95 sec = 7%. Speed 53.03 mB/s

All OK

Code:

Initial Size : 55.0 GB

Precompressed Size : 55.6 GB

Side Notes : I know this game is already compressed to its limit since it contains 3 titles and has a size of 55 GB, but is it normal that i am only seeing a 600 MB gain?

Something wrong...

MK11 *.xxx

XTool v0.3.13 + Last plugin ue3

Quote:

Compressed 1 file, 115,900,882 => 115,970,146 bytes. Ratio 100.06%
Compression time: cpu 0.09 sec/real 0.55 sec = 17%. Speed 209.54 mB/s
All OK

XTool v0.3.9 + Last plugin ue3

Quote:

Compressed 1 file, 115,900,882 => 168,842,435 bytes. Ratio 145.68%
Compression time: cpu 0.13 sec/real 9.29 sec = 1%. Speed 12.47 mB/s
All OK

@dixen

I think these plugins still require an update for 0.3.13 version.

Mentioned by Razor above.

Code:

55.0 GB to 47.4 GB [SREP+4X4:LZMA]

55.0 GB to 47.0 GB [XTool+SREP+4X4:LZMA]

Code:

Compressed 1 file, 59,770,073,069 => 50,552,525,489 bytes. Ratio 84.58%

Compression time: cpu 456.05 sec/real 14875.74 sec = 3%. Speed 4.02 mB/s

All OK

@Razor12911, is this fine? i mean i got 101.16% ratio on Precompression.

Drag and drop one of the rpkg files on test.bat, an output folder named "output should be created, wait till finish.

Run the same file using the method hitman3+lz4 on xtool, compare the results.

Quote:

Originally Posted by dixen (Post 492371)

Razor, what about plugin for FarCry 3?)

common.dat + common.fat, + all .fat files samples needed for this.