FileForums - XTool 2020 (Main Project)

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - XTool 2020 (Main Project) (https://fileforums.com/showthread.php?t=102832)

so game like (just cause 3 &4, ac syndicate...) using dedup xtool will give similar results as mad max :(
so i guess dedup xtool most useful on small chunks :confused:

For future repacks Borderlands 3))

pakchunk0-WindowsNoEditor_0_P.pak

packcmd = xtool.exe precomp -mzlib+preflate -c128mb -t100p-1 - - <stdin> <stdout>

Quote:

Compressed 1 file, 415,114,853 => 539,243,092 bytes. Ratio 129.90%
Compression time: cpu 0.41 sec/real 8.27 sec = 5%. Speed 50.17 mB/s
All OK

packcmd = xtool.exe precomp -mzlib+preflate -d3 -c128mb -t100p-1 - - <stdin> <stdout>

Quote:

Compressed 1 file, 415,114,853 => 1,540,405,512 bytes. Ratio 371.08%
Compression time: cpu 0.42 sec/real 106.39 sec = 0%. Speed 3.90 mB/s
All OK

Final compress with srep+lolz

With -d3 - 61 mb
Without -d3 - 270 mb

NOTE.
Before precompress *.pak is decrypted with ue4dt
Used XTool v0.3.9

For some reason, they gave me an decompression failed corrupted archive error by decrypting the pak file.

unarc.dll returned -11

I put a config on Bunti's Windows Phone Bug Free Installer arc.ini file.

Is there anything wrong?

Solved by adding a new resource.

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mzlib+ue4:m1:kC40250B917281AC9874D93C53E429255177E A6E038A117054A1F1C5DA92AB26A -c128mb -t75p -d3 --dbase - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t75p - - <stdin> <stdout>

Hi. Someone tested xtool 0.3.9 with the command "-mlz4" with some game and it worked? I'm testing it with several games made with unity engine and it doesn't work. Tested also with all the downloadable lz4 dll (i have downloaded from github versions 1.7.3, 1.7.4, 1.7.4-2, 1.8.0, 1.8.1.2, 1.8.2, 1.8.3, 1.9.3). Looks like xtool doesn't try either to precompress the files, because it is very fast, maybe it is ignoring that command "-mlz4"? Is that command a placeholder or what?

Quote:

Originally Posted by L0v3craft (Post 490885)

Maybe, try using the old XTool?

Some use LZMA, but some use LZ4?

Seems like razor was planning on it?

@Moderators
Don't you guys think that this thread should be pinned?

There'll be more sticky threads than normal threads per page )

@Moderator
unstick these threads
https://fileforums.com/showthread.php?t=94605
https://fileforums.com/showthread.php?t=96630

Thanks

Quote:

Originally Posted by Razor12911 (Post 491319)

There'll be more sticky threads than normal threads per page )

@Moderator
unstick these threads
https://fileforums.com/showthread.php?t=94605
https://fileforums.com/showthread.php?t=96630

Thanks

I unstuck those 2 and made this thread a Sticky ;)

Oodle Precompressor works well.

[External compressor:xtool]
header = 0
packcmd = xtool_0.3.9\xtool.exe precomp -mkraken -c32mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = xtool_0.3.9\xtool.exe decode -t100p - - <stdin> <stdout>

Tested games

Code:

Gears Tactics

Assassin's Creed Valhalla

Why are you using an Oodle kraken precompressor when Valhalla is compressed using Oodle Mermaid? :confused:

Quote:

Originally Posted by Masquerade (Post 491479)

Why are you using an Oodle kraken precompressor when Valhalla is compressed using Oodle Mermaid? :confused:

DataPC_extra_patch_01.forge 529MB

Code:

Creating archive: data.arc using xtool

Compressed 1 file, 555,122,688 => 1,072,196,303 bytes. Ratio 193.15%       

Compression time: cpu 0.64 sec/real 64.80 sec = 1%. Speed 8.57 mB/s

All OK

      

Testing time: cpu 0.75 sec/real 44.12 sec = 2%. Speed 12.58 mB/s

All OK

____________________________



Creating archive: data.arc using oo2recm

Compressed 1 file, 555,122,688 => 1,173,235,688 bytes. Ratio 211.35%       

Compression time: cpu 0.58 sec/real 229.01 sec = 0%. Speed 2.42 mB/s

All OK



Testing time: cpu 0.52 sec/real 52.80 sec = 1%. Speed 10.51 mB/s

All OK

____________________________



Creating archive: data.arc using xtool+srep:m3f:l512+4x4:t10:i0:lzma:64mb:normal:32

Compressed 1 file, 555,122,688 => 413,916,053 bytes. Ratio 74.56%          

Compression time: cpu 536.95 sec/real 125.05 sec = 429%. Speed 4.44 mB/s

All OK



Testing time: cpu 38.48 sec/real 49.68 sec = 77%. Speed 11.17 mB/s

All OK

____________________________

Creating archive: data.arc using oo2recm+srep:m3f:l512+4x4:t10:i0:lzma:64mb:normal:32

Compressed 1 file, 555,122,688 => 403,297,897 bytes. Ratio 72.65%          

Compression time: cpu 559.47 sec/real 295.72 sec = 189%. Speed 1.88 mB/s

All OK

   

Testing time: cpu 37.36 sec/real 58.93 sec = 63%. Speed 9.42 mB/s

All OK

Quote:

Originally Posted by dixen (Post 490476)

packcmd = xtool.exe precomp -mzlib+preflate -d3 -c128mb -t100p-1 - - <stdin> <stdout>
...
With -d3 - 61 mb
Without -d3 - 270 mb
...
Used XTool v0.3.9

Old XTool 0.1.2 x86 version capable the preflate compression schema? (This -d3 switch preflate or zlib command?) Required external EXE/DLL files?

For some reason xtool does not precompress /detect zlib streams in *.map files from halo2 folder and *.s3pak from halo1 folder (Halo: The Master Chief Collection).
Examples in attachments.
And xtool 0.12 detects them and inflates them just fine!
Tried all possible codec combos in xtool 0.3.9, -mzlib+reflate, -mzlib+preflate, -mzlib etc... no working. -mreflate works on other *.map files from halo3, halo4 perfectly...But not on halo2 (*.map files) and halo1 (*.s3pak files).
Since xtool 0.12 uses zlib+reflate xtool 2020 should detect this also...maybe there could be some *.ini plugin for 2020 to detect this streams?

Thanks,
regards.

Quote:

Originally Posted by ozolt (Post 491749)

I personally use pzlib3:m1 for zlib streams, it has worked well for me so far.

Code:

infile: 14.1GB

srep:m3f+pzlib3:m1+lolz

Outfile:1.80GB



Also, first tempfile was 14.1GB (srep)

Second tempfile was 2.11GB (pzlib3)

Final file was 1.80GB (lolz ultra)

I ALSO TRIED VERSION OF XTOOL THAT COMES WITH ULTRA ARC BUT IT DIDN'T ACHIEVE GOOD RESULTS.

@Razor12911, I had an idea for XTool.
I don't know if that would be possible, but since we can't pass the "+" character in a parameter on the FreeArc command line, I thought it might be possible to make XTool decode multiple method parameters separately, allowing you to send multiple commands in a bat file...

Currently the parameter for the XTool method is -m.
Currently it is possible to use this way:

Code:

Arc.ini

[External compressor:xtool]

header    = 0

default   = -c64mb -t100p

packcmd   = "PRE\XTool_2020\XTool.exe" precomp {options} --dbase - - <stdin> <stdout>



pack.bat

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:mzlib data.arc "pack\*"

Suggestion is to use multiple parameters (XTool concatenated with "+" sign the parametters -m1, -m2, -m3, etc if it exists, otherwise it would use -m current).
This change in XTool would allow you to use combinations (without parameters)

Code:

Arc.ini

[External compressor:xtool]

header    = 0

default   = -c64mb -t100p

packcmd   = "PRE\XTool_2020\XTool.exe" precomp {options} --dbase - - <stdin> <stdout>



pack.bat

arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:m1zlib:m2reflate data.arc "pack\*"



The result would be as if using mzlib+reflate

To make it possible to send parameters, "," could be used in the parameters -m1, -m2, etc. and XTool replaces ":" internally when concatenating the methods.

Borderlands 3 method if usage example if I applied my idea to XTool

Code:

pack.bat



arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool:m1zlib:m2ue4,m1,k0x115EE4F8C625C792F37A503308048E79726E512F0BF8D2AD7C4C87BC5947CBA7 data.arc "pack\*"

This is just an idea.
I don't know if it would be good for XTool or if for some reason it would hinder performance so think about this idea.

This would be very useful to use with DiskSpan_GUI as I cannot send combined methods currently. And using XTool.ini is complicated because DiskSpan_GUI is fully configurable in the INI file without internal setinistring processing with sections and fixed keys to insert these values in XTool.ini (You would have to read the DiskSpan_GUI configuration INI file to know where it would be inserted the value).