tested on just cause2 arc files...
default setting nothing change "ProcProfile64.exe xtool.exe precomp -mzlib -c16mb -t100p-1 %1 %1.out"
system ryzen 3900x with 32gb
*is there arc.ini setting ?

Rayman Orgins
bundle_pc.pak (1.9 gb)

PS. tested on my 2nd pc (fx-4100, 2 cores, 4 threads).

here's preflate test, test on all zlib compressed games + dishonored and doom

tested on Dishonored2 with c16m and 512m and set -t100p-1...
work fine on ryzen 3900x and 32gb use all core and ram...

42.1gb to 57.2gb with c16mb
42.1gb to 59.8gb with c512mb

*used on all game file...

tested unpacking with inno
i get ERROR: archive data corrupted...

I must have messed up stdio mode during decoding but here is the fixed version.

now dec work super fast but i noticed it cpu usage around 50% to 70% of threads unlike compress use 90% to 100% when set to

unpackcmd = xtool.exe decode -t100p-1 - - <stdin> <stdout>

disk write using ssd nvme mp510 write after burst 400 to 500 mb/s...
nvme bottleneck ?
need ps5 ssd to get the max :D

you noticed how much memory xtool uses when compressing compared to when decompressing? that's why. xtool uses less memory when decoding and because of this it can't use up the entire cpu because there are times in between where there is nothing to process from memory. I haven't implemented faster code but in future I will.

I talked to you about preflate quite some time ago :D

glad to see you have made something out of it, will be returning to testing as soon as i am back home!!


have produced several videos on youtube on advanced compression past weeks.

talking to me about it isn't the same as implementing it ;)

@everyone

here's the xtool with reflate support.

I'll once again explain what's the difference. There are 3 deflate precompressors in xtool: zlib, reflate and preflate.

The old xtool/ztool/pzlib all had zlib+reflate but they had so many errors so I added preflate as an alternative if you have issues when you use reflate.

There are other things to this of course. I added all 3 because sometimes one has an advantage such as speed or better size output. Which is up to you to pick.

reflate cannot be used at the same time as preflate or the other way round.

but zlib can be used with reflate or preflate (pick one) like this -mzlib+reflate or -mzlib+preflate

here are my results on games that use the "normal" deflate configuration

using -mzlib:
using -mreflate:
using -mpreflate

Razor,
it would be nice if you could update the "Game File Scanner" with the new xtool. ;)

Dishonored. Death of the outsider (yes, again)

game1.resources
game1_001.resources
game1_patch.resources

-mpreflate

Unpack

I actually have a better idea :rolleyes:

try with reflate

sounds great :D

-mreflate

Test on DOOM - later..

DOOM 2016

snap_gameresources.resources
gameresources.resources

-mxtool 2019 (R3)

-mreflate

Decompress

Unpack

-mpreflate