@Razor12911
Thanks for the documentation. Brought me a few steps further (I didn't even know that xtool has mermaid/leviathan support until I read your documentation lol).
But what I don't understand right now is what to do if there is no signature (or repeating pattern) before an oodle header or if the pattern is different before many headers.

Currently I'm dealing with mermaid (8C 0A) and there is no visible pattern before the header, just always different random bytes.

---

In a different test I was looking for kraken header (8C 06). There seems to be a repeating pattern, namely 6 bytes (00 00 00 00 01 00) + 1 or 2 random byte. The 9th byte is always X (58).

https://i.imgur.com/qEKZ9IK.png

Maybe I have to work with Conditions, but unfortunatelly you forgot to explain them somehow in the documentation :D

LZMA Codec for TTW2. It possible?)

Attachment 30469

:(

yes, read documentation and make plugin :rolleyes:

@Razor12911
Sorry, I already found it (I just forgot to edit my post) and I made some steps forward (on my sample I made +3% ratio compared to xtool without configutation, I will see if there are more) :)

Update available

Changes

- updated search support (speed improvements)
- updated command line parser
- added partial universal scanner for lzo1x streams
- added universal scanner for lz4f streams
- fixed issue with configuration files failing to execute without conditions

Notes

The previous update is still up, in case if there are issues with this one as I'm rusty af at the moment. (I haven't coded in months)
The lzo1x codec uses LZO1X-999 (level 1-9) and should only be used if you have no alternatives for precompression such as no plugins as this thing can be slow at times.

Razor12921
Welcome back, thank you for the update. Merry Christmas! :D

Thanks Razor! Please can you write a list of games that are compatible with that lz4f scanner? For example is it for new or old unity games?

the xtool has an xtool.ini with xcompress.exe and crilayla.exe where can i find those ?

I think they are coming soon.

Update available

Changes

- project made open source
- added external executable support
- added generate database feature
- fixed search support bug

Notes

The source code will be made available on GitHub
https://github.com/Razor12911/xtool

External executable support is still in development and not thoroughly tested and below shows how it is used within xtool.ini

possible constants: <stdin> <stdout> <filein> <fileout> <fileres> <filestore> <size>

Update available

Changes

- fixed issue of status not reporting when encoding
- added depth method support for search support
- fixed zlib encoding issues for different window bits (thanks KaktoR)
- fixed zlib memory leak issue (thanks KaktoR)
- updated all internal codecs to support information relayed by external codecs
- updated lz4f codec and removed temporarily removed support for universal scanning
- added option to change recompression level to be used by reflate
- updated external executable support
- generate database feature currently bugged, wait for next update
- search database structure changed, older database files will no longer work with newer releases

Notes

Older database files will not work with future updates, use the older version 0.3.21 for old database files as you wait for them to be updated
A temp file may be created when using database files which can be the size of the largest file in the data to be processed.

how come I can't open the xtool.exe?
 

I'm in win11.

im curious, if you can now select a reflate level what does it do as standard? maybe set to 6 as as default?

Xtool isn't used directly, look at test example or the Freearc example to see how it works.

The idea of reflate is by selecting the correct level you get the best result. You can perform trial and error on an input by trying out different levels and the best one is the one that gives the least output. Default is level 6

Update available

Changes

- removed debugging code from encryption and executable codec
- fixed issue with depth when using search codec
- fixed external executable support issues

Im trying to understand the commands for xtool_0.4.2

my arc.ini file is this

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mzlib+preflate -c32mb -t85p - - <stdin> <stdout>

[External compressor:lolz]
header = 0
packcmd = lolz\lolz_x64.exe -d256 -dt -dtb1 -mtt1 -mt14 -fba1024 -tt5 -mc128 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:srep]
header = 0
packcmd = srep\srep.exe -m3f -l512 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

and the pack.bat file is this
del /q data.bin
arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool+srep+lolz data.bin "pack\*"
pause

it creates a freearc1.tmp file only and not a .bin file
what am i doing wrong with this.

Thanks

try removing all plugins (xtl and ini) files near xtool, they may be causing it to crash and try again.

ERROR: write error (disk full?) in compression algorithm xtool

arc.ini
[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mzlib+kraken:l4 -c256mb -lm - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

[External compressor:srep]
header = 0
packcmd = srep64 -mem512m -l512 -m5f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -d128 -mc1023 -dtb1 -tt4 -mtt1 -mt8 -mtb128 -fba1024 -oh14 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lolz_x86.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

cmd:
arc.exe a -ep1 -r -ed -s; -i2 -w.\temp -mxtool+srep+lolz Packs\data.bin "data\*"

With xtool_0.3.9 there is no such problem.

What could be the problem?

Thank you in advance.

I did try and remove all .xtl and .ini files and same thing.. just a freearc1.tmp was created only

ScOOt3r

zlib+kraken? :confused:

Is there any ui-based interface that I can use to input the commands?

i just used the same files located in xtool 0.4.2
and here are my pics

Attachment 31263
It compressed just fine with no errors

Attachment 31264
here are the files for xtool 0.4.2 as you can see it created a freearc1.tmp file

Attachment 31265
here are the files that i was test packing

my arc.ini is
[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp -mzlib+preflate -c32mb -t85p - - <stdin> <stdout>

[External compressor:lolz]
header = 0
packcmd = lolz\lolz_x64.exe -d256 -dt -dtb1 -mtt1 -mt14 -fba1024 -tt5 -mc128 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:srep]
header = 0
packcmd = srep\srep.exe -m3f -l512 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

my pack.bat file is
arc.exe a -ep1 -r -ed -s; -w.\temp -mxtool+srep+lolz data.bin "pack\*"

https://fileforums.com/showthread.php?t=104507

I doubt that's the issue, @ScOOt3r only uses zlib related codecs however he has an issue of his own (might be related)

@seryogakms, @ScOOt3r

I'll take a look at it but it will be challenge because I am not experiencing any of the issues you're reporting.

When using Knight Compressor, it uses too much DLL files that made it crash. But, I deleted some to make it work. Multiple files work but not Unity.

seryogakms
Apologies for criticising your zlib+kraken method, I have tested out a new game which contains both. Sorry. Hope you can forgive.

@seryogakms, @ScOOt3r
can you try this configuration, if xtool throws any errors please post the error message here

ok after testing it i now get this error

if i do a clean install of xtool 0.4.1 with no library files added i get this

it creates the data.arc with this xtool setting, but it wont decompress with out errors.


[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp { -moption} -c32mb -t100p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = xtool.exe decode -t100p - - <stdin> <stdout>

can you share this input along with your system specs?

My System Specs are as follows:
AMD Ryzen 9 5950X
16 Cores
32 Logical Processors
64 GB of Ram
NVIDIA GeForce RTX3090 GPU

i had the same Disk Full issue, remove libzstd.dll and it will work.

It's all right!

ScOOt3r,
this is ISDone right? how about the unpack.bat? you get the same error?

well i got it working compressing and decompression as someone posted above to remove libzstd.dll.. i did that and it works just fine now.. weird that it was that file
not sure how important libzstd.dll is...

ScOOt3r

File Patch.bin from "Horizon zero dawn" (last version).
5 434 479 154 bytes → 360 912 358 bytes (xtool_0.3.9 ONLY). Compression time — 36 minutes. Unpacking time — 18 minutes.

Intel core i5-3550, 20 GB RAM.

No other version of xtool gives such results under any settings.

xtool_0.4.2 with the same (and other) settings:
5 434 479 154 bytes → 2 738 426 574 bytes. Compression time — 3 hours and 56 minutes. Unpacking time — 18 minutes.

oo2reck+srep+lolz - 340 mb
Decompression time - 4 min:cool:

Sample?

https://imageup.ru/img160/thumb/13887671.jpg

arc.exe a -ep1 -r -ed -s; -i2 -w.\temp -mxt22+srep+lolz Packs\data.bin "DATAS\*"

[External compressor:xt22_zstd]
header = 0
packcmd = xtool\zlib\xt22.exe precomp -mzlib+zstd:l19,l22 -c32mb -t100p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = xt22.exe decode -t100p - - <stdin> <stdout>

[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -d128 -mc1023 -dtb1 -tt4 -mtt1 -mt8 -mtb128 -fba1024 -oh14 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lolz_x86.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:srep]
header = 0
packcmd = srep64 -mem512m -l512 -m5f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

В очередной раз спасибо за подсказку, но у меня комп «немного» слабее твоего. ):

shhh. english only in post...
Razor12911
Hi)
What about *.bdt from Elden Ring? It encrypted oodle streams?