XTool 2020 (Main Project)

[Sebazz]

Originally Posted by Razor12911

try the same input without using Freearc and see if the error persists and if it does, send over the sample and I'll see what is causing the problem.

The only setting that works for me. I could solve it

[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 $$arcdatafile$$.tmp <stdout>

This Setting dont work for me, stopped the conversion.

[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 - - <stdin> <stdout>

This setting works but freezes the compresion.

[External compressor:xzlib]
header = 0
packcmd = xtool precomp -mzlib -c128mb -t100p-1 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Mmm rare bug

[Razor12911]

1.3 billion streams? Alrighty then, looks like I have to start working on this bug.

[Sebazz]

[External compressor:xzstd]
header    = 0
packcmd   = xtool precomp -mzstd -t100p-1 - - <stdin> <stdout>
unpackcmd = xtool decode -t100p-1 - - <stdin> <stdout>

With this setting, the zstd compression is much slower compared with zlib .
In my tests > zstd use aprox 150 mb memory / zlib use aprox 450 mb memory
With the new libzstd, what is an optimal setting for use ?

[Razor12911]

naturally zstd compresses slower than zlib especially when xtool tries high levels. optimal use is specifying what level to use furthermore, xdelta steps in for imperfect restoration.
-mzstd:l19 as an example.

[ozolt]

Sorry I must ask...is main project renamed to 2010 so it's now XTool 2010, or is it 2020? ...because if this is not a mistake, this version numbering is very, very wrong. I'm guessing 2010 stands for year 2020 and 10th month but OMG...

[Razor12911]

It's the same way Microsoft releases versions for its Windows 10. And yes, year 2020 and 10th month. 2010

[Giriplayslegend899]

hey,razor uh i dont know coding and stuff but what does this do ? create repacks or compress game files and how can i use it?

[Giriplayslegend899]

and also what is source code? ( sorry if asking in wrong place) when i see some projects they say an update is out and give some kind of source code. what is that?

[Sebazz]

Originally Posted by Giriplayslegend899

hey,razor uh i dont know coding and stuff but what does this do ? create repacks or compress game files and how can i use it?

This tools are for compress game files, in the case of XTool has functionally of inflate compatible streams of game engine, then srep compresses it and finally lzma or lolz or lzma2 compresses it even more.

Here are best methods for compress games ... usually i use srep+lzma2 for fast compression, but in some cases i add xtool depend of game.

https://fileforums.com/showthread.php?t=101639

You can get all other tools here.

https://www.fileforums.com/showthread.php?p=478349

[ozolt]

Razor12911, can you please add , (or some other sign) as alternate option to specify combining codecs? I'm actually trying to use arc.exe by specifying codecs from command line rather than modifying arc.ini, so I'm trying to use packcmd in arc.ini like this:
...
[External compressor:xtool]
header = 0
packcmd = xtool precomp -m{option} -c32mb -t100p-1 - - <stdin> <stdout>
..so I can use, for example, arc.exe a -mxtool:zlib+reflate ...
But since you choose to use + sign to combine codecs this will not work....or if somebody have another idea how to specify different codecs that requires + sign from command line and not by editing arc.ini everytime, I would much appreciate advice...

Thanks in advance,
regards

[Giriplayslegend899]

Originally Posted by Sebazz

This tools are for compress game files, in the case of XTool has functionally of inflate compatible streams of game engine, then srep compresses it and finally lzma or lolz or lzma2 compresses it even more.

Here are best methods for compress games ... usually i use srep+lzma2 for fast compression, but in some cases i add xtool depend of game.

https://fileforums.com/showthread.php?t=101639

You can get all other tools here.

https://www.fileforums.com/showthread.php?p=478349

A heavy Thanks But i already have razor 's quick archive packer which is okay for me but how can i use custom installer ultimate ( the second link u gave ) . what can i do with it? and also whenever razor or y_thelastknight release an update for a project how can i update it? and what is source code?

sorry if i am asking too many questions.

[Masquerade]

Just another oodle test:

Sekiro v1.05 Data4.bdt:

oo2reck (oo2core_4_win64.dll):

Compressed 1 file, 541,402,628 => 1,065,375,629 bytes. Ratio 196.78%
Compression time: cpu 0.63 sec/real 52.87 sec = 1%. Speed 10.24 mB/s
All OK

Xtool Kraken (oo2core_4_win64.dll):

Compressed 1 file, 541,402,628 => 1,045,442,710 bytes. Ratio 193.10%
Compression time: cpu 0.55 sec/real 38.73 sec = 1%. Speed 13.98 mB/s
All OK

[Razor12911]

Originally Posted by ozolt

Razor12911, can you please add , (or some other sign) as alternate option to specify combining codecs? I'm actually trying to use arc.exe by specifying codecs from command line rather than modifying arc.ini, so I'm trying to use packcmd in arc.ini like this:
...
[External compressor:xtool]
header = 0
packcmd = xtool precomp -m{option} -c32mb -t100p-1 - - <stdin> <stdout>
..so I can use, for example, arc.exe a -mxtool:zlib+reflate ...
But since you choose to use + sign to combine codecs this will not work....or if somebody have another idea how to specify different codecs that requires + sign from command line and not by editing arc.ini everytime, I would much appreciate advice...

Thanks in advance,
regards

I'll add "+" as a resource string and if you want to change it as a user, you'd have to do it yourself. in the next update, that is

Update available

Changes

- added database search
- updated zlib scanner
- fixed reflate bug
- fixed 2GB memory limit

Notes
Database search is a feature similar to configuration support, a demonstration on Far Cry 5 and Watch Dogs Legion will be posted to show how it works.

Updated zlib scanner to eliminate some pesky false positives that cause reflate bugs, verification of reflate removed and should work faster now.

2010_R2 update broke reflate, not sure if you noticed but it's now fixed.

Report made by Kaktor on some file that gave outrageous ratios.
https://fileforums.com/showpost.php?...&postcount=559
Turns out the issue was caused by this
https://community.idera.com/develope...ream-2gb-limit

So I created a custom TMemoryStream that can handle more than 2GB data in x64

Compressed 1 file, 26,336,816 => 3,013,659,460 bytes. Ratio 11442.76%
Compression time: cpu 0.19 sec/real 11.60 sec = 2%. Speed 2.27 mB/s

Tested 1 file, 3,013,659,460 => 26,336,816 bytes. Ratio 11442.76%
Testing time: cpu 0.09 sec/real 3.05 sec = 3%. Speed 8.62 mB/s

[Sebazz]

Originally Posted by Masquerade

Just another oodle test:

Sekiro v1.05 Data4.bdt:

oo2reck (oo2core_4_win64.dll):

Compressed 1 file, 541,402,628 => 1,065,375,629 bytes. Ratio 196.78%
Compression time: cpu 0.63 sec/real 52.87 sec = 1%. Speed 10.24 mB/s
All OK

Xtool Kraken (oo2core_4_win64.dll):

Compressed 1 file, 541,402,628 => 1,045,442,710 bytes. Ratio 193.10%
Compression time: cpu 0.55 sec/real 38.73 sec = 1%. Speed 13.98 mB/s
All OK

Whats parameters you use in your arc.ini settings ? Thanks

[Masquerade]

Originally Posted by Sebazz

Whats parameters you use in your arc.ini settings ? Thanks

[External compressor: xkraken]
header = 0
packcmd = xtool precomp -mkraken -c128mb -t16 - - <stdin> <stdout>