XTool - Successor of ZTool

[Razor12911]

Here's the first release

XTool version 0.1

Created by Razor12911

Commands:
e - encode
d - decode

Operations and codecs available:
precomp - data precompression
zlib : loaded
crilayla : loaded

Options:
precomp - data precompression
c#: chunk size (default 16mb)
t#: number of threads, use p for percentage

Usage : XTool [command]:[operation]:[options]:[codecs] [input] [output]
Example : XTool e:precomp:c32mb,t4:zlib,lz4 Textures.tfc Textures.tfc.xtl

Acknowledgement:
zlib:
- Jean-loup Gailly
- Mark Adler
reflate:
- Eugene Shelwien
bdiff:
- Peter Johnson
crilayla:
- KenTse
- RamiroCruzo

[KaktoR]

Wooh nice.

Thank you!

[Mini]

you are the best.

[Simorq]

Thanks Razor12911
__________________________________
x86: Precompressor is OK - Decompress is OK
x64: Precompressor is DiskFull:rolleyes: - Decompress is OK:D

[Razor12911]

x64: Precompressor is DiskFull:rolleyes:

In my defence, even I haven't used x64 version of this thing.

[Jiva newstone]

Thanks Razor12911 for this aio tool, why don't you made this tool also as compresstor like precomp's lzma... like lzna in it
but this tool is very helpfull for repacker

[CANNIBAL]

Thanks Razor12911 U R DA Best......

[masen485]

XTool - Successor of ZTool
XTool version 0.1
Information for detailed and comfortable use
ultra arc.ini settings info if available
if you can give me a few examples
precomp - data precompression arc.ini settings info if available
zlib : loaded arc.ini settings info if available
crilayla : loaded arc.ini settings info if available

thanks for everything Razor12911

[doofoo24]

seems not to work with zlibwapi only like ztool ?
* and srep and lolz does not show data size ???

[78372]

Great work Razor12911 as always
data1 = ZTool
data2 = XTool

ZTool:
FreeArc 0.67 (March 15 2014) creating archive: data1.arc
Compressing 1 file, 197,759,488 bytes. Processed 0% 21%
41% 73%100%
Compressed 1 file, 197,759,488 => 949,878,926 bytes. Ratio 480.32%
Compression time: cpu 0.75 sec/real 115.69 sec = 1%. Speed 1.71
mB/s
All OK

XTool:
FreeArc 0.67 (March 15 2014) creating archive: data2.arc
Compressing 1 file, 197,759,488 bytes. Processed 0% 54%
92%100%
Compressed 1 file, 197,759,488 => 943,633,165 bytes. Ratio 477.16%
Compression time: cpu 0.70 sec/real 97.73 sec = 1%. Speed 2.02 mB/
s
All OK

XTool inflated less, but compressed much
ZTool: 188mb>127MB
XTool: 188mb>121MB


Thanks again for all your effort.

[Simorq]

Creating Archive: DarkSouls3.Bin.001 using xprecomp+srep:m3f+lzma2:d256m:fb273:mc1000000:lc4: lp0+diskspan:4350mb:4430mb
Compressed 254 files, 26,882,370,544 => 4,561,305,627 bytes. Ratio 16.97%
Compression time: cpu 139.39 sec/real 19780.55 sec = 1%. Speed 1.36 mB/s
All OK

Testing archive: DarkSouls3.Bin.001
Tested 254 files, 4,561,305,627 => 26,882,370,544 bytes. Ratio 16.9%
Testing time: cpu 83.33 secs, real 2379.55 secs. Speed 11,297 kB/s
All OK

[KaktoR]

Unfortunatelly xtool doesn't work with UA.

Will go for DS then :)

[shazzla]

@Razor12911 : is the crilayla x64 dll missing ?!

[Webster17]

Metal Gear Rising Revengeance (Crilayla)
Data size : 2,745,508,712
Compressed Size : 850,414,132
Compression Ratio : 30.9 %

Cons:
Decompression takes a lot of time.
Installer freezes if aborted, just like pzlib3. You have to close the xtool process from task manager.

Wonderful tool, Can't thank you enough Razor...

[Mini]

Metal Gear Rising Revengeance (Crilayla)
Data size : 2,745,508,712

758 282 960 (723 mb) - xtool+srep+lolz

[ZakirAhmad]

Tried it on a file from mass effect 3, precomp042 precompresses better than xtool on it.

[Simorq]

Cons:
Installer freezes if aborted, just like pzlib3. You have to close the xtool process from task manager.


Use TaskKill
Exec(ExpandConstant('{sys}\taskkill.exe'), ' /F /IM XTool.exe', '', SW_HIDE, ewNoWait, ResultCode);

[Sergey3695]

When packed file more 4 gb
http://i104.fastpic.ru/big/2018/0416/99/e9ddfaabaceb55f3028381ca106f6399.jpg

[Razor12911]

seems not to work with zlibwapi only like ztool ?
* and srep and lolz does not show data size ???

works with zlibwapi.dll, zlib1.dll or zlib.dll, whichever is found

When packed file more 4 gb
http://i104.fastpic.ru/big/2018/0416/99/e9ddfaabaceb55f3028381ca106f6399.jpg

Probably some bug, will look at it, found more bugs while working on the Naruto series

Tried it on a file from mass effect 3, precomp042 precompresses better than xtool on it.

Great, this is only news. Upload file if you want something done about it.

[ZakirAhmad]

ofcourse i will send u the file.

[darkwolves]

i repacked sonic forces to 7.94 gb by extracting the cpk... files and packed the files back up after installing.... and it takes alot of time but now i will use this and see how well i can compress it .

[-NORO-]

x64 xtool shows DiskFull
x86 is working

[Gupta]

X32:



FreeArc 0.67 (March 15 2014) Creating archive: Data\xtooltest.arc using xprecomp
Memory for compression 0b, decompression 0b, cache 32mb
Compressed 2 files, 1,164,384,256 => 2,249,898,011 bytes. Ratio 193.23%
Compression time: cpu 0.66 sec/real 42.90 sec = 2%. Speed 27.14 mB/s
All OK

FreeArc 0.67 (March 15 2014) Extracting archive: Data\xtooltest.arc
Extracted 2 files, 2,249,898,011 => 1,164,384,256 bytes. Ratio 193.23%
Extraction time: cpu 0.30 sec/real 37.40 sec = 1%. Speed 31.14 mB/s
All OK


X64:



FreeArc 0.67 (March 15 2014) Creating archive: Data\xtooltest.arc using xprecomp
Memory for compression 0b, decompression 0b, cache 32mb
ERROR: write error (disk full?) in compression algorithm xprecomp*

FreeArc 0.67 (March 15 2014) Extracting archive: Data\xtooltest.arc
Extracted 2 files, 2,249,898,011 => 1,164,384,256 bytes. Ratio 193.23%
Extraction time: cpu 0.23 sec/real 36.51 sec = 1%. Speed 31.89 mB/s
All OK



*no crashes or anything else

[78372]

Probably this disk full error is by fa(standard error), I faced it many times during many projects and when I used stdin for encoding, this was a common error, though I am not sure it is the same error for xtool or not. But those who are facing these errors, try using $$arcdatafile$$.tmp instead of stdin(Not tested here)

[Gupta]

why do you think i haven't tried it?

[darkwolves]

trying xtool with uharcmt it seems to be working pretty well

[Razor12911]

I'll take a look at x64 issue

[elit]

Greetings Razor, I only now discovered this. Its fantastic that you decided to remake ztool. Specifically CRI format is great to see for sure.

If you are interested in adding oodle in future, it is pretty much "8C 06" pattern to look for *always*, with cmd/uncmp sizes preceding it. Even in engines like unreal where offsets to these sizes are to get from initial game header, they are still located just before "8C 06"(xcom 2 wotch), e.g: cmp(long) - uncmp(long) - data(starting with and including "8C 06").
Oodle is in fact rather predictable to detect and extract, I made bms script that was able to extract from xcom 2(over 20gb+ data) unreal files error-free without bothering to use their own format to locate those chunks.
To differentiate from fakes, first byte before "8C 06" must be "00" because chunks should never be bigger than 8mb and whole 4byte set before "8C 06" when translated to integer should not exceed 8mb. Thats all.

Well anyway, I hope for this to become as great tool one day as is ztool now. Thank you.

[Razor12911]

Greetings Razor, I only now discovered this. Its fantastic that you decided to remake ztool. Specifically CRI format is great to see for sure.

If you are interested in adding oodle in future, it is pretty much "8C 06" pattern to look for *always*, with cmd/uncmp sizes preceding it. Even in engines like unreal where offsets to these sizes are to get from initial game header, they are still located just before "8C 06"(xcom 2 wotch), e.g: cmp(long) - uncmp(long) - data(starting with and including "8C 06").
Oodle is in fact rather predictable to detect and extract, I made bms script that was able to extract from xcom 2(over 20gb+ data) unreal files error-free without bothering to use their own format to locate those chunks.
To differentiate from fakes, first byte before "8C 06" must be "00" because chunks should never be bigger than 8mb and whole 4byte set before "8C 06" when translated to integer should not exceed 8mb. Thats all.

Well anyway, I hope for this to become as great tool one day as is ztool now. Thank you.

http://fileforums.com/showpost.php?p=463788&postcount=64

[darkwolves]

sonic forces repacked from 16 gigs to 8.6 gigs using xtool with srep and uharcmt with it
will be testing other compressors with it as well

[danswano]

I;'m having a problem arc.exe crashing when the operation starts and i guess it's related to my settings.
let's say i want to compress a cpk file and load crilayla library how the command in arc.ini would look like?
Thanks.

[78372]

why do you think i haven't tried it?

Just in case :p

[darkwolves]

I;'m having a problem arc.exe crashing when the operation starts and i guess it's related to my settings.
let's say i want to compress a cpk file and load crilayla library how the command in arc.ini would look like?
Thanks.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c32mb,t3 - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t75p - - <stdin> <stdout>

thats the typical command razor gave for it
also don't use x64 at this time something is wrong with it
razor said he would look into it

[danswano]

When i used $$.tmp instead of stdio i got no disk full error.

[darkwolves]

When i used $$.tmp instead of stdio i got no disk full error.

it gives me a CRC error when i use that i wonder why every individual computer must be so complicated lol

[KaktoR]

XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same

[Simorq]

XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same

Need dll
hif2raw_dll.dll
raw2hif_dll.dll
zlibwapi.dll

[KaktoR]

Files are present

[KaktoR]

Test.zip (https://drive.google.com/file/d/1bHkms1DZ1t4HNB2sZg_qj9FYCdnv1cAz/view?usp=sharing)

[elit]

@KaktoR you have a typo in packcmd: c32mb,t3

[KaktoR]

That's the command razor gave us, and it works just fine (except for the above^^)

[darkwolves]

each time razor releases a new version i will use it to repack a larger cpk game
i did with sonic forces because it is 16 gigs so its not too terribly large
it is the guinea pig lol

[panker1992]

There you go :D

Decomp one will pop shortly

[darkwolves]

holy giant post panker lol

[KaktoR]

Just to let you know regarding my problem with xtool+diskspan.

It works actually, but i had to drag&drop the game folder 7 times actually (like spamming the folder into batch) before xtool starts working without windows problem reporting. It seems like a bug somewhere in batch, diskspan or even xtool, i don't know. Maybe my machine is the problem, but i had it only with xtool now.

Edit:
Have searched a bit, seems to be a problem with one of the vc redists, so i uninstalled them all, rebooted and reinstalled them one by one
Faulting application name: Arc.exe, Version: 0.0.0.0, time stamp: 0x5324af98
Faulting application name: msvcrt.dll, Version: 7.0.17133.1, time stamp: 0xc5dd3631
Exception code: 0xc0000005
Fault offset: 0x00088a2a
Faulting process ID: 0x18fc
Faulting application start time: 0x01d3d9bcfd524e85
Faulting application path: C:\Windows\System32\msvcrt.dll

The problem is only when i use diskspan with xtool. All other tools working just fine.

Edit 2:
Compatibility Mode for Win7 (xtool.exe) seems to fix this issue. Really strange.

Edit 3:
Ok no it's not fixed actually. After i arborted compression because of wrong lzma2, i fixed that and run again -> same problem as before.

Edit 4:
I've found the problem. If the pack data has folders + subfolders then xtool (or diskspan i dont know) stop working for some reason. But if i copy all files from all folders + subfolders into one single directory, then it works (it's the same size, but without any folders).

Edit 5:
My solution was now to just pick up some files and use your pack.bat from post #1, after it starts, wait some secs until xtool.exe starts working and then drag&drop game folder into diskspan bat and it works *facepalm* wtf

I think the problem here is xtool, because all other pre-/compressors working just fine with diskspan and whole game folders, but xtool doesn't. So?

[elit]

Crilayla unfortunately doesn't work at all for me, on several files I tried, like this small one for example:
21751
It create output file of 0 size and close immediately. I used x86 exe as dll is only for that version:
xtool.exe e:crilayla:c32mb,t3 pack_031_message.cpk1 test

[ShivShubh]

Crilayla unfortunately doesn't work at all for me, on several files I tried, like this small one for example:
21751
It create output file of 0 size and close immediately. I used x86 exe as dll is only for that version:
xtool.exe e:crilayla:c32mb,t3 pack_031_message.cpk1 test

Your command is incorrect, use like this :-
xtool e:precomp:c32m,t1:crilayla pack_031_message.cpk1 test

[Razor12911]

Update available

Changelog:
v0.2:
- fixed x64 issues caused by compiler bugs
- slightly improved zlib/deflate scanner
- added entropy filter to fix reflate bug
- fixed MT zlib decoding bug

Notes:
There may be a few more bugs that still remain with regards to the zlib codec but if all is fixed then you guys should thank (http://fileforums.com/member.php?u=218595)
I removed crilayla support on Naruto series, no tests conducted and I don't plan on downloading that game just to add a feature on a tool I don't use.

[Razor12911]

XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same
Works here

[Sergey3695]

I removed crilayla support on Naruto series, no tests conducted and I don't plan on downloading that game just to add a feature on a tool I don't use.
https://yadi.sk/d/WNKW73Ht3UpyVN
data.cpk (393 mb)
NARUTO SHIPPUDEN Ultimate Ninja STORM 2

[LuzhinE]

Thank you

[darkwolves]

http://i63.tinypic.com/2w3rqqq.jpg

this is from the second release the first release inflated this file to over 4 gigs
the game is sonic lost world
this really did not do much at all

[LuzhinE]

does not contain zlib that .cpk
.cpk crilayla or am I wrong?

[Panky]

Xtool v0.2 doesn't recompress streams from This War of Mine, but v0.1 does/

animations.dat - 20,6 MB (21 696 742 bytes)
v0.1

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 25,479,373 bytes. Ratio 117.4%
Compression time: cpu 0.05 secs, real 14.55 secs. Speed 1,492 kB/s
All OK
v0.2

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 21,696,758 bytes. Ratio 100.0%
Compression time: cpu 0.02 secs, real 2.13 secs. Speed 10,208 kB/s
All OK

[ShivShubh]

^Did you test the decompression as well ?

[Panky]

^Did you test the decompression as well ?
Yep, decompression is ok with both versions.

[Illume]

Thanks Razor for keep doing tools that you don't use :)
can you add parameters to split threads like in ztool\pzlib?
st#: number of scanning threads
ct#: number of precompressing threads
normally using one thread for precompressing and multi for scanning gives less chance of an CRC errors

[darkwolves]

does not contain zlib that .cpk
.cpk crilayla or am I wrong?

it is a .cpk file that inflated on the first release
going to try on something with just zlib later
when i get time

[darkwolves]

Thanks Razor for keep doing tools that you don't use :)
can you add parameters to split threads like in ztool\pzlib?
st#: number of scanning threads
ct#: number of precompressing threads
normally using one thread for precompressing and multi for scanning gives less chance of an CRC errors

the t in the arc command stands for threads i believe it is t4 by default

[darkwolves]

xtool on batman arkham knight season of infamy dlc folder

xtool
Compressed 248 files, 3,388,376,675 => 5,043,877,778 bytes. Ratio 148.8%
Compression time: cpu 5.19 secs, real 167.14 secs. Speed 20,273 kB/s
All OK


ztool
Compressed 248 files, 3,388,376,675 => 5,043,877,778 bytes. Ratio 148.8%
Compression time: cpu 5.80 secs, real 262.81 secs. Speed 12,8 mB/s
All OK

identical end results but xtool precompressed these zlib files very noticably faster than ztool

[Razor12911]

Xtool v0.2 doesn't recompress streams from This War of Mine, but v0.1 does/

animations.dat - 20,6 MB (21 696 742 bytes)
v0.1

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 25,479,373 bytes. Ratio 117.4%
Compression time: cpu 0.05 secs, real 14.55 secs. Speed 1,492 kB/s
All OK
v0.2

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 21,696,758 bytes. Ratio 100.0%
Compression time: cpu 0.02 secs, real 2.13 secs. Speed 10,208 kB/s
All OK

would help if you upload the sample :confused:

[Razor12911]

sonic generations also not precompiling like it did in the first release
below is an attachment with a file sample

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t2:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>

with first release

Compressed 1 file, 69,265,624 => 126,761,898 bytes. Ratio 183.01%

with second release
Compressed 1 file, 69,265,624 => 127,517,586 bytes. Ratio 184.10%

after strong compression
using 0.1: 121 MB (127,517,813 bytes) >> 22.0 MB (23,120,406 bytes)
using 0.2: 120 MB (126,762,125 bytes) >> 21.4 MB (22,529,107 bytes)

[darkwolves]

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t2:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>



after strong compression
using 0.1: 121 MB (127,517,813 bytes) >> 22.0 MB (23,120,406 bytes)
using 0.2: 120 MB (126,762,125 bytes) >> 21.4 MB (22,529,107 bytes)

interesting it isn't inflating at all on my side
i will do some troubleshooting

[darkwolves]

alright seems to be in the arc.ini

in release 2 razor released the following command in the FA example

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t4:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>
with it set this way it will ignore the crilayla streams


the solution is to replace zlib with crilayla in the packcmd and xtool begins to read the cri streams again i have tried adding it with zlib still there but it does not work.

example
[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t4:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>


sonic lost world after replacing zlib with crilayla in the arc ini in release 2
Compressing 1 file, 2,463,058,976 bytes
Compressing sonic2013_0.cpk
Compressed 1 file, 2,463,058,976 => 5,067,368,904 bytes. Ratio 205.7%
Compression time: cpu 5.81 secs, real 1115.69 secs. Speed 2,208 kB/s
i came to this conclusion after sending a file to razor and it worked for him and his command
did not have zlib in it only crilayla

[Panky]

would help if you upload the sample :confused:
Here you are.

[darkwolves]

Here you are.

try these arc settings

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t2:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>


i've found manually changing crilayla to zlib or zlib to crilayla
in the arc ini works depandant on what you are trying to precompress

[KaktoR]

Works here

Yep, with update 2 it works now. Thank you!

[Panky]

try these arc settings



i've found manually changing crilayla to zlib or zlib to crilayla
in the arc ini works depandant on what you are trying to precompress
Yeah, my mistake, thanks.

[darkwolves]

Yeah, my mistake, thanks.

i did the exact same thing lol
i gave the sample to razor after he posted the results
i felt stupid..lol prompting me to make the post above
for those who may make the same mistake..

[Simorq]

"Resident Evil 6" "Dir DX9 222 MB"

XTool 0.1
Creating archive: xprecomp.Bin using xprecomp:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:ul tra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 16,971,873 bytes. Ratio 7.29%
Compression time: cpu 0.61 sec/real 129.38 sec = 0%. Speed 1.80 mB/s
All OK

__________________________________________________ ______
XTool 0.2 32Bit
Creating archive: xprecomp2.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 43,084,237 bytes. Ratio 18.50%
Compression time: cpu 0.66 sec/real 122.06 sec = 1%. Speed 1.91 mB/s
All OK

__________________________________________________ ______
XTool 0.2 64Bit
Creating archive: xprecomp2_64.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 16,953,160 bytes. Ratio 7.28%
Compression time: cpu 0.59 sec/real 125.23 sec = 0%. Speed 1.86 mB/s
All OK

__________________________________________________ ______
Ztool
Creating archive: Ztool.Bin using pzlib:max:c32m+srep:m3f:l256:a0+lzma:ultra:d768m:m fbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 17,636,136 bytes. Ratio 7.57%
Compression time: cpu 0.67 sec/real 133.21 sec = 1%. Speed 1.75 mB/s
All OK

__________________________________________________ ______
Precomp043
Creating archive: Precomp043.Bin using precomp+srep:m3f:l256:a0+lzma:ultra:d768m:mfbt4:lc 8:fb273
Compressed 474 files, 232,916,010 => 17,309,956 bytes. Ratio 7.43%
Compression time: cpu 0.83 sec/real 243.89 sec = 0%. Speed 0.95 mB/s
All OK



http://www.mediafire.com/file/rrrwmw7ibcazx0u/RE6_.DX9.exe C FreeArc Sfx

[Razor12911]

"Resident Evil 6" "Dir DX9 222 MB"
XTool 0.2 32Bit
Creating archive: xprecomp2.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 43,084,237 bytes. Ratio 18.50%
Compression time: cpu 0.66 sec/real 122.06 sec = 1%. Speed 1.91 mB/s
All OK

Out of memory exceptions probably occurred.

Here you are.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t2:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>

with first release

Compressed 1 file, 21,696,742 => 25,479,385 bytes. Ratio 117.43%
Compression time: cpu 0.11 sec/real 34.21 sec = 0%. Speed 0.63 mB/s

with second release

Compressed 1 file, 21,696,742 => 25,477,946 bytes. Ratio 117.43%
Compression time: cpu 0.06 sec/real 32.07 sec = 0%. Speed 0.68 mB/s

after strong compression
using 0.1: 24.2 MB (25,479,618 bytes) >> 15.7 MB (16,488,938 bytes)
using 0.2: 24.2 MB (25,478,179 bytes) >> 15.7 MB (16,485,534 bytes)

:confused:

[Simorq]

XTool 0.2 32Bit has a problem.

[Razor12911]

XTool 0.2 32Bit has a problem.

use 16mb chunk size and try again

[Simorq]

use 16mb chunk size and try again

Good

Creating archive: xprecomp2.Bin using xprecomp2:c16mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Memory for compression 0b, decompression 0b, cache 1kb
Compressed 474 files, 232,916,010 => 17,091,192 bytes. Ratio 7.34%
Compression time: cpu 0.66 sec/real 130.44 sec = 1%. Speed 1.79 mB/s
All OK

But the extraction speed is less
Even when using XTool x64 to decompress.

[darkwolves]

XTool 0.2 32Bit has a problem.

the only thing i see wrong is the fact i have to manually type in zlib or crilayla
in the arc.ini packcmd it doesn't work if both are present only the one you are trying to precompress

[darkwolves]

@Razor12911

i ran into his same problem its just an arc.ini issue seems you can only have zlib or crilayla typed in one at a time wich explained why this worked on the FA example command
its with zlib being in the command it will target zlib with crilayla in the command it will target cpk but if you have both it will ignore both

ztool zlib vs xtool zlib with just zlib in the command
http://fileforums.com/showpost.php?p=470549&postcount=60

[Simorq]

the only thing i see wrong is the fact i have to manually type in zlib or crilayla
in the arc.ini packcmd it doesn't work if both are present only the one you are trying to precompress

Arc.ini
[Compression Methods]
Zlib = xprecomp:c32mb,t100p:zlib
Cri = xprecomp:c32mb,t1:crilayla

[External compressor:xprecomp]
header = 0
default = :c32mb,t100p:zlib
packcmd = XTool e:precomp{:option} - - <stdin> <stdout>
unpackcmd = XTool d:precomp:t100p - - <stdin> <stdout>

Bat
:-ioff --shutdown
Arc create --cache=1k -ma9 -dses -ep1 -ed -i2 -r -s; -w.\Temp -dp"Pack" -mZlib Test.Bin
RD /S /Q TEMP
pause

[darkwolves]

[External compressor:xprecomp]
header = 0
default = :c32mb,t100p:zlib
packcmd = XTool e:precomp{:option} - - <stdin> <stdout>
unpackcmd = XTool d:precomp:t100p - - <stdin> <stdout>


Arc.ini
[Compression Methods]
Zlib = xprecomp:c32mb,t100p:zlib
Cri = xprecomp:c32mb,t1:crilayla

Bat
:-ioff --shutdown
Arc create --cache=1k -ma9 -dses -ep1 -ed -i2 -r -s; -w.\Temp -dp"Pack" -mZlib Test.Bin
RD /S /Q TEMP
pause

crashed with those settings

[Simorq]

crashed with those settings

Works for me!

[darkwolves]

Works for me!

its most likley a corrupted runtime on my end... sometimes i have to do fresh installs or repairs

[Simorq]

its most likley a corrupted runtime on my end... sometimes i have to do fresh installs or repairs

and use --cache=0

[darkwolves]

this is what fixed it for me

for zlib
[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t4:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>


for crilayla
[External compressor:cpk]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t4:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>

[Razor12911]

Guys, the usage information is simple and straightforward.
If you have issues with codecs, just put all of them at once
zlib,crilayla

[doofoo24]

test on witcher 3 improve 200mb over ztool/pzlib,
final size with xtool 24.1gb with ztool/pzlib 24.3gb...
install time on I7 8700K with SSD NVME 960 evo around 6 min...
the setting precomp:t100p:zlib+srep:m3f:a2+lolz:d64

[Razor12911]

test on witcher 3 improve 200mhz over ztool/pzlib,
final size with xtool 24.1gb with ztool/pzlib 24.3gb...
install time on I7 8700K with SSD NVME 960 evo around 6 min...
the setting precomp:t100p:zlib+srep:m3f:a2+lolz:d64

200mhz :)

[-NORO-]

200 mhz lol

[doofoo24]

i wish mhz :D

[darkwolves]

Guys, the usage information is simple and straightforward.
If you have issues with codecs, just put all of them at once
zlib,crilayla

will try it in that context when i get time but for now work beckons..
i was putting them in zlib:crilayla but if a simple , will solve all the problem then
i am all for it

[LuzhinE]

Help used xtool v2
https://i.imgur.com/J4rILsN.png

used xtool v1
https://i.imgur.com/LyE196L.png

both with the same .arc

[Razor12911]

0.2 is incompatible with 0.1 data, so if the data was precompressed with 0.1, you're gonna have to recompress the whole thing again.

[darkwolves]

0.2 is incompatible with 0.1 data, so if the data was precompressed with 0.1, you're gonna have to recompress the whole thing again.

darn that means i'll have to do sonic forces over again...
oh well having two computers is a good thing lol

[LuzhinE]

0.2 is incompatible with 0.1 data, so if the data was precompressed with 0.1, you're gonna have to recompress the whole thing again.

What I understood, is that you try to say that I compressed with v1 and I'm trying to decompress with v2.

I did 2 comprehensions, as with the 1 and the 2, the only thing I use the same .arc os the parameters, the problem is when decompressing.

[darkwolves]

i look forward to improvments in speed with crilayla
the zlib feature works very well and it is faster than ztool
zlib from my testing..

[Razor12911]

i look forward to improvments in speed with crilayla
the zlib feature works very well and it is faster than ztool
zlib from my testing..

crilayla speed isn't relevant to xtool itself but the dll which is used. Pretty much nothing I can do on my side.

[darkwolves]

crilayla speed isn't relevant to xtool itself but the dll which is used. Pretty much nothing I can do on my side.

thats too bad well at least... its still faster than extracting the file and packing it back up and even when you do pack it back up there is no guarantee it will work...i hated searching forum after forum for a packing tool that would work

[ZakirAhmad]

@Razor. Thanks for the tool buddy.

I checked it with the files of mass effect 3, everything is precompressed better. I got output size what was shown by ds4zlib.
Speed is better than ztool.
ram utilization is better than ztool.
only one bug which i encountered was manually closing xtool when pressing cancel button on setup.
The latest version v02 doesnt include cryla library. have u removed this lib support.
It would be nice, if u create tools like DS4ZLIB, they come very handy.
r u planing to add lz4 support?

Thanks

[KaktoR]

^use taskkill for cancel button

[darkwolves]

@Razor. Thanks for the tool buddy.

I checked it with the files of mass effect 3, everything is precompressed better. I got output size what was shown by ds4zlib.
Speed is better than ztool.
ram utilization is better than ztool.
only one bug which i encountered was manually closing xtool when pressing cancel button on setup.
The latest version v02 doesnt include cryla library. have u removed this lib support.
It would be nice, if u create tools like DS4ZLIB, they come very handy.
r u planing to add lz4 support?

Thanks


if you set the arc.ini settings similar to this
it will read both zlib and cri

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t4:zlib,crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>

[ZakirAhmad]

^use taskkill for cancel button

Yeah I know that bro. I just informed about the bug.

[KaktoR]

Ehh :D

[Sergey3695]

Ehh :D
use unarc. example:
unarc x -o+ -w.\ -dp_TEST DMC3-0.bin

[KaktoR]

I use the example from razor (v02). And it was only once. On second test unpack all was normal again.

[Sergey3695]

I use the example from razor (v02). And it was only once. On second test unpack all was normal again.
I always have this if use the example from razor (v02). :) because arc.exe x32 bit.

[Razor12911]

Ehh :D

Freearc bug, not related to xtool at all.

[Simorq]

Creating archive: Dishonored Death Of The Outsider.Bin.001 using xprecomp:c128mb,t100p:zlib+srep:m3f:l256:a0+lzma2: d256m:fb273:mc1000000:lc4:lp0:mmt2+diskspan:4096mb :4096mb
Compressed 275 files, 25,136,559,305 => 4,294,967,345 bytes. Ratio 17.09%
Compression time: cpu 169.14 sec/real 11880.99 sec = 1%. Speed 2.12 mB/s
All OK

Extracting archive: Dishonored Death Of The Outsider.Bin.001
Extracted 275 files, 4,294,967,345 => 25,136,559,305 bytes. Ratio 17.09%
Directory 3,884 => 10,321 bytes. Ratio 37.63%
Extraction time: cpu 67.69 sec/real 955.05 sec = 7%. Speed 26.32 mB/s
All OK

[Simorq]

Creating archive: Call Of Duty Black Ops III.Bin.001 using xprecomp:c32mb,t100p:zlib+srep:m3f:l256:a0+4x4:b12 8mb:lzma:ultra:64mb:bt4:fb273:lc8:mc1000000+disksp an:4350mb:4450mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 994 files, 113,284,312,081 => 4,561,305,643 bytes. Ratio 4.03%
Compression time: cpu 915.33 sec/real 16872.19 sec = 5%. Speed 6.71 mB/s
All OK

Testing archive: Call Of Duty Black Ops III.Bin.001
WARNING: CRC failed in "zone\snd\all\cp_mi_sing_biodomes.all.sabl". File is broken.
WARNING: CRC failed in "zone\snd\all\zm_castle.all.sabl". File is broken.
WARNING: CRC failed in "zone\zm_island.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_sing_biodomes2.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_cairo_lotus2.xpak". File is broken.
WARNING: CRC failed in "zone\cp_sh_singapore.xpak". File is broken.
WARNING: CRC failed in "zone\zm_stalingrad.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_sing_vengeance.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch_tu17.xpak". File is broken.
WARNING: CRC failed in "zone\zm_factory.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_cairo_infection2.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch_tu13.xpak". File is broken.
WARNING: CRC failed in "zone\zm_sumpf.xpak". File is broken.
WARNING: CRC failed in "zone\zm_theater.xpak". File is broken.
WARNING: CRC failed in "zone\zm_cosmodrome.xpak". File is broken.
WARNING: CRC failed in "zone\zm_temple.xpak". File is broken.
WARNING: CRC failed in "zone\zm_tomb.xpak". File is broken.
WARNING: CRC failed in "zone\zm_moon.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch.xpak". File is broken.
WARNING: CRC failed in "zone\zm_genesis.xpak". File is broken.
WARNING: CRC failed in "zone\base_dlc1.xpak". File is broken.
WARNING: CRC failed in "zone\base_dlc3.xpak". File is broken.
WARNING: CRC failed in "zone\initial.xpak". File is broken.
WARNING: CRC failed in "zone\base.xpak". File is broken.
Tested 994 files, 4,561,305,643 => 113,284,312,081 bytes. Ratio 4.03%
Directory 9,461 => 37,041 bytes. Ratio 25.54%
Testing time: cpu 256.88 sec/real 799.10 sec = 32%. Speed 141.76 mB/s
There were 24 warning(s)

[doofoo24]

i was about to redo game's with xtool since there is improve ratio on mad max (10%) compare to ztool/pzlib.
any idea why CRC error ?

[KaktoR]

c32m,t4:zlib
No error with this for mad max (latest version)

[Razor12911]

Ok, I'm removing support for the weird streams that are in the DH2 game, they are causing nothing but trouble.

anyhow:

changelog for 0.3
- fixed zlib precompression crc issues
- Added EA Frostbite 3 lz4 stream precompression support
- Fixed overall chunk size 2GB limit

as for lz4 test:

Frostbite 3 (LZ4) - test, cas_01.cas

ZTool: 375 MB (394,239,224 bytes) > 924 MB (969,163,164 bytes) > 98.9 MB (103,708,039 bytes), took 16.645s and used 406 MB memory

XTool: 375 MB (394,239,224 bytes) > 917 MB (961,843,247 bytes) > 97.9 MB (102,685,972 bytes), took 14.737s and used 303 MB memory

Not sure just yet if these tests are correct as I only ran one test and ended up with these results.

[darkwolves]

[QUOTE=Razor12911;470742]Ok, I'm removing support for the weird streams that are in the DH2 game, they are causing nothing but trouble.


i am watching this thread closely once this tool is matured to a much better degree i am going to start posting compression methods on the repack methods threads after using it to do it with...

[LuzhinE]

Will it only be for me?
but I'm having problems decompressing with xtool v2, (zlib+srep+lzma2)

https://i.imgur.com/Qvp555f.png

[darkwolves]

LuzhinE;470744]Will it only be for me?
but I'm having problems decompressing with xtool v2, (zlib+srep+lzma2)



what are your srep commands? arc.ini etc you have to be a bit more specific if you want some help

[LuzhinE]

what are your srep commands? arc.ini etc you have to be a bit more specific if you want some help

https://i.imgur.com/zgGdd8a.png

[Andu21]

LuzhinE, xtool.exe e:precomp,t4:zlib

[LuzhinE]

but so it comes by default xtool

https://i.imgur.com/opUZvoO.png
grabbing the change already decompresses thanks

[Sergey3695]

LuzhinE, xtool.exe e:precomp,t4:zlib
:confused:
now does not work xtool. lol.
> grabbing the change already decompresses thanks
np )
darkwolves's -_-

[darkwolves]

:confused:
now does not work xtool. lol.
> grabbing the change already decompresses thanks
np )

xtool.exe e:precomp:t4:zlib

it goes like that you only need ,
if you are adding crilayla after zlib

[Razor12911]

Creating archive: Call Of Duty Black Ops III.Bin.001 using xprecomp:c32mb,t100p:zlib+srep:m3f:l256:a0+4x4:b12 8mb:lzma:ultra:64mb:bt4:fb273:lc8:mc1000000+disksp an:4350mb:4450mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 994 files, 113,284,312,081 => 4,561,305,643 bytes. Ratio 4.03%
Compression time: cpu 915.33 sec/real 16872.19 sec = 5%. Speed 6.71 mB/s
All OK

Testing archive: Call Of Duty Black Ops III.Bin.001
WARNING: CRC failed in "zone\snd\all\cp_mi_sing_biodomes.all.sabl". File is broken.
WARNING: CRC failed in "zone\snd\all\zm_castle.all.sabl". File is broken.
WARNING: CRC failed in "zone\zm_island.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_sing_biodomes2.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_cairo_lotus2.xpak". File is broken.
WARNING: CRC failed in "zone\cp_sh_singapore.xpak". File is broken.
WARNING: CRC failed in "zone\zm_stalingrad.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_sing_vengeance.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch_tu17.xpak". File is broken.
WARNING: CRC failed in "zone\zm_factory.xpak". File is broken.
WARNING: CRC failed in "zone\cp_mi_cairo_infection2.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch_tu13.xpak". File is broken.
WARNING: CRC failed in "zone\zm_sumpf.xpak". File is broken.
WARNING: CRC failed in "zone\zm_theater.xpak". File is broken.
WARNING: CRC failed in "zone\zm_cosmodrome.xpak". File is broken.
WARNING: CRC failed in "zone\zm_temple.xpak". File is broken.
WARNING: CRC failed in "zone\zm_tomb.xpak". File is broken.
WARNING: CRC failed in "zone\zm_moon.xpak". File is broken.
WARNING: CRC failed in "zone\base_patch.xpak". File is broken.
WARNING: CRC failed in "zone\zm_genesis.xpak". File is broken.
WARNING: CRC failed in "zone\base_dlc1.xpak". File is broken.
WARNING: CRC failed in "zone\base_dlc3.xpak". File is broken.
WARNING: CRC failed in "zone\initial.xpak". File is broken.
WARNING: CRC failed in "zone\base.xpak". File is broken.
Tested 994 files, 4,561,305,643 => 113,284,312,081 bytes. Ratio 4.03%
Directory 9,461 => 37,041 bytes. Ratio 25.54%
Testing time: cpu 256.88 sec/real 799.10 sec = 32%. Speed 141.76 mB/s
There were 24 warning(s)

Can you rerun the compression without the use of reflate libraries

@everyone
can one of you upload a sample from FIFA 17

[ShivShubh]

@everyone
can one of you upload a sample from FIFA 17

Here - https://www91.zippyshare.com/v/jC5IBBre/file.html

[Razor12911]

Here - https://www91.zippyshare.com/v/jC5IBBre/file.html

Thanks but it doesn't seem to have compressed streams.

[Simorq]

Can you rerun the compression without the use of reflate libraries

without zlibwapi.dll
CRC OK
The Ratio increased by 80%

Most likely the problem is from zlibwapi.dll.
In ZTool, the zlibwapi.dll file does not work.

[ShivShubh]

without zlibwapi.dll
CRC OK
The Ratio increased by 80%

Most likely the problem is from zlibwapi.dll.
In ZTool, the zlibwapi.dll file does not work.

Maybe you were using 32bit zlibwapi.dll ?

[Simorq]

Maybe you were using 32bit zlibwapi.dll ?

no

[oltjon]

@everyone
can one of you upload a sample from FIFA 17

ZSTD stream from fifa17

link (https://mega.nz/#!grBHRCyI!_tHXo3z-fWnDz26sfL_xQSf2RYoWnxebs2Y7gaKunUY)

[Razor12911]

without zlibwapi.dll
CRC OK
The Ratio increased by 80%

Most likely the problem is from zlibwapi.dll.
In ZTool, the zlibwapi.dll file does not work.

What do you mean, the problem is more likely from that dll? :confused:

[Razor12911]

Update available

Changes

- fixed zlib precompression crc issues // sort of
- Added EA Frostbite 3 lz4 and zstd stream precompression support
- Fixed overall chunk size 2GB limit

Roadmap

- Add Ubisoft game support for Anvil, Dunia and Unreal Engines
- Add support for FIFA 17 and FIFA 18 zstd streams
- Naruto series (Maybe)

[doofoo24]

@Razor12911 are you planning on adding support for other games like COD advanced warfare/infinite warfare/WWII/modern warfare remastered, and other game's like wolfenstein new order & the old blood :o

[KaktoR]

what about MEA zstd stream support? I could upload example if you wish

thanks for your great work, as always :)

[doofoo24]

will it work on MEA last time i tried with ztool with libzstd it did'nt work like i get final size 35.4gb, i tired with different files from c***p*** (libgcc_s_dw2-1.dll/zstdx86.dll/ztool 32bit) i get 30.4gb ?
i will tried to use xtool

[KaktoR]

here are samples from mea
https://www113.zippyshare.com/v/FW2kmxOo/file.html

[doofoo24]

does battlefield hardline have lz4 ?

[Razor12911]

what about MEA zstd stream support? I could upload example if you wish

thanks for your great work, as always :)

I have the game, I downloaded the game just to run zstd tests and all seems good, go for it. I have not played it though, piece of shit pc :(

does battlefield hardline have lz4 ?

yes

[masen485]

games I want to reduce size

Need for Speed™ Payback Frostbite 3 (LZ4)
Battlefield 1 Frostbite 3 (LZ4)
Battlefield 4 Frostbite 2 (LZ4)
Battlefield 3 Frostbite (LZ4)

XTool 0.3 ,ZTool in the version how to use it in the best way
Can you show me a few examples?
Frostbite games made with game engine
Compressing game files in the best way

[Razor12911]

test xtool v3
battlefield hardline 36.8gb to 49gb...
mirror edge catalyst 23gb to 29gb...

Cool, keep going. compare both precompressed and compressed size between ztool and xtool because if all is good, I no longer touch the codec but will move to the next.

[doofoo24]

i am trying MEA but always carsh...
packcmd = XTool e:precomp:c32mb,t100p:zstd - - <stdin> <stdout> :confused:

[doofoo24]

Cool, keep going. compare both precompressed and compressed size between ztool and xtool because if all is good, I no longer touch the codec but will move to the next.
ok it will take while to compress both game...

test xtool v3
battlefield hardline 36.8gb to 49gb to size 22.8 GB (24,436,696,587 bytes)
mirror edge catalyst 23gb to 29gb to 16.5 GB (17,814,184,692 bytes)

test ztool 0.19.8
battlefield hardline 36.8gb to 51.3gb with srep:m3f:a2+lolz:d64m size 22.7 GB (24,436,517,587 bytes)
mirror edge catalyst 23gb to 29.5gb with srep:m3f:a2+lolz:d64m size 16.5 GB (17,796,182,115 bytes)

*i used the same liblz4 from xtool v3 with ztool...
seems that the ratio with ztool better with about couple of mb...
decompression no crc error...

the arc.ini setting

[External compressor:xprecomp]
header = 0
packcmd = XTool e:precomp:c32mb,t100p:lz4 - - <stdin> <stdout>

[External compressor:plz4]
header = 0
packcmd = ztool e:plz4:t100p - <stdin> $$arcpackedfile$$.tmp

[ZakirAhmad]

Tried it on a file from Mass effect andromida.

ztools pzstd expanded it to 174.85%
xtools expanded it to 177.14%
ztool with v parameter 177.27%(since this produces result without varification, hence can b used for comparison. jusk like we use DS4Zlib before precompression.)

extraction is also successifully

After treating the output with srep + lzma

ztool 20.38%
xtool 20.21%

is it possible to provide v parameter with xtool, it might come handy for comparison.

[darkwolves]

@Razor12911
i will repack need for speed payback with it the lz4 on ztool froze on a certain file i am hoping this does not if it does i will give you the sample

[darkwolves]

apon using the x86 version it had an error that
libgcc_s_dw2-1.dll
was missing
so i found it and put it in the same folder no problem since
file included below for anyone who has had the same problem

[ZakirAhmad]

Sometimes xtool give arc.exe has stopped working...
But after two to 3 tries, it works on the file.

[darkwolves]

Sometimes xtool give arc.exe has stopped working...
But after two to 3 tries, it works on the file.

well it is still a work in progress afterall :D

[ZakirAhmad]

well it is still a work in progress afterall :D

well it happens, if the data to be processed contains a mixture of files say dlls, exes, txt etc.
it was alse problem of ztool.

[KaktoR]

well it happens, if the data to be processed contains a mixture of files say dlls, exes, txt etc.
it was alse problem of ztool.

That's why i don't mix them alltogether.

[ZakirAhmad]

That's why i don't mix them alltogether.

Everytime u cant separate files in different graops. suppose u separated files containing zlib streams in a folder. suppose some file is included in that folder which doesnt contain zlib streams. the precompression might fail because of that single file. theoritically, a file without streams should not crash ztool. There is something wrong somewhere which is causing the error.

[KaktoR]

Hm, i can always seperate them in groups.

[darkwolves]

i always use 3 data files i'd rather fix one fine than an entire game
for example if there is only something wrong with file 2 then i do not have to worry about 1 and 3
for example
batman arkham asylum
only lzo files in folder 1
folder 2 the bink videos
folder 3 the game executables redists etc the small stuff

[ZakirAhmad]

crash with pzlib/ztool/xtool with <stdin> <stdout> happened a lot even with zlib file only...
i used - <stdin> $$arcpackedfile$$.tmp always work without crash...

Great i will try. Thanks

@KaktoR: if their is a tool for grouping files in folders, can u post it.

[Andu21]

Sometimes xtool give arc.exe has stopped working...
But after two to 3 tries, it works on the file.
FA bug with stdio, not related to xtool.

Razor12911 will you give support to Unity engine as well?

[Simorq]

crash with pzlib/ztool/xtool with <stdin> <stdout> happened a lot even with zlib file only...
i used - <stdin> $$arcpackedfile$$.tmp always work without crash...

http://uupload.ir/files/ccf_2018-05-11_204149.png

--cache=0
stdin without crash:D

[Razor12911]

Update available

Changes

- added unity engine (5.x.x) lz4hc stream precompression support
- updated zlib precompression scanner
- improved reflate level detector for zip and png input

[JustFun]

@Razor12911 damn mate, I cant wait to see what are you going to do with xTool, as soon as I think that you are finished you include something new, huge thx and respect!!!

[KaktoR]

How to know what unity version a game is using?

[Andu21]

^Unity Studio.

[Simorq]

How to know what unity version a game is using?

https://pcgamingwiki.com/wiki/Engine:Unity

https://pcgamingwiki.com/wiki/Life_Is_Strange:_Before_the_Storm

[ZakirAhmad]

Great work as always.

Can u please add support for unreal engine, Titanfall 2.

[Razor12911]

Great work as always.

Can u please add support for unreal engine, Titanfall 2.

Sure, buy lzopro for me :)
http://www.oberhumer.com/products/lzo-professional/

[ZakirAhmad]

Sure, buy lzopro for me :)
http://www.oberhumer.com/products/lzo-professional/

I will if i can.

[masen485]

- Add Ubisoft game support for Anvil, Dunia and Unreal Engines
- Add support for FIFA 17 and FIFA 18 zstd streams
- Naruto series (Maybe)

Hi! Razor12911

you can add the above properties very soon

in a very short time you are doing a lot of other great features and great work and you are very supportive to the games with many game engines I am very happy with the new xtool tool every work you do is followed with great curiosity Thank you for everything

[doofoo24]

NeedForSpeedPayback size 13.5gb with xtool...
ztool stuck...
seems that lz4 only work on ea games for now,
tried on COD game's and gear of war 4 no luck...

[JRD!]

Sure, buy lzopro for me :)
http://www.oberhumer.com/products/lzo-professional/

Hi bro, for lzo maybe that might interest you:
https://github.com/synopse/mORMot/blob/master/SynLZO.pas

[Razor12911]

Update available

Changes

- added dunia engine lz4hc stream precompression support (Far Cry 5)
- fixed unity engine support

Notes

In terms of the Dunia engine, I advise that you use the latest liblz4.dll to avoid some streams being skipped due to their major difference, this could be because even I myself am not sure if I used the correct parameters for recompression, if you have an idea of what is used, please comment. (I used lz4hc, level 9)

Only Far Cry 5 is what I think is supported currently, that's the only game I had installed so run tests to see if all is good, if so then I'll be moving on to Far Cry 3 and 4. Add the dat files in xtool.ini, make sure in that same location, the dat files are with the fat files else they'll be errors.

Parsing the fat file is a pain in the ass especially for the big files (farcry5.dat and installpkg.dat), so xtool might seem stuck when running those, at most it should take 5-10 minutes before it begins actual precompression.

[darkwolves]

@Razor12911
excellent you have been on a roll with this tool the past couple of days

[KaktoR]

Oh, this updates come out like a machine gun.

Thank you rezor

[Razor12911]

any idea of xtool parameters for lz4hc

packcmd = ???

:confused:

and what game to test lz4hc ???

:rolleyes:
Levels are set by program

[doofoo24]

and what game's to test lz4
run on YookaLaylee with v and the same nothing as xtool v4 ???
did you test on any unity games ?

[Razor12911]

and what game's to test lz4
run on YookaLaylee with v and the same nothing as xtool v4 ???
did you test on any unity games ?
XTool works on none of the unity games I have but I was sent samples to work on the tool and was told not all Unity Games are compressed therefore, perhaps the game you're testing it on are not compressed or do not follow the headers which are read by the tool.

[doofoo24]

ok i will test on other unity game's and report...
any future support for COD GAMES : Warfare Remastered , Advanced Warfare , Infinite Warfare . WWII :)

[Razor12911]

I currently have no leads on the header structure of those games quite yet.

[Razor12911]

seems to crash on cuphead...

try isolating the issue then upload result, I'm not planning on downloading the game just to see what's really wrong. Some of us are on caps :)

[Simorq]

XTool 0.4 Zlib

Creating archive: Warriors All-Stars.Bin.001 using xprecomp:c32mb,zlib+srep:m3f+lolz:d64:mc1023:tt2+d iskspan:4096mb:4096mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 342 files, 23,626,897,455 => 4,294,967,331 bytes. Ratio 18.18%
Compression time: cpu 1869.13 sec/real 13768.85 sec = 14%. Speed 1.72 mB/s
All OK

Testing Archive: Warriors All-Stars.Bin.001
WARNING: CRC failed in "LINKDATA.BIN". File is broken.
WARNING: CRC failed in "KTSLXA2C.dll". File is broken.
WARNING: CRC failed in "steam_api64.dll". File is broken.
WARNING: CRC failed in "KTSLXA27.dll". File is broken.
WARNING: CRC failed in "KTSLXA29.dll". File is broken.
WARNING: CRC failed in "Config.exe". File is broken.
WARNING: CRC failed in "Star_US.exe". File is broken.
WARNING: CRC failed in "Star_KR.exe". File is broken.
WARNING: CRC failed in "Star_JP.exe". File is broken.
WARNING: CRC failed in "Star_TW.exe". File is broken.
WARNING: CRC failed in "Star_.ico". File is broken.
WARNING: CRC failed in "LINKDATA.IDX". File is broken.
WARNING: CRC failed in "steam_emu.ini". File is broken.
Tested 342 files, 4,294,967,331 => 23,626,897,455 bytes. Ratio 18.18%
Testing time: cpu 45.33 sec/real 657.06 sec = 7%. Speed 35.96 mB/s
There were 13 warning(s)

[Razor12911]

XTool 0.4 Zlib

Creating archive: Warriors All-Stars.Bin.001 using xprecomp:c32mb,zlib+srep:m3f+lolz:d64:mc1023:tt2+d iskspan:4096mb:4096mb
Memory for compression 0b, decompression 0b, cache 0b
Compressed 342 files, 23,626,897,455 => 4,294,967,331 bytes. Ratio 18.18%
Compression time: cpu 1869.13 sec/real 13768.85 sec = 14%. Speed 1.72 mB/s
All OK

Testing Archive: Warriors All-Stars.Bin.001
WARNING: CRC failed in "LINKDATA.BIN". File is broken.
WARNING: CRC failed in "KTSLXA2C.dll". File is broken.
WARNING: CRC failed in "steam_api64.dll". File is broken.
WARNING: CRC failed in "KTSLXA27.dll". File is broken.
WARNING: CRC failed in "KTSLXA29.dll". File is broken.
WARNING: CRC failed in "Config.exe". File is broken.
WARNING: CRC failed in "Star_US.exe". File is broken.
WARNING: CRC failed in "Star_KR.exe". File is broken.
WARNING: CRC failed in "Star_JP.exe". File is broken.
WARNING: CRC failed in "Star_TW.exe". File is broken.
WARNING: CRC failed in "Star_.ico". File is broken.
WARNING: CRC failed in "LINKDATA.IDX". File is broken.
WARNING: CRC failed in "steam_emu.ini". File is broken.
Tested 342 files, 4,294,967,331 => 23,626,897,455 bytes. Ratio 18.18%
Testing time: cpu 45.33 sec/real 657.06 sec = 7%. Speed 35.96 mB/s
There were 13 warning(s)

Try isolating error

[ZakirAhmad]

since u do not need to set parameter in case of xtool (like plz4, pzstd, pzlib), during compression. soppose u r expanding a zlib compressed file with xtool, so during decompression u have to nclude only xtool + zlibapi.dll with decompresser. But in my case i got crc errors. when i included whole xtool (that is xtool, zlibapi, liblz4etc) the error got away.

@Razor. Is this farcry primal or farcry 5

[Razor12911]

Dude, the input files must have a header structure that has those

[doofoo24]

game with unity tested : Firewatch, Syberia 3, cuphead, Yooka-Laylee nothingfound with xtool 0.5

setting for arc.ini
[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c32mb,t100p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>

[Razor12911]

what game did you sample :(

I don't know lol, I got my samples from FitGirl. I don't have good memory of the games the samples came from.

Just google search "Fitgirl Repack uses pUnity library by Razor12911"

From the search I get NASCAR Heat 2, Hand of Fate 2, The Raven Remastered: Digital Deluxe Edition...

[Razor12911]

better edit fit**** re**** :D

In any case, I didn't break rule 1-12 :)

[Grumpy]

better edit fit**** re**** :D

In any case, I didn't break rule 1-12 :)

Just to clear something up regarding rules ...

You can not say things like "I downloaded the Fitgirl release ... "

You can say things like "I want to repack my games like Fitgirl does .."

Therefore Razor did not break any rules ;)

[darkwolves]

-clears throat loudly- :D

[ShivShubh]

game with unity tested : Firewatch, Syberia 3, cuphead, Yooka-Laylee nothingfound with xtool 0.5

Don't know about the other games but Firewatch and Cuphead doesn't have any LZ4 streams. Unity Engine games doesn't always have compression, mostly they come with no compression.

[doofoo24]

seems to work on super lucky tale but the ratio after srep+lolz not good...

[ShivShubh]

seems to work on super lucky tale but the ratio after srep+lolz not good...

Not good as compared to without xtool ? Make sure you used xt 0.5.

[masen485]

xtool_v05 Do you have any information, do you know how to use it?
I have a few games with 3 game engines and how do I use them with xtool v0.5?
methods and compression tools and ArC.in content, please help

unity engine support -----Cuphead
dunia engine support-----Far Cry 5
Frostbite engine support--Battlefield 4

[ShivShubh]

xtool_v05 Do you have any information, do you know how to use it?
I have a few games with 3 game engines and how do I use them with xtool v0.5?
methods and compression tools and ArC.in content, please help

unity engine support -----Cuphead
dunia engine support-----Far Cry 5
Frostbite engine support--Battlefield 4

What is your problem dude ? Why dont you check topics before asking these stupid question everytime ? arc.ini was already included with xtool so its very clear that you never even checked the tool itself :|

[masen485]

I checked all of them,

[-NORO-]

xtool 0.5 lz4 doesnt seem to work on life is strange before the storm

[masen485]

CAR MECHANIC SIMULATOR 2018 unity engine xtool 0.5 not working

[ShivShubh]

xtool 0.5 lz4 doesnt seem to work on life is strange before the storm

Hmmm then I wonder how I have already repacked the game with it xD

CAR MECHANIC SIMULATOR 2018 unity engine xtool 0.5 not working

Can you please upload some of the files ? Supported streams should be in the StreamingAssets folder.

[masen485]

StreamingAssets folder.
Upload Status %55

[masen485]

CAR MECHANIC SIMULATOR 2018 unity engine
http://s7.dosya.tc/server6/jg5ujg/cms2018_Data.rar.html

[-NORO-]

Hmmm then I wonder how I have already repacked the game with it xD




ok lol

[Razor12911]

CAR MECHANIC SIMULATOR 2018 unity engine
http://s7.dosya.tc/server6/jg5ujg/cms2018_Data.rar.html
Your files

Look at this post:
http://fileforums.com/showpost.php?p=470934&postcount=174

[Razor12911]

Update available

Changes

- updated unity engine support for closely packed files
- older zstd libraries now supported

Notes

A sample of Unity is included in the attachment in "xtool_v06.7z\FA_example\pack", check via Hex as to how the headers should look like.

Don't use lz4 with other codecs when packing FC5 at the moment to avoid errors, work incomplete.

If you're planning to use zlib codec, use version 0.5's, I only remembered now after upload that I was doing something to it last night and might result in errors.

[darkwolves]

@Razor12911
already? i just got done putting in update 5 lol :p

[LuzhinE]

Does this happen to anyone else

ERROR: write error (disk full?) in compression algorithm srep

there will be a way to fix it

[darkwolves]

Does this happen to anyone else

ERROR: write error (disk full?) in compression algorithm srep

there will be a way to fix it

no i get crc errors and have to make adjustments
has this happened to you before xtool?
did it work fine before?
wich srep do you have?
do you have cls dll files?

[LuzhinE]

It never happened to me, but the problem is not xtool, if not srep

[darkwolves]

It never happened to me, but the problem is not xtool, if not srep

what is the compression method used on that command line in wich the error was caused?

[ShivShubh]

FC5 no work /Ratio 100%

It works, tried on common.dat

[Perykles]

Mr. Razor12911,

There is a problem of CRC with these files of "Trials Evolution Gold Edition"
"data.pak" and "data_tex.pak"
I use the xtool version 0.5
I tested with version 0.6 but the files are not deflated !
The files being small I give you a link with "FA_Example" in pack directory of xtool 0.5

https://transfernow.net/5679c22198j4

Thank you for your hard work on pzlib, xtool and the other tools.

[Simorq]

Mr. Razor12911,

There is a problem of CRC with these files of "Trials Evolution Gold Edition"
"data.pak" and "data_tex.pak"
I use the xtool version 0.5
I tested with version 0.6 but the files are not deflated !
The files being small I give you a link with "FA_Example" in pack directory of xtool 0.5

https://transfernow.net/5679c22198j4

Thank you for your hard work on pzlib, xtool and the other tools.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t25p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t1 - - <stdin> <stdout>

t1 Only CRC is OK

[Razor12911]

FC5 no work /Ratio 100%

Make sure you have edited xtool.ini, the path specified must be valid

[Simorq]

Make sure you have edited xtool.ini, the path specified must be valid

[Dunia2]
File1=D:\Games\Far Cry 5\data_final\pc\common.dat
File2=D:\Games\Far Cry 5\data_final\pc\ingameeditor\igepack.dat

Creating archive: data.arc using xprecomp
Compressed 1 file, 182,265,474 => 541,415,990 bytes. Ratio 297.05%
Compression time: cpu 0.27 sec/real 43.10 sec = 1%. Speed 4.23 mB/s
All OK

Extracting archive: data.arc
Extracted 1 file, 541,415,990 => 182,265,474 bytes. Ratio 297.05%
Extraction time: cpu 0.19 sec/real 7.25 sec = 3%. Speed 25.14 mB/s
All OK

Good Work:D

Please XTool.ini for Zlib

[Simorq]

e1_s04_a.bytes 401 MB
XTool 0.6
Creating archive: data.arc using xprecomp
Compressed 1 file, 421,335,057 => 1,063,695,957 bytes. Ratio 252.46%
Compression time: cpu 0.94 sec/real 21.79 sec = 4%. Speed 19.34 mB/s
All OK

Testing archive: data.arc
Tested 1 file, 1,063,695,957 => 421,335,057 bytes. Ratio 252.46%
Testing time: cpu 0.38 sec/real 7.64 sec = 5%. Speed 55.13 mB/s
All OK

[KaktoR]

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t25p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t1 - - <stdin> <stdout>

t1 Only CRC is OK

Yep t1 is CRC good. But veeeeeery sloooow

I've tested on another file, 2.6GB, unpacking was about 15min :rolleyes:

[darkwolves]

I've tested on another file, 2.6GB, unpacking was about 15min :rolleyes:
i suppose it depends on the game mine was set to t4 on arkham knight it worked just fine

[Razor12911]

Update available

Changes

- added dunia engine lz4hc stream precompression support (Far Cry 5)
- fixed unity engine support

Notes

In terms of the Dunia engine, I advise that you use the latest liblz4.dll to avoid some streams being skipped due to their major difference, this could be because even I myself am not sure if I used the correct parameters for recompression, if you have an idea of what is used, please comment. (I used lz4hc, level 9)

Only Far Cry 5 is what I think is supported currently, that's the only game I had installed so run tests to see if all is good, if so then I'll be moving on to Far Cry 3 and 4. Add the dat files in xtool.ini, make sure in that same location, the dat files are with the fat files else they'll be errors.

Parsing the fat file is a pain in the ass especially for the big files (farcry5.dat and installpkg.dat), so xtool might seem stuck when running those, at most it should take 5-10 minutes before it begins actual precompression.

Doesn't seem like I'll be adding FC3-4 support since I think lzopro is required for them just like Unreal Engine games.

As for current progress, I added support for FIFA 18.

The idea of binding codecs together came when I saw that this game is compressed with two different algorithms, oodle (kraken) and zstd

This is the result:

when using:
oodle - - <stdin> <stdout>
Compressed 1 file, 317,249,339 => 586,677,625 bytes. Ratio 184.93%
Compression time: cpu 0.59 sec/real 172.68 sec = 0%. Speed 1.84 mB/s

however when using:
oodle,zstd - - <stdin> <stdout>
Compressed 1 file, 317,249,339 => 592,734,832 bytes. Ratio 186.84%
Compression time: cpu 0.66 sec/real 185.29 sec = 0%. Speed 1.71 mB/s

[doofoo24]

can't you make FC3/4 like FC5 file by file without lzopro ?

[Razor12911]

can't you make FC3/4 like FC5 file by file without lzopro ?

Streams never restore to their original form bro, that's the issue. Applying techniques of xdelta don't work either because there are a lot of differences between.

I could be missing something, who knows...

[doofoo24]

i guess also games with engine Disrupt (watch_dog) are the same ?

[Razor12911]

i guess also games with engine Disrupt (watch_dog) are the same ?

I have not tried that game before so I can't say for sure.

[ShivShubh]

can't you make FC3/4 like FC5 file by file without lzopro ?

It doesnt work like that. FC2/3/4 uses LZOPRO while FC5 uses LZ4HC.

[darkwolves]

It doesnt work like that. FC2/3/4 uses LZOPRO while FC5 uses LZ4HC.

looks like someone is going to have to break down and get LZOPRO for razor...
i will check my monthly budget..

[Edison007]

Fc234 do not use lzopro ;)

[Perykles]

Thank you Simorq for this solution but as KaktoR says it's slower.
What is surprising is that Pzlib V3 does not have this problem for this game.
I only created a new "xtoolslow" entry in the arc.ini for archives that have this problem.

[ShivShubh]

Fc234 do not use lzopro ;)

Thanks for confirming :) Then its probably some other problem.

[Razor12911]

Fc234 do not use lzopro ;)

Thanks, I figured out the solution to the problem after posting :)

[Razor12911]

Call of Duty IW test

europa_fatty_tr.ff:
ZTool: 38,489,248 => 85,959,469 => 39,719,836 bytes // negative ratio
XTool: 38,489,248 => 66,390,558 => 27,577,712 bytes

assetfile17.pak:
ZTool: 104,595,492 => 178,560,871 => 54,821,086 bytes
XTool: 104,595,492 => 139,027,892 => 33,859,574 bytes

[LuzhinE]

thanks for xtool, diskpan.

I hope that soon you can compress the call of duty games....
thanks-thanks-thanksthanks-thanks

[doofoo24]

xtool v0.5 on doom file's gameresources.patch & gameresources.resources
e:precomp:c256mb 9.20 > 19gb
e:precomp:c128mb 9.20 > 18.6gb
e:precomp:c64mb 9.20 > 16.6gb
e:precomp:c32mb 9.20 > 14.4gb

*for optimal setting for doom use xtool only on gameresources.patch & gameresources.resources
need hif2raw_dll.dll, raw2hif_dll.dll

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c160mb,t4:zlib - - <stdin> <stdout>

9.20gb > 19gb > 4.41gb , srep+lolz

*decompression seems to be very slow almost 20 min, xtool most of the time use only 11% with 438mb of ram...

unpackcmd = xtool.exe d:precomp:t100p - - <stdin> <stdout>

[1234567890123]

i get appcrash with xtool even in FA_example but randomly.it's weird but sometimes xtool is working but mostly it's give error.arc.exe stopped working and fault module is msvcrt. i formatted pc in windows 10 it gives memory could not be read in windows 7 it gives appcrash.any help?

[darkwolves]

i get appcrash with xtool even in FA_example but randomly.it's weird but sometimes xtool is working but mostly it's give error.arc.exe stopped working and fault module is msvcrt. i formatted pc in windows 10 it gives memory could not be read in windows 7 it gives appcrash.any help?

that is a runtime file if i am not mistaken...
wich msvcrt is it? there are more than one

[KaktoR]

I've the same error. But it was only with cls-diskspan and razor's original batch (drag&drop bat). Custom works perfectly. Only sometimes it doesn't work, then i just have to spam the batch :D

[KaktoR]

Is there a option to skip the "CRC is broken" message and just left the CRC corrupted file there and unpacking next file? I aking because i could just use xdelta afterwards without all the hassle to find the one-working-option for every file. In my tests all xdelta dif files are just about 15-30kb in size.

[ZakirAhmad]

Is there a option to skip the "CRC is broken" message and just left the CRC corrupted file there and unpacking next file? I aking because i could just use xdelta afterwards without all the hassle to find the one-working-option for every file. In my tests all xdelta dif files are just about 15-30kb in size.

I guess, FA will not allow u to do it. howver u can just use bat file to unpack xtool files and then use xdelta.

BTW, u will get crc errors, if u pack a file with xtool (say a zlib file) while cryla, liblz4 etc are also present during packing around xtool. and unpack with only xtool + zlibapi (excluding others).

[KaktoR]

I guess, FA will not allow u to do it. howver u can just use bat file to unpack xtool files and then use xdelta.

BTW, u will get crc errors, if u pack a file with xtool (say a zlib file) while cryla, liblz4 etc are also present during packing around xtool. and unpack with only xtool + zlibapi (excluding others).

Mhh too bad. Thanks anyway.

[darkwolves]

Mhh too bad. Thanks anyway.

i only get crc errors if i run multiple codecs at one time
so i divided them all and gave them thier own commands

[1234567890123]

http://i63.tinypic.com/1zytte8.png
first try always work but i do it again gives error.if i restart computer it works then errors :(

[darkwolves]

first try always work but i do it again gives error.if i restart computer it works then errors :(

do you have all the visual runtimes installed?
it could be that or antivirus or firewall
those 3 things i have seen cause this error
also sometimes certain compressor commands
do not miix well with eachother

[1234567890123]

probably my problem is that. where should I add it exactly?
-edit man thank you sooo much you helped me too much :)

[ZakirAhmad]

probably my problem is that. where should I add it exactly?
-edit man thank you sooo much you helped me too much :)

In arc.ini

[1234567890123]

i have a problem in extraction :)) i can unpack with arc.exe -x option but if i use unarc.exe or inno setup, in task manager xtool.exe do not close himself, stays in background and i can't see finish page of setup.how can i unpack them with arc.exe in inno?

[ZakirAhmad]

i have a problem in extraction :)) i can unpack with arc.exe -x option but if i use unarc.exe or inno setup, in task manager xtool.exe do not close himself, stays in background and i can't see finish page of setup.how can i unpack them with arc.exe in inno?

Use taskkill function

[NexusIV]

Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>

[Panky]

Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>
Try t1 parameter for unpacking.

[oltjon]

Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>



maybe you have problems with srep no xtool. you can put the file on the forum so I do that test. so we are not forced to download the whole game

[NexusIV]

maybe you have problems with srep no xtool. you can put the file on the forum so I do that test. so we are not forced to download the whole game

Thanks for the reply. You're probably right. I use Srep 3.93 x64 version which would seem to have a bug. Unfortunately I can not recover version 3.92 which would seem to be more stable.

Can someone tell me where I can download it?

[oltjon]

Can someone tell me where I can download it?

here is srep 3.92 beta

[Razor12911]

did you test other cod games advanced warfare & modern warfare remastered ?

i don't have those games :(

[Razor12911]

Sure, pak and ff samples from those games would do.
Also if possible, CODWWII, I have this game but I don't feel like installing...

[NexusIV]

here is srep 3.92 beta

Thank You.

[kassane]

I tested xtool in Divinity Original Sin 1 EE and 2.

GameMaster.pak[DOS2] => 426MB

methods:
1) xtool.exe e:precomp:c32mb:t100p:zlib
2) xtool.exe e:precomp:c32mb:t100p:lz4

Result:
Compressed 1 file, 447,157,530 => 447,157,650 bytes. Ratio 100.00%
Compression time: cpu 1.11 sec/real 9.31 sec = 12%. Speed 48.03 mB/s


PAK format (https://divinity.gamepedia.com/PAK_format)

[Razor12911]

I tested xtool in Divinity Original Sin 1 EE and 2.

GameMaster.pak[DOS2] => 426MB

methods:
1) xtool.exe e:precomp:c32mb:t100p:zlib
2) xtool.exe e:precomp:c32mb:t100p:lz4

Result:
Compressed 1 file, 447,157,530 => 447,157,650 bytes. Ratio 100.00%
Compression time: cpu 1.11 sec/real 9.31 sec = 12%. Speed 48.03 mB/s


PAK format (https://divinity.gamepedia.com/PAK_format)
Sample?

[kassane]

Sample?

GameMaster.pak - (DOS2) (https://mir.cr/T0CIEHPB)

[oltjon]

Call of Duty WWII
bulge.fd
bulge.ff
imagefile19.pak

link (https://mega.nz/#!hmgVxJDB!arcMBknBN892fnk7I9JZ1MwixpC-Rs-402whevXCaV8)

[MM32]

Please help with the decompression program

[Razor12911]

Update available

Changes

- added ea frostbite 3 oodle and zstd support for fifa 18
- added dunia 2 lzo support for fc series
- added iw engine lz4hc support
- added partial crilayla support for naruto series
- added anvil engine lzo and oodle support
- fixed crilayla inflation bug
- fixed non-stdio mode bug
- updated zlib precompression
- removed MT scanning for some codecs

[Razor12911]

test lzo on ac i afr detect more..

The samples you uploaded:

DataPC_LoadingRoom2.forge

afr19: 10,780,672 => 13,917,326 => 8,970,681 bytes
xtool: 10,780,672 => 13,917,332 => 8,983,511 bytes

DataPC_Map_Menu.forge

afr19: 1,605,632 => 6,956,755 => 821,299 bytes
xtool: 1,605,632 => 6,957,991 => 820,636 bytes

:confused::confused::confused:

[Razor12911]

@Razor12911 i uploaded Samples of cod game's in DevXTool thread

have you tested xtool on the samples you uploaded?

[Razor12911]

ok xtool setting
packcmd = xtool.exe e:precomp:c32mb,t6:lzo - - <stdin> <stdout>
work on all file but one by one if i apply xtool on all file seems to skip on ac i...

Have you tried to increase chunk size?

ok test it on cod aw 33gb to 37.2gb seems to work...

Skip verification to see what you're really suppose to get, if it's more then try using an older liblz4.dll since AW came before the version of the library in the attachment.

[Razor12911]

increase chunk size ?
yes
tried to test it on ac ii nothing :confused:

Use the x86 version for that