FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   XTool - Successor of ZTool (https://fileforums.com/showthread.php?t=101729)

KaktoR 20-04-2018 08:30

That's the command razor gave us, and it works just fine (except for the above^^)

darkwolves 20-04-2018 12:52

each time razor releases a new version i will use it to repack a larger cpk game
i did with sonic forces because it is 16 gigs so its not too terribly large
it is the guinea pig lol

panker1992 20-04-2018 16:49

1 Attachment(s)
There you go :D

Decomp one will pop shortly

darkwolves 20-04-2018 20:16

holy giant post panker lol

KaktoR 21-04-2018 14:15

Just to let you know regarding my problem with xtool+diskspan.

It works actually, but i had to drag&drop the game folder 7 times actually (like spamming the folder into batch) before xtool starts working without windows problem reporting. It seems like a bug somewhere in batch, diskspan or even xtool, i don't know. Maybe my machine is the problem, but i had it only with xtool now.

Edit:
Have searched a bit, seems to be a problem with one of the vc redists, so i uninstalled them all, rebooted and reinstalled them one by one
Code:

Faulting application name: Arc.exe, Version: 0.0.0.0, time stamp: 0x5324af98
Faulting application name: msvcrt.dll, Version: 7.0.17133.1, time stamp: 0xc5dd3631
Exception code: 0xc0000005
Fault offset: 0x00088a2a
Faulting process ID: 0x18fc
Faulting application start time: 0x01d3d9bcfd524e85
Faulting application path: C:\Windows\System32\msvcrt.dll

The problem is only when i use diskspan with xtool. All other tools working just fine.

Edit 2:
Compatibility Mode for Win7 (xtool.exe) seems to fix this issue. Really strange.

Edit 3:
Ok no it's not fixed actually. After i arborted compression because of wrong lzma2, i fixed that and run again -> same problem as before.

Edit 4:
I've found the problem. If the pack data has folders + subfolders then xtool (or diskspan i dont know) stop working for some reason. But if i copy all files from all folders + subfolders into one single directory, then it works (it's the same size, but without any folders).

Edit 5:
My solution was now to just pick up some files and use your pack.bat from post #1, after it starts, wait some secs until xtool.exe starts working and then drag&drop game folder into diskspan bat and it works *facepalm* wtf

I think the problem here is xtool, because all other pre-/compressors working just fine with diskspan and whole game folders, but xtool doesn't. So?

elit 21-04-2018 17:43

1 Attachment(s)
Crilayla unfortunately doesn't work at all for me, on several files I tried, like this small one for example:
Attachment 21751
It create output file of 0 size and close immediately. I used x86 exe as dll is only for that version:
Code:

xtool.exe e:crilayla:c32mb,t3 pack_031_message.cpk1 test

ShivShubh 22-04-2018 03:16

Quote:

Originally Posted by elit (Post 470455)
Crilayla unfortunately doesn't work at all for me, on several files I tried, like this small one for example:
Attachment 21751
It create output file of 0 size and close immediately. I used x86 exe as dll is only for that version:
Code:

xtool.exe e:crilayla:c32mb,t3 pack_031_message.cpk1 test

Your command is incorrect, use like this :-
Code:

xtool e:precomp:c32m,t1:crilayla pack_031_message.cpk1 test

Razor12911 26-04-2018 21:29

Update available

Changelog:
v0.2:
- fixed x64 issues caused by compiler bugs
- slightly improved zlib/deflate scanner
- added entropy filter to fix reflate bug
- fixed MT zlib decoding bug

Notes:
There may be a few more bugs that still remain with regards to the zlib codec but if all is fixed then you guys should thank
I removed crilayla support on Naruto series, no tests conducted and I don't plan on downloading that game just to add a feature on a tool I don't use.

Razor12911 26-04-2018 21:58

1 Attachment(s)
Quote:

Originally Posted by KaktoR (Post 470413)
XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same

Works here

Sergey3695 26-04-2018 22:24

Quote:

Originally Posted by Razor12911 (Post 470515)
I removed crilayla support on Naruto series, no tests conducted and I don't plan on downloading that game just to add a feature on a tool I don't use.

https://yadi.sk/d/WNKW73Ht3UpyVN
data.cpk (393 mb)
NARUTO SHIPPUDEN Ultimate Ninja STORM 2

LuzhinE 26-04-2018 22:32

Thank you

darkwolves 26-04-2018 23:32

http://i63.tinypic.com/2w3rqqq.jpg

this is from the second release the first release inflated this file to over 4 gigs
the game is sonic lost world
this really did not do much at all

LuzhinE 27-04-2018 05:43

does not contain zlib that .cpk
.cpk crilayla or am I wrong?

Panky 27-04-2018 06:20

Xtool v0.2 doesn't recompress streams from This War of Mine, but v0.1 does/

animations.dat - 20,6 MB (21 696 742 bytes)
v0.1
Code:

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 25,479,373 bytes. Ratio 117.4%
Compression time: cpu 0.05 secs, real 14.55 secs. Speed 1,492 kB/s
All OK

v0.2
Code:

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 21,696,758 bytes. Ratio 100.0%
Compression time: cpu 0.02 secs, real 2.13 secs. Speed 10,208 kB/s
All OK


ShivShubh 27-04-2018 06:27

^Did you test the decompression as well ?

Panky 27-04-2018 06:33

Quote:

Originally Posted by ShivShubh (Post 470536)
^Did you test the decompression as well ?

Yep, decompression is ok with both versions.

Illume 27-04-2018 07:03

Thanks Razor for keep doing tools that you don't use :)
can you add parameters to split threads like in ztool\pzlib?
st#: number of scanning threads
ct#: number of precompressing threads
normally using one thread for precompressing and multi for scanning gives less chance of an CRC errors

darkwolves 27-04-2018 10:00

Quote:

Originally Posted by LuzhinE (Post 470534)
does not contain zlib that .cpk
.cpk crilayla or am I wrong?

it is a .cpk file that inflated on the first release
going to try on something with just zlib later
when i get time

darkwolves 27-04-2018 10:14

Quote:

Originally Posted by Illume (Post 470540)
Thanks Razor for keep doing tools that you don't use :)
can you add parameters to split threads like in ztool\pzlib?
st#: number of scanning threads
ct#: number of precompressing threads
normally using one thread for precompressing and multi for scanning gives less chance of an CRC errors

the t in the arc command stands for threads i believe it is t4 by default

darkwolves 27-04-2018 10:50

xtool on batman arkham knight season of infamy dlc folder

xtool
Quote:

Compressed 248 files, 3,388,376,675 => 5,043,877,778 bytes. Ratio 148.8%
Compression time: cpu 5.19 secs, real 167.14 secs. Speed 20,273 kB/s
All OK

ztool
Quote:

Compressed 248 files, 3,388,376,675 => 5,043,877,778 bytes. Ratio 148.8%
Compression time: cpu 5.80 secs, real 262.81 secs. Speed 12,8 mB/s
All OK
identical end results but xtool precompressed these zlib files very noticably faster than ztool

Razor12911 27-04-2018 15:20

Quote:

Originally Posted by Panky (Post 470535)
Xtool v0.2 doesn't recompress streams from This War of Mine, but v0.1 does/

animations.dat - 20,6 MB (21 696 742 bytes)
v0.1
Code:

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 25,479,373 bytes. Ratio 117.4%
Compression time: cpu 0.05 secs, real 14.55 secs. Speed 1,492 kB/s
All OK

v0.2
Code:

FreeArc 0.67 (December 12 2012) Creating archive: ..\1.bin using xprecomp
Memory for compression 0b, decompression 0b, cache 1mb
Compressed 1 file, 21,696,742 => 21,696,758 bytes. Ratio 100.0%
Compression time: cpu 0.02 secs, real 2.13 secs. Speed 10,208 kB/s
All OK


would help if you upload the sample :confused:

Razor12911 27-04-2018 18:42

Quote:

Originally Posted by darkwolves (Post 470560)
sonic generations also not precompiling like it did in the first release
below is an attachment with a file sample

Code:

[External compressor:xprecomp]
header    = 0
packcmd  = xtool.exe e:precomp:c16mb,t2:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>

with first release
Code:

Compressed 1 file, 69,265,624 => 126,761,898 bytes. Ratio 183.01%
with second release
Code:

Compressed 1 file, 69,265,624 => 127,517,586 bytes. Ratio 184.10%
after strong compression
using 0.1: 121 MB (127,517,813 bytes) >> 22.0 MB (23,120,406 bytes)
using 0.2: 120 MB (126,762,125 bytes) >> 21.4 MB (22,529,107 bytes)

darkwolves 27-04-2018 19:31

Quote:

Originally Posted by Razor12911 (Post 470562)
Code:

[External compressor:xprecomp]
header    = 0
packcmd  = xtool.exe e:precomp:c16mb,t2:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>



after strong compression
using 0.1: 121 MB (127,517,813 bytes) >> 22.0 MB (23,120,406 bytes)
using 0.2: 120 MB (126,762,125 bytes) >> 21.4 MB (22,529,107 bytes)

interesting it isn't inflating at all on my side
i will do some troubleshooting

darkwolves 27-04-2018 20:02

Release 2 Troubleshooting
 
alright seems to be in the arc.ini

in release 2 razor released the following command in the FA example

Quote:

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t4:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>
with it set this way it will ignore the crilayla streams


the solution is to replace zlib with crilayla in the packcmd and xtool begins to read the cri streams again i have tried adding it with zlib still there but it does not work.

example
Quote:

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t4:crilayla - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t4 - - <stdin> <stdout>

sonic lost world after replacing zlib with crilayla in the arc ini in release 2
Quote:

Compressing 1 file, 2,463,058,976 bytes
Compressing sonic2013_0.cpk
Compressed 1 file, 2,463,058,976 => 5,067,368,904 bytes. Ratio 205.7%
Compression time: cpu 5.81 secs, real 1115.69 secs. Speed 2,208 kB/s
i came to this conclusion after sending a file to razor and it worked for him and his command
did not have zlib in it only crilayla

Panky 27-04-2018 23:47

1 Attachment(s)
Quote:

Originally Posted by Razor12911 (Post 470559)
would help if you upload the sample :confused:

Here you are.

darkwolves 28-04-2018 01:17

Quote:

Originally Posted by Panky (Post 470565)
Here you are.

try these arc settings

Quote:

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t2:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>
i've found manually changing crilayla to zlib or zlib to crilayla
in the arc ini works depandant on what you are trying to precompress

KaktoR 28-04-2018 06:05

Quote:

Originally Posted by Razor12911 (Post 470517)
Works here

Yep, with update 2 it works now. Thank you!

Panky 28-04-2018 12:15

Quote:

Originally Posted by darkwolves (Post 470567)
try these arc settings



i've found manually changing crilayla to zlib or zlib to crilayla
in the arc ini works depandant on what you are trying to precompress

Yeah, my mistake, thanks.

darkwolves 28-04-2018 13:26

Quote:

Originally Posted by Panky (Post 470582)
Yeah, my mistake, thanks.

i did the exact same thing lol
i gave the sample to razor after he posted the results
i felt stupid..lol prompting me to make the post above
for those who may make the same mistake..

Simorq 28-04-2018 15:42

"Resident Evil 6" "Dir DX9 222 MB"

XTool 0.1
Creating archive: xprecomp.Bin using xprecomp:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:ul tra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 16,971,873 bytes. Ratio 7.29%
Compression time: cpu 0.61 sec/real 129.38 sec = 0%. Speed 1.80 mB/s
All OK

__________________________________________________ ______
XTool 0.2 32Bit
Creating archive: xprecomp2.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 43,084,237 bytes. Ratio 18.50%
Compression time: cpu 0.66 sec/real 122.06 sec = 1%. Speed 1.91 mB/s
All OK

__________________________________________________ ______
XTool 0.2 64Bit
Creating archive: xprecomp2_64.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 16,953,160 bytes. Ratio 7.28%
Compression time: cpu 0.59 sec/real 125.23 sec = 0%. Speed 1.86 mB/s
All OK


__________________________________________________ ______
Ztool
Creating archive: Ztool.Bin using pzlib:max:c32m+srep:m3f:l256:a0+lzma:ultra:d768m:m fbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 17,636,136 bytes. Ratio 7.57%
Compression time: cpu 0.67 sec/real 133.21 sec = 1%. Speed 1.75 mB/s
All OK

__________________________________________________ ______
Precomp043
Creating archive: Precomp043.Bin using precomp+srep:m3f:l256:a0+lzma:ultra:d768m:mfbt4:lc 8:fb273
Compressed 474 files, 232,916,010 => 17,309,956 bytes. Ratio 7.43%
Compression time: cpu 0.83 sec/real 243.89 sec = 0%. Speed 0.95 mB/s
All OK



http://www.mediafire.com/file/rrrwmw...u/RE6_.DX9.exe C FreeArc Sfx

Razor12911 28-04-2018 15:43

Quote:

Originally Posted by Simorq (Post 470585)
"Resident Evil 6" "Dir DX9 222 MB"
XTool 0.2 32Bit
Creating archive: xprecomp2.Bin using xprecomp2:c32mb,t100p:zlib+srep:m3f:l256:a0+lzma:u ltra:d768m:mfbt4:lc8:fb273
Compressed 474 files, 232,916,010 => 43,084,237 bytes. Ratio 18.50%
Compression time: cpu 0.66 sec/real 122.06 sec = 1%. Speed 1.91 mB/s
All OK

Out of memory exceptions probably occurred.

Quote:

Originally Posted by Panky (Post 470565)
Here you are.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c16mb,t2:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t2 - - <stdin> <stdout>

with first release
Code:

Compressed 1 file, 21,696,742 => 25,479,385 bytes. Ratio 117.43%
Compression time: cpu 0.11 sec/real 34.21 sec = 0%. Speed 0.63 mB/s

with second release
Code:

Compressed 1 file, 21,696,742 => 25,477,946 bytes. Ratio 117.43%
Compression time: cpu 0.06 sec/real 32.07 sec = 0%. Speed 0.68 mB/s

after strong compression
using 0.1: 24.2 MB (25,479,618 bytes) >> 15.7 MB (16,488,938 bytes)
using 0.2: 24.2 MB (25,478,179 bytes) >> 15.7 MB (16,485,534 bytes)

:confused:

Simorq 28-04-2018 15:46

XTool 0.2 32Bit has a problem.

Razor12911 28-04-2018 15:47

Quote:

Originally Posted by Simorq (Post 470587)
XTool 0.2 32Bit has a problem.

use 16mb chunk size and try again

Simorq 28-04-2018 16:07

Quote:

Originally Posted by Razor12911 (Post 470588)
use 16mb chunk size and try again

Good

Code:

Creating archive: xprecomp2.Bin using xprecomp2:c16mb,t100p:zlib+srep:m3f:l256:a0+lzma:ultra:d768m:mfbt4:lc8:fb273
Memory for compression 0b, decompression 0b, cache 1kb
Compressed 474 files, 232,916,010 => 17,091,192 bytes. Ratio 7.34%       
Compression time: cpu 0.66 sec/real 130.44 sec = 1%. Speed 1.79 mB/s
All OK

But the extraction speed is less
Even when using XTool x64 to decompress.

darkwolves 28-04-2018 16:46

Quote:

Originally Posted by Simorq (Post 470587)
XTool 0.2 32Bit has a problem.

the only thing i see wrong is the fact i have to manually type in zlib or crilayla
in the arc.ini packcmd it doesn't work if both are present only the one you are trying to precompress

darkwolves 28-04-2018 16:58

@Razor12911

i ran into his same problem its just an arc.ini issue seems you can only have zlib or crilayla typed in one at a time wich explained why this worked on the FA example command
its with zlib being in the command it will target zlib with crilayla in the command it will target cpk but if you have both it will ignore both

ztool zlib vs xtool zlib with just zlib in the command
http://fileforums.com/showpost.php?p...9&postcount=60

Simorq 28-04-2018 17:02

Quote:

Originally Posted by darkwolves (Post 470591)
the only thing i see wrong is the fact i have to manually type in zlib or crilayla
in the arc.ini packcmd it doesn't work if both are present only the one you are trying to precompress

Code:

Arc.ini
[Compression Methods]
Zlib = xprecomp:c32mb,t100p:zlib
Cri  = xprecomp:c32mb,t1:crilayla

[External compressor:xprecomp]
header    = 0
default = :c32mb,t100p:zlib
packcmd  = XTool e:precomp{:option} - - <stdin> <stdout>
unpackcmd = XTool d:precomp:t100p - - <stdin> <stdout>

Bat
Code:

:-ioff        --shutdown
Arc create --cache=1k -ma9 -dses -ep1 -ed -i2 -r -s; -w.\Temp -dp"Pack" -mZlib Test.Bin
RD /S /Q TEMP
pause


darkwolves 28-04-2018 17:05

Quote:

Originally Posted by Simorq (Post 470593)
Code:

[External compressor:xprecomp]
header    = 0
default = :c32mb,t100p:zlib
packcmd  = XTool e:precomp{:option} - - <stdin> <stdout>
unpackcmd = XTool d:precomp:t100p - - <stdin> <stdout>

Arc.ini
Code:

[Compression Methods]
Zlib = xprecomp:c32mb,t100p:zlib
Cri  = xprecomp:c32mb,t1:crilayla

Bat
Code:

:-ioff        --shutdown
Arc create --cache=1k -ma9 -dses -ep1 -ed -i2 -r -s; -w.\Temp -dp"Pack" -mZlib Test.Bin
RD /S /Q TEMP
pause


crashed with those settings

Simorq 28-04-2018 17:09

Quote:

Originally Posted by darkwolves (Post 470594)
crashed with those settings

Works for me!

darkwolves 28-04-2018 17:11

Quote:

Originally Posted by Simorq (Post 470595)
Works for me!

its most likley a corrupted runtime on my end... sometimes i have to do fresh installs or repairs


All times are GMT -7. The time now is 17:39.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com