FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   XTool - Successor of ZTool (https://fileforums.com/showthread.php?t=101729)

Razor12911 15-04-2018 15:03

XTool - Successor of ZTool
 
6 Attachment(s)
Here's the first release

Code:

XTool version 0.1

Created by Razor12911

Commands:
  e - encode
  d - decode

Operations and codecs available:
  precomp - data precompression
    zlib    : loaded
    crilayla : loaded

Options:
  precomp - data precompression
    c#: chunk size (default 16mb)
    t#: number of threads, use p for percentage

Usage  : XTool [command]:[operation]:[options]:[codecs] [input] [output]
Example : XTool e:precomp:c32mb,t4:zlib,lz4 Textures.tfc Textures.tfc.xtl

Acknowledgement:
  zlib:
  -  Jean-loup Gailly
  -  Mark Adler
  reflate:
  -  Eugene Shelwien
  bdiff:
  -  Peter Johnson
  crilayla:
  -  KenTse
  -  RamiroCruzo


KaktoR 15-04-2018 15:11

Wooh nice.

Thank you!

Mini 15-04-2018 15:51

you are the best.

Simorq 15-04-2018 18:44

Thanks Razor12911
__________________________________
x86: Precompressor is OK - Decompress is OK
x64: Precompressor is DiskFull:rolleyes: - Decompress is OK:D

Razor12911 15-04-2018 19:53

Quote:

Originally Posted by Simorq (Post 470218)
x64: Precompressor is DiskFull:rolleyes:

In my defence, even I haven't used x64 version of this thing.

Jiva newstone 15-04-2018 19:57

Thanks Razor12911
 
Thanks Razor12911 for this aio tool, why don't you made this tool also as compresstor like precomp's lzma... like lzna in it
but this tool is very helpfull for repacker

CANNIBAL 15-04-2018 20:12

Thanks Razor12911 U R DA Best......

masen485 15-04-2018 21:45

XTool - Successor of ZTool
XTool version 0.1
Information for detailed and comfortable use
ultra arc.ini settings info if available
if you can give me a few examples
precomp - data precompression arc.ini settings info if available
zlib : loaded arc.ini settings info if available
crilayla : loaded arc.ini settings info if available

thanks for everything Razor12911

doofoo24 15-04-2018 23:58

seems not to work with zlibwapi only like ztool ?
* and srep and lolz does not show data size ???

78372 16-04-2018 01:04

ZTool vs XTool Test
 
1 Attachment(s)
Great work Razor12911 as always
data1 = ZTool
data2 = XTool

ZTool:
FreeArc 0.67 (March 15 2014) creating archive: data1.arc
Compressing 1 file, 197,759,488 bytes. Processed 0% 21%
41% 73%100%
Compressed 1 file, 197,759,488 => 949,878,926 bytes. Ratio 480.32%
Compression time: cpu 0.75 sec/real 115.69 sec = 1%. Speed 1.71
mB/s
All OK

XTool:
FreeArc 0.67 (March 15 2014) creating archive: data2.arc
Compressing 1 file, 197,759,488 bytes. Processed 0% 54%
92%100%
Compressed 1 file, 197,759,488 => 943,633,165 bytes. Ratio 477.16%
Compression time: cpu 0.70 sec/real 97.73 sec = 1%. Speed 2.02 mB/
s
All OK

XTool inflated less, but compressed much
ZTool: 188mb>127MB
XTool: 188mb>121MB


Thanks again for all your effort.

Simorq 16-04-2018 02:51

Code:

Creating Archive: DarkSouls3.Bin.001 using xprecomp+srep:m3f+lzma2:d256m:fb273:mc1000000:lc4:lp0+diskspan:4350mb:4430mb
Compressed 254 files, 26,882,370,544 => 4,561,305,627 bytes. Ratio 16.97% 
Compression time: cpu 139.39 sec/real 19780.55 sec = 1%. Speed 1.36 mB/s
All OK

Testing archive: DarkSouls3.Bin.001
Tested 254 files, 4,561,305,627 => 26,882,370,544 bytes. Ratio 16.9%     
Testing time: cpu 83.33 secs, real 2379.55 secs. Speed 11,297 kB/s
All OK


KaktoR 16-04-2018 04:21

Unfortunatelly xtool doesn't work with UA.

Will go for DS then :)

shazzla 16-04-2018 05:50

@Razor12911 : is the crilayla x64 dll missing ?!

Webster17 16-04-2018 09:33

Metal Gear Rising Revengeance (Crilayla)
Data size : 2,745,508,712
Compressed Size : 850,414,132
Compression Ratio : 30.9 %

Cons:
Decompression takes a lot of time.
Installer freezes if aborted, just like pzlib3. You have to close the xtool process from task manager.

Wonderful tool, Can't thank you enough Razor...

Mini 16-04-2018 09:36

Metal Gear Rising Revengeance (Crilayla)
Data size : 2,745,508,712

758 282 960 (723 mb) - xtool+srep+lolz

ZakirAhmad 16-04-2018 09:47

Tried it on a file from mass effect 3, precomp042 precompresses better than xtool on it.

Simorq 16-04-2018 10:04

Quote:

Originally Posted by Webster17 (Post 470254)
Cons:
Installer freezes if aborted, just like pzlib3. You have to close the xtool process from task manager.

Use TaskKill
Code:

Exec(ExpandConstant('{sys}\taskkill.exe'), ' /F /IM XTool.exe', '', SW_HIDE, ewNoWait, ResultCode);

Sergey3695 16-04-2018 11:28

When packed file more 4 gb
http://i104.fastpic.ru/big/2018/0416...ca106f6399.jpg

Razor12911 16-04-2018 15:10

Quote:

Originally Posted by doofoo24 (Post 470228)
seems not to work with zlibwapi only like ztool ?
* and srep and lolz does not show data size ???

works with zlibwapi.dll, zlib1.dll or zlib.dll, whichever is found

Quote:

Originally Posted by Sergey3695 (Post 470262)

Probably some bug, will look at it, found more bugs while working on the Naruto series

Quote:

Originally Posted by ZakirAhmad (Post 470258)
Tried it on a file from mass effect 3, precomp042 precompresses better than xtool on it.

Great, this is only news. Upload file if you want something done about it.

ZakirAhmad 16-04-2018 18:53

ofcourse i will send u the file.

darkwolves 17-04-2018 00:13

i repacked sonic forces to 7.94 gb by extracting the cpk... files and packed the files back up after installing.... and it takes alot of time but now i will use this and see how well i can compress it .

-NORO- 17-04-2018 09:22

x64 xtool shows DiskFull
x86 is working

Gupta 17-04-2018 10:21

X32:

Code:


FreeArc 0.67 (March 15 2014) Creating archive: Data\xtooltest.arc using xprecomp
Memory for compression 0b, decompression 0b, cache 32mb
Compressed 2 files, 1,164,384,256 => 2,249,898,011 bytes. Ratio 193.23%   
Compression time: cpu 0.66 sec/real 42.90 sec = 2%. Speed 27.14 mB/s
All OK

FreeArc 0.67 (March 15 2014) Extracting archive: Data\xtooltest.arc
Extracted 2 files, 2,249,898,011 => 1,164,384,256 bytes. Ratio 193.23%   
Extraction time: cpu 0.30 sec/real 37.40 sec = 1%. Speed 31.14 mB/s
All OK

X64:

Code:


FreeArc 0.67 (March 15 2014) Creating archive: Data\xtooltest.arc using xprecomp
Memory for compression 0b, decompression 0b, cache 32mb
ERROR: write error (disk full?) in compression algorithm xprecomp*

FreeArc 0.67 (March 15 2014) Extracting archive: Data\xtooltest.arc
Extracted 2 files, 2,249,898,011 => 1,164,384,256 bytes. Ratio 193.23%   
Extraction time: cpu 0.23 sec/real 36.51 sec = 1%. Speed 31.89 mB/s
All OK

*no crashes or anything else

78372 17-04-2018 10:49

Probably this disk full error is by fa(standard error), I faced it many times during many projects and when I used stdin for encoding, this was a common error, though I am not sure it is the same error for xtool or not. But those who are facing these errors, try using $$arcdatafile$$.tmp instead of stdin(Not tested here)

Gupta 17-04-2018 10:57

why do you think i haven't tried it?

darkwolves 17-04-2018 11:59

trying xtool with uharcmt it seems to be working pretty well

Razor12911 17-04-2018 15:05

I'll take a look at x64 issue

elit 17-04-2018 17:14

Greetings Razor, I only now discovered this. Its fantastic that you decided to remake ztool. Specifically CRI format is great to see for sure.

If you are interested in adding oodle in future, it is pretty much "8C 06" pattern to look for *always*, with cmd/uncmp sizes preceding it. Even in engines like unreal where offsets to these sizes are to get from initial game header, they are still located just before "8C 06"(xcom 2 wotch), e.g: cmp(long) - uncmp(long) - data(starting with and including "8C 06").
Oodle is in fact rather predictable to detect and extract, I made bms script that was able to extract from xcom 2(over 20gb+ data) unreal files error-free without bothering to use their own format to locate those chunks.
To differentiate from fakes, first byte before "8C 06" must be "00" because chunks should never be bigger than 8mb and whole 4byte set before "8C 06" when translated to integer should not exceed 8mb. Thats all.

Well anyway, I hope for this to become as great tool one day as is ztool now. Thank you.

Razor12911 17-04-2018 17:49

Quote:

Originally Posted by elit (Post 470326)
Greetings Razor, I only now discovered this. Its fantastic that you decided to remake ztool. Specifically CRI format is great to see for sure.

If you are interested in adding oodle in future, it is pretty much "8C 06" pattern to look for *always*, with cmd/uncmp sizes preceding it. Even in engines like unreal where offsets to these sizes are to get from initial game header, they are still located just before "8C 06"(xcom 2 wotch), e.g: cmp(long) - uncmp(long) - data(starting with and including "8C 06").
Oodle is in fact rather predictable to detect and extract, I made bms script that was able to extract from xcom 2(over 20gb+ data) unreal files error-free without bothering to use their own format to locate those chunks.
To differentiate from fakes, first byte before "8C 06" must be "00" because chunks should never be bigger than 8mb and whole 4byte set before "8C 06" when translated to integer should not exceed 8mb. Thats all.

Well anyway, I hope for this to become as great tool one day as is ztool now. Thank you.

http://fileforums.com/showpost.php?p...8&postcount=64

darkwolves 17-04-2018 19:32

sonic forces repacked from 16 gigs to 8.6 gigs using xtool with srep and uharcmt with it
will be testing other compressors with it as well

danswano 18-04-2018 01:13

I;'m having a problem arc.exe crashing when the operation starts and i guess it's related to my settings.
let's say i want to compress a cpk file and load crilayla library how the command in arc.ini would look like?
Thanks.

78372 18-04-2018 02:09

Quote:

Originally Posted by Gupta (Post 470311)
why do you think i haven't tried it?

Just in case :p

darkwolves 18-04-2018 11:13

Quote:

Originally Posted by danswano (Post 470334)
I;'m having a problem arc.exe crashing when the operation starts and i guess it's related to my settings.
let's say i want to compress a cpk file and load crilayla library how the command in arc.ini would look like?
Thanks.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c32mb,t3 - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t75p - - <stdin> <stdout>

thats the typical command razor gave for it
also don't use x64 at this time something is wrong with it
razor said he would look into it

danswano 19-04-2018 06:06

When i used $$.tmp instead of stdio i got no disk full error.

darkwolves 19-04-2018 18:05

Quote:

Originally Posted by danswano (Post 470390)
When i used $$.tmp instead of stdio i got no disk full error.

it gives me a CRC error when i use that i wonder why every individual computer must be so complicated lol

KaktoR 20-04-2018 02:16

1 Attachment(s)
XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same

Simorq 20-04-2018 04:08

Quote:

Originally Posted by KaktoR (Post 470413)
XTool doesn't work with Diskspan unfortunatelly.

If i use stdin then xtool closes itself with a windows error reporting in task manager (it will be shown just for a second).

I have used also $$.tmp and Input, same

Need dll
hif2raw_dll.dll
raw2hif_dll.dll
zlibwapi.dll

KaktoR 20-04-2018 04:12

1 Attachment(s)
Files are present

KaktoR 20-04-2018 04:47

3 Attachment(s)
Test.zip

elit 20-04-2018 07:41

@KaktoR you have a typo in packcmd: c32mb,t3


All times are GMT -7. The time now is 09:37.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com