FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   XTool - Successor of ZTool (https://fileforums.com/showthread.php?t=101729)

Razor12911 14-05-2018 16:08

Quote:

Originally Posted by Simorq (Post 470978)
FC5 no work /Ratio 100%

Make sure you have edited xtool.ini, the path specified must be valid

Simorq 14-05-2018 16:19

Quote:

Originally Posted by Razor12911 (Post 470992)
Make sure you have edited xtool.ini, the path specified must be valid

[Dunia2]
File1=D:\Games\Far Cry 5\data_final\pc\common.dat
File2=D:\Games\Far Cry 5\data_final\pc\ingameeditor\igepack.dat

Code:

Creating archive: data.arc using xprecomp
Compressed 1 file, 182,265,474 => 541,415,990 bytes. Ratio 297.05%       
Compression time: cpu 0.27 sec/real 43.10 sec = 1%. Speed 4.23 mB/s
All OK

Extracting archive: data.arc
Extracted 1 file, 541,415,990 => 182,265,474 bytes. Ratio 297.05%         
Extraction time: cpu 0.19 sec/real 7.25 sec = 3%. Speed 25.14 mB/s
All OK

Good Work:D

Please XTool.ini for Zlib

Simorq 14-05-2018 17:14

Life is Strange Before the Storm (Unity5)
 
Code:

e1_s04_a.bytes 401 MB
XTool 0.6
Code:

Creating archive: data.arc using xprecomp
Compressed 1 file, 421,335,057 => 1,063,695,957 bytes. Ratio 252.46%     
Compression time: cpu 0.94 sec/real 21.79 sec = 4%. Speed 19.34 mB/s
All OK

Testing archive: data.arc
Tested 1 file, 1,063,695,957 => 421,335,057 bytes. Ratio 252.46%         
Testing time: cpu 0.38 sec/real 7.64 sec = 5%. Speed 55.13 mB/s
All OK


KaktoR 15-05-2018 12:21

Quote:

Originally Posted by Simorq (Post 470989)
[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:t25p:zlib,crilayla,lz4,zstd - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t1 - - <stdin> <stdout>

t1 Only CRC is OK

Yep t1 is CRC good. But veeeeeery sloooow

I've tested on another file, 2.6GB, unpacking was about 15min :rolleyes:

darkwolves 15-05-2018 12:59

Quote:

I've tested on another file, 2.6GB, unpacking was about 15min :rolleyes:
i suppose it depends on the game mine was set to t4 on arkham knight it worked just fine

Razor12911 15-05-2018 16:29

Quote:

Originally Posted by Razor12911 (Post 470916)
Update available

Changes

- added dunia engine lz4hc stream precompression support (Far Cry 5)
- fixed unity engine support

Notes

In terms of the Dunia engine, I advise that you use the latest liblz4.dll to avoid some streams being skipped due to their major difference, this could be because even I myself am not sure if I used the correct parameters for recompression, if you have an idea of what is used, please comment. (I used lz4hc, level 9)

Only Far Cry 5 is what I think is supported currently, that's the only game I had installed so run tests to see if all is good, if so then I'll be moving on to Far Cry 3 and 4. Add the dat files in xtool.ini, make sure in that same location, the dat files are with the fat files else they'll be errors.

Parsing the fat file is a pain in the ass especially for the big files (farcry5.dat and installpkg.dat), so xtool might seem stuck when running those, at most it should take 5-10 minutes before it begins actual precompression.

Doesn't seem like I'll be adding FC3-4 support since I think lzopro is required for them just like Unreal Engine games.

As for current progress, I added support for FIFA 18.

The idea of binding codecs together came when I saw that this game is compressed with two different algorithms, oodle (kraken) and zstd

This is the result:

when using:
Quote:

oodle - - <stdin> <stdout>
Quote:

Compressed 1 file, 317,249,339 => 586,677,625 bytes. Ratio 184.93%
Compression time: cpu 0.59 sec/real 172.68 sec = 0%. Speed 1.84 mB/s
however when using:
Quote:

oodle,zstd - - <stdin> <stdout>
Quote:

Compressed 1 file, 317,249,339 => 592,734,832 bytes. Ratio 186.84%
Compression time: cpu 0.66 sec/real 185.29 sec = 0%. Speed 1.71 mB/s

doofoo24 15-05-2018 16:48

can't you make FC3/4 like FC5 file by file without lzopro ?

Razor12911 15-05-2018 16:50

Quote:

Originally Posted by doofoo24 (Post 471011)
can't you make FC3/4 like FC5 file by file without lzopro ?

Streams never restore to their original form bro, that's the issue. Applying techniques of xdelta don't work either because there are a lot of differences between.

I could be missing something, who knows...

doofoo24 15-05-2018 16:57

i guess also games with engine Disrupt (watch_dog) are the same ?

Razor12911 15-05-2018 16:59

Quote:

Originally Posted by doofoo24 (Post 471013)
i guess also games with engine Disrupt (watch_dog) are the same ?

I have not tried that game before so I can't say for sure.

ShivShubh 15-05-2018 21:13

Quote:

Originally Posted by doofoo24 (Post 471011)
can't you make FC3/4 like FC5 file by file without lzopro ?

It doesnt work like that. FC2/3/4 uses LZOPRO while FC5 uses LZ4HC.

darkwolves 15-05-2018 23:59

Quote:

Originally Posted by ShivShubh (Post 471017)
It doesnt work like that. FC2/3/4 uses LZOPRO while FC5 uses LZ4HC.

looks like someone is going to have to break down and get LZOPRO for razor...
i will check my monthly budget..

Edison007 16-05-2018 01:31

Fc234 do not use lzopro ;)

Perykles 16-05-2018 01:45

Thank you Simorq for this solution but as KaktoR says it's slower.
What is surprising is that Pzlib V3 does not have this problem for this game.
I only created a new "xtoolslow" entry in the arc.ini for archives that have this problem.

ShivShubh 16-05-2018 09:15

Quote:

Originally Posted by Edison007 (Post 471020)
Fc234 do not use lzopro ;)

Thanks for confirming :) Then its probably some other problem.

Razor12911 16-05-2018 15:15

Quote:

Originally Posted by Edison007 (Post 471020)
Fc234 do not use lzopro ;)

Thanks, I figured out the solution to the problem after posting :)

Razor12911 16-05-2018 15:16

Call of Duty IW test

europa_fatty_tr.ff:
ZTool: 38,489,248 => 85,959,469 => 39,719,836 bytes // negative ratio
XTool: 38,489,248 => 66,390,558 => 27,577,712 bytes

assetfile17.pak:
ZTool: 104,595,492 => 178,560,871 => 54,821,086 bytes
XTool: 104,595,492 => 139,027,892 => 33,859,574 bytes

LuzhinE 16-05-2018 16:11

thanks for xtool, diskpan.

I hope that soon you can compress the call of duty games....
thanks-thanks-thanksthanks-thanks

doofoo24 17-05-2018 01:37

xtool v0.5 on doom file's gameresources.patch & gameresources.resources
e:precomp:c256mb 9.20 > 19gb
e:precomp:c128mb 9.20 > 18.6gb
e:precomp:c64mb 9.20 > 16.6gb
e:precomp:c32mb 9.20 > 14.4gb

*for optimal setting for doom use xtool only on gameresources.patch & gameresources.resources
need hif2raw_dll.dll, raw2hif_dll.dll

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c160mb,t4:zlib - - <stdin> <stdout>

9.20gb > 19gb > 4.41gb , srep+lolz

*decompression seems to be very slow almost 20 min, xtool most of the time use only 11% with 438mb of ram...

unpackcmd = xtool.exe d:precomp:t100p - - <stdin> <stdout>

1234567890123 17-05-2018 23:35

i get appcrash with xtool even in FA_example but randomly.it's weird but sometimes xtool is working but mostly it's give error.arc.exe stopped working and fault module is msvcrt. i formatted pc in windows 10 it gives memory could not be read in windows 7 it gives appcrash.any help?

darkwolves 18-05-2018 00:06

Quote:

Originally Posted by 1234567890123 (Post 471043)
i get appcrash with xtool even in FA_example but randomly.it's weird but sometimes xtool is working but mostly it's give error.arc.exe stopped working and fault module is msvcrt. i formatted pc in windows 10 it gives memory could not be read in windows 7 it gives appcrash.any help?

that is a runtime file if i am not mistaken...
wich msvcrt is it? there are more than one

KaktoR 18-05-2018 02:50

I've the same error. But it was only with cls-diskspan and razor's original batch (drag&drop bat). Custom works perfectly. Only sometimes it doesn't work, then i just have to spam the batch :D

KaktoR 18-05-2018 03:52

Is there a option to skip the "CRC is broken" message and just left the CRC corrupted file there and unpacking next file? I aking because i could just use xdelta afterwards without all the hassle to find the one-working-option for every file. In my tests all xdelta dif files are just about 15-30kb in size.

ZakirAhmad 18-05-2018 07:34

Quote:

Originally Posted by KaktoR (Post 471047)
Is there a option to skip the "CRC is broken" message and just left the CRC corrupted file there and unpacking next file? I aking because i could just use xdelta afterwards without all the hassle to find the one-working-option for every file. In my tests all xdelta dif files are just about 15-30kb in size.

I guess, FA will not allow u to do it. howver u can just use bat file to unpack xtool files and then use xdelta.

BTW, u will get crc errors, if u pack a file with xtool (say a zlib file) while cryla, liblz4 etc are also present during packing around xtool. and unpack with only xtool + zlibapi (excluding others).

KaktoR 18-05-2018 11:00

Quote:

Originally Posted by ZakirAhmad (Post 471050)
I guess, FA will not allow u to do it. howver u can just use bat file to unpack xtool files and then use xdelta.

BTW, u will get crc errors, if u pack a file with xtool (say a zlib file) while cryla, liblz4 etc are also present during packing around xtool. and unpack with only xtool + zlibapi (excluding others).

Mhh too bad. Thanks anyway.

darkwolves 18-05-2018 11:26

Quote:

Originally Posted by KaktoR (Post 471056)
Mhh too bad. Thanks anyway.

i only get crc errors if i run multiple codecs at one time
so i divided them all and gave them thier own commands

1234567890123 18-05-2018 13:01

http://i63.tinypic.com/1zytte8.png
first try always work but i do it again gives error.if i restart computer it works then errors :(

darkwolves 18-05-2018 13:46

Quote:

first try always work but i do it again gives error.if i restart computer it works then errors :(
do you have all the visual runtimes installed?
it could be that or antivirus or firewall
those 3 things i have seen cause this error
also sometimes certain compressor commands
do not miix well with eachother

1234567890123 20-05-2018 01:47

probably my problem is that. where should I add it exactly?
-edit man thank you sooo much you helped me too much :)

ZakirAhmad 20-05-2018 02:34

Quote:

Originally Posted by 1234567890123 (Post 471088)
probably my problem is that. where should I add it exactly?
-edit man thank you sooo much you helped me too much :)

In arc.ini

1234567890123 24-05-2018 04:18

i have a problem in extraction :)) i can unpack with arc.exe -x option but if i use unarc.exe or inno setup, in task manager xtool.exe do not close himself, stays in background and i can't see finish page of setup.how can i unpack them with arc.exe in inno?

ZakirAhmad 24-05-2018 05:19

Quote:

Originally Posted by 1234567890123 (Post 471135)
i have a problem in extraction :)) i can unpack with arc.exe -x option but if i use unarc.exe or inno setup, in task manager xtool.exe do not close himself, stays in background and i can't see finish page of setup.how can i unpack them with arc.exe in inno?

Use taskkill function

NexusIV 26-05-2018 02:40

Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>

Panky 26-05-2018 03:13

Quote:

Originally Posted by NexusIV (Post 471163)
Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>

Try t1 parameter for unpacking.

oltjon 26-05-2018 03:16

Quote:

Originally Posted by NexusIV (Post 471163)
Hi everyone, does any of you have problems with files larger than 4GB?

In my case:
Game > Shadow OF Mordor
File > DLC2.arch05

Xtool hangs at the beginning of the decompression and giving CRC error. With FIles of the same type and smaller size I do not have the same problem.

Setting are: packcmd = XTool.exe e:precomp:c256mb,t4:zlib - - <stdin> <stdout>



maybe you have problems with srep no xtool. you can put the file on the forum so I do that test. so we are not forced to download the whole game

NexusIV 26-05-2018 04:11

Quote:

Originally Posted by oltjon (Post 471165)
maybe you have problems with srep no xtool. you can put the file on the forum so I do that test. so we are not forced to download the whole game

Thanks for the reply. You're probably right. I use Srep 3.93 x64 version which would seem to have a bug. Unfortunately I can not recover version 3.92 which would seem to be more stable.

Can someone tell me where I can download it?

oltjon 26-05-2018 10:56

1 Attachment(s)
Quote:

Originally Posted by NexusIV (Post 471167)
Can someone tell me where I can download it?

here is srep 3.92 beta

Razor12911 26-05-2018 17:19

Quote:

Originally Posted by doofoo24 (Post 471200)
did you test other cod games advanced warfare & modern warfare remastered ?

i don't have those games :(

Razor12911 26-05-2018 17:21

Sure, pak and ff samples from those games would do.
Also if possible, CODWWII, I have this game but I don't feel like installing...

NexusIV 27-05-2018 05:47

Quote:

Originally Posted by oltjon (Post 471180)
here is srep 3.92 beta

Thank You.


All times are GMT -7. The time now is 07:07.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com