FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   XTool 2020 (Main Project) (https://fileforums.com/showthread.php?t=102832)

Razor12911 15-06-2021 08:43

Update available

Changes

- fixed library support bug
- x86 build discontinued (has bugs from nowhere)

@Masquerade

Use an even older library for Unity games

https://github.com/lz4/lz4/releases/tag/v1.8.0

Also use v0.3.20+

And there is no way you can tell what version of lz4 was used, that's why I made xtool to allow users to change them and go with the one that they think is the best.

Results from the samples you sent:
Code:

Tested 6 files, 2,793,950,894 => 531,410,227 bytes. Ratio 525.76%
Testing time: cpu 0.47 sec/real 92.79 sec = 1%. Speed 5.73 mB/s


Masquerade 16-06-2021 00:23

Quote:

Originally Posted by Razor12911 (Post 492900)
Results from the samples you sent:
Code:

Tested 6 files, 2,793,950,894 => 531,410,227 bytes. Ratio 525.76%
Testing time: cpu 0.47 sec/real 92.79 sec = 1%. Speed 5.73 mB/s


Thanks for the update. I can only get the results you are showing if I run xtool in non-solid mode however, which doesn't really work when trying to chain it with srep and lolz.

Masquerade 20-06-2021 07:01

What's the method to use for lzo precompression?

I have xtool + lzo2.dll, with packcmd:

Code:

[External compressor: lzo]
header = 0
packcmd = xrool precomp -mlzo -c512mb -t16 - - <stdin> <stdout>

Code:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressing 1 file, 51,286,661 bytes. Processed  0%
ERROR: write error (disk full?) in compression algorithm lzo

I have also tried using the xtool example with same result.

Test file: https://1fichier.com/?1lbx3d68cud09anxs39v

It contains zlib and lzo streams - from Bioshock Infinite (unreal engine 3).

Using uelr:

Code:

Compressed 1 file, 51,286,661 => 100,636,058 bytes. Ratio 196.22%
Compression time: cpu 0.08 sec/real 6.75 sec = 1%. Speed 7.59 mB/s
All OK

uelr+xtool for zlib:

Code:

Compressed 1 file, 51,286,661 => 153,379,576 bytes. Ratio 299.06%
Compression time: cpu 0.08 sec/real 12.26 sec = 1%. Speed 4.18 mB/s
All OK


dixen 20-06-2021 10:33

Quote:

Originally Posted by Masquerade (Post 492947)
What's the method to use for lzo precompression?

I have xtool + lzo2.dll, with packcmd:

Code:

[External compressor: lzo]
header = 0
packcmd = xrool precomp -mlzo -c512mb -t16 - - <stdin> <stdout>

Code:

FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressing 1 file, 51,286,661 bytes. Processed  0%
ERROR: write error (disk full?) in compression algorithm lzo

I have also tried using the xtool example with same result.

Test file: https://1fichier.com/?1lbx3d68cud09anxs39v

It contains zlib and lzo streams - from Bioshock Infinite (unreal engine 3).

Using uelr:

Code:

Compressed 1 file, 51,286,661 => 100,636,058 bytes. Ratio 196.22%
Compression time: cpu 0.08 sec/real 6.75 sec = 1%. Speed 7.59 mB/s
All OK

uelr+xtool for zlib:

Code:

Compressed 1 file, 51,286,661 => 153,379,576 bytes. Ratio 299.06%
Compression time: cpu 0.08 sec/real 12.26 sec = 1%. Speed 4.18 mB/s
All OK


https://fileforums.com/showpost.php?...3&postcount=73

Masquerade 20-06-2021 11:05

Quote:

Originally Posted by dixen (Post 492948)

Yes, I also used uelr previously when I compressed this game, but I want to test xtool lzo.

ffmla 20-06-2021 11:37

^^
Try lzo with Far cry 3.

Quote:

[External compressor: lzo]
header = 0
packcmd = xrool precomp -mlzo -c512mb -t16 - - <stdin> <stdout>
spelling...

----------------------
old xtool LZO usage

Quote:

[External compressor:deflate,reflate,unity,lzo1c,lzo1x,lzo2a]
packcmd = xtool.exe precomp:{compressor}:c16mb,lm,t90p - - <stdin> <stdout>
unpackcmd = xtool.exe decode:t100p - - <stdin> <stdout>
Quote:

arc.exe a -ep1 -r -ed -s; -w.\temp -mlzo1x data.arc "X:\datatobepacked\*"

Masquerade 20-06-2021 13:03

Quote:

Originally Posted by ffmla (Post 492950)
spelling...

This was an error when I typed the post and not from my arc.ini.

If I change to -mlzo1x, it does pack, but only to 100% ratio - no inflation.

ffmla 20-06-2021 20:21

1 Attachment(s)
Quote:

Originally Posted by Masquerade (Post 492951)
This was an error when I typed the post and not from my arc.ini.

If I change to -mlzo1x, it does pack, but only to 100% ratio - no inflation.

During my testing with Far Cry 3 repack i am also faced this issue but ,I don`t know which version of XTOOL is this.
Use the attached one and try it.

My result with FC3.
8.51GB to 4.04 GB

EDT:XTOOL version 1908_R5

Masquerade 23-06-2021 11:37

Here's another Unity sample, xtool doesn't detect any streams at all (regardless of which liblz4 is used, the previous sample I posted: streams were found, just not processed).

https://1fichier.com/?x630wefm2269eh4d81ya

It decompresses to 6.9GB

Razor12911 25-06-2021 01:57

lzo does not have a universal scanner, for the far cry series, you'll need a database file, like fc3.xtl and then use -mfc3 method.

Quote:

Originally Posted by Masquerade (Post 492975)
Here's another Unity sample, xtool doesn't detect any streams at all (regardless of which liblz4 is used, the previous sample I posted: streams were found, just not processed).

https://1fichier.com/?x630wefm2269eh4d81ya

It decompresses to 6.9GB

This contains file version 7, not implemented in unity.dll as it only supports version 6.

An update is required

Razor12911 25-06-2021 23:53

Update available

Changes

- updated search support

Gamer2023 27-06-2021 19:52

What is the best compression method ? how to use it ?

dixen 27-06-2021 21:00

Quote:

Originally Posted by Gamer2023 (Post 493036)
What is the best compression method ? how to use it ?

It's PREcompressor but not compressor

Gamer2023 28-06-2021 04:06

How to use Xtool ?
 
I-How to use it ?
My pc
1.Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz 2.90 GHz
2.8gb ram
II-What is the best compression my computer can handle?
III-Can I use some type of virtual ram to do better compression ?
IV-Can to decompress using inno compiler ?
After compression How could I repack The games?

Sorry for long Questions.:(:(:(:(:(

st0rm 28-06-2021 12:22

Quote:

Originally Posted by Gamer2023 (Post 493040)
I-How to use it ?
My pc
1.Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz 2.90 GHz
2.8gb ram
II-What is the best compression my computer can handle?
III-Can I use some type of virtual ram to do better compression ?
IV-Can to decompress using inno compiler ?
After compression How could I repack The games?

Sorry for long Questions.:(:(:(:(:(

try to use ultraarc.

Gamer2023 28-06-2021 19:46

Best compression my pc can handle .
 
My pc details Below.
Quote:

Originally Posted by Gamer2023 (Post 493040)
I-How to use it ?
My pc
1.Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz 2.90 GHz
2.8gb ram
II-What is the best compression my computer can handle?
III-Can I use some type of virtual ram to do better compression ?
IV-Can to decompress using inno compiler ?
After compression How could I repack The games?

Sorry for long Questions.:(:(:(:(:(

If I have a game say "Grand Theft Auto San Andreas". How could I repack it ?
Can Anyone tell the process to repack the game to under 1.5 gb ?

L33THAK0R 28-06-2021 20:48

Quote:

Originally Posted by Gamer2023 (Post 493045)
My pc details Below.

If I have a game say "Grand Theft Auto San Andreas". How could I repack it ?
Can Anyone tell the process to repack the game to under 1.5 gb ?

I dunno if 1.5gb is possible for san andreas, at least not for the most current PC release (v1.0.0.22). I was able to get it down to 2.87gb from 4.58gb, with xtool you'll want to use the zlib codec for that title.

Gamer2023 28-06-2021 20:54

How ?
 
Quote:

Originally Posted by L33THAK0R (Post 493046)
I dunno if 1.5gb is possible for san andreas, at least not for the most current PC release (v1.0.0.22). I was able to get it down to 2.87gb from 4.58gb, with xtool you'll want to use the zlib codec for that title.

How ?
Can u tell the complete process ?

Masquerade 29-06-2021 09:02

@Razor12911
Here is another unity sample, it should decompress to 254MB however xtool can only get it to 122MB.

I have tried many liblz4s (including the one you gave me last time). The most recent dll gives the highest size.

https://1fichier.com/?06vig7zj102jjv5l07hz

Gamer2023 29-06-2021 19:45

Complete process to repack games ?
 
How to repack a game highly compressed ?
You Tell step by step.(Please provide files used for compression ) I don't know much about repacking.
For example a game alien shooter.
Attachment Removed by Grumpy
Create a repack and provide me. Can you repack it to less than 10 mb.
Please provide the steps.
Setup may be like Fitgirl or normal installation ?

Grumpy 30-06-2021 08:32

Quote:

Originally Posted by Gamer2023 (Post 493055)
How to repack a game highly compressed ?
You Tell step by step.(Please provide files used for compression ) I don't know much about repacking.
For example a game alien shooter.
Attachment Removed by Grumpy
Create a repack and provide me. Can you repack it to less than 10 mb.
Please provide the steps.
Setup may be like Fitgirl or normal installation ?

Do not post full game links.

You need to read/search the forums for the answers you are after, all the information can be found on the forums, you can not expect to come onto a forum and have members take there time to just answer your questions without doing some of your own research first.

Game Repacker 02-07-2021 19:39

Soory. I read the chm file and understood it nicely.but need still help ?
 
I got how to use the xtool. But I want to know the best compression of an 8 GB, 6 GB, 4 GB ram pc can repack ?

Harsh ojha 02-07-2021 19:57

Quote:

Originally Posted by game repacker (Post 493093)
i got how to use the xtool. But i want to know the best compression of an 8 gb, 6 gb, 4 gb ram pc can repack ?

dm 😅

sajmon83 03-07-2021 05:48

I have been trying for a long time to use the latest version of xTool for LZ4 compression. Unfortunately, no results. I did a short test with a sample. Only the older xTool can handle it. My question is, am I doing something wrong? Bad syntax, parameter? I've tried multiple versions of liblz4.dll and unfortunately no result. In the test, I used the latest version of the liblz4.dll v1.9.3 library on all xTool versions. And only one brings results (v0.12). The question is what am I doing wrong?
I enclose a link to the sample and test

And the contents of the test script
Code:

xtool_0.3.03_hotfix\xtool.exe precomp -mlz4 -c1024mb -t100p "sniperescape.ff" xtool_0.3.03sniperescape.ff.unlz4
xtool_0.3.03_hotfix\xtool.exe precomp -mlz4hc -c1024mb -t100p "sniperescape.ff" xtool_0.3.03sniperescape.ff.unlz4hc

xtool_0.3.21\xtool.exe precomp -mlz4 -c1024mb -t100p "sniperescape.ff" xtool_0.3.21sniperescape.ff.unlz4
xtool_0.3.21\xtool.exe precomp -mlz4hc -c1024mb -t100p "sniperescape.ff" xtool_0.3.21sniperescape.ff.unlz4hc

xTool_0.12\xtool.exe e:precomp:c1024mb,t100p:lz4 "sniperescape.ff" xTool_0.12sniperescape.ff.unlz4
xTool_0.12\xtool.exe e:precomp:c1024mb,t100p:lz4hc "sniperescape.ff" xTool_0.12sniperescape.ff.unlz4hc

xtool_2010_R5\xtool.exe precomp -mlz4 -c1024mb -t100p "sniperescape.ff" xtool_2010_R5sniperescape.ff.unlz4
xtool_2010_R5\xtool.exe precomp -mlz4hc -c1024mb -t100p "sniperescape.ff" xtool_2010_R5sniperescape.ff.unlz4hc

xtool_2012_R2\xtool.exe precomp -mlz4 -c1024mb  -t100p "sniperescape.ff" xtool_2012_R2sniperescape.ff.unlz4
xtool_2012_R2\xtool.exe precomp -mlz4hc -c1024mb -t100p "sniperescape.ff" xtool_2012_R2sniperescape.ff.unlz4hc

pause


Game Repacker 04-07-2021 23:33

Best one ?
 
Do you know the best compression method ?

sajmon83 05-07-2021 14:08

Game Repacker One way to find the best compressor is to try it out (or possibly knowledge of the engine and its compression method). One of the more important methods is the precompressor (if there is one). Let me give you a simple example on the CoD 4 MW Remaster. All * .ff files 10870.08Mb I passed through precompressor (most files are already compressed precomporsssor such as xTool can extract these files) xTool_lz4 which gave me a result of 24633.98 Mb Then I used srep (the tool finds the same files and duplicates) which gave me 9113.11 Mb. And for all this I use the LOLZ compressor (currently one of the best compressors for graphics files) which gives me 2,766.74 Mb which gives an amazing 25.45% result. But not every file type gives the best result for LOLZ compression. For some it is a razor compressor for others LZMA and different for audio files. There is simply no one method.

There's a great FitGirl post on the web about compression. I recommend you to find it and read it there is probably everything you need to know about compression these days ^^ And I think that as simply as it was explained there, it cannot be easier ^^ And above all, beautifully written

Game Repacker 05-07-2021 19:05

How ?
 
Quote:

Originally Posted by sajmon83 (Post 493113)
Game Repacker One way to find the best compressor is to try it out (or possibly knowledge of the engine and its compression method). One of the more important methods is the precompressor (if there is one). Let me give you a simple example on the CoD 4 MW Remaster. All * .ff files 10870.08Mb I passed through precompressor (most files are already compressed precomporsssor such as xTool can extract these files) xTool_lz4 which gave me a result of 24633.98 Mb Then I used srep (the tool finds the same files and duplicates) which gave me 9113.11 Mb. And for all this I use the LOLZ compressor (currently one of the best compressors for graphics files) which gives me 2,766.74 Mb which gives an amazing 25.45% result. But not every file type gives the best result for LOLZ compression. For some, it is a razor compressor for others LZMA and different for audio files. There is simply no one method.

There's a great FitGirl post on the web about compression. I recommend you to find it and read it there is probably everything you need to know about compression these days ^^ And I think that as simple as it was explained there, it cannot be easier ^^ And above all, beautifully written

What code used for xtool?

sajmon83 06-07-2021 08:45

Run xTool in cmd xtool precomp and xtool decode
You will see all the information about the xtool or run xtool.chm which also contains most of the information

Game Repacker 06-07-2021 22:01

Ok
 
I used free arc to compress GTA San Andreas. from 4.5Gb to 3.3 Gb.
Can I use precomp+srep+freearc for a better one?
Which one would be the best process?
Please tell me.
:p:p:p:p

Game Repacker 07-07-2021 21:01

I found.
 
1 Attachment(s)
I got the files used by fit girl repacks. I providing files but don't know how to use these files.
These files I found in the temp folder during the installation of a game from the official website.
Files below.

L33THAK0R 08-07-2021 00:01

those are just the files used for unpacking the archive(s), the majority of the tools you need for data compression/decompression can be found here, under the "stickied" / "pinned" posts.

doofoo24 08-07-2021 01:57

@Game Repacker
this is XTOOL THREAD :mad::mad::mad:
there is guide threads on the site how to compress games..

Game Repacker 08-07-2021 06:35

I know
 
Quote:

Originally Posted by doofoo24 (Post 493147)
@Game Repacker
this is XTOOL THREAD :mad::mad::mad:
there is guide threads on the site how to compress games..

I know that but usage?

infovs 12-07-2021 15:47

Anyone noticed xtool and unreal.dll plugin are broken for Street Fighter V since xtool 0.3.9 + unrealplugin R3?
Don't know about other games, I own SF5 and did personal repack with 0.3.9 + unreal.dll R3, .pak files are decrypted normally.
Tried to use it on 0.3.21 + unreal.dll R5 -> nothing is decrypted at all

Btw, yes, I used -d1. Maybe I overlooked something, but if that's true can you please explain to me what am I doing wrong.

For sample I used small 20mb pakchunk50-WindowsNoEditor.pak

With xtool.exe 0.3.9 + unreal.dll R3 - WORKING, decrypted, inflated
Code:

[External compressor:xtool]
header = 0
packcmd  = xtool precomp -mue4:m1:k5F6153346D665A4B384D3573354B5743324C7A325673466E474B4937617A676C+zlib -d1 -c128mb -t100p --dbase - - <stdin> <stdout>

With xtool.exe 0.3.21 + unreal.dll R5 - NOT WORKING, nothing is decrypted (m1 is not needed in latest unreal.dll version)
Code:

[External compressor:xtool]
header = 0
packcmd  = xtool precomp -mue4:k5F6153346D665A4B384D3573354B5743324C7A325673466E474B4937617A676C+zlib -d1 -c128mb -t100p --dbase - - <stdin> <stdout>

Used -mxtool+srep:m2f:l512+lolz arc.exe pack command on both.

Joe Forster/STA 13-07-2021 09:00

Quote:

Originally Posted by Game Repacker (Post 493155)
I know that but usage?

If you have specific questions then ask them. Otherwise, I quote from the first post of this thread: "Read the documentation to find out how it works and how to use it."

L33THAK0R 03-08-2021 01:31

Does using the "LZ4" codec require a specific library version? I'm currently trying to pack the Sony "PlayStation 3" exclusive, "Demon's Souls" (which has LZ4 streams). Attempting to use xtool 2020 results in this output as soon as the temp file has been generated. Utilising xtool 2019 only inflates the input by ~1kb. I'm not able to find any prior examples of the codec being used so I'm not quite sure whats going on.

L33THAK0R 31-08-2021 03:44

Has anyone encountered this error before? I've had it happen with a handful of game-data files, curiously I was able to pack this title ("DOOM", the 2016 reboot of the series) previously, when using the default scanning range (I think 16mb), but I'm redoing it since some files failed to decompress properly.

MineRocker 25-09-2021 05:51

Quote:

Originally Posted by L33THAK0R (Post 493812)
Has anyone encountered this error before? I've had it happen with a handful of game-data files, curiously I was able to pack this title ("DOOM", the 2016 reboot of the series) previously, when using the default scanning range (I think 16mb), but I'm redoing it since some files failed to decompress properly.

maybe it's an issue with the -t100p-1? :confused:

Razor12911 28-09-2021 02:09

1 Attachment(s)
Here's the documentation. It took weeks to write this as I'm very busy.

I'm still unavailable for two more months but the documentation should give insights as to how to fully utilize xtool and how to create plugins.

PsYcHo_RaGE 28-09-2021 09:56

Quote:

Originally Posted by Razor12911 (Post 494131)
Here's the documentation. It took weeks to write this as I'm very busy.

Thank you very much @Razor12911 👍


All times are GMT -7. The time now is 07:48.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com