FileForums - Metro Exodus Precompression Tool

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Metro Exodus Precompression Tool (https://fileforums.com/showthread.php?t=103563)

Metro Exodus Precompression Tool

Another lz4 game in the bag as requested

I rushed this release, something came up and got busy. I ran one test and compared it with metro-vfx-unpacker and it seems like some streams are left behind.

test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using vfxrec 4.85 GB (5,215,404,338 bytes)
using metro-vfx-unpacker 5.29 GB (5,690,004,897 bytes)

That's all I can do for now :(

Code:

Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%

Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s

Probably R2 will be able to detect everything. :)

content_03.vfs0

Code:



Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%

Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s

All OK

test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using R1

Code:

Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%

Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s

using R2

Code:

Tested 3 files, 6,026,396,117 => 3,369,431,485 bytes. Ratio 178.85%

Testing time: cpu 3.19 sec/real 177.10 sec = 2%. Speed 19.03 mB/s

Quote:

Originally Posted by ZAZA4EVER (Post 486189)

content_03.vfs0

Code:



Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%

Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s

All OK

using R2

Code:

Compressed 1 file, 2,146,319,821 => 2,950,730,980 bytes. Ratio 137.48%

Compression time: cpu 2.59 sec/real 61.16 sec = 4%. Speed 35.09 mB/s

Running a few tests before update is released

Update available

Changes

- Scanner updated to find all lz4 streams the game has (I think)

Notes

The files in vfx_data directory should be present ONLY during encoding and you should get this result when inflating

Code:

Compressed 70 files, 77,548,153,037 => 108,796,991,535 bytes. Ratio 140.30%

Compression time: cpu 131.33 sec/real 3361.83 sec = 4%. Speed 23.07 mB/s

all *.vfs# files except
content_platform.vfs0 {contains shaders}
content_05_sounds_us.vfs0
content_06_sounds_ru.vfs0
content_07_sounds_de.vfs0
content_08_sounds_es.vfs0
content_09_sounds_fr.vfs0
content_10_sounds_it.vfs0
patch_02_sounds_uk.vfs0

// use a different liblz4.dll to get 102GB instead of 101GB

Code:

Compressed 70 files, 77,548,153,037 => 109,700,728,480 bytes. Ratio 141.46%

Compression time: cpu 92.30 sec/real 1173.97 sec = 8%. Speed 66.06 mB/s

There are 5 streams in this game that take about 60-90 seconds each to recompress. (cpu usage will be at its minimum during this)

// I noticed a lot of ogg headers in the game files, so maybe consider oggre (maybe it will work)

After working on this for 2 days I've come to a conclusion, fuck these lz4 compressed games. :mad:

Does not precompress anything for me

Code:

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%

Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad :(

i have put alot of effort to find this game's data struc. there are alot of ogg files in it.

Basically its OGG only high quality as well.

there is 2 options, either that precompressor can opt out the data or we must zero out. for maximum compression ratio.

Quote:

Originally Posted by KaktoR (Post 486300)

Does not precompress anything for me

Code:

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%

Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad :(

that's strange

Quote:

Originally Posted by KaktoR (Post 486300)

Does not precompress anything for me

Code:

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%

Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad :(

i just reinstalled the game and ran a test with all files (no splits) and it worked. :confused::confused::confused:

False alarm :D

My problem was I didn't include the vfx folder aswell. Oh boy.:rolleyes:

For Enhanced Edition of this game, you'll need to generate new vfx_data files because the vfx_data in the main post contains header information for the standard game before the ray tracing update with high resolution textures.

to do that, you'll need to use vfxgen

Code:

vfxgen GamePath LogFile

Use the newly generate files on the game files.

Notes

Use metro-vfx-tool to generate new log files if the game has been updated or if the uploaded log files seem to not work.