Metro Exodus Precompression Tool

[Razor12911]

Another lz4 game in the bag as requested

I rushed this release, something came up and got busy. I ran one test and compared it with metro-vfx-unpacker and it seems like some streams are left behind.

test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using vfxrec 4.85 GB (5,215,404,338 bytes)
using metro-vfx-unpacker 5.29 GB (5,690,004,897 bytes)

That's all I can do for now

Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%
Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s

Probably R2 will be able to detect everything.

[ZAZA4EVER]

content_03.vfs0

Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%
Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s
All OK

[Razor12911]

test on patch_01.vfx (patch_01.vfs0, patch_01.vfs1):
using R1

Extracted 3 files, 5,215,404,078 => 3,369,431,485 bytes. Ratio 154.79%
Extraction time: cpu 7.53 sec/real 196.03 sec = 4%. Speed 17.19 mB/s

using R2

Tested 3 files, 6,026,396,117 => 3,369,431,485 bytes. Ratio 178.85%
Testing time: cpu 3.19 sec/real 177.10 sec = 2%. Speed 19.03 mB/s

Originally Posted by ZAZA4EVER

content_03.vfs0

Compressed 1 file, 2,146,319,821 => 2,315,767,934 bytes. Ratio 107.89%
Compression time: cpu 5.16 sec/real 81.81 sec = 6%. Speed 26.23 mB/s
All OK

using R2

Compressed 1 file, 2,146,319,821 => 2,950,730,980 bytes. Ratio 137.48%
Compression time: cpu 2.59 sec/real 61.16 sec = 4%. Speed 35.09 mB/s

Running a few tests before update is released

[Razor12911]

Update available

Changes

- Scanner updated to find all lz4 streams the game has (I think)

Notes

The files in vfx_data directory should be present ONLY during encoding and you should get this result when inflating

Compressed 70 files, 77,548,153,037 => 108,796,991,535 bytes. Ratio 140.30%
Compression time: cpu 131.33 sec/real 3361.83 sec = 4%. Speed 23.07 mB/s

all *.vfs# files except
content_platform.vfs0 {contains shaders}
content_05_sounds_us.vfs0
content_06_sounds_ru.vfs0
content_07_sounds_de.vfs0
content_08_sounds_es.vfs0
content_09_sounds_fr.vfs0
content_10_sounds_it.vfs0
patch_02_sounds_uk.vfs0


// use a different liblz4.dll to get 102GB instead of 101GB

Compressed 70 files, 77,548,153,037 => 109,700,728,480 bytes. Ratio 141.46%
Compression time: cpu 92.30 sec/real 1173.97 sec = 8%. Speed 66.06 mB/s

There are 5 streams in this game that take about 60-90 seconds each to recompress. (cpu usage will be at its minimum during this)

// I noticed a lot of ogg headers in the game files, so maybe consider oggre (maybe it will work)

After working on this for 2 days I've come to a conclusion, fuck these lz4 compressed games.

[KaktoR]

Does not precompress anything for me

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad

[panker1992]

i have put alot of effort to find this game's data struc. there are alot of ogg files in it.

Basically its OGG only high quality as well.

there is 2 options, either that precompressor can opt out the data or we must zero out. for maximum compression ratio.

[Razor12911]

Originally Posted by KaktoR

Does not precompress anything for me

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad

that's strange

[Razor12911]

Originally Posted by KaktoR

Does not precompress anything for me

Compressing 283 files, 80,582,727,204 bytes. Processed  10.0%
Compressing 80,582,736,816 bytes with "srep_x64" -m3f -a0/0 InFile OutFile

So I assume I have to split all the files rather do the job for the whole folder. Sad

i just reinstalled the game and ran a test with all files (no splits) and it worked.

[KaktoR]

False alarm

My problem was I didn't include the vfx folder aswell. Oh boy.

[Razor12911]

For Enhanced Edition of this game, you'll need to generate new vfx_data files because the vfx_data in the main post contains header information for the standard game before the ray tracing update with high resolution textures.

to do that, you'll need to use vfxgen

vfxgen GamePath LogFile

Use the newly generate files on the game files.

Notes

Use metro-vfx-tool to generate new log files if the game has been updated or if the uploaded log files seem to not work.