Best Compression Methods for 'Specific' Games. Q&A

KaktoR · #1 13-06-2020, 07:33

Yet another piece of bloatware shit with at least 40% patch files just like KCD and some others...

Metro Exodus
1 Language

Code:

vfxrec+srep:m3f+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

13:08:09 - Starting Archive Creation. 
16:32:45 - Archive Creation Complete. 

Input Size: 75.04 GB. 
Output Size: 50.98 GB.

PS: At least content_07_sounds_XX.vfs0 and patch_02_sounds_uk.vfs0 contain ogg streams. Compress with oggre is easy, decompress is tricky.

Example for patch_02_sounds_uk.vfs0

Code:

Compressed 1 file, 638,939,169 => 522,221,038 bytes. Ratio 81.73%
Compression time: cpu 1.02 sec/real 220.64 sec = 0%. Speed 2.90 mB/s
All OK

Extracting 1 file, 638,939,169 bytes. Processed 100%
.....
....
..
Extracting just like forever, output is after 5 minutes over 10GB in size, so obviously broken.

Masquerade · #2 14-06-2020, 07:26

Removed Art + Soundtrack viewer.

Total start size: 14.5GB

Compress using the following method:

*.bdt

Code:

oo2recK+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

*.bik
Code:
```
bpk
```

Everything else:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 10.4GB

Important note: Do not use the oo2core_6_win64.dll that comes with the game to precompress with oo2rec. Use oo2core_4_win64.dll + oo2ext_4_win64.dll that comes with poodle shared by panker1992 here. Otherwise precompression doesn't work.

Tools used by: Razor12911, ProFrager, Bulat Ziganshin

Thanks to KaktoR for helping me with oodlerec.

Masquerade · #3 14-06-2020, 12:02

Total start size: 4.63GB

Compress using following method:

*.jpg
Code:
```
packjpg
```
*.mp3
Code:
```
mpz / pmtmpz
```

Everything else:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 3.16GB

Tools used by: ProFrager, Bulat Ziganshin

These games get progressively more painful to compress (in order, 1, 2, 3, 4 - 4 is worst!).

You can use QuickBMS to unpack fbq archives but the game does not read from the raw files, and instead searches for the packed fbq. There's not a way I've found that can take an FBQ archive, unpack it, then rebuild.

Masquerade · #4 14-06-2020, 12:11

Total start size: 13.1GB

Compress using the following method:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 10.5GB

Not very satisfying to compress

Masquerade · #5 15-06-2020, 04:19

In it's retail state (just like all other LEGO Games) this game is impossible to compress properly. In order to make a decent conversion, you first need to use QuickBMS on the DAT files to unpack them.

You can download QuickBMS here.

You will also need the TTGames BMS script which you can get here.

Drag the BMS script over the QuickBMS EXE file and select all the DAT files. I like to unpack to a separate folder then merge the files with the rest of the game after unpacking, but it's perfectly fine to unpack to the game directory.

After unpacking, move or delete the DAT files since we no longer need them.

Test the game to make sure it still loads correctly, it will load from the raw assets just like it would from the DAT files.

Total retail size: 4.13GB

Total size after being unpacked using QuickBMS: 7.62GB

Compress using the following method:

*.bik
Code:
```
bpk
```
*.ogg
Code:
```
oggre
```
*.wav
Code:
```
msc:wav=1:tak=9+srep:a2:m5f:l512
```

Everything else:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 1.52GB

Masquerade · #6 15-06-2020, 12:33

Total start size: 8.57GB

Compress using following method:

*.bpk
Code:
```
bpk
```
*.mp3
Code:
```
mpz
```

Everything else:

Code:

xtool:e:precomp:c128m,100p:zlib+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 5.16GB

Yes, the BSA files contain dds images, wav audio and mp3 streams and this can be solved with msc - but this brings the conversion to 5.7GB. The files are full of zlib streams, making xtool a fine choice.

Tools used by: Razor12911, ProFrager, Bulat Ziganshin

Masquerade · #7 16-06-2020, 03:29

Total start size: 1.97GB

Compress using following method:

The following passage is reuqired in Arc.groups:

Code:

$mp3
*.mp3

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096/$mp3=mpz

Total packed size: 532mb

Tools used by: Bulat Ziganshin, Profrager

Masquerade · #8 17-06-2020, 02:49

Total start size: 15.7GB

Compress using following method:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 6.40GB

Tools used by: ProFrager, Bulat Zignashin

Masquerade · #9 17-06-2020, 05:38

Total start size: 553mb

Compress as follows:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 303mb

Tools used by: ProFrager, Bulat Ziganshin

Masquerade · #10 17-06-2020, 07:17

Total start size: 3.76GB

Compress using the following method:

*.bmp

Code:

msc:bmp=1:bmf=9+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

*.wav
Code:
```
msc:wav=1:tak=9+srep:a2:m5f:l512
```
*.ogg
Code:
```
oggre
```
*.mp3
Code:
```
mpz
```

Everything else:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 2.04GB

Tools used by ProFrager, Bulat Ziganshin

Masquerade · #11 18-06-2020, 05:17

Total Start Size: ~5.50GB

Compress using following method:

Code:

xtool:e:precomp:t100p:zlib+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 2.41GB

Note: Using a chunk size of 128m in XTool causes it to get stuck eventually. I used default size 16m and everything ran smooth

Masquerade · #12 21-06-2020, 05:43

Ripped: _supersecret.rar

Total start size: 19.9GB

Compress using following method:

*.ogg
Code:
```
oggre
```

*.png

Code:

xtool:e:precomp:zlib+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

*.jpg
Code:
```
packjpg
```

*.bmp

Code:

msc:bmp=1:bmf=9+srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Everything else:

Code:

srep:a2:m5f:l512+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d64m:fba4096

Total packed size: 8.01GB

Tools used by: Razor12911, Bulat Ziganshin, ProFrager

KaktoR · #13 26-06-2020, 03:01

Quote:

Originally Posted by KaktoR

Yet another piece of bloatware shit with at least 40% patch files just like KCD and some others...

Metro Exodus
1 Language

Code:

vfxrec+srep:m3f+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

13:08:09 - Starting Archive Creation. 
16:32:45 - Archive Creation Complete. 

Input Size: 75.04 GB. 
Output Size: 50.98 GB.

PS: At least content_07_sounds_XX.vfs0 and patch_02_sounds_uk.vfs0 contain ogg streams. Compress with oggre is easy, decompress is tricky.

Example for patch_02_sounds_uk.vfs0

Code:

Compressed 1 file, 638,939,169 => 522,221,038 bytes. Ratio 81.73%
Compression time: cpu 1.02 sec/real 220.64 sec = 0%. Speed 2.90 mB/s
All OK

Extracting 1 file, 638,939,169 bytes. Processed 100%
.....
....
..
Extracting just like forever, output is after 5 minutes over 10GB in size, so obviously broken.

Another one with lolz:dtb1:mtt1:mt6:d128m:mc1023 instead of 4x4:lzma

Code:

20:57:01 - Starting Archive Creation. 
11:24:34 - Archive Creation Complete. 

Input Size: 75.04 GB. 
Output Size: 47.92 GB.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (30-06-2020)

The Following 2 Users Say Thank You to Masquerade For This Useful Post:
JustFun (30-06-2020), ScOOt3r (21-06-2021)

The Following User Says Thank You to Masquerade For This Useful Post:
JustFun (30-06-2020)

The Following 5 Users Say Thank You to Masquerade For This Useful Post:
ARTEMiS14 (01-08-2020), fabrieunko (10-06-2022), ffmla (15-06-2020), JustFun (30-06-2020), mausschieber (15-06-2020)

The Following 3 Users Say Thank You to Masquerade For This Useful Post:
devil777 (05-03-2021), dixen (17-06-2020), JustFun (30-06-2020)

The Following 3 Users Say Thank You to Masquerade For This Useful Post:
dixen (18-06-2020), JustFun (30-06-2020), ScOOt3r (08-08-2021)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
alexachu (26-06-2020), JustFun (30-06-2020), L33THAK0R (29-04-2021)