Best Compression Methods for 'Specific' Games. Q&A

[L33THAK0R]

Foreword: Thought I'd just post some of the more interesting projects in one large post rather than clog up the forums. Mainly to demonstrate that existing published results are able, (in some cases quite easily) to be improved outside of pure chance through non-deterministic algorithms. That being said, I'm still very much an amateur (see the "A Plague Tale: Requiem" & "Dead Island 2" entries), and despite my current knowledge and skill set, I still have plenty of room to learn and improve.

Red Dead Redemption (PC Port)

Details:

• Source: Clean Steam Files
• Build 16471194
• Original Size: 8.88 GiB
• Final Size : 5.16 GiB (Incl. Installer)
• Ripped Files: None

Internal Tools used:

• Xtool v0.5.3 (Codecs: reflate, zlib, zstd)
• Srep
• Lolz

External Tools used:

• None

Additional notes:

Unable to process audio, in the original console releases there were a few hundred MiB of Bink1 video embedded, in the form of a projector film. I was unable to isolate these videos in the PC release.

/////////////////////////////////

Dead Island 2

Details:

• Source: Clean Steam Files
• Build 20514355
• Original Size: 70.79/71.09 GiB
• Final Size : 47.90/48.20 GiB (Incl. Installer)
• Ripped Files: 2160p/1080p Video

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib, unreal, oodle)
• Srep
• Lolz

External Tools used:

• None

Additional notes:

Was lazy with this one due to juggling more interesting projects at the time, did not process Wwise audio.

/////////////////////////////////

The Darkness II

Details:

• Source: Clean Steam Files
• Build 11598
• Original Size: 6.70 GiB
• Final Size : 4.44 GiB (Incl. Installer)
• Ripped Files: Non EN Loc.

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• MSC
• Srep
• Lolz

External Tools used:

• None

Additional notes:

None.

/////////////////////////////////

Dark Souls Remastered

Details:

• Source: Clean Steam Files
• Build 9694186
• Original Size: 6.86 GiB
• Final Size : 4.03 GiB (Incl. Installer)
• Ripped Files: Non EN Loc.

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• MSC
• Srep
• Lolz
• Bpk

External Tools used:

• None

Additional notes:

None.

/////////////////////////////////

Dying Light - The Following (Definitive Edition)

Details:

• Source: Clean GOG Files
• Version 1.54.0
• Original Size: 27.6 GiB
• Final Size : 12.9 GiB (Incl. Installer)
• Ripped Files: Non EN Loc., Optional Main Menu Promo Videos

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• Oggre
• Srep
• Lolz
• Bpk

External Tools used:

• HDiffZ

Additional notes:

To process all OGG Vorbis audio you will need to patch some archives.

/////////////////////////////////

Heavy Rain

Details:

• Source: Clean Steam Files
• Build 5236766
• Original Size: 31.70 GiB
• Final Size : 7.88 GiB (Incl. Installer)
• Ripped Files: Non EN Loc., Optional BTS Video

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• MSC
• Srep
• Lolz
• Bpk

External Tools used:

• Mparallel
• SFK

Additional notes:

Audio can be processed with MSC, however not all streams are valid, you will need to generate a database and rip the extracted streams. As assets are only compressed and not encrypted, I recommend ripping the compressed streams processed seperateley, diffing the individual streams and patching these compressed streams post-install, if you don't care for the end-user's write-endurance you can just brute force it with less elegant methods. Same method applies for ripping localised content. Additional Bink1 videos are also embedded within the main data containers.

/////////////////////////////////

The Last of Us: Part I

Details:

• Source: Clean Steam Files
• Build 17034831
• Original Size: 62.8 GiB
• Final Size : 38.4 GiB (Incl. Installer)
• Ripped Files: Non EN Loc., Optional BTS Video, Credits

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib, oodle, psarc)
• Srep
• Lolz

External Tools used:

• None

Additional notes:

None.

/////////////////////////////////

Lorelei and the Laser Eyes

Details:

• Source: Clean Steam Files
• Build 15691260
• Original Size: 1.180 GiB
• Final Size : 0.535 GiB (Incl. Installer)
• Ripped Files: None

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• Srep
• Lolz

External Tools used:

• None

Additional notes:

None.

/////////////////////////////////

A Plague Tale: Requiem

Details:

• Source: Clean GOG Files
• Build 56580004591411255
• Original Size: 49.4 GiB
• Final Size : 24.3 GiB (Incl. Installer)
• Ripped Files: Non EN Loc.

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• Srep
• Lolz

External Tools used:

• SFK
• Mparallel
• Oggre (Wwise)

Additional notes:

PCK & BNK archives were processed, localised content is compressed within archives, rip streams using a database. See my "A Plague Tale: Innocence" results for more information.

/////////////////////////////////

Total War: Three Kingdoms

Details:

• Source: Scene Release
• Build 10356423
• Original Size: 39.5 GiB
• Final Size : 15.6 GiB (Incl. Installer)
• Ripped Files: Non EN Loc.

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• Srep
• Lolz

External Tools used:

• SFK
• Mparallel
• Oggre (Wwise)

Additional notes:

Audio was processed externally, and patched post-install.

/////////////////////////////////

Trials Rising

Details:

• Source: Scene Release
• Build 10831717
• Original Size: 25.92 GiB
• Final Size : 15.83 GiB (Incl. Installer)
• Ripped Files: Non EN Loc. Videos

Internal Tools used:

• Xtool v0.8.9 (Codecs: reflate, zlib)
• Srep
• Lolz
• Bpk

External Tools used:

• None

Additional notes:

Wasn't able to extract audio for this title, it's one of the less documented "Trials" titles, tried a variety of solutions but no luck. Potentially future attempts could see some gains if audio is processed.