Watch_Dogs

Full game will ALL languages and ALL DLC content.

Redists and UPlay installer ripped - they are completely unneeded if NoCD is applied.

Requires latest XTool with Watch_Dogs Database and XCompress Plugin thanks to Razor12911.

Requires QuickBMS thanks to Luigi Auriemma and Dunia Engine script.

Thanks to Nicolas Comerci for precomp stdio fork.

Do not use Oggre on the vorbis audio. Encoding is fine, but the decoder will crash.

Conversion Structure:

• Archive 1: *.DAT (all except sound.dat, language dats and videos.dat)
• Archive 2: All remaining files (binaries and misc documents, *.FAT except language fats)
• Archive 3: Bink Videos listed below (pre-packed with BPK)
• Archive 4: Videos.dat with BPK compatible videos removed
• Archive 5: Sound.dat + English FATs/DATs
• Remaining Language Archives: FATs/DATs for extra Non-English languages.

Compress with the following:

• Archive 1:
  
  Code:

  ---

  xtool_mwatchdogs_dedup5+lolz

  ---

• Archive 2:
  
  Code:

  ---

  precomps+srep+lolz

  ---

• Archive 3:
  • Extract the videos.dat with QuickBMS. Use XTool erase command to erase the following videos from the dat:
    
    Code:

    ---

    0000000000000000.kb2
0000000000000001.kb2
0000000000000003.kb2
0000000000000005.kb2
0000000000000007.kb2
000000000000000a.kb2
000000000000000b.kb2
000000000000000d.kb2
000000000000000f.kb2
0000000000000012.kb2
0000000000000018.kb2
000000000000001a.kb2
000000000000001c.kb2
000000000000001d.kb2
000000000000001f.kb2
0000000000000021.kb2
0000000000000022.kb2
0000000000000026.kb2
0000000000000028.kb2
0000000000000029.kb2
000000000000002b.kb2
000000000000002c.kb2
000000000000002e.kb2
0000000000000033.kb2
0000000000000035.kb2
0000000000000038.kb2
000000000000003b.kb2
000000000000003e.kb2
000000000000003f.kb2
0000000000000040.kb2
0000000000000041.kb2
0000000000000042.kb2
0000000000000045.kb2
0000000000000048.kb2
0000000000000049.kb2
000000000000004a.kb2
000000000000004b.kb2
000000000000004c.kb2
000000000000004d.kb2
000000000000004e.kb2
0000000000000051.kb2
0000000000000052.kb2
0000000000000053.kb2
0000000000000054.kb2
0000000000000055.kb2
0000000000000057.kb2
000000000000005e.kb2
000000000000005f.kb2
0000000000000060.kb2
0000000000000061.kb2
000000000000006b.kb2
000000000000006c.kb2
0000000000000072.kb2
0000000000000073.kb2
0000000000000075.kb2
0000000000000076.kb2
0000000000000078.kb2
000000000000007b.kb2
000000000000007e.kb2
0000000000000080.kb2
0000000000000081.kb2
0000000000000084.kb2
0000000000000086.kb2
0000000000000087.kb2
0000000000000089.kb2
000000000000008b.kb2
000000000000008e.kb2
0000000000000094.kb2
0000000000000095.kb2
0000000000000096.kb2
000000000000009a.kb2
000000000000009b.kb2
00000000000000a2.kb2
00000000000000a5.kb2
00000000000000a8.kb2
00000000000000aa.kb2
00000000000000ad.kb2
00000000000000ae.kb2
00000000000000b0.kb2
00000000000000b6.kb2
00000000000000b7.kb2
00000000000000b8.kb2
00000000000000ba.kb2
00000000000000bb.kb2
00000000000000bd.kb2
00000000000000c0.kb2
00000000000000c2.kb2
00000000000000c3.kb2
00000000000000ca.kb2
00000000000000cc.kb2
00000000000000cf.kb2
00000000000000d3.kb2
00000000000000d5.kb2
00000000000000d7.kb2
00000000000000d8.kb2
00000000000000da.kb2
00000000000000db.kb2
00000000000000dc.kb2
00000000000000e5.kb2
00000000000000e9.kb2
00000000000000ea.kb2
00000000000000eb.kb2
00000000000000ec.kb2
00000000000000f1.kb2
00000000000000f2.kb2
00000000000000f3.kb2
00000000000000f6.kb2
00000000000000fa.kb2
00000000000000fd.kb2
00000000000000fe.kb2
0000000000000101.kb2
0000000000000102.kb2
0000000000000104.kb2
000000000000010c.kb2
000000000000010d.kb2

    ---

  • Pack those videos with BPK (use CLS if you want, I used BPK executable version since I could MT it with mparallel). Those above videos don't require patching. The other videos from the dat get motion_data warning upon packing so packing those is impossible.
    
  • Pack Archive 3 with srep.
  
  
• Archive 4:
  
  Code:

  ---

  srep+LZMA2

  ---

• Archive 5:
  
  Code:

  ---

  rz

  ---

• Remaining Language Archives:
  
  Code:

  ---

  xtool_mwatchdogs+rz

(don't use xtool dedup since rz has built in dedup)

  ---

Final Size

One Piece Odyssey

One Piece Odyssey

Used CLS-UE4D library by Shegorat, but you can also use XTool by Razor12911 (method here by KaktoR).

The file "pakchunk10-WindowsNoEditor.pak" contains only CriMovie USM files so you can just Store this file or decrypt and dedup.

Remaining files:

Start Size: 29.2GB
Final Size: 22.7GB

Aquatico

Had a quick look so maybe I'm missing something obvious but are there any lossless compressors that support WaveForm "MS ADPCM" formatted audio? MSC only supports PCM formatted samples, and I got a feeling some substantial gains could be had if this format is able to be properly processed across a range of titles.

No afaik. ADPCM is a lossy format. You could try looking into this: https://monkeysaudio.com/

But it works in a similar way to Toms Lossless Audio Kompressor so then again it may do nothing.

A Variety of Results
 

All results include the installer's weight (usually between 4 - 9mb)

Avatar: The Game, James Cameron’s

3.31 GiB >>> 1.98 GiB

xtool 0.6.5 + srep + lolz

Batman: Arkham Knight

51.75 GiB >>> 26.2 GiB (Incl. Optional Videos + Lossless Videos) | 25.3 (Incl. Lossy Videos)

Note: In order to properly create lossy videos you have to extract the cue points from the appropriate USMs'. This process isn't tricky and only takes around a minute in an ideal setup however calculating the offsets and translating them into usable integers can take a hot minute. As I'm sure those who have done a similar job are aware this process can't be automated due to the lack of consistency that cue timings are stored within their appropriate headers, this was definitely more so a proof of concept considering the fact there are ~880 videos that require cue point decoding.

xtool (I forgot to document the version I used, since I did this one back in mid 2020) + uelr + srep + lolz

Far Cry 2 (Fortunes Edition)

3.27 GiB >>> 1.62 GiB

delzorec + srep + lolz

Just Cause 2

4.08 GiB >>> 1.00 GiB

Note: Final size could've been smaller (~950MiB) but I included a couple dozen QoL fixes that added a bit of weight in additional texture data.

xtool 0.3.21 + msc + srep + lolz

Mad Max

32.88 GiB >>> 3.55 GiB (Incl. Lossless Videos) | 3.50 GiB (Incl. Lossy Videos)

Note: Lossy videos were definitley just an experiement, 1080p Bink2 videos rescaled to 720p Bink1, even at 99% the target filesize look like dog-shit. Honestly just wanted to see how small I could get things. There is potential room for improvement if someone can pack the ~900 MiB of dialogue thats packed into one of the Banks, but it's encoded in a format that I can't seem to process, or even losslessly transform to and from a packable format.

xtool 0.3.21 + oggre + srep + lolz

The Surge

21.78 GiB >>> 3.86 GiB (720p Lossless Videos) | 3.72 GiB (720p Lossy Videos)

Note: 1080p + 720p videos both exist in the original game files, I just chose to present 720p for the results as its the smallest, valid, lossless size. Use a LZ4 library to recompress, I got pretty similar results accross a good dozen or so libraries, but some streams were still dropped, I'd encourage people to investigate further but I honestly spent too much time on this series for me to justify spending any more time testing is tricky.

xtool 0.3.21 + oggre + srep + lolz

-----------------------------------------------

I would post more, but these are just the most interesting results I've gotten. I've managed to beat a fair few records posted both here and by other repackers on their own websites but only by using more modern methods and by managing to process troublesome blocks of data by patching out the offending data.

@L33THAK0R
Would love it if you could make a post detailing more about the Cue points in the USM videos. I believe it would truly be a valuable resource.

Project Zomboid v41.78.12
 

Original Size: 6.82 GB
Compressed Size: 1.68 GB

Option:

Sid Meier's Civilization VI
v1.0.12.31 (19 January 2023), all DLC, OST ripped

hi

i try precomp Steel Division 2

use xtool reflate but still got CRC error when decomp

any info for solve ?

thanks

Exclude those files from precomp process. I did it,too.

Try with compatibility with Windows 7
Or use XTool 0.2. (It works well with ZLib's strange streams.):D

Far Cry 4 Gold Edition (1.10)
 

Sound*
*.DAT
Other Files

Far Cry 4 Gold Edition (v1.10)
 

27.30 GiB >>> 10.9 GiB (Incl. Lossless Videos + Ripped Startup Videos, weighing in at ~40 MiB)

DELZORec + srep + lolz

Note: BPK can't be used as these are the "g" revision of the Bink2 codec. Ripped files include any included redists and non-English loc., as well as the startup video.

It's interesting to see that @Gehrman managed to get MSC working with the by just using the RAW detection, I'll give it a shot myself to see if any further gains can be had.