FileForums - Best Compression Methods for 'Specific' Games. Q&A

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

Thank you for your time KaktoR, it seems the developers have gone extra lengths to implement custom scheme to ensure that no one can mod the game easily.. :(
Regards

It'd probably be easier to unpack + repak the game data.

CODE VEIN 2
JP audio ripped.
Movie files are encrypted for some reason so just use something fast on them. No need to waste time.

Code:

 00:06:12 - Selected ARC/DS method for Data1a-01.bin was: xtool:d1:c128mb:mue5,k0x6B17F169C7C367C7C277987FDAE44185ED4D9CFC2D94F012E5A8110A8FDDF227:mmermaid:mkraken:core_2.9.10:lib_2:dd3:l10,d128mb

 00:06:12 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 05:25:28 - Overall input size: 62,39 GB

 05:25:28 - Overall output size: 43,95 GB (Ratio 70.44%)

 05:25:28 - Overall conversion time: 05:19:13

For future repacks RE: Requiem

zstdrec (or Xtool:mzstd:l11) + libzstd.dll v1.44

Desynced:

Quote:

Data1(*.pak) : xtool:c64mb:mzlib:dd3+LOLZ_NORMAL
Data2(*.zip) : precomp+xtool:mflac,l8:mpng:d1:dd3+LOLZ_NORMAL
Data3(other): xtool:mreflate:dd3+razor_stdio

GreedFall: The Dying World

GreedFall: The Dying World (deluxe edition, 63.8gb)

Quote:

Data1 : xtool:c64mb:d1:df20p:mzlib:mpng:d1:mbrunsli+srep_n ew:490g+LOLZ_NORMAL
Data2 : xtool:mzlib:mreflate+srep_new:490g+razor_mtx

Data1 = .spk .stc .pgz
Data2 = other

final size around 45gb

Is it safe to remove mp001-mp009 and patchpack_mp001,patchpack_mp003,patchpack_mp006 folders from RDR2 or are they needed for sp as well ?

A small note on RE 9.
PAK files with the prefix _sub_ use gdeflate instead of zstd and xtool barely works with this

Test re_dlc_stm_3990820.pak.sub_000.pak

Quote:

Streams: 487 / 3017
Time: 00:00:23 (CPU 00:02:18)

Size: 789 MB >> 789 MB

100%
Errorlevel=0
Compressed 1 file, 827,159,225 => 827,538,089 bytes. Ratio 100.05%
Compression time: cpu 0.75 sec/real 25.88 sec = 3%. Speed 31.96 mB/s
All OK

with -mlibgdeflate same result.

https://drive.google.com/file/d/1j6s...ew?usp=sharing

Styx: Blades of Greed
It has encryption
k0xD9BCBAC009D6881140AF8721394E0C9A40428A9A213AC5F 39FA4CBF88FE18772

but unreal.dll doesn't work; decompression doesn't occur. Maybe it's not oodle that's being used, but something else
Can anyone help? I'm attaching the example files.

https://drive.google.com/file/d/1zdg...usp=drive_link

The key is wrong.

The correct key is

Code:

0x40428A9A213AC5F39FA4CBF88FE18772D9BCBAC009D6881140AF8721394E0C9A

Use mermaid+kraken
Use library 2.9.10 (2)

Death Stranding 2: On the Beach

Need help for best method for Death Stranding 2: On the Beach

Here is a sample
https://gofile.io/d/odZGfN

If it's anything like the first entry I'm going to guess encryption + oodle, best bet would be wait for a foss tool to release that tackles the former. Will hopefully be an interesting title to tackle.

I used dstorage method on this and got 80.7 GB it compressed nicely, the OLDER methods for death stranding do not work anymore

ScOOt3r

Quote:

Originally Posted by ScOOt3r (Post 509627)

I used dstorage method on this and got 80.7 GB it compressed nicely, the OLDER methods for death stranding do not work anymore

ScOOt3r

Details plz

Quote:

Originally Posted by KaktoR (Post 509617)

The key is wrong.

The correct key is

Code:

0x40428A9A213AC5F39FA4CBF88FE18772D9BCBAC009D6881140AF8721394E0C9A

Use mermaid+kraken
Use library 2.9.10 (2)

Many thanx:)

Quote:

Originally Posted by vanya (Post 509629)

Details plz

https://www.fileforums.com/showthrea...gin#post501722

Death Stranding 2 On The Beach

I think the good method is:

Quote:

xtool:c32mb:minsomniac,spiderman+xtool:dd3+LOLZ_NO RMAL

I'm searching how to extract audio to remove unused languages.

I'm not finished compression yet

Quote:

Originally Posted by wareck (Post 509647)

I think the good method is:

I'm searching how to extract audio to remove unused languages.

I'm not finished compression yet

https://steamdb.info/app/3280350/depots/

Example French audio: https://steamdb.info/depot/3280356/

Edit:
package.43.00.core.stream + package.43.01.core.stream contain bink2 videos you can compress, in total 326MB.

For RDR2 should i use the oo2core_5_win64.dll from the game or another one ? Also how did fitgirl get to 68 GB ?:confused:

Also, Is it safe to remove mp files ?

^^
Red Dead Redemption 2 is encrypted, you need to find a way to decrypt it. And no, you cannot rip multiplayer files.

Quote:

Originally Posted by Masquerade (Post 509665)

^^
Red Dead Redemption 2 is encrypted, you need to find a way to decrypt it. And no, you cannot rip multiplayer files.

Got it, thanks :)

Street Fighter 6
Removed JP language.

Code:

 06:29:20 - Selected ARC/DS method for Data1a-01.bin was: xtool:dd3:l10,d128mb

 06:29:20 - Selected ARC/DS method for Data1b-01.bin was: xtool:mzstd,l11:zstd_120+xtool:c128mb:mzlib:dd3:l10,d128mb

 06:29:20 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 10:03:24 - Overall input size: 98,93 GB

 10:03:24 - Overall output size: 60,91 GB (Ratio 61.56%)

 10:03:24 - Overall conversion time: 03:34:03

Edit:

Code:

 00:32:37 - Overall input size: 100,25 GB

 00:32:37 - Overall output size: 60,75 GB (Ratio 60.61%)

 00:32:37 - Overall conversion time: 03:53:38

Sniper : Ghost Warrior [Gold Edition] [2013]

Code:

Game Version : 1.2



Ripped - Re-encoded Files : Nothing



Original Size : 7 GB



Compressed Size : 1.36 GB



Install Time : 5 Minutes (Depends your system)



Method : xt_zlib+srep:m3f+lzma

RV There Yet? v1.2.17120 - Steam

Original Size: 2.29 GB
Compress Size: 1.21 GB

Method:

Code:

*.bmp > msc+grzip:8388096b:m2:l2048:h15:a > 820kb = 194kb

*.ucas *.utoc *.pak > xtunreal+srep:m3f:a2+dispack070+lolz:d128m:mt4:mtt1:lmdf1 > 1.87gb = 1.19gb

* rest of the files > xprecomp+srep:m3f:a2+dispack070+lolz:d128m:mt4:mtt1:lmdf1 > 587mb = 116mb

Thanks to @wrathma for providing the oodle library for XTool.

Quote:

Originally Posted by Carldric Clement (Post 509740)

P.S: the ucas and utoc file was difficult to compress even that I have the unreal plugin for XTool. If someone manage to decrypt, that would be useful to reduce the size. Thanks

you might have used the wrong oodle library. try the one i attached. here are my compression results -

*.ucas *.utoc *.pak -> xt_unreal+msc:raw+srep+lolz
1.70gb => 1.10gb

everything else -> dispack070+delta+rzs
393mb => 119mb

overall size 2.08gb
compressed size 1.21

edit: xt_unreal is xtool -mkraken+mermaid, you dont need unreal.dll and you can skip msc:raw it gives about 50mb difference.

Quote:

Originally Posted by darkwolves (Post 469106)

WWE 2K19
the oodle precompressor from Razor12911 was used in this repack
https://fileforums.com/showthread.php?t=102453

method
converted all bk2 to bik with a bk2 file extension so the game recognizes it
and to avoid bpk compression errors bitrate is the same so the video is lossless due to that
oo2reck+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt 1:mt4:d100m:tt4 h14:fba4096:mc1023:bc8:blr8:bm
on main game files
bpk on bk2 files
original size 44gb
repack size 29.gb

I know this is old but... I took a look on this and was surprised that you have precompressed this game with such a method.

I used the same as you did and after 3 hours I was into 30%... still precompression stage of course.

I know this game is old and no ass will repack this ever anymore but whatever.

So I looked up the game files and came to the following conclusion:
The game is shipped with oo2core_6_win64.dll which is v2.6.0 but some of the game files were compressed with a different oodle version, namely v2.5.3. You cannot precompress some of the files with shipped library. You will get 0 streams precompressed, plus it takes a long time.
So I wrote a quick xtool plugin.
I think all the files are compressed with kraken level6 (I am not in the mood to look up over 20k files, so I assume all the files are compressed with kraken level6).

Some examples.

Code:

-mwwe2k19

Streams: 809 / 809

Time: 00:00:26 (CPU 00:02:24)



Size: 353 MB >> 0,99 GB



Done!!!



-mkraken:l6

Streams: 498 / 802

Time: 00:01:33 (CPU 00:08:07)



Size: 353 MB >> 921 MB



Done!!!

Code:

-mkraken

Compressed 109 files, 1,866,438,656 => 3,240,060,056 bytes. Ratio 173.60%

Compression time: cpu 1.50 sec/real 327.79 sec = 0%. Speed 5.69 mB/s

All OK



-mwwe2k19

Compressed 109 files, 1,866,438,656 => 3,327,328,916 bytes. Ratio 178.27%

Compression time: cpu 1.69 sec/real 166.69 sec = 1%. Speed 11.20 mB/s

All OK

I said that some of the files are packed with a different oodle version, namely v2.5.3.
So you have to use two libraries at once to get probably all the streams.

Example:

Code:

xtool:mwwe2k19:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mwwe2k19:oodleoo2core_6_win64.dll:core_2.6.0



Compressed 1 file, 746,374,144 => 4,560,712,728 bytes. Ratio 611.05%

Compression time: cpu 0.88 sec/real 96.40 sec = 1%. Speed 7.74 mB/s

All OK



xtool:mkraken:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mkraken:oodleoo2core_6_win64.dll:core_2.6.0



Compressed 1 file, 746,374,144 => 3,790,919,089 bytes. Ratio 507.91%

Compression time: cpu 1.05 sec/real 296.24 sec = 0%. Speed 2.52 mB/s

All OK

I did not tested this with the full game. If anyone wants to dig deeper then there you go.

Edit: I guess it's better to first use the higher library, then the lower (2.6.0 -> 2.5.3).

Code:

[Stream1]

Name=wwe2k19

Codec=kraken:l6

BigEndian=0

Signature=0x4E4B524B

Structure=Signature(4),DSize(4),CSize(4),OodleHdr(2),Stream

StreamOffset=-2

CompressedSize=CSize

DecompressedSize=DSize

Condition1=OodleHdr = 0x068C

Condition2=CSize > 64

Edit:

Code:

 23:28:40 - Selected ARC/DS method for Data1a-01.bin was: xtool:c32mb:mkak,wwe2k19:oodleoo2core_6_win64.dll:core_2.6.0+xtool:mkak,wwe2k19:oodleoo2core_5_win64.dll:core_2.5.3:dd3:l10,d128mb

 23:28:40 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 23:28:40 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 02:46:23 - Overall input size: 57,32 GB

 02:46:23 - Overall output size: 32,91 GB (Ratio 57.41%)

 02:46:23 - Overall conversion time: 03:17:40

Processed wwise too.
Install time was 1h40min

i am trying to compress this ue4 game released on 2024 called The Black Within, but using xtool with oodle 2.9.11-12 cant decompress all streams. also i dont think the pak is encrypted. here is a 200mb sample+game exe if anyone would like to help me with it.

Code:

XTool is created by Razor12911



Version 0.9.4



Streams: 535 / 1991

Time: 00:01:53 (CPU 00:14:18)



Size: 200 MB >> 211 MB



Done!!!

edit: even tho it was released in 2024 it uses a old oodle version from 2021. using oodle 2.9.5 decompresses all streams.

It worked with oo2core_8_win64.dll

Quote:

Version 0.9.5

Streams: 1987 / 1991
Time: 00:00:28 (CPU 00:02:44)

Size: 200 MB >> 363 MB

100%
Errorlevel=0
Compressed 1 file, 209,715,200 => 380,252,220 bytes. Ratio 181.32%
Compression time: cpu 0.25 sec/real 31.96 sec = 1%. Speed 6.56 mB/s
All OK

Quote:

Originally Posted by dixen (Post 509793)

It worked with oo2core_8_win64.dll

yeah i tried every oodle dll from 2.9.5 to 2.9.12, only 2.9.5 can decompress all 1991 detected streams.

Code:

XTool is created by Razor12911



Version 0.9.4



Streams: 1991 / 1991

Time: 00:00:25 (CPU 00:02:54)



Size: 200 MB >> 363 MB



Done!!!

UE4 games mostly use 2.9.5 if they are compressed with oodle, while UE5 use a variety of different libraries, mostly 2.9.10.

Starfield - Terrain01.ba2

3.9 GB >> 95 GB..Hm
Bug?

GRID Legends

Code:

 16:33:28 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd,l22:zstd_145:dd3:l10,d128mb

 16:33:28 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 16:33:28 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 19:27:25 - Overall input size: 35,41 GB

 19:27:25 - Overall output size: 26,67 GB (Ratio 75.32%)

 19:27:25 - Overall conversion time: 02:53:55

There is still room for improvement.
Installation time will take a long time (over 1 hour) due to high zstd level.

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance :)

Quote:

Originally Posted by Dunnowho69 (Post 509813)

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance :)

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

got this !

"ERROR: general (de)compression error in srep:m3f" how do i fix it ? thx for help!

Avatar Frontiers of Pandora
Nothing ripped.
Extracted and processed wwise audio aswell as bink videos.

Code:

 21:47:06 - Selected ARC/DS method for Data1a-01.bin was: xtool:mmermaid:core_2.9.10:lib_2:dd3:l10,d128mb

 21:47:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 21:47:06 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 04:58:41 - Overall input size: 149,17 GB

 04:58:41 - Overall output size: 93,02 GB (Ratio 62.36%)

 04:58:41 - Overall conversion time: 07:11:31

Install time was about 1 hour

Pragmata
Compression same like RE9, like in dixen's post

Quote:

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

Game size: 34.65 GB
Compression size: 26.5 GB

Crimson Desert
Looks like there is no worth mentioning compression.
Extracted and processed Wwise audio

Code:

 09:53:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 12:39:04 - Overall input size: 126,09 GB

 12:39:04 - Overall output size: 73,57 GB (Ratio 58.35%)

 12:39:04 - Overall conversion time: 02:45:36

Black myth Wukong

work in progress ...

Data1.bin (*.pak excepted pakchunk10-Windows.pak pakchunk16-Windows.pak)

Quote:

xtool:mkraken:core_2.9.5:dd3+LOLZ_NORMAL

and maybe better with aes :

Quote:

xtool:c32mb:d1:mue4,k0xA896068444F496956900542A215 367688B49B19C2537FCD2743D8585BA1EB128+xtool:mkrake n:9:dd3+LOLZ_NORMAL

For data2 and data3:
pakchunk10-Windows.pak have a lot of small wem files. not very efficient with wemtool.
better to compress with razor than lolz.

Quote:

xtool:mkraken:core_2.9.5:dd3+razor_mtx

pakchunk16-Windows.pak is several bink2 videos who are not compressible with binkpack.
easy way is to again use razor

Quote:

xtool:mkraken:core_2.9.5:dd3+razor_mtx

I'm working on extract bk2 form this .pak to makes a process with lolz and bk2 with other compressor.
but due to AES i cant' use xtool/ringi/mesa to extract/recover files.
I'm working with a bms script in attachment

Try quickbms reimport -w -r