FileForums - Best Compression Methods for 'Specific' Games. Q&A

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

Quote:

Originally Posted by darkwolves (Post 469106)

WWE 2K19
the oodle precompressor from Razor12911 was used in this repack
https://fileforums.com/showthread.php?t=102453

method
converted all bk2 to bik with a bk2 file extension so the game recognizes it
and to avoid bpk compression errors bitrate is the same so the video is lossless due to that
oo2reck+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt 1:mt4:d100m:tt4 h14:fba4096:mc1023:bc8:blr8:bm
on main game files
bpk on bk2 files
original size 44gb
repack size 29.gb

I know this is old but... I took a look on this and was surprised that you have precompressed this game with such a method.

I used the same as you did and after 3 hours I was into 30%... still precompression stage of course.

I know this game is old and no ass will repack this ever anymore but whatever.

So I looked up the game files and came to the following conclusion:
The game is shipped with oo2core_6_win64.dll which is v2.6.0 but some of the game files were compressed with a different oodle version, namely v2.5.3. You cannot precompress some of the files with shipped library. You will get 0 streams precompressed, plus it takes a long time.
So I wrote a quick xtool plugin.
I think all the files are compressed with kraken level6 (I am not in the mood to look up over 20k files, so I assume all the files are compressed with kraken level6).

Some examples.

Code:

-mwwe2k19

Streams: 809 / 809

Time: 00:00:26 (CPU 00:02:24)



Size: 353 MB >> 0,99 GB



Done!!!



-mkraken:l6

Streams: 498 / 802

Time: 00:01:33 (CPU 00:08:07)



Size: 353 MB >> 921 MB



Done!!!

Code:

-mkraken

Compressed 109 files, 1,866,438,656 => 3,240,060,056 bytes. Ratio 173.60%

Compression time: cpu 1.50 sec/real 327.79 sec = 0%. Speed 5.69 mB/s

All OK



-mwwe2k19

Compressed 109 files, 1,866,438,656 => 3,327,328,916 bytes. Ratio 178.27%

Compression time: cpu 1.69 sec/real 166.69 sec = 1%. Speed 11.20 mB/s

All OK

I said that some of the files are packed with a different oodle version, namely v2.5.3.
So you have to use two libraries at once to get probably all the streams.

Example:

Code:

xtool:mwwe2k19:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mwwe2k19:oodleoo2core_6_win64.dll:core_2.6.0



Compressed 1 file, 746,374,144 => 4,560,712,728 bytes. Ratio 611.05%

Compression time: cpu 0.88 sec/real 96.40 sec = 1%. Speed 7.74 mB/s

All OK



xtool:mkraken:oodleoo2core_5_win64.dll:core_2.5.3+xtool:mkraken:oodleoo2core_6_win64.dll:core_2.6.0



Compressed 1 file, 746,374,144 => 3,790,919,089 bytes. Ratio 507.91%

Compression time: cpu 1.05 sec/real 296.24 sec = 0%. Speed 2.52 mB/s

All OK

I did not tested this with the full game. If anyone wants to dig deeper then there you go.

Edit: I guess it's better to first use the higher library, then the lower (2.6.0 -> 2.5.3).

Code:

[Stream1]

Name=wwe2k19

Codec=kraken:l6

BigEndian=0

Signature=0x4E4B524B

Structure=Signature(4),DSize(4),CSize(4),OodleHdr(2),Stream

StreamOffset=-2

CompressedSize=CSize

DecompressedSize=DSize

Condition1=OodleHdr = 0x068C

Condition2=CSize > 64

Edit:

Code:

 23:28:40 - Selected ARC/DS method for Data1a-01.bin was: xtool:c32mb:mkak,wwe2k19:oodleoo2core_6_win64.dll:core_2.6.0+xtool:mkak,wwe2k19:oodleoo2core_5_win64.dll:core_2.5.3:dd3:l10,d128mb

 23:28:40 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 23:28:40 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 02:46:23 - Overall input size: 57,32 GB

 02:46:23 - Overall output size: 32,91 GB (Ratio 57.41%)

 02:46:23 - Overall conversion time: 03:17:40

Processed wwise too.
Install time was 1h40min

i am trying to compress this ue4 game released on 2024 called The Black Within, but using xtool with oodle 2.9.11-12 cant decompress all streams. also i dont think the pak is encrypted. here is a 200mb sample+game exe if anyone would like to help me with it.

Code:

XTool is created by Razor12911



Version 0.9.4



Streams: 535 / 1991

Time: 00:01:53 (CPU 00:14:18)



Size: 200 MB >> 211 MB



Done!!!

edit: even tho it was released in 2024 it uses a old oodle version from 2021. using oodle 2.9.5 decompresses all streams.

It worked with oo2core_8_win64.dll

Quote:

Version 0.9.5

Streams: 1987 / 1991
Time: 00:00:28 (CPU 00:02:44)

Size: 200 MB >> 363 MB

100%
Errorlevel=0
Compressed 1 file, 209,715,200 => 380,252,220 bytes. Ratio 181.32%
Compression time: cpu 0.25 sec/real 31.96 sec = 1%. Speed 6.56 mB/s
All OK

Quote:

Originally Posted by dixen (Post 509793)

It worked with oo2core_8_win64.dll

yeah i tried every oodle dll from 2.9.5 to 2.9.12, only 2.9.5 can decompress all 1991 detected streams.

Code:

XTool is created by Razor12911



Version 0.9.4



Streams: 1991 / 1991

Time: 00:00:25 (CPU 00:02:54)



Size: 200 MB >> 363 MB



Done!!!

UE4 games mostly use 2.9.5 if they are compressed with oodle, while UE5 use a variety of different libraries, mostly 2.9.10.

Starfield - Terrain01.ba2

3.9 GB >> 95 GB..Hm
Bug?

GRID Legends

Code:

 16:33:28 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd,l22:zstd_145:dd3:l10,d128mb

 16:33:28 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 16:33:28 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 19:27:25 - Overall input size: 35,41 GB

 19:27:25 - Overall output size: 26,67 GB (Ratio 75.32%)

 19:27:25 - Overall conversion time: 02:53:55

There is still room for improvement.
Installation time will take a long time (over 1 hour) due to high zstd level.

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance :)

Quote:

Originally Posted by Dunnowho69 (Post 509813)

https://gofile.io/d/PM6spx

This is from RE9. Can anyone share the best compression method for this ? Thanks in advance :)

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

got this !

"ERROR: general (de)compression error in srep:m3f" how do i fix it ? thx for help!

Avatar Frontiers of Pandora
Nothing ripped.
Extracted and processed wwise audio aswell as bink videos.

Code:

 21:47:06 - Selected ARC/DS method for Data1a-01.bin was: xtool:mmermaid:core_2.9.10:lib_2:dd3:l10,d128mb

 21:47:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:lm:c1792mb:mbik:mbk2:df20p

 21:47:06 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 04:58:41 - Overall input size: 149,17 GB

 04:58:41 - Overall output size: 93,02 GB (Ratio 62.36%)

 04:58:41 - Overall conversion time: 07:11:31

Install time was about 1 hour

Pragmata
Compression same like RE9, like in dixen's post

Quote:

-mxtool:zstd:l11+gdeflate (libzstd.dll v1.44).
Needed Xtool 0.9.5

Game size: 34.65 GB
Compression size: 26.5 GB

Crimson Desert
Looks like there is no worth mentioning compression.
Extracted and processed Wwise audio

Code:

 09:53:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 12:39:04 - Overall input size: 126,09 GB

 12:39:04 - Overall output size: 73,57 GB (Ratio 58.35%)

 12:39:04 - Overall conversion time: 02:45:36

Black myth Wukong

work in progress ...

Data1.bin (*.pak excepted pakchunk10-Windows.pak pakchunk16-Windows.pak)

Quote:

xtool:mkraken:core_2.9.5:dd3+LOLZ_NORMAL

and maybe better with aes :

Quote:

xtool:c32mb:d1:mue4,k0xA896068444F496956900542A215 367688B49B19C2537FCD2743D8585BA1EB128+xtool:mkrake n:9:dd3+LOLZ_NORMAL

For data2 and data3:
pakchunk10-Windows.pak have a lot of small wem files. not very efficient with wemtool.
better to compress with razor than lolz.

Quote:

xtool:mkraken:core_2.9.5:dd3+razor_mtx

pakchunk16-Windows.pak is several bink2 videos who are not compressible with binkpack.
easy way is to again use razor

Quote:

xtool:mkraken:core_2.9.5:dd3+razor_mtx

I'm working on extract bk2 form this .pak to makes a process with lolz and bk2 with other compressor.
but due to AES i cant' use xtool/ringi/mesa to extract/recover files.
I'm working with a bms script in attachment

Try quickbms reimport -w -r