Best Compression Methods for 'Specific' Games. Q&A - Page 210

Masquerade · #1 08-02-2023, 09:28

Epic Games owns Unreal Engine and Rad Tools so its a free for all when it comes to Unreal Engine games using Bink Video and Oodle compression. The latest Bink version is KB2n so it's this year that BPK will be obsolete for newer titles.

-tara · #2 12-02-2023, 04:15

Bright Memory: Infinite

Code:

*.pak
xtool(zlib)+srep+lolz
(58.60% Ratio)

*.png
precompmt+srep+lolz
(79.57% Ratio)

*.mp4
srep
(99.97% Ratio)

rest
razor
(16.73% Ratio)


Size Before - 10.8 GB			After - 6.36 GB (58.88% Ratio)
CT: 6 hours and 20 minutes		DT: 9 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Fallout New Vegas Ultimate Edition

Code:

*.bsa
xtool(zlib)+srep+lolz
(54.5% Ratio)

FNVIntro.bik
bpk
(77.8% Ratio)

*.mp3
mpz (Multithread this with PMT/MTX)
(81.4% Ratio)

MailTitle.wav
msc (You can skip this however, its just 6 MB and can be passed to rz for simular result)

rest
razor
(60.1% Ratio)


Size Before - 9.4 GB			After - 5.36 GB (57.02% Ratio)
CT: Don't have anymore but 5+ Hours 	DT: 8 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Hike Isle

Code:

*.assets
*.resS
*.resource
(no extension)
srep+lolz
(12.17% Ratio)

rest
razor
(25.07% Ratio)


Size Before - 2.5 GB			After - 321 MB (12.8% Ratio)
CT: 1 Hour and 45 Minutes	DT: 1 Minute (On i5-4570s 4T/4C + 8GB RAM)

Inscryption

Code:

*.assets
*.resS
*.resource
(no extension)
srep+lolz
(49.13% Ratio)

rest
razor
(23.82% Ratio)


Size Before - 3.3 GB			After - 1.6 GB (48.48% Ratio)
CT: 1 Hour and 38 Minutes		DT: 2 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Mirror's Edge Catalyst

Code:

Ripped - Trial executable

*.cas
xtlz4(v12)+srep+lolz
(72.3% Ratio) 	

rest
razor
(31.5% Ratio)


Size Before - 23 GB			After - 16.5 GB (71.73% Ratio)
CT: 8 Hours and 40 Minutes	DT: 12 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Need for Speed: Payback – Deluxe Edition

Code:

This is compression of the full version with all DLCs and depots included

*.cas
xtlz4(v12)+srep+lolz
(~62% Ratio)

rest
razor
(20.58% Ratio)


Size Before - 27 GB			After - 15.9 GB (58.88% Ratio)
CT: 10 Hours and 30 Minutes	DT: 15 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Papers, Please

Code:

*
razor

Size Before - 58 MB			After - 24.4 (42.06% Ratio)
CT: 2 Minutes	DT: 2 Seconds (On i5-4570s 4T/4C + 8GB RAM)
(This was done outside of Arc, the decompression is done with a simple bat)

PowerWash Simulator v1.1

Code:

*.bundle
xtool(unity plugin)+srep+lolz
(50.6% Ratio)

rest
razor
(37.1% Ratio)


Size Before - 6.6 GB			After - 3.3 GB (50% Ratio)
CT: Lost data, sorry			DT: 12 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Sapper - Defuse The Bomb Simulator v1.0.18

Code:

*.assets
*.resS
*.resource
(no extension)
srep+lolz
(29.7%% Ratio)

rest
razor
(25.3% Ratio)


Size Before - 7.1 GB			After - 2.1 GB (29.57% Ratio)
CT: Lost data, sorry			DT: 3 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Stray v1.4#227

Code:

Hk_project-WindowsNoEditor.pak
oo2reck+xtool(zlib)+srep+lolz
(70.2% Ratio)

rest
razor
(To not waste time with razor for bk2, pass them to srep+lz4/anything fast)


Size Before - 6.8 GB			After - 4.7 GB (69.11% Ratio)
CT: Lost data, sorry			DT: 26 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Subnautica

Code:

Ripped - Soundtrack

*.assets
*.resS
*.resource
(no extension)
srep+lolz
(31.5% Ratio)

rest
razor
(79.9% Ratio)


Size Before - 7.4 GB			After - 2.7 GB (36.45% Ratio)
CT: Lost data, sorry			DT: 6 Minutes (On i5-4570s 4T/4C + 8GB RAM)

Super Meat Boy

Code:

rz/$gd=srep+lolz

Arc.groups: 
$gd
*.dat


Size Before - 486 MB			After - 315 MB (64.1% Ratio)
CT: Lost data, sorry			DT: 10 Seconds (On i5-4570s 4T/4C + 8GB RAM)

Super Meat Boy Forever

Code:

rz/$gd=srep+lolz/$bik=bpk
(I used PMT on Razor here)

Arc.groups: 
$gd
*.swfc
*.smbl
*.tga
*.rply

$bik
*.bik


Size Before - 5.2 GB			After - 1.7 GB (32.4% Ratio)
CT: Lost data, sorry			DT: 2 Minutes (On i5-4570s 4T/4C + 8GB RAM)

The Stanley Parable Ultra Deluxe

Code:

*.assets
*.resS
*.resource
(no extension)
srep+lolz
(33.83% Ratio)

*.mp4
lzma (~50mb smaller output compared to lz4/zstd)
(87.32% Ratio)

voice.deafult
srep
(99.87% Ratio)

rest
razor
(20.53% Ratio)


Size Before - 7.2 GB		After - 2.7 GB	(37.5% Ratio)
CT: 2 Hours and 40 Minutes	DT: 4 Minutes (On i5-4570s 4T/4C + 8GB RAM)

PS: If this type of method sharing is not useful in the thread anymore, delete this reply. And if the format in which they're shared is a bit bulky and mods want reformat, I'm happy to oblige. This is just a few games I've done for the month

FitGirl · #3 15-02-2023, 09:43

Returnal has Leviathan inside. Unpacking on 24-threads CPU takes 3 hours and saves only 4 GBs compared to pure srep+lolz, don't bother.

Razor12911 · #4 16-02-2023, 16:39

Quote:

Originally Posted by FitGirl

Returnal has Leviathan inside. Unpacking on 24-threads CPU takes 3 hours and saves only 4 GBs compared to pure srep+lolz, don't bother.

If you are stubborn and still want to compress the game regardless for archival purposes then I suggest using the unreal engine plugin with the method -mue4:leviathan:l9 include -s parameter as well to skip verification this way you can skip precompression part of the process because its the slowest part of compressing this game.

Note: Skip works provided you have used the correct oodle library.

Code:

Compressed 1 file, 462,045,227 => 1,175,858,081 bytes. Ratio 254.49%
Compression time: cpu 0.44 sec/real 4.67 sec = 9%. Speed 99.03 mB/s

Quote:

Originally Posted by Butza

I am newbie. this is what it says to me when I use it Skipped VO_MEDIA.PC.PCK (Larger than 2147483647)

the original file must not be part of the extracted streams.

KaktoR · #5 17-02-2023, 13:59

Quote:

Originally Posted by Razor12911

If you are stubborn and still want to compress the game regardless for archival purposes then I suggest using the unreal engine plugin with the method -mue4:leviathan:l9 include -s parameter as well to skip verification this way you can skip precompression part of the process because its the slowest part of compressing this game.

Note: Skip works provided you have used the correct oodle library.

Code:

Compressed 1 file, 462,045,227 => 1,175,858,081 bytes. Ratio 254.49%
Compression time: cpu 0.44 sec/real 4.67 sec = 9%. Speed 99.03 mB/s

Big welp

Code:

Extracted 1 file, 1,175,857,894 => 462,045,227 bytes. Ratio 254.49%
Extraction time: cpu 0.16 sec/real 260.22 sec = 0%. Speed 1.78 mB/s
All OK

I guess extraction time for the whole thing should take a half day

Razor12911 · #6 17-02-2023, 14:20

Quote:

Originally Posted by KaktoR

Big welp

Code:

Extracted 1 file, 1,175,857,894 => 462,045,227 bytes. Ratio 254.49%
Extraction time: cpu 0.16 sec/real 260.22 sec = 0%. Speed 1.78 mB/s
All OK

I guess extraction time for the whole thing should take a half day

Quote:

Originally Posted by Razor12911

aRrChIvAl pUrPoSeS

KaktoR · #7 17-02-2023, 05:52

The file will not change the size, but it is better compressable because the erased files are just overwritten with zero bytes (00).

Butza · #8 17-02-2023, 06:17

Thanks, got it)

Quote:

Originally Posted by KaktoR

The file will not change the size, but it is better compressable because the erased files are just overwritten with zero bytes (00).

KaktoR · #9 18-02-2023, 05:18

Don't worry, I've read it

It was just meant as another information

Masquerade · #10 19-02-2023, 11:42

Football Manager 2023

*.fmf, *.dat, *.dbc:
Code:
```
xtool_zstd_dedup5+lolz
```
Everything else:
Code:
```
razor
```

5GB ---> 2.4GB

libzstd v1.4.7 used.

dixen · #11 19-02-2023, 12:28

Atomic Heart (DEV BUILD)

*.pak
XTool (zlib)+sdrep+lzma2
78 gb > 84 gb > 59 gb > 28.7 gb

Rest Files
srep+lzma2

Repack's size = 29.7 gb
Install time = ~7 min.

KaktoR · #12 20-02-2023, 02:56

Can anyone tell me something about the new settlers game? Seems to be zstd mostly and some zlibs aswell but couldn't get much out of it. Seems like 1.5.0 library is the correct one.

Code:

Streams: 2887/11649
Time: 00:02:05 (00:12:23)
Memory: 204 MB (204 MB)

Results: 256 MB >> 331 MB

Sample
https://pixeldrain.com/u/jzeJThv3

Razor12911 · #13 20-02-2023, 04:39

For zstd streams

zstd1.PNG

zstd2.PNG

The version is 1.5.1 or 1.5.2, not 1.5.0

For deflate streams

zstd3.PNG

so... png+reflate and -d1

Code:

-mreflate+png+zstd:l16 -d1

Code:

Streams: 11977/11984
Time: 00:00:16 (00:01:32)
Memory: 215 MB (215 MB)

Results: 256 MB >> 686 MB

Make sure there is no xdelta library, xtool freezes because of what I assume would be false positive streams or very small streams.

KaktoR · #14 20-02-2023, 05:34

Thanks, seems my collection was a bit out of date..

KaktoR · #15 26-02-2023, 09:03

Assassin's Creed Valhalla
v1.7.0, all DLC, 1 language

Code:

 12:34:56 - Selected ARC/DS method for Data1a-01.bin was: xtool:manvil:core_2.8.4+xtool:db:dd3+4x4:lzma
 12:34:56 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 18:02:03 - Overall input size: 143.64 GB
 18:02:03 - Overall output size: 50.18 GB (Ratio 34.93%)
 18:02:03 - Overall conversion time: 05:27:04

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following 5 Users Say Thank You to -tara For This Useful Post:
exorc (14-02-2023), Gehrman (22-03-2023), JustFun (12-03-2023), Razor12911 (12-02-2023), Wanterlude (13-02-2023)

The Following 3 Users Say Thank You to FitGirl For This Useful Post:
KaktoR (16-02-2023), Razor12911 (16-02-2023), Wanterlude (16-02-2023)

The Following 2 Users Say Thank You to Razor12911 For This Useful Post:
KaktoR (17-02-2023), ScOOt3r (17-02-2023)

The Following User Says Thank You to KaktoR For This Useful Post:
Razor12911 (17-02-2023)

The Following User Says Thank You to KaktoR For This Useful Post:
Butza (17-02-2023)

The Following User Says Thank You to Masquerade For This Useful Post:
JustFun (12-03-2023)

The Following User Says Thank You to dixen For This Useful Post:
JustFun (12-03-2023)

The Following 2 Users Say Thank You to Razor12911 For This Useful Post:
KaktoR (20-02-2023), Wanterlude (22-02-2023)

The Following 4 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (01-03-2023), JustFun (12-03-2023), Wanterlude (26-02-2023), ZAZA4EVER (13-04-2023)