Best Compression Methods for 'Specific' Games. Q&A - Page 202

Masquerade · #1 03-11-2022, 23:42

FModel gave me this output for most files

KaktoR · #2 04-11-2022, 00:15

Maybe it's the xtool plugin. I will test with ue4d

kuyhaa · #3 05-11-2022, 13:53

HARVESTELLA

kraken+zlib+ue4

key

Quote:

0xAA07B9EF2AD5A0F2C1299355B0760B2808F11038753D5959 D5CA0923A6EE44A5

Harvestella-WindowsNoEditor.ucas

Quote:

Streams: 190379/194399194420
Time: 00:09:15 (02:01:43)
Memory: 520 MB (520 MB)

100.0%
Errorlevel=0

Compressed 1 file, 10,680,406,976 => 26,584,688,310 bytes. Ratio 248.91%
Compression time: cpu 195.23 sec/real 857.13 sec = 23%. Speed 12.46 mB/s
All OK

dixen · #4 06-11-2022, 12:31

Sackboy: A Big Adventure (2nd repack)

*.pak - XTool v0.65 + unreal.dll + SREP + LOLZ

Quote:

Compressed 20 files, 56,772,715,077 => 19,317,821,479 bytes. Ratio 34.03%
Compression time: cpu 159.44 sec/real 18183.77 sec = 1%. Speed 3.12 mB/s
All OK

Test

Quote:

Tested 20 files, 19,317,821,479 => 56,772,715,077 bytes. Ratio 34.03%
Testing time: cpu 6.55 sec/real 263.93 sec = 2%. Speed 215.11 mB/s
All OK

No used precompress function, decrypt .pak only

Razor12911 · #5 06-11-2022, 23:51

Burnout Paradise Remastered

-mxzlib+srep+fl2

Code:

Compressed 8,468 files, 7,752,954,658 => 3,415,874,982 bytes. Ratio 44.06%
Compression time: cpu 5.81 sec/real 237.31 sec = 2%. Speed 32.67 mB/s

7,21 GB >> 3.18 GB

Need For Speed Hot Pursuit Remastered

-m0

Code:

UI\MOVIES
UI\MOVIES_4K

Use store compression, bpk fails on a lot of videos

-mxzlib+srep+fl2

Code:

Compressed 20,498 files, 15,721,041,999 => 3,315,144,330 bytes. Ratio 21.09%
Compression time: cpu 12.61 sec/real 277.57 sec = 5%. Speed 56.64 mB/s

on the rest of the files

34.8 GB >> 23.2 GB w/ 4K videos
22,2 GB >> 10.7 GB w/o 4K videos

KaktoR · #6 08-11-2022, 15:30

DOOM Eternal

I made some tests but couldn't find the correct oodle library. Maybe someone find this usefull.

gameresources_0_2.streamdb

Code:

oo2core_4_win64_v3 712/1283 Ratio 126.48%
oo2core_6_win64    312/1283 Ratio 101.85%
oo2core_7_win64_v1 650/1283 Ratio 148.50%
oo2core_7_win64_v2 710/1283 Ratio 126.35%
oo2core_7_win64_v3 650/1283 Ratio 148.50%
oo2core_7_win64_v4 759/1283 Ratio 168.52%
oo2core_7_win64_v5 712/1283 Ratio 126.48%
oo2core_7_win64_v6 650/1283 Ratio 148.50%
oo2core_8_win64_v1 759/1283 Ratio 168.52%
oo2core_8_win64_v2 710/1283 Ratio 126.35%
oo2core_8_win64_v3 712/1283 Ratio 126.48%
oo2core_8_win64_v4 759/1283 Ratio 168.52%
oo2core_8_win64    759/1283 Ratio 168.52% (Days Gone (Special Libraries))
oo2core_9_win64_v1 710/1283 Ratio 126.35%
oo2core_9_win64_v2 45/1283  Ratio 100.08%

Side note: The suspicion is obvious that "oo2core_4_win64_v3" is in fact at least "oo2core_7_win64". Stream count, Ratio and file size speaks for itself I think. But I have only tested on this single sample and this should not be used as an evidence at all. Libraries from this post.

Razor12911 · #7 08-11-2022, 22:56

Doom Eternal uses two libraries on this file however I'm not sure if this applies to the whole game.

oo2core_7_win64.dll -> 283 MB > 421 MB (691/1332)
oo2core_8_win64.dll -> 283 MB > 479 MB (790/1332)

For some reasons, streams that can be processed 7 cannot be processed by 8 and visa versa.

However if you precompress the game using both libraries one after the other you get

283 MB > 421 MB > 614 MB

The second pass using oo2core_8_win64.dll processed the remaining streams (640/640).

This is part of the reason I added --oodle= parameter in xtool, to allow you to specify exactly what library you want to use.

Code:

[External compressor:doom7]
header    = 0
packcmd   = xtool.exe precomp -mkraken,l6,n256 -c32mb -t50p --oodle=oo2core_7_win64.dll - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p --oodle=oo2core_7_win64.dll - - <stdin> <stdout>

[External compressor:doom8]
header    = 0
packcmd   = xtool.exe precomp -mkraken,l6,n256 -c32mb -t50p --oodle=oo2core_8_win64.dll - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t100p --oodle=oo2core_8_win64.dll - - <stdin> <stdout>

Your arc.ini then looks like this then you run the method

-mdoom7+doom8

KaktoR · #8 09-11-2022, 01:49

HARVESTELLA

Code:

 09:53:02 - Selected ARC/DS method for Data1a-01.bin was: xtool:mue4,k0xAA07B9EF2AD5A0F2C1299355B0760B2808F11038753D5959D5CA0923A6EE44A5:mkraken,l5:9+srep+4x4:lzma
 09:53:02 - Selected ARC/DS method for Data1b-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 10:39:44 - Overall input size: 10.65 GB
 10:39:44 - Overall output size: 8.45 GB (Ratio 79.31%)
 10:39:44 - Overall conversion time: 00:46:40
-------------------------------------------------------------------------------------------------------------------------------------------
 10:49:06 - Overall decompression time: 00:08:08
 10:49:06 - All files have been successfully extracted!

Use oo2core_9_win64 in attachment to get all streams.

PS: You can use reflate on pak file to get additional ~20mb inflation.

panker1992 · #9 09-11-2022, 06:57

Elden Ring is also one more game that uses 2 different oodle libraries to have 100% coverage of streams.

its best to create a massive batch to process combinations of libraries

Masquerade · #10 09-11-2022, 08:06

Quote:

Originally Posted by panker1992

Elden Ring is also one more game that uses 2 different oodle libraries to have 100% coverage of streams.

Which libraries are best for this game?

KaktoR · #11 09-11-2022, 08:11

Quote:

Originally Posted by Masquerade

Which libraries are best for this game?

Code:

v2.8.14
1267/1413

v2.5.5 / v2.5.2 / v2.5.0
132/134
_____________
1399/1413

I can't get more. I have tested the first 200mb from Data0.bdt

Code:

200 -> 355 -> 366

Edit: Here is another test for Data3.bdt

Code:

v2.8.14
15077/18312

v2.5.5 / v2.5.2 / v2.5.0
2566/2641
_____________
17643/18312
_____________
669 streams left

---

2.47 GB -> 4.35 GB -> 4.51 GB

Maybe you get more out of it using n# option

dixen · #12 09-11-2022, 12:19

F.I.S.T.: Forged In Shadow Torch

Tests

XZlib+Reflate (-d3 -c32mb)
21.2 gb > 39 gb

unreal.dll+Xzlib+Reflate (-d3 c128mb)
21.2 gb > 65 gb

AES Key

Code:

0xEABBDBD5A27C73D8CDAE3179A36C9EB793C3C61188A5763FBC35ACD155D0C604

KaktoR · #13 09-11-2022, 13:54

Halo Infinite
Winter Update (8th November 2022)

Code:

 14:02:46 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n64:8+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1b-01.bin was: xtool:mreflate+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-----------------------------------------------------------------------------------------
 16:25:26 - Overall input size: 44.02 GB
 16:25:26 - Overall output size: 31.19 GB (Ratio 70.86%)
 16:25:26 - Overall conversion time: 02:22:21

KaktoR · #14 10-03-2023, 14:12

Halo Infinite
Season 3 Echoes Within (7th March 2023)

Code:

 21:14:05 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n64:core_2.8.9+xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:14:05 - Selected ARC/DS method for Data1b-01.bin was: xtool:mreflate+xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:14:05 - Selected ARC/DS method for Data1c-01.bin was: xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
 23:00:58 - Overall input size: 50.64 GB
 23:00:58 - Overall output size: 34.11 GB (Ratio 67.36%)
 23:00:58 - Overall conversion time: 01:46:49

KaktoR · #15 10-11-2022, 03:07

ELDEN RING
v1.07

Code:

 09:30:58 - Selected ARC/DS method for Data1a-01.bin was: xtool1+xtool2+srep+4x4:lzma
 09:30:58 - Selected ARC/DS method for Data1b-01.bin was: srep+lzma_sdk
-----------------------------------------------------------------------------------------
 11:55:14 - Overall input size: 45.07 GB
 11:55:14 - Overall output size: 36.75 GB (Ratio 81.54%)
 11:55:14 - Overall conversion time: 02:21:24

Oodle libraries used: v2.5.5 (xtool1) + v2.8.14 (xtool2)

xtool options: l6,n64

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following 2 Users Say Thank You to dixen For This Useful Post:
JustFun (11-12-2022), Wanterlude (06-11-2022)

The Following 5 Users Say Thank You to Razor12911 For This Useful Post:
JustFun (11-12-2022), kapinoy (27-03-2024), kuyhaa (07-11-2022), L0v3craft (17-11-2025), ScOOt3r (07-11-2022)

The Following 7 Users Say Thank You to Razor12911 For This Useful Post:
Gehrman (09-11-2022), KaktoR (09-11-2022), kuyhaa (09-11-2022), L0v3craft (11-11-2022), ScOOt3r (09-11-2022), shazzla (08-11-2022), Wanterlude (09-11-2022)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (09-11-2022), JustFun (11-12-2022), ScOOt3r (09-11-2022)

The Following User Says Thank You to panker1992 For This Useful Post:
L0v3craft (11-11-2022)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
L0v3craft (21-06-2024), Masquerade (09-11-2022)

The Following User Says Thank You to dixen For This Useful Post:
Wanterlude (10-11-2022)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (25-11-2022), JustFun (11-12-2022), ScOOt3r (10-11-2022)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (17-03-2023), JustFun (12-03-2023), Sebazz (10-03-2023)

The Following 6 Users Say Thank You to KaktoR For This Useful Post:
dixen (10-11-2022), Gehrman (25-11-2022), JustFun (11-12-2022), Masquerade (10-11-2022), ScOOt3r (10-11-2022), Wanterlude (10-11-2022)