Best Compression Methods for 'Specific' Games. Q&A - Page 209

Gehrman · #1 28-01-2023, 17:03

Code:

Game Size: 47/4 GB

Method#1

Code:

xtool:c256mb:mzlib:mpreflate:dd3+4x4:lzma:a1:mfbt4:32m:fb273:mc128:lc8

Code:

30.5 GB

Method#2

Code:

xtool:mreflate:dd3+4x4:lzma:a1:mfbt4:32m:fb273:mc1024:lc8

Code:

32.3 GB

KaktoR · #2 29-01-2023, 03:18

A Plague Tale: Requiem
v1.4.0.0, ripped languages from soundbanks

Code:

 10:58:07 - Selected ARC/DS method for Data1a-01.bin was: xtool:mreflate+xtool:db:dd3+4x4:lzma
 10:58:07 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 12:16:24 - Overall input size: 47.48 GB
 12:16:24 - Overall output size: 29.86 GB (Ratio 62.89%)
 12:16:24 - Overall conversion time: 01:18:16

KaktoR · #3 29-01-2023, 05:07

Dead Space Remake

Code:

Library loaded: zstd_145\libzstd.dll

Streams: 7656/7657
Time: 00:00:16 (00:01:33)
Memory: 177 MB (177 MB)

Results: 230 MB >> 478 MB

Edit:

Code:

 20:14:55 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd:zstd_145+xtool:db:dd3+4x4:lzma
 20:14:55 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 21:32:58 - Overall input size: 36.32 GB
 21:32:58 - Overall output size: 26.31 GB (Ratio 72.45%)
 21:32:58 - Overall conversion time: 01:18:01
-------------------------------------------------------------------------------------------------------------------------------------------
 21:57:32 - Overall decompression time: 00:23:12
 21:57:32 - All files have been successfully extracted!

L33THAK0R · #4 30-01-2023, 16:50

Seems like no matter how I go about attempting to pre-compress this title, I'm unable to pick up all the oodle streams, as a last resort I'm going to try unpacking the core 2 "*.pak" archives as a dirty solution and see if any gains can be had with this approach. Attached image displays my last two attempts to process all the Oodle streams with XTool (0.6.9).

Razor12911 · #5 30-01-2023, 20:30

https://fileforums.com/showpost.php?...&postcount=101

Masquerade · #6 01-02-2023, 00:27

PowerWash Simulator [v1.1]

Use SREP v3.2 due to crash on newer versions.
Don't use XTool built in deduplication.

Code:

xtool_unity+srep+lolz

6.6GB ---> 3.3GB

L33THAK0R · #7 01-02-2023, 08:41

A while back I took a shot at a title, "Trek to Yomi", which contains ~260mb of H.264 video, encoded at an exceedingly silly bit-rate. Linked here is a sample of my re-encoding.

The below figure should speak for itself, but after tuning ffmpeg a fair bit, I managed to get quite an extraordinary outcome, coupled with srep & lolz, a result of a 328x improvement with a near imperceivable loss in fidelity.

Has anyone else had any similar success stories? It's got me wondering how and why these algorithms were able to process these lower bit-rate frames in such an efficient manner compared to the original lossless files.

(And yes before anyone asks I did verify the archives to be valid)

shazzla · #8 01-02-2023, 10:59

For the records:

I recommend use CRF (lets say ,its constant quality) instead of targeting bitrate.

L33THAK0R · #9 01-02-2023, 17:09

Quote:

Originally Posted by shazzla

For the records:

I recommend use CRF (lets say ,its constant quality) instead of targeting bitrate.

Constant Rate Factor (CRF) encoding is pretty much mandatory I'd argue for producing any quality lossy videos. You can still use the available switches cap the maximum bit-rate as well manipulating the VBV buffer. I'd also recommend testing the various available tuning profiles (not to be confused with H.264 profiles or ffmpeg encoding presets) within ffmpeg especially if you're dealing with 2D video, as you can get some noticeable ratio improvements for a slightly longer encoding time.

shazzla · #10 02-02-2023, 00:17

Then give a shot for

Selur's Hybrid. Not ffmpeg.

I used it for encode TBs of x265 movies..

L33THAK0R · #11 02-02-2023, 07:54

xtool (0.3.21) + srep + lolz

42.26 GiB >>> 19.4 GiB

Ripped: Non-Eng. Loc., ~10 MiB of startup videos

Note: the entire "sfpaks" folder can be deleted, I'm surprised others that have tackled this title don't seem to know it just contains CRC-perfect duplicates of data contained within the 2 primary "*.pak" archives. In my conversion I unpacked the archives to remove the need for oodle pre-compression, honestly there are only ~200 MiB of zlib/reflate streams (See Figure 1) to be processed which only results in a ~60 MiB improvement (See Figure 2) over just sticking with srep + lolz. In this form there are only ~6 MiB of Oodle streams to be processed.

Interestingly enough I found on my system, when testing for ~1hr to make sure everything worked properly, I encountered fewer stutters during game-play when using the unpacked files.

Figure 1

Figure 2

dixen · #12 08-02-2023, 07:29

Hogwarts Legacy

Game used oodle kraken

Quote:

Compressing pakchunk11-WindowsNoEditor.ucas 98%
Compressing 676,197,072 bytes with xtool.exe precomp -mkraken -c128mb -t100p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 19271/19280
Time: 00:00:58 (00:08:35)
Memory: 514 MB (514 MB)

100%
Errorlevel=0

Compressed 1 file, 676,197,072 => 2,228,651,670 bytes. Ratio 329.59%
Compression time: cpu 0.08 sec/real 72.49 sec = 0%. Speed 9.33 mB/s
All OK

Needed oo2core_8_win64.dll v2.8.14

Sebazz · #13 24-02-2023, 08:08

Quote:

Originally Posted by dixen

Hogwarts Legacy

Game used oodle kraken

Needed oo2core_8_win64.dll v2.8.14

You can upload this oodle dll file please ?

KaktoR · #14 24-02-2023, 08:18

Quote:

Originally Posted by Sebazz

You can upload this oodle dll file please ?

You can find them here
https://fileforums.com/showpost.php?...2&postcount=97

KaktoR · #15 08-02-2023, 09:22

@dixen
Also bink2 videos are kb2n, so bpk is useless here.

Damn, I guess next year at the least bpk will be useless entirely for new titles

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following User Says Thank You to Gehrman For This Useful Post:
JustFun (12-03-2023)

The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (12-03-2023)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
JustFun (12-03-2023), L0v3craft (06-01-2026)

The Following User Says Thank You to Razor12911 For This Useful Post:
Gehrman (31-01-2023)

The Following 2 Users Say Thank You to Masquerade For This Useful Post:
JustFun (12-03-2023), Redmist2013 (05-02-2025)

The Following 4 Users Say Thank You to L33THAK0R For This Useful Post:
Abbat (05-12-2023), Gehrman (09-03-2023), JustFun (12-03-2023), oo7 (14-09-2024)

The Following User Says Thank You to KaktoR For This Useful Post:
Sebazz (24-02-2023)