Best Compression Methods for 'Specific' Games. Q&A - Page 205

KaktoR · #1 03-12-2022, 03:07

The Callisto Protocol

Code:

Compressed 2 files, 6,558,206,036 => 13,302,561,746 bytes. Ratio 202.84%
Compression time: cpu 2.78 sec/real 243.09 sec = 1%. Speed 26.98 mB/s
All OK

reflate
0x1958456F8B54A02D25DF32327C57C9D20DFCF7E948967D08 CFB48E8EBC65BEEB

Edit: Seems like you don't need the key. Without the key the output is the same.

abror · #2 06-12-2022, 19:04

please tell me the best compress method for gta 5 game. I am using Cesar82 Diskpan Gui

Cesar82 · #3 06-12-2022, 19:12

Quote:

Originally Posted by abror

please tell me the best compress method for gta 5 game. I am using Cesar82 Diskpan Gui

DiskSpan GUI has compression preset in DATABASE for this game, just load the preset.

abror · #4 11-12-2022, 07:33

Quote:

Originally Posted by Cesar82

DiskSpan GUI has compression preset in DATABASE for this game, just load the preset.

thank you, do you know how to make the game install process not take long.
I have compressed the gta 5 game using the method that is in the database but during install (unpack) it takes very long around 5-7 hours

KaktoR · #5 10-12-2022, 11:18

Anno 1800
v16.0, incl all DLC, all languages, artbook, ost

Code:

 21:12:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:mflac+xtool:mpreflate+xtool:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:12:27 - Selected ARC/SPLIT method for Data1b-01.bin was: xtool:db:dedup=3+razor_mtx/$mp3pack=mpzmt
-----------------------------------------------------------------------------------------
 23:12:09 - Overall input size: 86.73 GB
 23:12:09 - Overall output size: 31.42 GB (Ratio 36.23%)
 23:12:09 - Overall conversion time: 01:59:41

>> Unpacking finished successfully!

Edit: Method changed from "reflate" to "preflate" because of crc errors on file data13.rda

Masquerade · #6 10-12-2022, 11:21

@KaktoR
You can patch out the bink videos with XTool erase and squeeze the size down with bpk too

KaktoR · #7 10-12-2022, 11:34

@Masquerade
I know. bk2 files are spread all over inside many files and I for myself are just to lazy to do it

KaktoR · #8 11-12-2022, 11:00

Halo The Master Chief Collection
v1.3065.0.0 (7th December 2022), ripped multiplayer

Code:

 17:02:27 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:db:-dedup=3
 17:02:27 - Selected ARC/DS method for Data1b-01.bin was: xtool:c128mb:mpreflate:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 17:02:27 - Selected ARC/DS method for Data1c-01.bin was: xtool:db:-dedup=3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
 19:06:36 - Overall input size: 103.82 GB
 19:06:36 - Overall output size: 64.34 GB (Ratio 61.97%)
 19:06:36 - Overall conversion time: 02:04:07

>> Unpacking finished successfully!

---

Data1b:
halo1\prebuild\shaders_2_cache\prebuild\*.sdc
halo2\prebuild\shaders_2_cache\prebuild\*.sdc
halo2\preload\paks\*.pck
halo2\h2_maps_win64_dx11\*.map
halo2\h2_maps_win64_dx11\textures.dat
halo3\maps\*.map
halo3odst\maps\*.map
halo4\maps\*.map
haloreach\maps\*.map
mcc\Content\Paks\*.pak
data\ui\Screens\*.gfx

With reflate you will get a crc error on "MCC-WindowsNoEditor.pak" file. Seems there are lz4 streams too but couldn't process any of them properly (also look in "Data\ui\texturepacks" folder). With old xtool the output is same as reflate option (~1gb smaller) but I prefer speed

128mb chunk size is the sweet spot here. However you will get some additional mb on 256mb.

bpk output is 22.5 GB, with srep 21.5 GB (many video stream duplicates).

KaktoR · #9 13-12-2022, 12:00

Crisis Core - Final Fantasy VII - Reunion

pak/ucas -> kraken
Use oo2core v2.9.6

Edit: Ok seems like zlib/reflate is in there too. What a weird mess I made, sorry

Code:

pakchunk0-WindowsNoEditor.pak

156mb -> 175mb (kraken) -> 199mb (reflate)

Edit 2:
pakchunk1-WindowsNoEditor.pak has no kraken streams, but only reflate.

Edit 3:
pakchunk5-WindowsNoEditor.pak, pakchunk6-WindowsNoEditor.pak -> seems like only usm video
pakchunk4-WindowsNoEditor.pak -> sounds

Masquerade · #10 13-12-2022, 12:33

Crisis Core - Final Fantasy VII - Reunion UCAS contains encrypted Kraken streams but the UnrealDB creator does not work for this game and requires an update.

Razor12911 · #11 13-12-2022, 18:19

Crisis Core - Final Fantasy VII - Reunion

Used unreal_db
key 0x277041CBB2888087611DB5CBFEA119462920E1F67092C87E 87825725E38B320F
Oodle v2.9.5 dll

-mccff7r+kraken:l7 -d1 -c1gb -lm

Code:

pakchunk7-WindowsNoEditor.ucas
1.53 GB > 2.79 GB

idk, unreal db works for me, but there was a catch. The AES blocks can be larger than 700MB so just set a high chunk size value but add -lm parameter so that xtool doesn't tank your PC.

Edit: I recommend that you use two separate xtool processes (one for decryption and the other for processing kraken streams), since these aes blocks are big, xtool will use 1 thread in d1 mode for both encoding and decoding in an attempt to use the lowest possible memory, which will slow down installation tremendously if you plan to make a repack. This also eliminates the need for -d1, you can opt for oo2reck if you want, up to you.

KaktoR · #12 14-12-2022, 00:54

Thanks, this seem to work

Code:

-mff7rcc+xtool:kraken,l7

Compressed 2 files, 1,644,918,858 => 3,004,384,018 bytes. Ratio 182.65%
Compression time: cpu 1.22 sec/real 207.25 sec = 1%. Speed 7.94 mB/s
All OK

Extracted 2 files, 3,004,384,018 => 1,644,918,858 bytes. Ratio 182.65%
Extraction time: cpu 1.28 sec/real 191.11 sec = 1%. Speed 8.61 mB/s
All OK

Code:

[External compressor:xtool]
header = 0
packcmd   = xtool.exe precomp { -moption} -c64mb -t100p - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t75p - - <stdin> <stdout>

[External compressor:ff7rcc]
header = 0
packcmd   = xtool.exe precomp -mccff7r -c1gb -d1 -lm -t100p - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t75p - - <stdin> <stdout>

KaktoR · #13 14-12-2022, 07:59

Witcher 3 v4.0 Next Gen Update

Still the same algo from before
https://fileforums.com/showthread.ph...her#post498295

Code:

-mxtool:witcher3+xtool:zlib+xtool:lz4hc,l9

Compressed 1 file, 286,247,872 => 1,249,481,045 bytes. Ratio 436.50%
Compression time: cpu 0.41 sec/real 51.41 sec = 1%. Speed 5.57 mB/s
All OK

Extracted 1 file, 1,249,481,045 => 286,247,872 bytes. Ratio 436.50%
Extraction time: cpu 0.59 sec/real 37.01 sec = 2%. Speed 7.73 mB/s
All OK

dixen · #14 05-06-2023, 00:12

Quote:

Originally Posted by KaktoR

Witcher 3 v4.0 Next Gen Update

Still the same algo from before
https://fileforums.com/showthread.ph...her#post498295

Code:

-mxtool:witcher3+xtool:zlib+xtool:lz4hc,l9

Compressed 1 file, 286,247,872 => 1,249,481,045 bytes. Ratio 436.50%
Compression time: cpu 0.41 sec/real 51.41 sec = 1%. Speed 5.57 mB/s
All OK

Extracted 1 file, 1,249,481,045 => 286,247,872 bytes. Ratio 436.50%
Extraction time: cpu 0.59 sec/real 37.01 sec = 2%. Speed 7.73 mB/s
All OK

Which version xtool and liblz4.dll needed?
With W3.xtl - decompression error for me

KaktoR · #15 15-12-2022, 02:01

Grand Theft Auto V
Build 10107212 (13 December 2022)

Code:

 17:17:06 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:mreflate:db:-dedup=3+4x4:lzma
 17:17:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:-dedup=3+4x4:lzma
-----------------------------------------------------------------------------------------
 20:20:08 - Overall input size: 108.55 GB
 20:20:08 - Overall output size: 65.61 GB (Ratio 60.45%)
 20:20:08 - Overall conversion time: 03:02:59

Data1a
common.rpf
x64*.rpf
update\*.rpf

Edit: Use srep instead of xtool dedup. At least for me xtool just crashes in the middle, even with low settings. With srep cls it is working fine.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
Gehrman (03-12-2022), shazzla (03-12-2022)

The Following User Says Thank You to Cesar82 For This Useful Post:
abror (11-12-2022)

The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (11-12-2022)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
JustFun (11-12-2022), shazzla (11-12-2022)

The Following 5 Users Say Thank You to Razor12911 For This Useful Post:
Gehrman (14-12-2022), KaktoR (14-12-2022), kuyhaa (13-12-2022), L0v3craft (13-12-2022), Masquerade (14-12-2022)

The Following 2 Users Say Thank You to KaktoR For This Useful Post:
kuyhaa (14-12-2022), ScOOt3r (14-12-2022)

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
dixen (15-12-2022), Gehrman (15-12-2022), JustFun (12-03-2023)