FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

Razor12911 13-12-2022 18:19

Crisis Core - Final Fantasy VII - Reunion

Used unreal_db
key 0x277041CBB2888087611DB5CBFEA119462920E1F67092C87E 87825725E38B320F
Oodle v2.9.5 dll

-mccff7r+kraken:l7 -d1 -c1gb -lm
Code:

pakchunk7-WindowsNoEditor.ucas
1.53 GB > 2.79 GB

idk, unreal db works for me, but there was a catch. The AES blocks can be larger than 700MB so just set a high chunk size value but add -lm parameter so that xtool doesn't tank your PC.

Edit: I recommend that you use two separate xtool processes (one for decryption and the other for processing kraken streams), since these aes blocks are big, xtool will use 1 thread in d1 mode for both encoding and decoding in an attempt to use the lowest possible memory, which will slow down installation tremendously if you plan to make a repack. This also eliminates the need for -d1, you can opt for oo2reck if you want, up to you.

KaktoR 14-12-2022 00:54

Thanks, this seem to work :)

Code:

-mff7rcc+xtool:kraken,l7

Compressed 2 files, 1,644,918,858 => 3,004,384,018 bytes. Ratio 182.65%
Compression time: cpu 1.22 sec/real 207.25 sec = 1%. Speed 7.94 mB/s
All OK

Extracted 2 files, 3,004,384,018 => 1,644,918,858 bytes. Ratio 182.65%
Extraction time: cpu 1.28 sec/real 191.11 sec = 1%. Speed 8.61 mB/s
All OK

Code:

[External compressor:xtool]
header = 0
packcmd  = xtool.exe precomp { -moption} -c64mb -t100p - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t75p - - <stdin> <stdout>

[External compressor:ff7rcc]
header = 0
packcmd  = xtool.exe precomp -mccff7r -c1gb -d1 -lm -t100p - - <stdin> <stdout>
unpackcmd = xtool.exe decode -t75p - - <stdin> <stdout>


KaktoR 14-12-2022 07:59

Witcher 3 v4.0 Next Gen Update

Still the same algo from before
https://fileforums.com/showthread.ph...her#post498295

Code:

-mxtool:witcher3+xtool:zlib+xtool:lz4hc,l9

Compressed 1 file, 286,247,872 => 1,249,481,045 bytes. Ratio 436.50%
Compression time: cpu 0.41 sec/real 51.41 sec = 1%. Speed 5.57 mB/s
All OK

Extracted 1 file, 1,249,481,045 => 286,247,872 bytes. Ratio 436.50%
Extraction time: cpu 0.59 sec/real 37.01 sec = 2%. Speed 7.73 mB/s
All OK


KaktoR 15-12-2022 02:01

Grand Theft Auto V
Build 10107212 (13 December 2022)

Code:

17:17:06 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:mreflate:db:-dedup=3+4x4:lzma
 17:17:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:-dedup=3+4x4:lzma
-----------------------------------------------------------------------------------------
 20:20:08 - Overall input size: 108.55 GB
 20:20:08 - Overall output size: 65.61 GB (Ratio 60.45%)
 20:20:08 - Overall conversion time: 03:02:59

Data1a
common.rpf
x64*.rpf
update\*.rpf

Edit: Use srep instead of xtool dedup. At least for me xtool just crashes in the middle, even with low settings. With srep cls it is working fine.

Gehrman 15-12-2022 12:01

Quote:

Originally Posted by KaktoR (Post 499426)
Grand Theft Auto V
Build 10107212 (13 December 2022)

Code:

17:17:06 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:mreflate:db:-dedup=3+4x4:lzma
 17:17:06 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:-dedup=3+4x4:lzma
-----------------------------------------------------------------------------------------
 20:20:08 - Overall input size: 108.55 GB
 20:20:08 - Overall output size: 65.61 GB (Ratio 60.45%)
 20:20:08 - Overall conversion time: 03:02:59

Data1a
common.rpf
x64*.rpf
update\*.rpf

Edit: Use srep instead of xtool dedup. At least for me xtool just crashes in the middle, even with low settings. With srep cls it is working fine.

It is more optimal with --mem=10p
Code:

[External compressor: xtool]
header = 0
unpackcmd = "{compressor}.exe" decode -t100p --mem=10p - - <stdin> <stdout>

Also, use the 32-bit version of SREP.exe.

KaktoR 16-12-2022 09:57

Elden Ring
v1.08.1

Code:

17:21:11 - Selected ARC/DS method for Data1a-01.bin was: xtool1+xtool2+xtool:db:-dedup=3+4x4:lzma
 17:21:11 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:-dedup=3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 18:57:27 - Overall input size: 48.07 GB
 18:57:27 - Overall output size: 38.88 GB (Ratio 80.88%)
 18:57:27 - Overall conversion time: 01:36:15


Gehrman 17-12-2022 11:24

Forza Horizon 5 Premium Edition (1.522.259.0)
 
Code:

(EN) Without 4KMovie,SignLanguage
Code:

xtool:c256mb:mpreflate:mzlib+srep:m3f:l512+4x4:lzma:a1:mfbt4:32m:fb273:mc10000:lc8
Code:

109.98 GB → 180 GB → 120 GB → 67.6 GB
Code:

CT: 7H 35M
DT: 52M


KaktoR 25-12-2022 07:17

Crisis Core - Final Fantasy VII - Reunion
v1.01

Code:

13:45:17 - Selected ARC/DS method for Data1a-01.bin was: xtool:c1gb:d1:lm:mccff7r+xtool:mkraken,l7:core_2.9.5+xtool:mpreflate:db:dd3+4x4:lzma
 13:45:17 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 14:42:31 - Overall input size: 18.17 GB
 14:42:31 - Overall output size: 14.94 GB (Ratio 82.21%)
 14:42:31 - Overall conversion time: 00:56:26
 14:42:31 - Overall conversion media: 1 custom media
-------------------------------------------------------------------------------------------------------------------------------------------
 14:59:20 - Overall decompression time: 00:16:32
 14:59:20 - All files have been successfully extracted!


dixen 25-12-2022 08:16

Some tests MK11

DISMEMBERMENTSHARED_ScriptAssets.psf

Old version (oodle lzna). Need unreal.dll & oo2core_5_win64.dll from game folder

Quote:

Compressed 1 file, 959,141,047 => 2,044,941,730 bytes. Ratio 213.21%
Compression time: cpu 0.17 sec/real 101.97 sec = 0%. Speed 9.41 mB/s
All OK
Quote:

Tested 1 file, 2,044,941,730 => 959,141,047 bytes. Ratio 213.21%
Testing time: cpu 0.50 sec/real 88.30 sec = 1%. Speed 10.86 mB/s
All OK
New version (oodle kraken, last patch from 15.12.2022). Need oo2core_5_win64.dll from game folder

Quote:

Compressed 1 file, 1,052,382,310 => 2,005,105,169 bytes. Ratio 190.53%
Compression time: cpu 0.16 sec/real 36.26 sec = 0%. Speed 29.02 mB/s
All OK
Quote:

Tested 1 file, 2,005,105,169 => 1,052,382,310 bytes. Ratio 190.53%
Testing time: cpu 0.50 sec/real 7.24 sec = 7%. Speed 145.43 mB/s
All OK

KaktoR 25-12-2022 11:50

Immortals - Fenyx Rising
v1.3.4

Code:

16:18:24 - Selected ARC/DS method for Data1a-01.bin was: oo2recs:core_2.9.5+srep+4x4:lzma
 16:18:24 - Selected ARC/DS method for Data1b-01.bin was: srep+4x4:lzma
-----------------------------------------------------------------------------------------
 19:09:55 - Overall input size: 50.66 GB
 19:09:55 - Overall output size: 23.68 GB (Ratio 46.73%)
 19:09:55 - Overall conversion time: 02:51:28
-----------------------------------------------------------------------------------------
 20:47:21 - Overall decompression time: 00:21:56
 20:47:21 - All files have been successfully extracted!


Masquerade 28-12-2022 11:10

Melty Blood: Type Lumina [Build 10190280]

Code:

xtool (-mreflate --dedup=5) + lolz
20.7GB ---> 4.9GB

Masquerade 30-12-2022 10:18

Just an FYI, don't use XTool -mzlib+reflate on SnowRunner as it gives CRC fail upon decompression.

KaktoR 31-12-2022 06:09

Hardspace Shipbreaker
v1.3.0

Code:

14:56:59 - Selected ARC/DS method for Data1a-01.bin was: xtool:munity,lz4hc,l12:lz4_193+xtool:db:dd3+4x4:lzma
 14:56:59 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 15:06:54 - Overall input size: 5.03 GB
 15:06:54 - Overall output size: 2.33 GB (Ratio 46.38%)
 15:06:54 - Overall conversion time: 00:09:49
-------------------------------------------------------------------------------------------------------------------------------------------
 15:09:38 - Overall decompression time: 00:02:12
 15:09:38 - All files have been successfully extracted!


BKR-TN 01-01-2023 01:00

Europa Universalis IV Incl. All DLCs (GOG) v1.34.5.6
Code:

Compressed 25,670 files, 7,864,063,100 => 4,243,642,157 bytes. Ratio 53.96%
Compression time: cpu 36.48 sec/real 7572.58 sec = 0%. Speed 1.04 mB/s
All OK

Tested 25,670 files, 4,243,642,157 => 7,864,063,100 bytes. Ratio 53.96%   
Testing time: cpu 13.08 sec/real 102.04 sec = 13%. Speed 77.07 mB/s
All OK

Initial size: 7.32 GB
Final size: 3.95 GB
2 cores, 4 threads

Code:

*.mp3, *.ogg and *.zip => xtool:db:dd3
*.wav and *.bmp => msc_tak+xtool:db:dd3
rest of the files => xtool:db:dd3+lolz:dtb1:d128:mtt1:mt4:mc1023

Quote:

Note: There is not that much of gain with compressing mp3 files by mpz (saving ~100 MB), ogg files by oggre (~90 MB) and preflating zip files by xtool (~110 MB) considering how much slower the installer will be. Also, the "eu4.pdb" file will be ~36 MB after compressing.

kj911 02-01-2023 03:25

Good compression scheme, methods packing from old XIII game *.hsc files? (And the complete game.) These files encrypted or missed any header data from detectable? MSC not detect reasonable compressibble raw PCM/WAV or MP3 audio data the files. OGGRE it says, no effect. Size reduction its abysmal 5-6-7% no less higher. (Tested in: XIII GOG Update 32942 version.)

*.hxc files finely compressibble in MSC(tak)+ZSTD methods packed to in ~210MB size. (26% ratio, or use any hard final compressor, ex. LOLZ, RZ, more.)

UPD: SREP+DLZ its 2* better than MSC+ZSTD methods. Thanks hints the any repackers from net. :D

Code:

Compressed 59 files, 849,601,186 => 103,557,504 bytes. Ratio 12.19%
Compression time: cpu 2.20 sec/real 497.64 sec = 0%. Speed 1.71 mB/s
All OK

Testing now MSC+SREP+LOLZ combo.


All times are GMT -7. The time now is 09:34.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com