FileForums - Best Compression Methods for 'Specific' Games. Q&A

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

Use reflate/preflate

The pak file also contains 3mb of wave files and 875mb of ogg files.

Code:

 * wav     :        8, (3'117'860, 2.97 MB, 0.15%)

 * ogg     :     2463, (918'137'045, 875.60 MB, 44.32%)

Edit: Use png preprocessor+reflate/preflate as the file contains many png images.

Code:

 * png     :     1894, (1'052'939'729, 1004.16 MB, 50.83%)

 * wav     :        8, (3'117'860, 2.97 MB, 0.15%)

 * ogg     :     2463, (918'137'045, 875.60 MB, 44.32%)

 * Total   :     4365, (1'974'194'634, 1882.74 MB, 95.29%)

Code:

Streams: 3917 / 3917 (50,83%)

Patched: 2023 (41,8 MB)

Time: 00:06:53 (CPU 00:39:09)



Size: 1,93 GB >> 14,2 GB

You can extract ogg with mesa.
Then use xtool erase function to remove the files from the pak file.
After installation use xtool decode function + created xtl file to move the files back into the pak file.

^^ Thanks
Also is it possible to use xtool decode and xtl you mentioned on diskspan gui?
Or shall I only use png preprocessor with reflate/preflate to get some desent ratio? (Expecting 1.4-1.5GB)

In this case you have to work with CallBefore.bat and make a batch for installer aswell.

There are plenty examples in Database folder in DSG.

For .ogg files:

Code:

oggre+4x4:b32mb:lzma:ultra:bt4:fb273:lc8:mc1000000:32mb

For the rest of the files:

Code:

xtool:mzlib+srep_new:392+LOLZ_ULTRA

Input: 3.4 GB
Output: 920 MB

Path of Exile 2
In case someone ever wants to repack this..

Tiny*.bin, shadercache*.bin = oodle selkie
All others oodle hydra

bk2 files are mostly kb2j, just the big ones are kb2n.
Audio files are fmod (RIFF FEV FMT) so I don't checked them.

Use oodle library v2.9.10

Code:

Name: oo2core_9_win64.dll

Size: 637952 Bytes : 623 KiB

CRC32: D90CD562

CRC64: 87A25C803B8DC2EC

SHA256: 6f5d41a7892ea6b2db420f2458dad2f84a63901c9a93ce9497337b16c195f457

SHA1: b5120a64e2756eb99978a9ddc4fb36939a3d4cfe

BLAKE2sp: bdbc19f38c4d993bed1b81d6c7ba006e3ac72d1b4195e196478669c8b17e9249

MD5: cc81123b3396b838037113d230d31efe

XXH64: 8A16854D18FD4A04

SHA384: 433a988d1d86e810c90fb8484d22d4acb8700196e154b0981019fd67654d54e1e80c8054bec552f8efe4e1abf32106e8

SHA512: 8aad08bed85e0837a5593ccf1ae3bb2d9f25364c7cdf8c290e2ac3c33c019e7585f497f63c02ced97ea9aaaee850d7d3e454271ab5211f4a7506aa0c7f87437c

SHA3-256: cfe6fe3b4638909efd475da4c3df6a41dcf38ff8470881bb963e5989fd72b510

I was to lazy to pack them all together with srep+fa so there is a loss in deduplication, but I cannot tell how much.
Since I have no plugin using -mhydra is the best approach to precompress this.

Code:

 21:31:27 - Selected ARC/DS method for Data1a-01.bin was: xtool:mhydra:core_2.9.10:lib_2:dd3:l10,d128mb

 21:31:27 - Selected ARC/DS method for Data1b-01.bin was: xtool:mselkie:core_2.9.10:lib_2:dd3:l10,d128mb

 21:31:27 - Selected ARC/DS method for Data1c-01.bin was: xtool:lm:c1792mb:mbk2:df20p

 21:31:27 - Selected ARC/DS method for Data1d-01.bin was: xtool:dd3:l10,d128mb

-----------------------------------------------------------------------------------------------------------------------------------------

 06:08:07 - Overall input size: 141,61 GB

 06:08:07 - Overall output size: 102,47 GB (Ratio 72.36%)

 06:08:07 - Overall conversion time: 08:36:32

Extraction time ~45min

Is it not possible to change the location of srep-virtual-memory.tmp ? Or will it always be in the temp folder as TempPath doesnt seem to work ? Also is it possible to limit the virtual memory size ?

cls.ini

[Srep]
Bufsize=24m
transfer_ReadBufSize=512k
transfer_WriteBufSize=512k
Memory=60%-2048m
TempPath={app}

This is for ProFrager's implementation of cls-srep

Assassins Creed Black Flag Resynced
XTool anvil plugin still works like a charm.

Why XTool 2020 (any versions) don't proceed lz4 streams in *.ff and *.pak from Call of Duty games?

Because for lz4/lz4hc you need a plugin. Only lz4f works without plugin.

Quote:

Originally Posted by dixen (Post 510460)

Why XTool 2020 (any versions) don't proceed lz4 streams in *.ff and *.pak from Call of Duty games?

bms2xtl
https://aluigi.altervista.org/bms/cod_kapi.bms
lz4=lz4hc:l9
liblz4 https://www.upload.ee/files/19536606/liblz4.dll.html

Code:

xtool precomp -c128mb -t100p -mtest2 mp_chinatown.xpak

XTool is created by Razor12911



Version 0.8.9



Streams: 17397 / 17479

Time: 00:00:01 (CPU 00:00:11)



Size: 411 MB >> 585 MB

Thanks Theafe for the sample from Black Ops III
For .ff use zlib+reflate precompressor.

Quote:

Originally Posted by Masquerade (Post 510462)

bms2xtl
https://mirror.aluigi.org/bms/cod2_kapf.bms
lz4=lz4hc:l9
liblz4 https://www.upload.ee/files/19536606/liblz4.dll.html

Code:

xtool precomp -c128mb -t100p -mtest2 mp_chinatown.xpak

XTool is created by Razor12911



Version 0.8.9



Streams: 17397 / 17479

Time: 00:00:01 (CPU 00:00:11)



Size: 411 MB >> 585 MB

Thanks Theafe for the sample from Black Ops III
For .ff use zlib+reflate precompressor.

Thanks but it doesn't work in bms2xtl. With safemode or without, no matter
UPD. That script https://aluigi.altervista.org/bms/cod_kapi.bms ok

AC Blackflag resynced

Hello
for A.C blackflag :

Data1 : (*.forge except sound files)

Quote:

xtool:c32mb:manvil:core_2.9.10:lib_2:dd3+LOLZ_NORM AL

Data2 : (*.forge sound files)

Quote:

xtool:c32mb:manvil:core_2.9.10:lib_2:dd3+razor_std io

Data3: (*.webm)

Quote:

xtool:dd3+bcm

Data4: (other)

Quote:

xtool:mzlib:mreflate+srep_new:490g+razor_stdio

Optional: (foreign language):

Quote:

xtool:c32mb:manvil:core_2.9.10:lib_2:dd3+razor_std io

for this kind of game I prefer to backup all languages in case of future update.

I've got something like 39.3Gb with all languages and bonus.
takes 35 minutes to install with Asics installer

Quote:

Originally Posted by wareck (Post 510473)

Hello
for A.C blackflag :

Data1 : (*.forge except sound files)

Data2 : (*.forge sound files)

Data3: (*.webm)

Data4: (other)

Optional: (foreign language):

for this kind of game I prefer to backup all languages in case of future update.

I've got something like 39.3Gb with all languages and bonus.
takes 35 minutes to install with Asics installer

Facing general decompression error in xtool:manvil:dd3 in ACBFR v1.0.5.

Most likely srep problem.

Try xtool:manvil:<core>+rep+xtool:dd3

However it is also possible to change srep settings with xtool with -sp option.
xtool:manvil:<core>:dd#:sp<options>:<srepversion>
Example: xtool:manvil:core_2.9.12:dd3:spa0,l512:393a

PS: If you use DSG ofcourse