FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

KaktoR 09-11-2022 08:11

Quote:

Originally Posted by Masquerade (Post 499065)
Which libraries are best for this game?


Code:

v2.8.14
1267/1413

v2.5.5 / v2.5.2 / v2.5.0
132/134
_____________
1399/1413

I can't get more. I have tested the first 200mb from Data0.bdt

Code:

200 -> 355 -> 366
Edit: Here is another test for Data3.bdt

Code:

v2.8.14
15077/18312

v2.5.5 / v2.5.2 / v2.5.0
2566/2641
_____________
17643/18312
_____________
669 streams left

---

2.47 GB -> 4.35 GB -> 4.51 GB

Maybe you get more out of it using n# option

dixen 09-11-2022 12:19

F.I.S.T.: Forged In Shadow Torch

Tests

XZlib+Reflate (-d3 -c32mb)
21.2 gb > 39 gb

unreal.dll+Xzlib+Reflate (-d3 c128mb)
21.2 gb > 65 gb

AES Key
Code:

0xEABBDBD5A27C73D8CDAE3179A36C9EB793C3C61188A5763FBC35ACD155D0C604

KaktoR 09-11-2022 13:54

Halo Infinite
Winter Update (8th November 2022)

Code:

14:02:46 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n64:8+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1b-01.bin was: xtool:mreflate+srep+4x4:lzma
 14:02:46 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-----------------------------------------------------------------------------------------
 16:25:26 - Overall input size: 44.02 GB
 16:25:26 - Overall output size: 31.19 GB (Ratio 70.86%)
 16:25:26 - Overall conversion time: 02:22:21


KaktoR 10-11-2022 03:07

ELDEN RING
v1.07

Code:

09:30:58 - Selected ARC/DS method for Data1a-01.bin was: xtool1+xtool2+srep+4x4:lzma
 09:30:58 - Selected ARC/DS method for Data1b-01.bin was: srep+lzma_sdk
-----------------------------------------------------------------------------------------
 11:55:14 - Overall input size: 45.07 GB
 11:55:14 - Overall output size: 36.75 GB (Ratio 81.54%)
 11:55:14 - Overall conversion time: 02:21:24

Oodle libraries used: v2.5.5 (xtool1) + v2.8.14 (xtool2)

xtool options: l6,n64

L33THAK0R 10-11-2022 08:46

Does anyone know how BMP detection under MSC works? Got a few titles I'm working on that mainly use BMP images for texture assets, however MSC seems to skip over the majority of files. I had a brief trawl through some posts here but searching with shorter search terms is a massive pain in the arse and didnt yield a lot of information.

Masquerade 10-11-2022 09:08

Maybe the thread on Krinkels.org may help you?

KaktoR 11-11-2022 14:26

Saints Row (2022)
v1.1.6.4392638

Code:

21:38:42 - Selected ARC/DS method for Data1a-01.bin was: xtool:mlz4f,l9:lz4_192+srep+4x4:lzma
 21:38:42 - Selected ARC/DS method for Data1b-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 23:25:52 - Overall input size: 44.08 GB
 23:25:52 - Overall output size: 25.51 GB (Ratio 57.88%)
 23:25:52 - Overall conversion time: 01:47:08


KaktoR 13-11-2022 13:03

Wolfenstein II The New Colossus

Code:

15:56:42 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken:5+srep+4x4:lzma
 15:56:42 - Selected ARC/DS method for Data1b-01.bin was: bpk
 15:56:42 - Selected ARC/DS method for Data1c-01.bin was: srep+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 21:50:55 - Overall input size: 58.80 GB
 21:50:55 - Overall output size: 43.14 GB (Ratio 73.37%)
 21:50:55 - Overall conversion time: 05:53:20

Notes:
- Majority of *.resources files using level 4, majority of *.texdb and *.cache using level 5. I was too lazy to sort them out properly so I didn't use the l# option for xtool.
- On many files I didn't got all kraken streams, I checked with every library I have and even used different libraries with --oodle= option like with Elden Ring but to no avail.
- *.pages files using lz4hc but most likely weak compression, but couldn't get all streams (overall about half of streams), so I decided to just compress them with srep+lzma.

dixen 15-11-2022 09:40

Somerville (Steam version)

*.wem, *.bnk - srep+razorMT
6.3 gb> 1.6 gb

Rest files - srep+lolz
3.7 gb > 430 mb

Install time - 1 min.

Masquerade 17-11-2022 09:08

Unlike it's original variant, paks in Crysis 3 Remastered are not encrypted. They are just standard zip files and can be precompressed with xtool:

Code:

Compressed Animations.pak, 144,174,121 => 229,174,364 bytes. Ratio 158.96%

KaktoR 17-11-2022 11:34

Is anyone here working with xtool's --dedup option?

I made many tests since yesterday and I think this will replace srep command entirely, at least for me.

Code:

xtool+srep+4x4:lzma
Compressed 27 files, 4,594,892,800 => 2,346,970,567 bytes. Ratio 51.08%
Compression time: cpu 3.69 sec/real 921.49 sec = 0%. Speed 4.99 mB/s
All OK

15min 23sec

Code:

xtool+4x4:lzma
Compressed 27 files, 4,594,892,800 => 2,346,861,976 bytes. Ratio 51.08%
Compression time: cpu 2.69 sec/real 660.86 sec = 0%. Speed 6.95 mB/s
All OK

11min 02sec

--dedup=(1..5)
srep.exe must be present next to xtool.exe for compression and decompression (no cls-srep required)

KaktoR 18-11-2022 04:40

Here is another test. You can use xtool without any precompression too.

Code:

xtool+4x4:lzma
Compressed 7,383 files, 31,661,584,708 => 8,601,282,118 bytes. Ratio 27.17%
Compression time: cpu 16.39 sec/real 1506.53 sec = 1%. Speed 21.02 mB/s
All OK

28min


Code:

srep+4x4:lzma
Compressed 7,383 files, 31,661,584,708 => 8,601,527,510 bytes. Ratio 27.17%
Compression time: cpu 24.27 sec/real 2312.41 sec = 1%. Speed 13.69 mB/s
All OK

38min

Code:

[External compressor:xtool]
header    = 0
default  = -c64mb -t100p
packcmd  = "{compressor}.exe" precomp { -moption} --dbase --dedup=3 - - <stdin> <stdout>
unpackcmd = "{compressor}.exe" decode -t100p - - <stdin> <stdout>


KaktoR 18-11-2022 07:54

Crysis 2 Remastered

Code:

14:52:34 - Selected ARC/DS method for Data1a-01.bin was: oggre
 14:52:34 - Selected ARC/DS method for Data1b-01.bin was: xtool+4x4:lzma
 14:52:34 - Selected ARC/DS method for Data1c-01.bin was: xtool:mcrysis2remastered+4x4:lzma
 14:52:34 - Selected ARC/DS method for Data1d-01.bin was: xtool+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 16:53:20 - Overall input size: 53.76 GB
 16:53:20 - Overall output size: 34.79 GB (Ratio 64.72%)
 16:53:20 - Overall conversion time: 02:00:44

Data1a
GameCrysis2\music.pak
GameCrysis2\music_chk0.pak

Data1b
GameCrysis2\Video*.pak

Data1c
*.pak (excl 1a+1b)

Data1d
rest of the files

Thanks to Masquerade for database file

Masquerade 18-11-2022 13:57

For Spiderman Miles Morales, use XTool Spidey plugin with liblz4 v1.9.4 to get all streams.

KaktoR 18-11-2022 14:43

Edit: Have mixed up with another title :)


All times are GMT -7. The time now is 09:43.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com