FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

KaktoR 01-03-2023 11:27

Scars Above

Here are some tests, not digged deeper as I have no time nor interest in this

Code:

zlib
Chunk size: 32.0 MB, Threads: 6, Depth: 0

Streams: 336707/337175
Time: 00:02:32 (00:11:07)
Memory: 457 MB (457 MB)

Results: 12.5 GB >> 21.7 GB

reflate
Chunk size: 32.0 MB, Threads: 6, Depth: 0

Streams: 337175/337175
Time: 00:03:27 (00:16:07)
Memory: 457 MB (457 MB)

Results: 12.5 GB >> 21.7 GB

preflate
Chunk size: 32.0 MB, Threads: 6, Depth: 0

Streams: 335018/337175
Time: 00:05:14 (00:26:43)
Memory: 458 MB (458 MB)

Results: 12.5 GB >> 21.8 GB


Masquerade 01-03-2023 11:48

^^
Pak contains a shit ton of WWise Audio too so you can patch out the larger files using FModel / MESA and XTool's erase function and use WemTool. I'm skipping this one too :p

Gehrman 03-03-2023 05:48

Death Stranding Directors Cut v1.002
 
Code:

61/9 GB
*.Bin
Code:

dst+xtool:c32mb:mkraken:dd3+lolz2:mtt1:mt6:mc256
Movie.mpk
Code:

4x4
Other Files
Code:

srep:m3f+4x4:lzma:a1:mfbt4:32m:fb273:mc1024:lc8
Code:

51 GB
CT: 11 H
DT: 20 M

KaktoR 05-03-2023 12:55

Wo Long Fallen Dynasty

EventMaker3.rdb.bin
Code:

zlib
Chunk size: 32.0 MB, Threads: 6, Depth: 0

Streams: 685469/685469
Time: 00:00:44 (00:03:12)
Memory: 317 MB (317 MB)

Results: 4.09 GB >> 10.2 GB

Files in archive folder are webm videos.

KaktoR 06-03-2023 09:23

Hogwarts Legacy
v18th Februrary 2023, 2 languages

Code:

14:17:08 - Selected ARC/DS method for Data1a-01.bin was: xtool:c128mb:mkraken,l5,n256:core_2.8.14+xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 14:17:08 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 18:20:05 - Overall input size: 75.40 GB
 18:20:05 - Overall output size: 64.43 GB (Ratio 85.45%)
 18:20:05 - Overall conversion time: 04:02:52


Masquerade 06-03-2023 10:59

The DioField Chronicle
  • DFC-WindowsNoEditor.pak
    Code:

    ue4d:key=15E3110F40A348CFCC989F0A7A5506B6DE13942DB2F2F8C07F0D640968F9AF26+xtool_kraken_dedup5+lolz
  • Everything else:
    Code:

    razor

Thanks to Shegorat for UE4D library and Razor12911 for XTool library.

Oodle Core v2.9.5 used (v2.9.6 has outrageous memory issues).

22.8GB ---> 18.8GB

Compression Time: 9 hours.

Not worth it with lolz due to very little amount of space saved, best just use LZMA :p

KaktoR 09-03-2023 10:47

The Outer Worlds Spacer's Choice

kraken

pakchunk15-WindowsNoEditor.pak
Code:

Library loaded: v2.8.14\oo2core_8_win64.dll

Streams: 64668/64668
Time: 00:09:47 (00:57:18)
Memory: 479 MB (479 MB)

Results: 7.47 GB >> 15.0 GB

It seems that you can also use v2.9.2/2.9.5/2.9.6 libraries.

Masquerade 09-03-2023 10:59

Don't use library v2.9.6, there's a memory bug.

Sebazz 10-03-2023 11:33

Canīt Compress Halo Infinite
 
Hello, I tried to make a repack of Halo Infinite game, an its stuck at 60% ... i donīt know why. It's the only game that this happens to me.

Here is my arc.ini settings, i use srep+lzma2

Code:

[External compressor:srep]
header    = 0
packcmd  = srep -m3f -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d - - <stdin> <stdout>

[External compressor:lzma2]
header    = 0
packcmd  = 7z a -txz -an -mcrc=0 -m1=lzma2:d25:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mx9 -mmt=on -si -so <stdin> <stdout>
unpackcmd = 7z x -txz -an -y -si -so <stdin> <stdout>


Gehrman 10-03-2023 11:36

Quote:

Originally Posted by Sebazz (Post 500425)
Hello, I tried to make a repack of Halo Infinite game, an its stuck at 60% ... i donīt know why. It's the only game that this happens to me.

Here is my arc.ini settings, i use srep+lzma2

Code:

[External compressor:srep]
header    = 0
packcmd  = srep -m3f -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d - - <stdin> <stdout>

[External compressor:lzma2]
header    = 0
packcmd  = 7z a -txz -an -mcrc=0 -m1=lzma2:d25:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mx9 -mmt=on -si -so <stdin> <stdout>
unpackcmd = 7z x -txz -an -y -si -so <stdin> <stdout>


Use mc=128
Or use 4x4:lzma:a1:mfbt4:32m:fb273:mc1024:lc8, it has a better ratio and speed.

KaktoR 10-03-2023 14:12

Halo Infinite
Season 3 Echoes Within (7th March 2023)

Code:

21:14:05 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n64:core_2.8.9+xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:14:05 - Selected ARC/DS method for Data1b-01.bin was: xtool:mreflate+xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 21:14:05 - Selected ARC/DS method for Data1c-01.bin was: xtool:db:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
 23:00:58 - Overall input size: 50.64 GB
 23:00:58 - Overall output size: 34.11 GB (Ratio 67.36%)
 23:00:58 - Overall conversion time: 01:46:49


kuyhaa 15-03-2023 20:56

1 Attachment(s)
Quote:

Originally Posted by KaktoR (Post 499245)
Mount & Blade II Bannerlord

Seems like tpac files use lz4hc level 12. On this level you will get low streams but output is much bigger then with other levels.

Code:

Compressed 1 file, 7,120,255 => 14,068,315 bytes. Ratio 197.58%
Compression time: cpu 0.00 sec/real 30.88 sec = 0%. Speed 0.23 mB/s
All OK

However it is slow af

what the version of liblz4 and plugin ?

i'm trying unity_R6 , ratio 100%

sample attch

Masquerade 17-03-2023 09:42

The Sims 4 [v1.96.365.1030 + All DLCs]

Code:

xtool_zlib_dedup5+LZMA2
56.2GB ---> 35.1GB

Not used LOLZ because it takes too long.

KaktoR 20-03-2023 10:26

Diablo IV (Closed Beta)

Code:

zlib

Streams: 19842 / 19842
Time: 00:02:59 (CPU 00:02:58)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 1.00 GB >> 1.53 GB

I guess this will still the case for the release version.

Masquerade 23-03-2023 11:46

Don't use MSC on The Walking Dead Saints and Sinners Chapter 2: Retribution. It will cause archive corruption. :(

L33THAK0R 23-03-2023 16:13

Could anyone give me a bit of advice on how to properly use the UE4 XTool plugin? I'm currently using Unreal R8 with XTool 0.6.9 for a title called "The Entropy Center", but initial tests, at least to me are indicating I've somehow not managed to get XTool to decrypt the relevant ".PAK", ".UCAS" & ".UTOC" archives, I've attached an image below, if anyone could show me what I'm doing wrong I'd very much appreciate it.

https://i.imgur.com/spqCCGz.png

Razor12911 24-03-2023 00:14

https://fileforums.com/showpost.php?...2&postcount=14

dixen 24-03-2023 01:21

Quote:

Originally Posted by Razor12911 (Post 500573)

This version does not work on UCAS from Entropy Centre((

Razor12911 24-03-2023 02:18

Quote:

Originally Posted by dixen (Post 500574)
This version does not work on UCAS from Entropy Centre((

Code:

XTool is created by Razor12911

Streams: 353168 / 353168
Time: 00:09:03 (CPU 00:06:38)

Size: 10.9 GB >> 21.0 GB

Doesn't work you say, I suggest using two separate processes of xtool for this.

dixen 24-03-2023 04:56

Quote:

Originally Posted by Razor12911 (Post 500575)
Code:

XTool is created by Razor12911

Streams: 353168 / 353168
Time: 00:09:03 (CPU 00:06:38)

Size: 10.9 GB >> 21.0 GB

Doesn't work you say, I suggest using two separate processes of xtool for this.

Sorry, I forgot change AES key in db.bat))

panker1992 24-03-2023 07:20

Resident Evil 4 Remake

use zstd and zlib and reflate from xtool 6.9

they don't use oodle anymore :D

rest is srep and lzma

Masquerade 24-03-2023 11:29

Cities Skylines [v1.16.1-f2]

Code:

srep+lolz/$raw=msc+xtool_dedup5_fl2/$ogg=oggre
16.4GB ---> 6GB

KaktoR 26-03-2023 10:48

Elden Ring
v1.09

Code:

17:30:13 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken:odoo2core_5_win64.dll:core_2.5.5+xtool:mkraken:odoo2core_8_win64.dll:core_2.8.14+xtool:db:dd3:c32mb:dd:cpl8,t100p
 17:30:13 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3:c32mb:dd:cpl8,t100p
-------------------------------------------------------------------------------------------------------------------------------------------
 19:11:18 - Overall input size: 49.92 GB
 19:11:18 - Overall output size: 40.30 GB (Ratio 80.72%)
 19:11:18 - Overall conversion time: 01:41:04
-------------------------------------------------------------------------------------------------------------------------------------------
 19:11:23 - Starting Data1a-01.bin archive decompression.
 19:45:48 - Starting Data1b-01.bin archive decompression.
 19:47:32 - Overall decompression time: 00:36:09
 19:47:32 - All files have been successfully extracted!


IRAQIGHOST 28-03-2023 04:45

Hi
New way to compress Call of Duty Black Ops 3
SP+MP+ZM (with bots)

Repack Size: 76 Gb
Final Size: 124 Gb

*.xpak
srep_new:3+razor_stdio

*.ff + *.fd
xt_zlib+srep_new:3+LOLZ_NORMAL

*.sabl + *.sabs
srep_new:3+razor_stdio

rest of files
srep_new:3+LZMA-MT*

dixen 28-03-2023 09:51

Last Of Us Part 1

Game used oodle kraken (need oo2core_9_win64.dll renamed to oo2core_8_win64.dll from game folder)
UPD.
Some files used zlib+kraken

Masquerade 29-03-2023 00:07

Quote:

Originally Posted by dixen (Post 500620)
Last Of Us Part 1

Game used oodle kraken (need oo2core_9_win64.dll renamed to oo2core_8_win64.dll from game folder)

DO NOT use the v2.9.6 Oodle core, it has terrible memory problems!!

KaktoR 29-03-2023 01:19

You can use core 2.8.14 up to core 2.9.5

common.psarc
Code:

kraken:l4:n32

Streams: 14951 / 14974
Time: 00:00:35 (CPU 00:00:44)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 1.10 GB >> 1.66 GB


You will get some more streams if you increase scan iterations.

Code:

kraken:l4:n128

Streams: 16320 / 16331
Time: 00:00:16 (CPU 00:01:05)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 1.10 GB >> 1.68 GB

Code:

kraken:l4:n256

Streams: 16679 / 16686
Time: 00:00:38 (CPU 00:01:25)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 1.10 GB >> 1.69 GB

-----

core.psarc

Code:

kraken,l4,n256
Streams: 30184 / 30197
Time: 00:02:13 (CPU 00:01:40)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 2.12 GB >> 3.39 GB


zlib
Streams: 1243 / 1243
Time: 00:07:06 (CPU 00:06:51)
Duplicates: 0 (0.00 MB / 0.00 MB [0.00 MB])

Size: 3.39 GB >> 5.75 GB


Razor12911 29-03-2023 04:47

Forza Horizon 5 Premium Edition [1.573.834.0]
Code:

xtool:c16mb:mzlib:t50p:db:dd3:cpl6,t50p
Code:

Streams: 1364716 / 1373346
Time: 02:20:20 (CPU 16:23:30)
Duplicates: 408493 (8.52 GB) [12.9 GB >> 21.9 GB]
Srep decompression memory: 5.20 GB [19.7 GB*]

Size: 160 GB >> 241 GB >> 219 GB >> 170 GB >> 101 GB


dixen 29-03-2023 06:06

Quote:

Duplicates: 252533 (7.83 GB) [10.9 GB >> 18.9 GB]
How do it?) XTool without SREP?

KaktoR 29-03-2023 06:08

https://i.imgur.com/PV0dqwK.png

hdneo 29-03-2023 07:57

Quote:

Originally Posted by KaktoR (Post 500635)

what is version of this xtool?

KaktoR 29-03-2023 08:11

It is xtool.exe + xtoolui.dll.

I guess Razor12911 shared it in latest version. If not, then well :D

KaktoR 29-03-2023 08:27

The Last of Us Part 1

Code:

14:38:25 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l4,n256:core_2.9.5+xtool:mpreflate+xtool:db:dd3+4x4:lzma
 14:38:25 - Selected ARC/DS method for Data1b-01.bin was: xtool:db:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 16:55:48 - Overall input size: 69.72 GB
 16:55:48 - Overall output size: 50.55 GB (Ratio 72.51%)
 16:55:48 - Overall conversion time: 02:15:20
 16:55:48 - Overall conversion media: 1 custom media
-------------------------------------------------------------------------------------------------------------------------------------------
 17:07:14 - Starting Data1a-01.bin archive decompression.
 17:24:41 - Starting Data1b-01.bin archive decompression.
 17:25:31 - Overall decompression time: 00:18:17
 17:25:31 - All files have been successfully extracted!


dixen 30-03-2023 05:29

Last of Us. Part 1

Little test core.psarc

xtool 0.67 (kraken+zlib) - 2.1 gb > 4.3 gb
oo2reck+xtool (zlib) - 2.1 gb > 5.6 gb

IRAQIGHOST 30-03-2023 05:43

The Last of Us Part 1

Only English

*.psarc
oo2reck:9+srep_new:3+LOLZ_NORMAL
oo2core (2.9.5)

Other Files
srep_new:3+LOLZ_NORMAL

65 Gb --->> 43 Gb

KaktoR 31-03-2023 13:35

The Outer Worlds Spacer's Choice
v1.5931.19079

Code:

19:29:41 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l7:core_2.9.5+xtool:mreflate+xtool:odb_odd3+xtool:odb:odd3:ocpt100p,l6
 19:29:41 - Selected ARC/DS method for Data1b-01.bin was: xtool:odb:odd3:ocpt100p,l6
-------------------------------------------------------------------------------------------------------------------------------------------
 22:34:25 - Overall input size: 51.84 GB
 22:34:25 - Overall output size: 45.05 GB (Ratio 86.90%)
 22:34:25 - Overall conversion time: 03:04:41


Razor12911 01-04-2023 12:23

Wo Long: Fallen Dynasty [1.0.6]

Code:

xtool:c32mb:mzlib:t100p:db:dd3:cpl10,t100p
Code:

Compression time: 32 minutes, 29 seconds
Final Size: 39.7 GB > 21.2 GB


Wanterlude 02-04-2023 07:16

Quote:

Originally Posted by Razor12911 (Post 500673)
Wo Long: Fallen Dynasty [1.0.6]

Code:

xtool:c32mb:mzlib:t100p:db:dd3:cpl10,t100p
Code:

Compression time: 32 minutes, 29 seconds
Final Size: 39.7 GB > 21.2 GB


Wo long v.1.05 (last update)

system.rdb.bin CRC error

I try:
[xtool:zlib or preflate] [db or -] [dd5 or dd3] [lolz or lzma]

I want to know if this error is from my side or not.
I would be very grateful for your help!

Download a file [2.61 gb]:
Fileditch / Pixeldrain

Razor12911 02-04-2023 23:03

Quote:

Originally Posted by Wanterlude (Post 500678)
Wo long v.1.05 (last update)

system.rdb.bin CRC error

I try:
[xtool:zlib or preflate] [db or -] [dd5 or dd3] [lolz or lzma]

I want to know if this error is from my side or not.
I would be very grateful for your help!

Download a file [2.61 gb]:
Fileditch / Pixeldrain

I forgot I had fixed these issues on the WIP version of xtool as I've noticed this bug a few days after I released 0.6.9. Essentially for this input, do not use dd nor dd# because for one, the deduplication feature for this input is bugged. There are so many 16KB stream in this game and a lot of duplicates that the hash function used by xtool ended up detecting duplicates so do not use deduplication on 0.6.9 and older. I used 4x4:lzma equivalent which you can use to achieve the same result or lolz for better.

rbn1120 06-04-2023 00:21

Ready or Not | 92,00GB -> 33,90GB

Code:

.pak
srep:m3f:a2:l256+oodleMT:m0:l3:c128:t6

.wav
msc

rest
srep:m3f:a2:l256+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096



All times are GMT -7. The time now is 08:56.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com