FileForums - Best Compression Methods for 'Specific' Games. Q&A

 19:29:41 - Selected ARC/DS method for Data1a-01.bin was: xtool:mkraken,l7:core_2.9.5+xtool:mreflate+xtool:odb_odd3+xtool:odb:odd3:ocpt100p,l6

 19:29:41 - Selected ARC/DS method for Data1b-01.bin was: xtool:odb:odd3:ocpt100p,l6

-------------------------------------------------------------------------------------------------------------------------------------------

 22:34:25 - Overall input size: 51.84 GB

 22:34:25 - Overall output size: 45.05 GB (Ratio 86.90%)

 22:34:25 - Overall conversion time: 03:04:41

Razor12911

01-04-2023 12:23

Wo Long: Fallen Dynasty [1.0.6]

Code:

xtool:c32mb:mzlib:t100p:db:dd3:cpl10,t100p

Code:

Compression time: 32 minutes, 29 seconds

Final Size: 39.7 GB > 21.2 GB

Wanterlude

02-04-2023 07:16

Quote:

Originally Posted by Razor12911 (Post 500673)

Wo Long: Fallen Dynasty [1.0.6]

Code:

xtool:c32mb:mzlib:t100p:db:dd3:cpl10,t100p

Code:

Compression time: 32 minutes, 29 seconds

Final Size: 39.7 GB > 21.2 GB

Wo long v.1.05 (last update)

system.rdb.bin CRC error

I try:
[xtool:zlib or preflate] [db or -] [dd5 or dd3] [lolz or lzma]

I want to know if this error is from my side or not.
I would be very grateful for your help!

Download a file [2.61 gb]:
Fileditch / Pixeldrain

Razor12911

02-04-2023 23:03

Quote:

Originally Posted by Wanterlude (Post 500678)

I forgot I had fixed these issues on the WIP version of xtool as I've noticed this bug a few days after I released 0.6.9. Essentially for this input, do not use dd nor dd# because for one, the deduplication feature for this input is bugged. There are so many 16KB stream in this game and a lot of duplicates that the hash function used by xtool ended up detecting duplicates so do not use deduplication on 0.6.9 and older. I used 4x4:lzma equivalent which you can use to achieve the same result or lolz for better.

rbn1120

06-04-2023 00:21

Ready or Not | 92,00GB -> 33,90GB

Code:

.pak

srep:m3f:a2:l256+oodleMT:m0:l3:c128:t6



.wav

msc



rest

srep:m3f:a2:l256+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096

rbn1120

06-04-2023 04:02

Satisfactory | 19,90GB -> 6,08GB

Code:

.pak

srep:m3f:a2:l256+lolz:dt:dtb1:dtw1:dtm1:dto1:dtd1:mtt1:mt4:d128m:fba4096



rest

srep:m3f:a2:l256+oodleMT:m0:l3:c128:t6

KaktoR

07-04-2023 08:27

EVERSPACE 2

zlib

Code:

Streams: 927573 / 927957

Time: 00:08:21 (CPU 00:36:08)

Duplicates: 42779 (352 MB) [663 MB >> 2.60 GB]

Srep decompression memory: 619 MB [1.15 GB*]



Size: 28.0 GB >> 57.2 GB >> 54.6 GB >> 46.6 GB

Edit ---

Code:

 21:04:04 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzlib:odb:odd3+4x4:lzma

 21:04:04 - Selected ARC/DS method for Data1b-01.bin was: msc_tak

 21:04:04 - Selected ARC/DS method for Data1c-01.bin was: xtool:odb:odd3+4x4:lzma

-------------------------------------------------------------------------------------------------------------------------------------------

 22:20:13 - Overall input size: 34.27 GB

 22:20:13 - Overall output size: 24.85 GB (Ratio 72.51%)

 22:20:13 - Overall conversion time: 01:16:08

-------------------------------------------------------------------------------------------------------------------------------------------

 22:20:19 - Starting Data1a-01.bin archive decompression.

 22:28:59 - Starting Data1b-01.bin archive decompression.

 22:29:14 - Starting Data1c-01.bin archive decompression.

 22:31:15 - Overall decompression time: 00:10:55

 22:31:15 - All files have been successfully extracted!

KaktoR

08-04-2023 12:36

Hearts of Iron IV
v1.12.10

Code:

 20:54:11 - Selected ARC/DS method for Data1a-01.bin was: srep_new:1+lolz:d33:mtt1:mt12:mc1023

 20:54:11 - Selected ARC/DS method for Data1b-01.bin was: msc_tak

 20:54:11 - Selected ARC/DS method for Data1c-01.bin was: oggre

 20:54:11 - Selected ARC/DS method for Data1d-01.bin was: 1

 20:54:11 - Selected ARC/SPLIT method for Data1e-01.bin was: srep_new:1+lolz:d33:mtt1:mt12:mc1023/$jpgpack=xtool:mbrunsli/$mp3pack=7zdll-pm:m0=mp3det:m1=packmp3c/$deflatepack=xtool:c128mb:mpreflate:mpng:d1+srep_new:1+lolz:d33:mtt1:mt12:mc1023/$storepack=1/$textpack=srep_new:1+lzma:a1:mfbt4:256m:fb273:mc1000000000:lc8

-------------------------------------------------------------------------------------------------------------------------------------------

 21:18:08 - Overall input size: 6.38 GB

 21:18:08 - Overall output size: 3.03 GB (Ratio 47.49%)

 21:18:08 - Overall conversion time: 00:23:56

-------------------------------------------------------------------------------------------------------------------------------------------

 21:34:34 - Overall decompression time: 00:06:05

 21:34:34 - All files have been successfully extracted!





---





Data1a = *.dds

Data1b = *.wav, *.bmp

Data1c = *.ogg (exclude "dlc\dlc035_no_step_back_preorder_bonus\music\Katyusha.ogg")

Data1d = "dlc\dlc035_no_step_back_preorder_bonus\music\Katyusha.ogg"

Data1e = rest of the files - masked

L33THAK0R

10-04-2023 23:19

Bit of a basic question but how exactly does ZSTD re-compression work? Within XTool, is it a library-based like LZ4 or more universal like reflate? Additionally is ripping a block, say for example the first 200mb of a larger archive a suitable method for creating a sample to run tests on? I'm currently giving most of the RE Engine titles a crack and have been having some difficulties with testing different ZSTD libraries, as I've had no success with the stock XTool v0.5.3 ZSTD codec library, and its a bit of a waste to write so much data to the disk just for it to be for nothing.

dixen

12-04-2023 02:03

What about *.vpk from Half-Life Alyx? LZ4 algo?

Ra7eN

12-04-2023 14:26

Skyrim SE

definitely wrong area. Please delete this.

KaktoR

13-04-2023 13:24

X4 Foundations v6.0

Maybe someone might find this usefull

Code:

zlib+msc (oggre will crash)

01.dat

05.dat

06.dat

07.dat

extensions\ego_dlc_boron\ext_01.dat

extensions\ego_dlc_boron\ext_02.dat

extensions\ego_dlc_pirate\ext_01.dat

extensions\ego_dlc_pirate\ext_02.dat

extensions\ego_dlc_split\ext_01.dat

extensions\ego_dlc_terran\ext_01.dat

extensions\ego_dlc_terran\ext_02.dat



msc

02.dat



oggre will crash

03.dat

04.dat