Best Compression Methods for 'Specific' Games. Q&A

[L33THAK0R]

Originally Posted by KaktoR

If I may quote Razor12911 on this:

He should give up
2.6.0 leviathan
2.9.0 kraken

I'm nothing if not stubborn, well at least with that information I've got something to go off of, I'll see what I can do.

[shazzla]

Originally Posted by Jarmen_Kell

Hey guys. Is there any suggested method for ARMA III?

AFAIK half of this game is RSA encrypted ,so it cannot be recompressed (EBO)

PBOs maybe some kind of LZO?!

[Jarmen_Kell]

Originally Posted by shazzla

AFAIK half of this game is RSA encrypted ,so it cannot be recompressed (EBO)

PBOs maybe some kind of LZO?!

Then how Fitgirl compressed it from 146GB to 73GB?

[Masquerade]

Originally Posted by Jarmen_Kell

Then how Fitgirl compressed it from 146GB to 73GB?

Because she decrypted it... duh.

[shazzla]

IMHO its impossible ! RSA is asymmetric. So u can obtain the decryption key from the game ,but reencrypt...?! Only the devs knows the encryption key (Maybe its buried accidentally somewhere in a gamefile )...
Or am i wrong ?

btw Masquerade's answer seems good....

Edit:

Maybe start looking here :

https://www.unknowncheats.me/forum/arma-3-a/

[KaktoR]

Trine 5: A Clockwork Conspiracy

 19:18:46 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd:zstd_137+xtool:dd3+4x4:lzma
 19:18:46 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 20:12:09 - Overall input size: 16.92 GB
 20:12:09 - Overall output size: 12.42 GB (Ratio 73.38%)
 20:12:09 - Overall conversion time: 00:53:21

[Masquerade]

You can rip voiceovers from audio1.fbq in Trine 5 using this QuickBMS script:

get VERSION long
if VERSION <= 3
    comtype zstd
else
    comtype lz4
endif
get FILES long
get BASE_OFF long
math BASE_OFF += 0xc
for i = 0 < FILES
    get NAME string
    get OFFSET long
    get NOZIP byte
    get SIZE long
    get ZSIZE long
    get CRC long
    math OFFSET += BASE_OFF
    if NOZIP == 4
        clog NAME OFFSET ZSIZE SIZE
    else
        log NAME OFFSET SIZE
    endif
next i

Made by eaZy41 from XeNTaX community.

Although comtype LZ4 is mentioned, Trine 5 uses only ZSTD and you can use libzstd v1.3.7 (v1.3.6 also seems to work). LZ4 is used on older versions of the FBQ archive structure.

[KaktoR]

Better use zstd version "1.3.7", as it is stored in trine5.exe.


Although it doesn't make any sense, I looked through some of the streams in the texture archives.

#1 174760 > 174752 = 8 bytes
#2 349520 > 349504 = 16 bytes

#3 11184808 > 11184800 = 8 bytes
#4  5592400 >  5592384 = 16 bytes

#5  699048 >  699040 = 8 bytes
#6 1398096 > 1398080 = 16 bytes

#7    43688 >    43680 = 8 bytes
#8 22369616 > 22369600 = 16 bytes

Actually this is the repeating size pattern.

Signature(1),DSize(4),Unknown(8),ZstdHdr(4),Stream

This Unknown 8 bytes are actually the byte size difference for DSize. 8 and 16.

[Masquerade]

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

[Wanterlude]

Originally Posted by Masquerade

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

same, xtool just crash on unpack with 1.3.7 zstd lib
"ERROR: write error (disk full?) in compression algorithm zstd" in arc

edit.
1.3.5,1.3.6,1.3.7 - error (crash)
test file: gui1.fbq
Trine 5 [3 fbq files] - https://pixeldrain.com/u/cTSsXMes

[Razor12911]

Originally Posted by Wanterlude

same, xtool just crash on unpack with 1.3.7 zstd lib
"ERROR: write error (disk full?) in compression algorithm zstd" in arc

edit.
1.3.5,1.3.6,1.3.7 - error (crash)
test file: gui1.fbq
Trine 5 [3 fbq files] - https://pixeldrain.com/u/cTSsXMes

I won't test as I'm currently busy with something else but maybe try this development version of xtool as a ton of issues were fixed however no update as of yet because it's currently in development so if it works, use it for only this case and revert back to 0.7.8 for everything else. (don't use -dd#, it is bugged in dev build)

Originally Posted by L33THAK0R

I'm nothing if not stubborn, well at least with that information I've got something to go off of, I'll see what I can do.

[Stream1]
// 2.6.0
Name=leviathan
Codec=leviathan:l4
BigEndian=0
Signature=0x0
Structure=Signature(16),DSize(8),CSize(8),OodleHdr(2),Stream
StreamOffset=-2
CompressedSize=CSize
DecompressedSize=DSize
Condition1=OodleHdr = 0x0C8C
Condition2=CSize>=256
Condition3=DSize>CSize

I made quickly made this the other day, not sure if it works very well.

[KaktoR]

Originally Posted by Masquerade

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

Yes it works fine here using libzstd v1.3.7, but tbh I am using the development version of xtool since days, there were some fixes.

Extracting could take a while because of zstd l22 btw.

[KaktoR]

Sid Meier's Civilization VI
AUGUST 2023 UPDATE

 14:01:31 - Selected ARC/DS method for Data1a-01.bin was: xtool:c256mb:mbk2:df20p
 14:01:31 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2
 14:01:31 - Selected ARC/SPLIT method for Data1c-01.bin was: xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2/$deflatepack=xtool:c128mb:mpreflate:mpng:d1+xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2/$oggrepack=oggre
-------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------
 15:42:58 - Overall input size: 25.96 GB
 15:42:58 - Overall output size: 8.69 GB (Ratio 33.49%)
 15:42:58 - Overall conversion time: 01:41:25

Data1a = *.bk2
Data1b = *.blp
Data1c = rest of the files

PS: I used wemtool by Masquerade for the wem's

[KaktoR]

Originally Posted by Danziel123

Maybe someone know what best compress method for starfield? Thank you

Bruh
https://fileforums.com/showpost.php?...&postcount=379

[KaktoR]

Baldurs Gate 3
v4.1.1.3686210

 17:57:24 - Selected ARC/DS method for Data1a-01.bin was: xtool:mbg3+xtool:mzlib+xtool:dd3+4x4:lzma
 17:57:24 - Selected ARC/DS method for Data1b-01.bin was: xtool:c1024mb:mbk2:df20p
 17:57:24 - Selected ARC/DS method for Data1c-01.bin was: xtool:mbg3+xtool:dd3+zstd
 17:57:24 - Selected ARC/SPLIT method for Data1d-01.bin was: xtool:dd3+4x4:lzma/$deflatepack=xtool:c128mb:mpreflate:mpng:d1+xtool:dd3+4x4:lzma/$mp3pack=7zdll-pm:m0=mp3det:m1=packmp3c
-------------------------------------------------------------------------------------------------------------------------------------------
 21:42:21 - Overall input size: 137.01 GB
 21:42:21 - Overall output size: 88.23 GB (Ratio 64.39%)
 21:42:21 - Overall conversion time: 03:40:21