Best Compression Methods for 'Specific' Games. Q&A - Page 230

KaktoR · #1 29-08-2023, 05:57

If I may quote Razor12911 on this:

Code:

He should give up
2.6.0 leviathan
2.9.0 kraken

L33THAK0R · #2 29-08-2023, 08:03

Quote:

Originally Posted by KaktoR

If I may quote Razor12911 on this:

Code:

He should give up
2.6.0 leviathan
2.9.0 kraken

I'm nothing if not stubborn, well at least with that information I've got something to go off of, I'll see what I can do.

shazzla · #3 30-08-2023, 09:57

IMHO its impossible ! RSA is asymmetric. So u can obtain the decryption key from the game ,but reencrypt...?! Only the devs knows the encryption key (Maybe its buried accidentally somewhere in a gamefile )...
Or am i wrong ?

btw Masquerade's answer seems good....

Edit:

Maybe start looking here :

https://www.unknowncheats.me/forum/arma-3-a/

KaktoR · #4 31-08-2023, 11:12

Trine 5: A Clockwork Conspiracy

Code:

 19:18:46 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzstd:zstd_137+xtool:dd3+4x4:lzma
 19:18:46 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 20:12:09 - Overall input size: 16.92 GB
 20:12:09 - Overall output size: 12.42 GB (Ratio 73.38%)
 20:12:09 - Overall conversion time: 00:53:21

Masquerade · #5 31-08-2023, 12:09

You can rip voiceovers from audio1.fbq in Trine 5 using this QuickBMS script:

Code:

get VERSION long
if VERSION <= 3
    comtype zstd
else
    comtype lz4
endif
get FILES long
get BASE_OFF long
math BASE_OFF += 0xc
for i = 0 < FILES
    get NAME string
    get OFFSET long
    get NOZIP byte
    get SIZE long
    get ZSIZE long
    get CRC long
    math OFFSET += BASE_OFF
    if NOZIP == 4
        clog NAME OFFSET ZSIZE SIZE
    else
        log NAME OFFSET SIZE
    endif
next i

Made by eaZy41 from XeNTaX community.

Although comtype LZ4 is mentioned, Trine 5 uses only ZSTD and you can use libzstd v1.3.7 (v1.3.6 also seems to work). LZ4 is used on older versions of the FBQ archive structure.

KaktoR · #6 31-08-2023, 12:23

Better use zstd version "1.3.7", as it is stored in trine5.exe.

Although it doesn't make any sense, I looked through some of the streams in the texture archives.

Code:

#1 174760 > 174752 = 8 bytes
#2 349520 > 349504 = 16 bytes

#3 11184808 > 11184800 = 8 bytes
#4  5592400 >  5592384 = 16 bytes

#5  699048 >  699040 = 8 bytes
#6 1398096 > 1398080 = 16 bytes

#7    43688 >    43680 = 8 bytes
#8 22369616 > 22369600 = 16 bytes

Actually this is the repeating size pattern.

Code:

Signature(1),DSize(4),Unknown(8),ZstdHdr(4),Stream

This Unknown 8 bytes are actually the byte size difference for DSize. 8 and 16.

Masquerade · #7 31-08-2023, 15:17

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Code:

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

Wanterlude · #8 31-08-2023, 15:22

Quote:

Originally Posted by Masquerade

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Code:

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

same, xtool just crash on unpack with 1.3.7 zstd lib
"ERROR: write error (disk full?) in compression algorithm zstd" in arc

edit.
1.3.5,1.3.6,1.3.7 - error (crash)
test file: gui1.fbq
Trine 5 [3 fbq files] - https://pixeldrain.com/u/cTSsXMes

KaktoR · #9 01-09-2023, 01:17

Quote:

Originally Posted by Masquerade

Did your archive decompress alright? I'm getting this error from XTool when trying to decompress my archive:
I was using libzstd v1.3.7.

Code:

Unpacking 25,439,279,314 bytes with XTOOL decode -t100p $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
  0.0%XTool is created by Razor12911

Time: 00:00:15 (CPU 00:02:30)

  0.0%EThreadException: Error in the method 'zstd'

Errorlevel=1
  0.0%
ERROR: invalid compression method or parameters in XTZSTD

Yes it works fine here using libzstd v1.3.7, but tbh I am using the development version of xtool since days, there were some fixes.

Extracting could take a while because of zstd l22 btw.

Razor12911 · #10 31-08-2023, 18:39

Quote:

Originally Posted by Wanterlude

same, xtool just crash on unpack with 1.3.7 zstd lib
"ERROR: write error (disk full?) in compression algorithm zstd" in arc

edit.
1.3.5,1.3.6,1.3.7 - error (crash)
test file: gui1.fbq
Trine 5 [3 fbq files] - https://pixeldrain.com/u/cTSsXMes

I won't test as I'm currently busy with something else but maybe try this development version of xtool as a ton of issues were fixed however no update as of yet because it's currently in development so if it works, use it for only this case and revert back to 0.7.8 for everything else. (don't use -dd#, it is bugged in dev build)

Quote:

Originally Posted by L33THAK0R

I'm nothing if not stubborn, well at least with that information I've got something to go off of, I'll see what I can do.

Code:

[Stream1]
// 2.6.0
Name=leviathan
Codec=leviathan:l4
BigEndian=0
Signature=0x0
Structure=Signature(16),DSize(8),CSize(8),OodleHdr(2),Stream
StreamOffset=-2
CompressedSize=CSize
DecompressedSize=DSize
Condition1=OodleHdr = 0x0C8C
Condition2=CSize>=256
Condition3=DSize>CSize

I made quickly made this the other day, not sure if it works very well.

KaktoR · #11 01-09-2023, 06:44

Sid Meier's Civilization VI
AUGUST 2023 UPDATE

Code:

 14:01:31 - Selected ARC/DS method for Data1a-01.bin was: xtool:c256mb:mbk2:df20p
 14:01:31 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2
 14:01:31 - Selected ARC/SPLIT method for Data1c-01.bin was: xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2/$deflatepack=xtool:c128mb:mpreflate:mpng:d1+xtool:dd3+lolz:d64:mtt1:mt10:fba4096:mc2/$oggrepack=oggre
-------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------
 15:42:58 - Overall input size: 25.96 GB
 15:42:58 - Overall output size: 8.69 GB (Ratio 33.49%)
 15:42:58 - Overall conversion time: 01:41:25

Data1a = *.bk2
Data1b = *.blp
Data1c = rest of the files

PS: I used wemtool by Masquerade for the wem's

KaktoR · #12 01-09-2023, 12:46

Baldurs Gate 3
v4.1.1.3686210

Code:

 17:57:24 - Selected ARC/DS method for Data1a-01.bin was: xtool:mbg3+xtool:mzlib+xtool:dd3+4x4:lzma
 17:57:24 - Selected ARC/DS method for Data1b-01.bin was: xtool:c1024mb:mbk2:df20p
 17:57:24 - Selected ARC/DS method for Data1c-01.bin was: xtool:mbg3+xtool:dd3+zstd
 17:57:24 - Selected ARC/SPLIT method for Data1d-01.bin was: xtool:dd3+4x4:lzma/$deflatepack=xtool:c128mb:mpreflate:mpng:d1+xtool:dd3+4x4:lzma/$mp3pack=7zdll-pm:m0=mp3det:m1=packmp3c
-------------------------------------------------------------------------------------------------------------------------------------------
 21:42:21 - Overall input size: 137.01 GB
 21:42:21 - Overall output size: 88.23 GB (Ratio 64.39%)
 21:42:21 - Overall conversion time: 03:40:21

IRAQIGHOST · #13 01-09-2023, 21:19

Starfield

DiskSpan
xt_zlib+xtool:s:mzlib+srep_new:3+LOLZ_ULTRA

Test File (Starfield - Animations.ba2)
Size: 319 MB >> 711 MB
Final Size: 170.56 MB

KaktoR · #14 02-09-2023, 04:42

Quote:

Originally Posted by IRAQIGHOST

Starfield

DiskSpan
xt_zlib+xtool:s:mzlib+srep_new:3+LOLZ_ULTRA

Test File (Starfield - Animations.ba2)
Size: 319 MB >> 711 MB
Final Size: 170.56 MB

Why use old xtool with new xtool? And why skip parameter?

IRAQIGHOST · #15 02-09-2023, 05:24

Quote:

Originally Posted by KaktoR

Why use old xtool with new xtool? And why skip parameter?

for try to get more size

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following 3 Users Say Thank You to KaktoR For This Useful Post:
JustFun (02-09-2023), L0v3craft (31-08-2023), Wanterlude (31-08-2023)

The Following 2 Users Say Thank You to Masquerade For This Useful Post:
shazzla (31-08-2023), Wanterlude (31-08-2023)

The Following User Says Thank You to KaktoR For This Useful Post:
Wanterlude (31-08-2023)

The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
L0v3craft (31-08-2023), L33THAK0R (31-08-2023), Wanterlude (01-09-2023)

The Following User Says Thank You to KaktoR For This Useful Post:
JustFun (02-09-2023)