FileForums - Best Compression Methods for 'Specific' Games. Q&A

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

Code:

Title: Mafia II Director’s Cut Version: GOG (Update5) PC: 6 Cores 3.2GHz + 16GB Ram + HDD Original Size: 7.73 GB Compressed Size: 3.79 GB Method: SDS Files: XT+srep:m3f:l128+lolz:dtb1:d192m:mtt1:mt4:mc1023 BIK Files: bpk+srep:m5f:l512 Other Files: srep:m3f:l128+7z Compress Time: 1 Hours Install Time: 6 Min

Need for Speed Most Wanted 2012(English Only)
Initial Size : 5.36GB
Final Size: 2.27GB
Method: pzlibv32017:c256m:t2+srep64:m3f+4x4:lzma:16mb:norm al:32:lc8

Darksiders III steam

game size 18.6 Gb
compressed game size 13.2 Gb

NOTHING ripped
NOTHING re-encoded
ALL languages

xtool 0.9 library By Razor12911
Srep v3.92 library By Bulat Ziganshin
Lolz v2.1.a.7 library By ProFrager

compression time 25 hours + -
decompression time 25 min + -

all files---- xtool zlib+ srep + lolz ----data1.cab

intel core i7 2 cores 2.9Mhz
16GB ram

Code:

Title: Wreckfest Version: Update 5 (v20180821) Original Size: 13.3 GB Compressed Size: 8.54 GB + 232 MB DLC Soundtrack, DLC Wallpapers = 8.77 GB Method: srep:m3f:l128+4x4:lzma:a1:mfbt4:64m:fb273:mc1000000000:lc8+diskspan:4430mb:4481mb Compress Time: 25 Mins Install Time: 4 Mins

Darksiders III ver. 1.1 Codex + The Summoning Intro
text Ru/En
voice Only En
replaced intro on Darksiders 3 - The Summoning Trailer by Dark Corsair
game size 32 Gb (used for pack u4pak and QuickBMS for unpack)

Code:

# Unreal Engine 4 - Unreal Tournament 4 (script 0.4.2)

# script for QuickBMS http://quickbms.aluigi.org



# set your AES_KEY here as text or C string ("\x11\x22...")

set AES_KEY binary ""

putarray 10 -1 "KIWIKIWIKIWIKIWIKIWIKIWIKIWIKIWI"   # first beta of Street Fighter V

putarray 10 -1 "_aS4mfZK8M5s5KWC2Lz2VsFnGKI7azgl"   # current version of Street Fighter V

putarray 10 -1 "bR!@nbR0wnc@rychR!$d@nd@v3d3R3kj!mj0$hk3v!nm!ch@3lm!k3s3@nst3v3t!m" # Victory: The Culling

putarray 10 -1 "casd#55@#$%323!$^#b%05sa5W|hhaf4365s52ss51|55m!|{55s^@@36f233|-|0w@%3g8hssDk35/!Nm|_|%ds23%a32d5&23as3%12p|-|y$t3ds562d23fav3c@dyw38#49" # Victory: The Culling

putarray 10 -1 ""

math AES_KEY_IS_SET = 0



# 1 = HIT

math WORKAROUND = 0



goto -0x2c

get MAGIC long  #idstring "\xe1\x12\x6f\x5a" # 0x5a6f12e1

if MAGIC == 0x5a6f12e1

    # ok

elif MAGIC == 0xe1126f5a

    endian big

else

    # HIT game 0x1233a

    math WORKAROUND = 1

endif

get VERSION long

get OFFSET longlong

get SIZE longlong

getdstring HASH 20

if WORKAROUND == 1

    math VERSION = 3

endif



goto OFFSET

callfunction GET_NAME 1

get FILES long



for i = 0 < FILES

    callfunction GET_NAME 1

    savepos TMP_OFF



    get OFFSET longlong

    get ZSIZE longlong

    get SIZE longlong

    get ZIP long

    if WORKAROUND == 1

        getdstring HASH 20

    elif VERSION <= 1

        get TSTAMP longlong

    endif

    getdstring HASH 20

    math CHUNKS = 0

    math ENCRYPTED = 0

    if VERSION >= 3

        if ZIP != 0

            get CHUNKS long

            for x = 0 < CHUNKS

                get CHUNK_OFFSET longlong

                get CHUNK_END_OFFSET longlong

                putarray 0 x CHUNK_OFFSET

                putarray 1 x CHUNK_END_OFFSET

            next x

        endif

        get ENCRYPTED byte

        get CHUNK_SIZE long

    endif

    if WORKAROUND == 1

        math ENCRYPTED = 0

    endif



    comtype copy    # for AES

    if ZIP & 1

        comtype zlib

    elif ZIP & 2

        comtype gzip

    endif



    if CHUNKS > 0

        putvarchr MEMORY_FILE SIZE 0

        log MEMORY_FILE 0 0

        append

        for x = 0 < CHUNKS

            getarray CHUNK_OFFSET 0 x

            getarray CHUNK_END_OFFSET 1 x

            math CHUNK_ZSIZE = CHUNK_END_OFFSET

            math CHUNK_ZSIZE - CHUNK_OFFSET

            if ENCRYPTED != 0

                callfunction SET_AES_KEY 1

                math CHUNK_ZSIZE x 16

            endif

            clog MEMORY_FILE CHUNK_OFFSET CHUNK_ZSIZE CHUNK_SIZE

        next x

        append

        encryption "" ""

        log NAME 0 SIZE MEMORY_FILE

    else

        # the file offset points to an entry containing

        # the "same" OFFSET ZSIZE SIZE ZIP HASH ZERO fields,

        # just an additional backup... so let's skip them

        savepos BASE_OFF

        math BASE_OFF - TMP_OFF

        math OFFSET += BASE_OFF

        if ENCRYPTED != 0

            callfunction SET_AES_KEY 1

            math ZSIZE x 16

        endif

        clog NAME OFFSET ZSIZE SIZE

        encryption "" ""

    endif

next i



startfunction SET_AES_KEY_ASK

    math AES_KEY_IS_SET = 1

    print "The archive is encrypted, select the number of the key to use or type yours:"

    for z = 0

        getarray KEY 10 z

        if KEY == ""

            break

        endif

        print "%z%: %KEY%"

    next z

    set KEY unknown "???"

    strlen TMP KEY

    if TMP <= 2

        getarray AES_KEY 10 KEY

    else

        set AES_KEY binary KEY

    endif

    print "KEY: %AES_KEY%"

endfunction



startfunction SET_AES_KEY

    if AES_KEY_IS_SET == 0

        callfunction SET_AES_KEY_ASK 1

    endif

    encryption aes AES_KEY "" 0 32

endfunction



startfunction GET_NAME

    get NAMESZ signed_long

    if NAMESZ >= 0

        getdstring NAME NAMESZ

    else

        math NAMESZ n NAMESZ

        math NAMESZ * 2

        getdstring NAME NAMESZ

        set NAME unicode NAME

    endif

endfunction

compressed game size 12.39 Gb

pakchunk0-WindowsNoEditor.pak (31,5 Gb)
arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r -s64g -wE:\Temp -msrep:m3f:l1024:c64+lolz:tt4:mtb32:d512m: oh14:fba256:mc128:dtm1:dto0:dtd1:dtw1:gm10 "data.arc" "pack\*"
(compression time 21 hours)
movies
-mlolz:tt4:mtb32:d512m: oh14:fba256:mc128
other
-mexe2+delta+lzma:a1:mfbt4:d128mb:lc8:fb273:mc512

X4 Foundations
v1.00

XTool:t75p,c128m:zlib+srep:m3f+4x4:lzma

Code:

21:52:32 - Starting Data1.bin.001 creation

23:40:20 - Finished Data1.bin.001 creation

Original size:   11.178g

Compressed size: 7.664g

Euro Truck Simulator 2 Beyond the Baltic Sea

game size 5.85 Gb
compressed game size 2.56 Gb

NOTHING ripped
NOTHING re-encoded
ALL languages

xtool 0.9 library By Razor12911
Srep v3.92 library By Bulat Ziganshin
Lolz v2.1.a.7 library By ProFrager

compression time 15 hours + -
decompression time 18 min + -

all files---- xtool zlib+ srep + lolz ----data1.cab

intel core i7 2 cores 2.9Mhz
16GB ram

Can someone help me for Star Wars Battlefront II(2016)? Can't be compressing. I will test 1048MB with "XLZ4+srep+lzma2" but 1020MB. Next I'm try with "XZSTD+Srep+lzma2" but again 1010MB. What's this problem?

Do you have a test file for us?

Star Wars Battlefront II Test File

Quote:

Originally Posted by KaktoR (Post 477244)

Do you have a test file for us?

Here: https://openload.co/f/hs7cqSm_n8w/starwars_cas_04.zip

200kb/s, could take a while :D

Quote:

Originally Posted by E-Key (Post 477242)

did you try with precomp too?

Quote:

Originally Posted by E-Key (Post 477242)

Code:

packcmd   = xtool.exe e:precomp:t75p,c128m:zstd - - <stdin> <stdout>



Compressed 1 file, 1,074,909,220 => 1,639,405,038 bytes. Ratio 152.52%

I will try with srep+4x4:lzma next.

Code:

Compressed 1 file, 1,074,909,220 => 898,770,185 bytes. Ratio 83.61%

                             lzma2: 913.603.429 bytes

Thank you Kaktor

Quote:

Originally Posted by KaktoR (Post 477248)

Code:

packcmd   = xtool.exe e:precomp:t75p,c128m:zstd - - <stdin> <stdout>



Compressed 1 file, 1,074,909,220 => 1,639,405,038 bytes. Ratio 152.52%

I will try with srep+4x4:lzma next.

Code:

Compressed 1 file, 1,074,909,220 => 898,770,185 bytes. Ratio 83.61%

                             lzma2: 913.603.429 bytes

Thank you soo much;):). Frostbite usually uses "lz4". But this is a different method

ME:A used zstd too. So with this BF2 it's the third game I saw that use zstd compression.