FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

shazzla 10-12-2021 03:16

Good ideas to start :

1. Look for compression/encryption algorithm names in folder structure.
2. In Total Commander ,view the main gamefiles and its DLLs (F3) and search for comp/encr-algonames,too.
3. If none of them found ,try zlib ,maybe it works.
4. If zlib doesnt work,give it up!:D

KaktoR 10-12-2021 03:30

For dds, you can use just srep+lolz
ogv are video files, try to use a low freearc setting (m1, m2) or just use m0 for storing (sometimes you can compress video files, but just a few mb)
lvl, crf I don't know

As for "bin_addons_win32/SF3_Campaign/package.pak_data" you can try zlib

fabrieunko 10-12-2021 04:49

Hello what would be the best method for icarus? please. thanks in advance

Masquerade 10-12-2021 08:51

Quote:

Originally Posted by fabrieunko (Post 495134)
Hello what would be the best method for icarus? please. thanks in advance

srep+lolz/lzma - devs didn't use compression on their paks.

hwang4 15-12-2021 00:29

Bus Simulator 21
 
hi! need a valid unreal key ! :)

Masquerade 15-12-2021 04:35

Quote:

Originally Posted by hwang4 (Post 495170)
hi! need a valid unreal key ! :)

What do you mean? This game isn't encrypted.

hwang4 15-12-2021 04:50

sorry !thought it was!:)

Masquerade 17-12-2021 04:13

ARK Survival Evolved

400GB ----> 38.7GB

srep+lolz
mpz on soundtrack

Compression takes almost 40 hours, not for the faint hearted.

KaktoR 17-12-2021 04:33

400GB... I guess this game reaches 1TB soon :D

KaktoR 17-12-2021 05:06

Final Fantasy VII Remake Intergrade

oodle kraken 7

Code:

pakchunk0_s23-WindowsNoEditor.pak

Compressed 1 file, 8,184,822,018 => 8,551,069,519 bytes. Ratio 104.47%
Compression time: cpu 4.52 sec/real 1049.03 sec = 0%. Speed 7.80 mB/s
All OK

Video files are webm videos

dixen 17-12-2021 09:32

Final Fantasy VII Remake Intergrade

Quote:

pakchunk0_s5-WindowsNoEditor.pak

Compressed 1 file, 2,076,132,806 => 8,448,777,571 bytes. Ratio 406.95%
Compression time: cpu 1.80 sec/real 492.10 sec = 0%. Speed 4.22 mB/s
All OK
Quote:

Tested 1 file, 8,448,777,571 => 2,076,132,806 bytes. Ratio 406.95%
Testing time: cpu 2.11 sec/real 344.89 sec = 1%. Speed 6.02 mB/s
All OK
XTool v0.39 + oo2core.dll from game folder

KaktoR 17-12-2021 11:25

Anyone knows what's the point for all the different language movie files in FF7 Remake? I guess only lips movement right?

Masquerade 17-12-2021 14:21

Quote:

Originally Posted by KaktoR (Post 495192)
Anyone knows what's the point for all the different language movie files in FF7 Remake? I guess only lips movement right?

Yes, US files are for EN and all else is for FR/DE/JP - there are some dedicated videos for FR/DE videos (e.g. credits video).

P.S. do not rip any credits videos since the game actually has an ending scene before the credits show. If you rip the credits video, you lose the ending of the game.

KaktoR 18-12-2021 04:37

Ok then I guess you can rip all the lipsync files out of s21 pak and voices from s23 pak

Masquerade 18-12-2021 05:44

Quote:

Originally Posted by KaktoR (Post 495198)
Ok then I guess you can rip all the lipsync files out of s21 pak and voices from s23 pak

I've already ripped out the FR, DE, JP voices but didn't touch the lipsync. I cannot imagine it would save much space?

KaktoR 18-12-2021 06:13

Well I didn't extract the archive yet to see how much size they have.

KaktoR 18-12-2021 15:37

Assassin's Creed Odyssey
v1.5.6, One language

Code:

14:00:49 - Selected ARC/DS method for Data1a-01.bin was: oo2recm:4+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 14:00:49 - Selected ARC/DS method for Data1b-01.bin was: bpk+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 00:35:56 - Overall input size: 99.23 GB
 00:35:56 - Overall output size: 40.75 GB (Ratio 41.06%)
 00:35:56 - Data files creation time: 10:04:52

First archive *forge files
Second archive rest of the files


panker1992 19-12-2021 04:14

Quote:

Originally Posted by KaktoR (Post 495198)
Ok then I guess you can rip all the lipsync files out of s21 pak and voices from s23 pak

how do you unpack those pak files with oodle support ??

do you know the blocks for languages to rip via hex editor ?

Masquerade 19-12-2021 04:17

Quote:

Originally Posted by panker1992 (Post 495209)
how do you unpack those pak files with oodle support ??

do you know the blocks for languages to rip via hex editor ?

https://anonfiles.com/V9C101q5wb/unr..._4_0.4.25b_bms

quickbms -l "unreal_tournament_4_0.4.25b.bms" pakchunk0_s23-WindowsNoEditor.pak >> pakchunk0_s23-WindowsNoEditor.txt

This lists the contents and the locations of all the files in the pak.

German Block: 2583541977 - 4031342431

French Block: 4031342793 - 5445490559

Japanese Block: 5445490905 - 6823955647

KaktoR 19-12-2021 06:03

Assassin's Creed Valhalla
Changed from oodle mermaid 7 to 8 in v1.4.1

Code:

oo2core_7_win64.dll
Compressed 1 file, 1,103,790,080 => 1,747,822,450 bytes. Ratio 158.35%
Compression time: cpu 1.30 sec/real 492.31 sec = 0%. Speed 2.24 mB/s
All OK

oo2core_8_win64.dll
Compressed 1 file, 1,103,790,080 => 1,776,145,142 bytes. Ratio 160.91%
Compression time: cpu 1.20 sec/real 507.94 sec = 0%. Speed 2.17 mB/s
All OK


KaktoR 19-12-2021 08:59

Anyone knows how to use bsc with freearc? Packing works, but unpacking doesn't work here

panker1992 20-12-2021 03:12

Quote:

Originally Posted by Masquerade (Post 495210)
https://anonfiles.com/V9C101q5wb/unr..._4_0.4.25b_bms

quickbms -l "unreal_tournament_4_0.4.25b.bms" pakchunk0_s23-WindowsNoEditor.pak >> pakchunk0_s23-WindowsNoEditor.txt

This lists the contents and the locations of all the files in the pak.

German Block: 2583541977 - 4031342431

French Block: 4031342793 - 5445490559

Japanese Block: 5445490905 - 6823955647


This doesn't work at all, it asks for a key!

thanks for blocks :D

KaktoR 20-12-2021 04:02

Quote:

Originally Posted by panker1992 (Post 495217)
This doesn't work at all, it asks for a key!

thanks for blocks :D

The key is
Code:

0x23989837645C9D28BA58072B2076E895B853A7C9E1C5591B814C4FD2A2D7B782

panker1992 20-12-2021 04:19

thanks alot :D

lipsync isnt worth the hassle... 30 mb and if you compress it you will gain 1 or 2 mb of space

removing voice though saves 1.4 GB per language

Masquerade 20-12-2021 04:35

panker1992
I thought you would be capable of finding the key yourself :p

There's a list of keys and an AES finder application uploaded by Spiritovod on the CounterStrike.RussianInformationNetwork ;) which I cannot link here for obvious reasons. You can use those resources in future.

KaktoR 20-12-2021 04:38

Or use this, if you don't have an account over there (I update this list every week for DSG)
https://drive.google.com/file/d/1aF3...ew?usp=sharing

ffmla 20-12-2021 09:25

Try this command
 
Quote:

Originally Posted by KaktoR (Post 495213)
Anyone knows how to use bsc with freearc? Packing works, but unpacking doesn't work here

in arc.ini
[External compressor:bsc]
header = 0
packcmd = bsc.exe e $$arcdatafile$$.tmp $$arcpackedfile$$.tmp {options}

For Pack
arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r -m=bsc:b128:m0 data_bsc.arc _Pack\*

For Unpack

arc.exe x -dpunpacked\ data_bsc.arc

NOTE:
cls version (Shegorat) available in Krinkels for 0.3.1

KaktoR 20-12-2021 09:37

Thanks, I already know about this, but was corious if it is possible with bsc.exe too, but it doesn't looks so.

panker1992 20-12-2021 14:42

Quote:

Originally Posted by Masquerade (Post 495220)
panker1992
I thought you would be capable of finding the key yourself :p

There's a list of keys and an AES finder application uploaded by Spiritovod on the CounterStrike.RussianInformationNetwork ;) which I cannot link here for obvious reasons. You can use those resources in future.

I have a very tight schedule these days my friend,
anything that cant be automated or i dont solve in under 5 minutes goes to bin.

BTW Final Fantasy is the worst remake for these past years according to some !!!

let me at least share my findings before i delete this game

ffmpeg -i <emov.file> -c:v libvpx-vp9 -b:v 2000k -c:a copy -c:s copy -y <output.webm_then_rename>

use this on all videos

you will end up with 2.2GB of videos

dixen 20-12-2021 20:26

Five Nights at Freddy’s: Security Breach (Build 7902251)

*.pak - ue4d+srep+lolz
75 gb > 54 gb > 28.5 gb

*.mp4 - srep+zstd
no changed size (3.4 gb)

Rest files - srep+lolz

Quote:

Init encryption key: 85F7D4007015493ED0359C9007266038F8F7B1F96988F19A61 0103874CC95286
99.8%
Total encrypted UE records 46345/46383
Tested 1 file, 30,685,710,536 => 81,036,615,981 bytes. Ratio 37.87%
Testing time: cpu 239.63 sec/real 434.69 sec = 55%. Speed 186.42 mB/s
All OK
Thanks to Masquerade for update & Shegorat for ue4d plugin.

L33THAK0R 22-12-2021 18:18

Quote:

Originally Posted by dixen (Post 495228)
*.mp4 - srep+zstd
no changed size (3.4 gb)

Can I ask why you used zstd for the "*.mp4" files?

Masquerade 23-12-2021 00:21

Quote:

Originally Posted by L33THAK0R (Post 495251)
Can I ask why you used zstd for the "*.mp4" files?

ZSTD is very fast and you can maybe squeeze compression ratio to 98%.

dixen 23-12-2021 01:22

Quote:

Originally Posted by L33THAK0R (Post 495251)
Can I ask why you used zstd for the "*.mp4" files?

Fast unpack - ~300-800 Mbit on uncompressed data (movies, audio and encrypted data)

Masquerade 23-12-2021 13:42

SCARF [Build 7811230]
 
Ripped Credits Video

XTool:zlib+srep+lolz

Videos: srep+zstd

12.1GB ---> 7.6GB

KaktoR 24-12-2021 16:00

Assassin's Creed Valhalla
v1.4.1, all DLC, One language

*forge files -> oo2recm+srep+lzma-mt (use oo2core_8_win64.dll rename to 7)
rest of the files -> srep+lzma-mt

97.1GB -> 40.9GB
Time: 10 hours

PS: DSG just crashed at ISO creation and no LOG was saved.

KaktoR 29-12-2021 17:56

Final Fantasy VII Remake Intergrade
Nothing ripped

Code:

13:26:23 - Selected ARC/DS method for Data1a-01.bin was: oo2reck:7+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 13:26:23 - Selected ARC/DS method for Data1b-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 13:26:23 - Selected ARC/DS method for Data1c-01.bin was: 1
-------------------------------------------------------------------------------------------------------------------------------------------
 00:55:09 - Overall input size: 94.31 GB
 00:55:09 - Overall output size: 82.01 GB (Ratio 86.95%)
 00:55:09 - Overall conversion time: 11:27:39

Data1a -> pak files
Data1b -> all except pak and emov
Data1c -> emov files

You can save additional ~2GB with removing languages from pak files.
https://fileforums.com/showpost.php?...postcount=2701

:( Sad8669 31-12-2021 06:56

Yakuza 4 - From Yakuza's Series 5/7
 
Code:

Method : srep:m3f:l512+lolz:dtb1:d128:mtt0:mt4:mc1023
Method (on USM files) : srep:m3f:l512+zstd
Compression Time : 7.5 Hours
Decompression Time : Soon
Initial Size : 34.1 GB
Final Size : 16.2 GB
Extra Tip : USM's are worth 5.09 GB and can be encoded to almost half of its original size but you know i am just too lazy for that.

Side : It's been a while since i have posted, i am just lazy lol. Anyway good to see you guys digging on newest games.

Masquerade 31-12-2021 10:05

Dr Livingstone, I Presume?
 
Code:

msc+xtool_zlib+srep+lolz
4.7GB ---> 1.6GB

:( Sad8669 01-01-2022 23:24

Yakuza 3 - From Yakuza's Series 4/7
 
Code:

Method : srep:m3f:l512+lolz:dtb1:d128:mtt0:mt4:mc1023
Compression Time : 9.2 Hours
Decompression Time : 7.7 Minutes
Initial Size : 25.1 GB
Final Size : 11.3 GB
Extra Tip : USM's are worth 2.22 GB and can be encoded to almost half of its original size.


KaktoR 05-01-2022 05:29

Anno 1404 History Edition
Nothing ripped, all languages

Code:

Selected ARC/DS method for Data1a-01.bin was: srep_new+mpz_mtx
Selected ARC/DS method for Data1b-01.bin was: srep_new+msc_tak+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
Selected ARC/SPLIT method for Data1c-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000/$mp3pack=srep_new+mpz_mtx/$jpgpack=packjpg
-----------------------------------------------------------------------------------------
Installation folder size: 7.26 GB
Compressed game size: 4.47 GB (Ratio 61.52%)

Data1a = all language files in addon/maindata folder
Data1b = maindata\data4.rda
Data1c = rest of the files including Soundtrack/Poster

Note: maindata\data4.rda has bink videos inside. You can compress with bpk, but unpacking will lead to crc errors.

Anno 1503 History Edition
Nothing ripped, all languages

Code:

Selected ARC/SPLIT method for Data2a-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000/$bpkpack=bpk/$mscpack=srep_new+msc_tak/$mp3pack=srep_new+mpz_mtx/$jpgpack=packjpg
-----------------------------------------------------------------------------------------
Installation folder size: 6.75 GB
Compressed game size: 3.32 GB (Ratio 49.25%)

Anno 1602 History Edition
Nothing ripped, all languages

Code:

Selected ARC/SPLIT method for Data3a-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000/$bpkpack=1/$mscpack=srep_new+msc_tak/$mp3pack=srep_new+mpz_mtx/$jpgpack=packjpg
-----------------------------------------------------------------------------------------
Installation folder size: 1.52 GB
Compressed game size: 0.94 GB (Ratio 61.83%)

Note: Using binkpack for bik videos will lead to crc errors on all files if you unpack.

Anno 1701 History Edition
Nothing ripped, all languages

Code:

Selected ARC/SPLIT method for Data4a-01.bin was: xt_zlib+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000/$anno1701hempz=bpk+srep_new+mpz_mtx/$anno1701hebpk=bpk+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000/$mp3pack=srep_new+mpz_mtx/$jpgpack=packjpg/$libpack=srep_new+razor_mtx
-----------------------------------------------------------------------------------------
Installation folder size: 12.77 GB
Compressed game size: 5.86 GB (Ratio 45.87%)

Mask $anno1701hempz = data2_<language>.rda (all of this files also containing bink videos. binkpack works fine here)
Mask $anno1701hebpk =  data4.rda, data5.rda (this files also containing non-bink files, so use bpk+<some compressor>)

Code:

Overall Note: For the rda files in the "ahe" folders of all 4 games you can use zlib
NOTE:
Code:

Anno 1404 History Edition
maindata\data4.rda (contains bink videos/wav/raw/mp3, bpk crc error, msc works fine)

Anno 1503 History Edition
Videos\1080p_30fps_5Sec.bk2 (bpk crc error)
Videos\1080p_30fps_5Sec.bk2 (bpk crc error)
BonusContent\Anno_1503_soundtrack\60 - Windgames.mp3 (mpz unpack error, use packmp3/msc)
ToolGfx\*.bmp (msc crash)

Anno 1701 History Edition
data2_<lang>.rda (contains bink videos/mp3, bpk+mpz throws errors, use bpk+msc)



All times are GMT -7. The time now is 02:58.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com