FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

fabrieunko 06-04-2022 22:44

Quote:

Originally Posted by Mypko (Post 496440)
LEGO® Star Wars™: The Skywalker Saga

oo2core_8_Win64.dll from game folder

thanks dixen and Masquerade

hello, where do we put this file in diskpan 2008?

dixen 07-04-2022 08:43

Deathloop XTool+Kraken
19 gb > 56 gb > 48 gb > 17 gb

Quote:

Compressed 83 files, 20,926,146,568 => 18,793,496,896 bytes. Ratio 89.81%
Compression time: cpu 418.80 sec/real 12641.62 sec = 3%. Speed 1.66 mB/s
All OK
:confused:

Mypko 07-04-2022 08:47

Quote:

Originally Posted by fabrieunko (Post 496443)
hello, where do we put this file in diskpan 2008?

yes, add new file xtool in pre/xtool2020 and file .dll to /pre/OodleRec

KaktoR 07-04-2022 09:41

Quote:

Originally Posted by Mypko (Post 496451)
yes, add new file xtool in pre/xtool2020 and file .dll to /pre/OodleRec

Newest DiskSpan_GUI do the job for you, you don't have to copy anything.

DSG scans the input folder (game folder) and if DSG finds a "oo2core_#_Win64.dll" file it will copy it to either XTool or oo2rec folder, depending on if you use XTool or oo2rec.

If DSG does not find a "oo2core_#_Win64.dll" file in input folder then DSG will use a file from "Resources\ADDONS\Libraries\Oodle" folder, depending on which "oodle number" you pick.

In some cases a game will be shipped with a "wrong" file, in this case you have to test.

Masquerade 07-04-2022 10:27

Quote:

Originally Posted by pslove (Post 496442)
Hello, can you re-upload this? The link is dead. Thank you.

I think this link refers to srep v3.2 which you can download here: https://bayfiles.com/L0H7x0Ufxd/srep-3.2_exe

Razor12911 07-04-2022 13:50

1 Attachment(s)
Quote:

Originally Posted by dixen (Post 496450)
Deathloop XTool+Kraken
19 gb > 56 gb > 48 gb > 17 gb

:confused:

:rolleyes:

KaktoR 08-04-2022 02:15

Orcs Must Die! 3

Code:

-mxtool:OMD3+srep+4x4:lzma

Compressed 268 files, 14,300,670,829 => 9,091,805,875 bytes. Ratio 63.58%
Compression time: cpu 59.80 sec/real 2041.67 sec = 3%. Speed 7.00 mB/s
All OK

Extracted 268 files, 9,091,805,875 => 14,300,670,829 bytes. Ratio 63.58%
Extraction time: cpu 18.83 sec/real 397.61 sec = 5%. Speed 35.97 mB/s
All OK

Thanks to Masquerade for database

Masquerade 08-04-2022 09:09

Orcs Must Die! 3 [Build 8508638]

*.PAK
Code:

xtool_OMD3+srep+lolz
Everything else:
Code:

srep+razor
13.2GB ---> 7GB

Masquerade 08-04-2022 09:10

The Drained Goddess

Code:

xzlib+srep+lolz
13GB ---> 9.9GB

KaktoR 08-04-2022 13:57

Age of Empires 3 Definitive Edition
1 language, v latest (I don't know lol)

Code:

18:47:43 - Selected ARC/DS method for Data1a-01.bin was: xtool:c256mb:malz4:mreflate+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 18:47:43 - Selected ARC/DS method for Data1b-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
-------------------------------------------------------------------------------------------------------------------------------------------
 22:56:39 - Overall input size: 47.31 GB
 22:56:39 - Overall output size: 26.55 GB (Ratio 56.13%)
 22:56:39 - Data files creation time: 03:54:16

Thanks to Edison007 for xtool plugin

KaktoR 09-04-2022 13:15

FINAL FANTASY VII Remake Intergrade
Movies ripped, v1.001

Code:

09:51:56 - Selected ARC/DS method for Data1a-01.bin was: oo2reck:7+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 09:51:56 - Selected ARC/DS method for Data1b-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 09:51:56 - Selected ARC/DS method for Data1c-01.bin was: srep_new+1
-------------------------------------------------------------------------------------------------------------------------------------------
 21:47:09 - Overall input size: 81.52 GB
 21:47:09 - Overall output size: 69.26 GB (Ratio 84.97%)
 21:47:09 - Overall conversion time: 11:55:06

Data1a -> pak files
Data1b -> all except pak and emov
Data1c -> emov files

This is basically a update for my last report about this game.

English, French and Japanese movies were ripped. Game was tested 100% in german + english with ripped video files (I played the game twice in english + german with all additional side quest stuff + DLC). I assume it will work on french and japanese languages too.

How to know if the game works with ripped movie files? You will encounter game freezes on points were a video should play (the game is not "freezing" actually, but you can't do any actions). Luckily you can guess which video is missing or wrong ripped by folder and file names.

*_US files are used for english only. Files without language code are used by french, german, japanese (except for credits videos, but this is obvious).

You can delete language voiceovers out of "pakchunk0_s23-WindowsNoEditor.pak" file with quickbms + hex editor to save additional ~2GB, but I didn't for this test.

fabrieunko 11-04-2022 23:20

Quote:

Originally Posted by dixen (Post 496386)
Usual zlib compression + reimport zero-bytes .mp4 to pak (quickbms v0.11 + ue4_27,bms script to help)

1. Exctract .mp4 from .pak archive (qbms -f *.mp4 ue4_27.bms <path_to_pak-file> <path for extracted files>)
2. zero-byte build .mp4 cmd

3. Reimport your zero-bytes .mp4 to .pak file (qbms -G -w -r -r ue4_27.bms ue4_27.bms <path_to_pak-file> <path for extracted files>)


Hello, just a question when importing 0bit files, if I redo an extraction of mp4 files should I have 0bit files?

:( Sad8669 12-04-2022 03:56

Yes you will have null video files.

Zero bytes still takes up space, if you look at them in the file explorer the size doesn't change, since 00 bytes are repeated all until the end of the file, lossless data compression algorithms takes good use of repeated bytes, hence the compressed file is so small.

i think that's how it works :D though i am not sure.

OR

you can take srep for example, it just saves the position of dupes occurrence and copies a single of copy of these dupes to those positions during decompression.

Rainiu 16-04-2022 01:56

Help with compressing Ender Lillies smaller please. Thanks.

Masquerade 16-04-2022 02:08

Quote:

Originally Posted by Rainiu (Post 496526)
Help with compressing Ender Lillies smaller please. Thanks.

xzlib+srep+lolz

For the banks, try following this guide.

Rainiu 16-04-2022 10:12

Quote:

Originally Posted by Masquerade (Post 496527)
xzlib+srep+lolz

For the banks, try following this guide.

what about the ucas extension? is xzlib taking care of both the .pak and .ucas files? I was only able to compress it to around 870mb.

Masquerade 16-04-2022 13:30

Quote:

Originally Posted by Rainiu (Post 496529)
what about the ucas extension? is xzlib taking care of both the .pak and .ucas files? I was only able to compress it to around 870mb.

Yes. In this case, the UCAS files are not encrypted.

KaktoR 17-04-2022 15:04

Anno 1800
v14.0, all DLC, nothing ripped

Code:

11:38:48 - Selected ARC/DS method for Data1a-01.bin was: msc_tak+srep_new+razor_mtx
 11:38:48 - Selected ARC/DS method for Data1b-01.bin was: xtool:mzlib+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc10000
--------------------------------------------------------------------------------------
 16:38:34 - Overall input size: 72.87 GB
 16:38:34 - Overall output size: 28.32 GB (Ratio 38.87%)
 16:38:34 - Data files creation time: 04:33:15


Masquerade 18-04-2022 03:40

Five Nights At Freddy's: Security Breach [Build 8479365]

Code:

srep+razor/$pak=ue4d:key=85F7D4007015493ED0359C9007266038F8F7B1F96988F19A610103874CC95286+srep+lolz/$mp4=srep+zstd
60.3GB ----> 21.2GB

Notes:
  • cls-ue4d used - made by Shegorat
  • Do not use srep 3.93b, crash on decompression.

Masquerade 19-04-2022 03:40

Winter Ember [Build 8534177] [Lossy + Lossless]

If you want to recode the videos, you can recode them to 3000kb/s bitrate using ffmpeg:
Code:

for %f in (*.MP4) do ffmpeg -i "%f" -b:v 3000k "_%~nf.MP4"
You can view a comparison between the quality of original videos and recoded videos here.

Compression

Code:

xzlib+srep+lolz/$mp4=srep
Original Size [Lossless Videos]: 5.7GB

Final Size [Lossless Videos]: 2.9GB

Original Size [Recoded Videos]: 4.6GB

Final Size [Recoded Videos]: 1.8GB

Masquerade 21-04-2022 00:23

Wolcen Lords of Mayhem [v1.1.5.5]
 
1 Attachment(s)
Step 1: Decrypt the game files:
  1. Download the decryption tool from the attachment below (credits to atom0s & Gabriel Dehan). This EXE is specific to game version v1.1.5.5.
  2. Drop the EXE into the game's root folder.
  3. Open CMD prompt here.
  4. Run the following command:
    Code:

    for /r %f in (*.pak) do Pak_Decrypt "%f" "%~df%~pf%~nf.zip"
  5. Once the above command completes, run the next command:
    Code:

    for /r %f in (*.zip) do del "%~df%~pf%~nf.pak"
  6. Once the above command completes, run the next command:
    Code:

    for /r %f in (*.zip) do ren "%f" "%~nf.pak"
Now you have a fully decrypted game.

Step 2: Compression
  • Make 2 archives.
  • Archive 2 will contain "Sounds_MISC.pak" and "Sounds_WEM.pak".
  • Archive 1 will contain everything else.

Start Size: 33.6GB

Method for archive 1:
Code:

xzlib+srep+lolz
Method for archive 2:
Code:

srep+lz4:l12
Final Compressed Size: 13.6GB

Rainiu 21-04-2022 04:23

Couldn't find the answer through search. What compression method do I use for pdf files?
I think if we have a sticky thread about a general compression method for specific types of files, it would greatly help newbies like us.

KaktoR 21-04-2022 04:33

png, pdf = reflate

Masquerade 21-04-2022 07:02

1 Attachment(s)
Use precomp on pdf.

KaktoR 21-04-2022 11:42

F.E.A.R
latest version, incl all DLC

Code:

17:36:13 - Selected ARC/DS method for Data1a-01.bin was: msc_tak+srep_new+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 18:26:20 - Overall input size: 14.33 GB
 18:26:20 - Overall output size: 2.43 GB (Ratio 16.95%)
 18:26:20 - Overall conversion time: 00:50:06

 19:39:54 - Overall decompression time: 00:08:14
 19:39:54 - All files have been successfully extracted!


KaktoR 21-04-2022 13:05

F.E.A.R 2
latest version, incl all DLC

Code:

20:49:39 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:mzlib+srep_new+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 21:27:24 - Overall input size: 14.64 GB
 21:27:24 - Overall output size: 5.74 GB (Ratio 39.17%)
 21:27:24 - Overall conversion time: 00:37:43

 22:02:08 - Overall decompression time: 00:06:53
 22:02:08 - All files have been successfully extracted!


KaktoR 21-04-2022 14:01

F.E.A.R. 3
latest version, incl all DLC

Code:

22:41:45 - Selected ARC/DS method for Data1a-01.bin was: bpk+msc_tak+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
 22:41:45 - Selected ARC/DS method for Data1b-01.bin was: mpz_mtx
-------------------------------------------------------------------------------------------------------------------------------------------
 22:56:25 - » Installation folder size: 4.58 GB
 22:56:25 - » Data1a-01.bin file size: 2.53 GB
 22:56:25 - » Data1b-01.bin file size: 757.65 MB
 22:56:25 - » Compressed game size: 3.27 GB (Ratio 71.27%)

 23:00:29 - Overall decompression time: 00:03:57
 23:00:29 - All files have been successfully extracted!


:( Sad8669 22-04-2022 02:37

Yakuza 6 - From Yakuza's Series 7/7
 
Code:

Method : srep:m3f:l512+lolz:normal/$criwarevideo=srep:m3f:l512+bcm
Compression Time : 8 Hours
Decompression Time : 1.5 Hours (4T)
Initial Size : 38.9 GB
Final Size : 27.8 GB.

Code:

$criwarevideo
*.usm

Note : You can use BCM with mtx to gain speed.

kj911 22-04-2022 05:10

This BMF compressor not repleceable using the BIM compressor usage the MSC/FreeArc? Newest or patched/fixed versions, from fix freezing DDS compression its available? (Win7 x64) Found BMP only fixed v2.01 copy from FreeArc usages. (v1.1 its very old.) This v2.0 its totally lost from net?

This BIM v0.03 version, support only 24bit BMP, TGA and PNM/PPM images. (No available more info this compression rate difference than BMF.)

Masquerade 22-04-2022 07:31

MotoGP 22

Code:

xzlib+srep+lolz/$mp4=srep+lz4:l12
29.2GB ---> 16.6GB

I have stopped using zstd for videos and prefer lz4 instead because it is faster.

CLS-LZ4 library used by Shegorat.

kj911 22-04-2022 11:41

Masquerade: Some code's contains ...lz4:l12 switches. This FreeArc 0.67 internal switches from lz4 algo?? Tested in Arc.exe with -mlz4:l12 don't work. Pure lz4 or lz4:h32m or lz4:h32m:b8m its ok.

Masquerade 22-04-2022 14:16

Quote:

Originally Posted by kj911 (Post 496571)
Masquerade: Some code's contains ...lz4:l12 switches. This FreeArc 0.67 internal switches from lz4 algo?? Tested in Arc.exe with -mlz4:l12 don't work. Pure lz4 or lz4:h32m or lz4:h32m:b8m its ok.

I am using cls-lz4 plugin by Shegorat. I have amended my post to reflect this.

L33THAK0R 23-04-2022 22:34

ZenStudios Pinball FX3 ".pxp" archives
 
1 Attachment(s)
Anyone given the ZenStudio's "Pinball FX" series a shot? Can't seem to find any information about the engine or the archives it uses. It (as well as all other ZenStudio titles) use a "*.pxp" archive format (File signature of 50 58 1A CD, decodes to "PX.Í"), and using the zlib codec under xtool picks up ~3 streams but crashes with a general decompression error after trying to parse them. Attached is a sample if anyone wants to have a look. Only mention I can find of this series/engine is this post, but cant find anything else online. There seems to be a QuickBMS script for decompressing these archives but unfortunately it doesn't seem to support the current iteration of ZenStudio's archive-type, introduced archives pertaining to more recent DLC.

:( Sad8669 24-04-2022 01:33

https://forum.xentax.com/viewtopic.php?t=10182
https://forum.xentax.com/viewtopic.php?f=10&t=10654

There is a decompression tool by Ekey, but i think you need to be a member to download it.

L33THAK0R 24-04-2022 01:41

2 Attachment(s)
I didn't include Ekey's unpacking tool as it serves the same purpose as the QuickBMS script, however its a tad more outdated and is less compatible with the more current iterations of the ".pxp" archive. For anyone interested I've attached the aforementioned tool, as well as the source code for Ekey's decompression library.

L33THAK0R 24-04-2022 06:33

Beyond Good & (And) Evil
 
Beyond Good & Evil (GOG Edition)

Files ripped:
  • German, Dutch, Spanish, French, Italian localised content can be ripped, amounting to 0.96GB
  • Unused pre-rendered trailer footage as well as the "Making Of" Bink1 file in the root directory can be safely removed, amounting to 0.22GB (or at the very least I haven't had any user reports of the contrary being true, I myself have only tested ~30minutes of gameplay so I can't be certain either)

2.02 GB => 520.7 MB

Method:
HTML Code:

srep + lolz
Compression time - 30 minutes

The tricky part about this one is calculating the offsets for localised content as well as the unused videos, as this data isn't stored in a logical way, thankfully though, through my analysis and subsequent repacking of titles utilising the "Jade" engine, I can say with a fair degree of confidence that only the primary localisation is intermingled with other data (such as graphical assets, animations and game logic) within a given "*.bfX" archive, with subsequent localisations, in this case the aforementioned five, being stored in a more logical way, allowing for fewer ripped blocks to be generated.

:( Sad8669 24-04-2022 09:30

DRAGON BALL Z: KAKAROT [v1.60][ENG]
 
Code:

Method : xt_zlib+srep:m3f:l512+lolz:normal/$criwarevideo=srep:m3f:l512+bcmx
Compression Time : 10.3 Hours
Decompression Time : ~ 55 Minutes (4T)
Initial Size : 36.8 GB
Final Size : 28.9 GB.
Ripped Files : Japanese audio.

Code:

$criwarevideo
*.usm

Note : Compressor "bcmx" is just bcm used with MTX.

KaktoR 25-04-2022 09:24

Martha is Dead
v1.04

Code:

14:50:47 - Selected ARC/DS method for Data1a-01.bin was: xtool:mmartha:1+srep_new+4x4:lzma
 14:50:47 - Selected ARC/DS method for Data1b-01.bin was: srep_new+4x4:lzma
-------------------------------------------------------------------------------------------------------------------------------------------
 17:47:31 - Overall input size: 17.13 GB
 17:47:31 - Overall output size: 14.05 GB (Ratio 82.01%)
 17:47:31 - Overall conversion time: 02:53:12

 18:22:38 - Overall decompression time: 00:35:01
 18:22:38 - All files have been successfully extracted!

You can speed up compression by doing it on ssd because of copying temp files.

KaktoR 26-04-2022 09:24

Dune: Spice Wars

Code:

res.compressed.pak

xtool+srep+4x4:lzma
Compressed 1 file, 2,958,404,716 => 725,268,911 bytes. Ratio 24.52%
Compression time: cpu 2.50 sec/real 484.56 sec = 1%. Speed 6.11 mB/s
All OK

precomp+srep+4x4:lzma
Compressed 1 file, 2,958,404,716 => 704,372,043 bytes. Ratio 23.81%
Compression time: cpu 3.48 sec/real 564.58 sec = 1%. Speed 5.24 mB/s
All OK

Code:

wem files: 145mb -> 140mb with wemtool

kuyhaa 28-04-2022 08:56

anyone, have method for .bundle file from StreamingAssets\aa\StandaloneWindows64 ?

ex : https://bayfiles.com/P90ef8b3y6/tech...ets_all_bundle

thanks


All times are GMT -7. The time now is 22:55.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com