FileForums - Best Compression Methods for 'Specific' Games. Q&A

Installation folder size: 7.73 GB
Compressed game size: 4.20 GB (Ratio 54.35%)

Installation time:
Installation started at 14:38:04
Installation stopped at 14:47:28

Fak Eid

20-07-2023 06:57

I tried a conversion algo srep_new:3+rzr_mtx from Diskspan GUI v2.0.1.8. What files do I need on my installer to extract the data from it? Can someone also provide me with the files?

KaktoR

20-07-2023 07:22

All files which are included in Setup.dll

Fak Eid

20-07-2023 12:01

Quote:

Originally Posted by KaktoR (Post 501645)

All files which are included in Setup.dll

Sorry for this noob question. But Setup.dll can't be opened. What tool should I use to open that or am I looking at wrong place? What changes need to be done as part of the 'Arc.ini' file inside my setup installer, if I compress via these files inside my 'unpack' folder

KaktoR

20-07-2023 13:45

Use DSG. Click the "Tools" button at the bottom, then this appears.

https://i.imgur.com/ymPSfjI.png

For the future, ask such questions in DiskSpan_GUI topic to keep this topic here clean, as it should be only for compression related things. Thanks.

KaktoR

22-07-2023 07:14

Grand Theft Auto V
13 June 2023

Code:

 12:19:10 - Selected ARC/DS method for Data1a-01.bin was: bpk+xtool:mreflate+xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 12:19:10 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-----------------------------------------------------------------------------------------

 15:01:02 - Overall input size: 109.44 GB

 15:01:02 - Overall output size: 65.85 GB (Ratio 60.17%)

 15:01:02 - Overall conversion time: 02:41:51



Data1:

common.rpf

x64*.rpf

update\*.rpf



Data2:

rest of the files

KaktoR

22-07-2023 13:01

Unholy

Code:

 20:56:16 - Selected ARC/DS method for Data1a-01.bin was: xtool:mzlib:dd3+4x4:b64mb:lzma:ultra:bt4:fb273:lc8:mc1000000:64mb

 20:56:16 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:bt4:fb273:lc8:mc1000000:64mb

-------------------------------------------------------------------------------------------------------------------------------------------

 21:53:58 - Overall input size: 30.65 GB

 21:53:58 - Overall output size: 22.64 GB (Ratio 73.87%)

 21:53:58 - Overall conversion time: 00:57:40

KaktoR

23-07-2023 07:42

The Long Dark
v2.22

Code:

 14:53:09 - Selected ARC/DS method for Data1a-01.bin was: xtool:munity,lz4hc,l12:lz4_193+xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 14:53:09 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-------------------------------------------------------------------------------------------------------------------------------------------

 15:33:15 - Overall input size: 14.28 GB

 15:33:15 - Overall output size: 7.32 GB (Ratio 51.26%)

 15:33:15 - Overall conversion time: 00:40:00

WemTool used.
2.34GB -> 2.18GB

KaktoR

23-07-2023 10:12

DAVE THE DIVER

Code:

 18:54:02 - Selected ARC/DS method for Data1a-01.bin was: xtool:munity,lz4hc,l12:lz4_193+xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 18:54:02 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-------------------------------------------------------------------------------------------------------------------------------------------

 19:07:11 - Overall input size: 8.82 GB

 19:07:11 - Overall output size: 1.81 GB (Ratio 20.48%)

 19:07:11 - Overall conversion time: 00:13:07

-------------------------------------------------------------------------------------------------------------------------------------------

 19:10:44 - All files have been successfully extracted!

KaktoR

23-07-2023 14:54

Remnant 2

Code:

Streams: 658698 / 659636

Time: 00:18:35 (CPU 01:32:56)



Size: 26.3 GB >> 49.6 GB

Code:

ue5:k0x0D2FCCB28812883236070C3098006BB686352061FE5F78DEC6B6186118927193

kraken

dixen

24-07-2023 03:47

The Sims 3

*.package *.world
XTool v0.76+lolz
20 gb > 32 gb > 29 gb > 23 gb > 13.5 gb

Quote:

xtool precomp -mpng+zlib+reflate -d3 -dd3 -spa0/0 -c64mb

NOTE.
Some files used lz4 streams but xtool can't decompress it.

KaktoR

24-07-2023 08:19

Generation Zero
v18.07.2023

Code:

 15:22:18 - Selected ARC/DS method for Data1a-01.bin was: xtool:c128mb:mzlib:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 15:22:18 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-------------------------------------------------------------------------------------------------------------------------------------------

 16:37:28 - Overall input size: 54.23 GB

 16:37:28 - Overall output size: 13.54 GB (Ratio 24.96%)

 16:37:28 - Overall conversion time: 01:15:09

-------------------------------------------------------------------------------------------------------------------------------------------

 17:14:12 - Overall decompression time: 00:14:04

 17:14:12 - All files have been successfully extracted!

FitGirl

25-07-2023 02:03

Quote:

Originally Posted by dixen (Post 501682)

The Sims 3

*.package *.world
XTool v0.76+lolz
20 gb > 32 gb > 29 gb > 23 gb > 13.5 gb

NOTE.
Some files used lz4 streams but xtool can't decompress it.

Sims 3 doesn't have LZ4 streams, the game was released before LZ4 was invented. Those are false detections of old custom EA algo, used in many of their games.

Danziel123

25-07-2023 18:50

Anyone know what best compression for forspoken? Thank you:)

ScOOt3r

25-07-2023 20:06

i used zlib+srep+lolz and it compressed to 88.8 gb

Danziel123

25-07-2023 20:13

Quote:

Originally Posted by ScOOt3r (Post 501699)

i used zlib+srep+lolz and it compressed to 88.8 gb

No files can delete to save some space? (Languages files)

ScOOt3r

25-07-2023 20:39

no as its only about 8 large files about 20gb each..

KaktoR

26-07-2023 07:46

Viewfinder

Code:

 15:42:29 - Selected ARC/DS method for Data1a-01.bin was: msc_tak+srep_new:1

 15:42:29 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-------------------------------------------------------------------------------------------------------------------------------------------

 16:01:27 - Overall input size: 14.29 GB

 16:01:27 - Overall output size: 4.99 GB (Ratio 34.91%)

 16:01:27 - Overall conversion time: 00:18:56

KaktoR

26-07-2023 07:52

Quote:

Originally Posted by Danziel123 (Post 501698)

Anyone know what best compression for forspoken? Thank you:)

Cut the first 200mb of one of the big files and send it to me.

Also tell me the file header of the bk2 files if possible with hxd.

Razor12911

26-07-2023 08:39

Forspoken

Code:

-mlz4f:l9

Use liblz4.dll that comes with xtool (v1.8.3)
You must also have xdelta, every stream has 8 byte difference and will not precompress without it.

Code:

Compressed 1 file, 104,857,600 => 210,035,729 bytes. Ratio 200.31%

Compression time: cpu 0.08 sec/real 1.15 sec = 7%. Speed 91.17 mB/s

dixen

26-07-2023 11:26

What about extensionless from Ratchet & Clank: Rift Apart? Same as in SpiderMan?
Sample https://pixeldrain.com/u/cKV4RvZa

Razor12911

26-07-2023 17:53

Ratchet & Clank: Rift Apart

Code:

-minsomniac:rcrads

tex_global

Code:

Compressed 1 file, 216,354,837 => 232,416,562 bytes. Ratio 107.42%

Compression time: cpu 0.19 sec/real 1.37 sec = 14%. Speed 157.41 mB/s

actor

Code:

Compressed 1 file, 797,350 => 5,150,215 bytes. Ratio 645.92%

Compression time: cpu 0.00 sec/real 0.67 sec = 0%. Speed 1.19 mB/s

Link

Danziel123

26-07-2023 20:27

Quote:

Originally Posted by ScOOt3r (Post 501701)

no as its only about 8 large files about 20gb each..

Thank you for suggestion, i compress using mzlib + dedub + lzma-MT get 89.4 gb

Quote:

Originally Posted by KaktoR (Post 501716)

Cut the first 200mb of one of the big files and send it to me.

Also tell me the file header of the bk2 files if possible with hxd.

Sorry for dumb question, how to cut the big files? Here i send sample earc and bk2 files
bk2: https://drive.google.com/file/d/1ueY...ew?usp=sharing
earc: https://drive.google.com/file/d/1y8O...ew?usp=sharing

Quote:

Originally Posted by Razor12911 (Post 501723)

Ratchet & Clank: Rift Apart

Code:

-minsomniac:rcra

Use liblz4.dll that comes with xtool (v1.8.3)

tex_global

Code:

Compressed 1 file, 216,354,837 => 232,416,562 bytes. Ratio 107.42%

Compression time: cpu 0.19 sec/real 1.37 sec = 14%. Speed 157.41 mB/s

actor

Code:

Compressed 1 file, 797,350 => 5,150,215 bytes. Ratio 645.92%

Compression time: cpu 0.00 sec/real 0.67 sec = 0%. Speed 1.19 mB/s

Link

PLUGIN RECEIVED A HOTFIX, MAKE SURE YOU USE THAT

Sorry, but how to use it in DSG? Thank you

dixen

26-07-2023 22:45

Quote:

Originally Posted by Razor12911 (Post 501723)

Ratchet & Clank: Rift Apart

Code:

-minsomniac:rcrads

tex_global

Code:

Compressed 1 file, 216,354,837 => 232,416,562 bytes. Ratio 107.42%

Compression time: cpu 0.19 sec/real 1.37 sec = 14%. Speed 157.41 mB/s

actor

Code:

Compressed 1 file, 797,350 => 5,150,215 bytes. Ratio 645.92%

Compression time: cpu 0.00 sec/real 0.67 sec = 0%. Speed 1.19 mB/s

Link

lz4_1.82 - best result

Quote:

Compressing zone_openarea 92%
Compressing 862,286,145 bytes with xtool.exe precomp -minsomniac -c128mb -t100p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
Streams: 11004 / 11004
Time: 00:00:21 (CPU 00:01:20)

Size: 822 MB >> 2.54 GB

100%
Errorlevel=0

Compressed 1 file, 862,286,145 => 2,730,091,250 bytes. Ratio 316.61%
Compression time: cpu 0.27 sec/real 44.57 sec = 1%. Speed 19.35 mB/s
All OK

KaktoR

26-07-2023 23:27

Quote:

Originally Posted by Danziel123 (Post 501727)

Thank you for suggestion, i compress using mzlib + dedub + lzma-MT get 89.4 gb

Sorry for dumb question, how to cut the big files? Here i send sample earc and bk2 files
bk2: https://drive.google.com/file/d/1ueY...ew?usp=sharing
earc: https://drive.google.com/file/d/1y8O...ew?usp=sharing

Sorry, but how to use it in DSG? Thank you

There is a file cutter somewhere here on fileforums, shared by Razor12911, which I personally use.

For the earc files use like this

Code:

xtool:mlz4f,l9:lz4_183

For the bk2 files you have to use xtool aswell with the bink plugin because bpk will break the file on unpacking.

Code:

xtool:c256mb:mbk2:df20p

However I suggest to test all of the bk2 files first. In DSG_Settings.ini set it like this and select the game folder normally (this will only compress *.bk2 files). Test compress and decompress. Maybe it is required to set the correct chunk size too.

Code:

[Game1Settings]

Name=Unknown 1

Exec=

EGPath=C:\Program Files (x86)\Unknown <game>

MethodState=0

Data1.Name=Data<game><data>-01.bin

Data1.InclText=*.bk2

Masquerade

26-07-2023 23:33

VGMToolbox has a FileCutter too afair.

Danziel123

26-07-2023 23:59

Quote:

Originally Posted by KaktoR (Post 501731)

There is a file cutter somewhere here on fileforums, shared by Razor12911, which I personally use.

For the earc files use like this

Code:

xtool:mlz4f,l9:lz4_183

For the bk2 files you have to use xtool aswell with the bink plugin because bpk will break the file on unpacking.

Code:

xtool:c256mb:mbk2:df20p

Code:

[Game1Settings]

Name=Unknown 1

Exec=

EGPath=C:\Program Files (x86)\Unknown <game>

MethodState=0

Data1.Name=Data<game><data>-01.bin

Data1.InclText=*.bk2

Here it's result compress the bk2 files

Quote:

-----------------------------------------------------------------------------------------
-------------------------------- CONVERSION DATE 27/07/2023 --------------------------------
-----------------------------------------------------------------------------------------
13:43:53 - You have chosen the unlimited type for the output size.
13:43:53 - ISO images will not be created when conversion is complete.
13:43:53 - The computer will remain on when the conversion is complete.
13:43:53 - Selected ARC/DS method for Data1a-01.bin was: xtool:c256mb:mbk2:df20p
-----------------------------------------------------------------------------------------
13:43:57 - Compression initialized in 27/07/2023 at 13:43:57.
13:43:57 - Starting Data1a-01.bin archive creation.
13:49:39 - Moving Data1a-01.bin file to media folder.
13:49:44 - Compression finished in 27/07/2023 at 13:49:44.
-----------------------------------------------------------------------------------------
13:49:44 - Getting size of the game: Forspoken
13:49:44 - » Installation folder size: 6,84 GB
13:49:44 - » Compressed game size: 6,24 GB (Ratio 91.28%)
-----------------------------------------------------------------------------------------
13:49:44 - Overall input size: 6,84 GB
13:49:44 - Overall output size: 6,24 GB (Ratio 91.28%)
13:49:44 - Overall conversion time: 00:05:46
13:49:44 - Overall conversion media: 1 custom media
-----------------------------------------------------------------------------------------

It's good ratio?

And yes it can install/decompress, here the proof
http://i.ibb.co/kgknfTW/Forspoken.png

KaktoR

27-07-2023 00:05

BPK is always around ~10% saving, same as oggre.

So yes you can use it.

Danziel123

27-07-2023 00:23

Quote:

Originally Posted by KaktoR (Post 501738)

BPK is always around ~10% saving, same as oggre.

So yes you can use it.

Here is my setting in DSG_Settings, it is correct to compress this game?

Quote:

[Game1Settings]
Name=Forspoken
Exec=
EGPath=C:\Program Files (x86)\Forspoken
MethodState=0
Data1.Name=Data1a-01.bin
Data1.InclText=*.earc
Data1.ExclText=
Data1.Method1=xtool:mlz4f,l9:lz4_183+xtool:dd3+LZM A-MT
Data2.Name=Data1b-01.bin
Data2.Method1=xtool:c256mb:mbk2:df20p
Data2.InclText=*.bk2

KaktoR

27-07-2023 00:28

You have forgot something important.

You have 2 data.bin's, just including particular files.

But what about all the other files of the game?

Use ExclText=*.earc|*.bk2 for data3 ;)

Danziel123

27-07-2023 00:44

Quote:

Originally Posted by KaktoR (Post 501740)

You have forgot something important.

You have 2 data.bin's, just including particular files.

But what about all the other files of the game?

Use ExclText=*.earc|*.bk2 for data3 ;)

Sorry i don't get it
Should like this?

Quote:

KaktoR

27-07-2023 00:48

Yes you got it ;)

Danziel123

27-07-2023 01:14

Quote:

Originally Posted by KaktoR (Post 501742)

Yes you got it ;)

Thank you, still compressing RN and i will report back:)

Edit
It works (Compressing & decompressing) Sorry i can't post the conversion log, because i deleted (my bad)
Using those method get 80.9 GB and install time:
http://i.ibb.co/9YF8rVR/Untitled.png

Danziel123

27-07-2023 06:31

Sorry if i ask again, anyone know best compression method for ratchet & clank - rift apart? Thank you:)

Masquerade

27-07-2023 06:41

Quote:

Originally Posted by Danziel123 (Post 501750)

Sorry if i ask again, anyone know best compression method for ratchet & clank - rift apart? Thank you:)

You could at least read back a page rather than being lazy! :mad:

https://www.fileforums.com/showpost....postcount=3582

Danziel123

27-07-2023 06:50

Quote:

Originally Posted by Masquerade (Post 501751)

You could at least read back a page rather than being lazy! :mad:

https://www.fileforums.com/showpost....postcount=3582

Sorry don't mad at me, but where to put those file? In folder XTool/Xtool_2020?

ScOOt3r

27-07-2023 07:39

Yes those files will have to be copied into your xtool folder and then compress.. hope this helps and good luck compressing..

cheers
ScOOt3r

Danziel123

27-07-2023 23:29

Quote:

Originally Posted by ScOOt3r (Post 501754)

Yes those files will have to be copied into your xtool folder and then compress.. hope this helps and good luck compressing..

cheers
ScOOt3r

Hi sorry if i ask again, alredy copy those file to folder XTool and compressing with this method:

Quote:

-----------------------------------------------------------------------------------------
-------------------------------- CONVERSION DATE 28/07/2023 --------------------------------
-----------------------------------------------------------------------------------------
08:43:31 - You have chosen the unlimited type for the output size.
08:43:31 - ISO images will not be created when conversion is complete.
08:43:31 - The computer will remain on when the conversion is complete.
08:43:31 - Selected ARC/DS method for Data1a-01.bin was: xtool:insomniac:rcrads+xtool:dd3+4x4:b64mb:lzma:ul tra:64m:bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
08:43:33 - Compression initialized in 28/07/2023 at 08:43:33.
08:43:33 - Starting Data1a-01.bin archive creation.
09:27:40 - Moving Data1a-01.bin file to media folder.
09:27:42 - Compression finished in 28/07/2023 at 09:27:42.
-----------------------------------------------------------------------------------------
09:27:42 - Getting size of the game: Ratchet & Clank - Rift Apart
09:27:42 - » Installation folder size: 38,79 GB
09:27:42 - » Compressed game size: 32,21 GB (Ratio 83.04%)
-----------------------------------------------------------------------------------------
09:27:42 - Overall input size: 38,79 GB
09:27:42 - Overall output size: 32,21 GB (Ratio 83.04%)
09:27:42 - Overall conversion time: 00:44:09
09:27:42 - Overall conversion media: 1 custom media
-----------------------------------------------------------------------------------------

But it not good with ratio, maybe you know what cause it? or i wrong write compress method in DSG? Thank you:)

dixen

27-07-2023 23:40

Quote:

Originally Posted by Danziel123 (Post 501759)

But it not good with ratio, maybe you know what cause it? or i wrong write compress method in DSG? Thank you:)

https://fileforums.com/showpost.php?...&postcount=372

Danziel123

28-07-2023 00:24

Quote:

Originally Posted by dixen (Post 501760)

https://fileforums.com/showpost.php?...&postcount=372