FileForums - Best Compression Methods for 'Specific' Games. Q&A

Tony Hawk uses a non-standard encryption scheme such that decryption is possible using the attached script, but encryption is not.

https://files.catbox.moe/08vsy7.bms

How could I use this in DiskSpan_GUI?

HunterEmrah

07-10-2023 13:10

FAZip gets stuck while compressing Forza Horizon 5 files excluding zip files.

even after 7 hours FAZip uses high CPU and RAM but there is no disk activity.

compressing using DiskSpan_GUI v2.0.1.9 (x64)

method: rep+srep+LZMA-MT (stuck at 100% error level) or srep+LZMA-MT (stuck at 33.5% error level)

conf: i5-13600K + 32 GB DDR5 5600MHz RAM + 2 TB NVMe SSD

KaktoR

08-10-2023 00:18

Most likely it is because of lzma. On some inputs lzma has insanely times to compress data. Try with another method, like fast lolz.

Oh, and do not compress games on your SSD, because of all that data write you will let your SSD die sooner then later.

KaktoR

08-10-2023 00:21

Assassin's Creed Mirage
Initial release version

Code:

 11:36:22 - Selected ARC/DS method for Data1a-01.bin was: xtool:manvil:core_2.8.4+xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 11:36:22 - Selected ARC/DS method for Data1b-01.bin was: xtool:dd3+bcm

 11:36:22 - Selected ARC/DS method for Data1c-01.bin was: xtool:dd3+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

-------------------------------------------------------------------------------------------------------------------------------------------

 12:58:34 - Overall input size: 37.23 GB

 12:58:34 - Overall output size: 19.75 GB (Ratio 53.05%)

 12:58:34 - Overall conversion time: 01:22:07

Razor12911

08-10-2023 08:35

Quote:

Originally Posted by L33THAK0R (Post 502553)

I've been investigating a 2017 title "Lone Echo", which seems to use a previously undocumented Oodle Library, v0.1.0, and whose CRCs don't match any other libraries, as posted by KaktoR.

Code:

    

File:   oodle_11_win64.dll

CRC-32: 15a0f169

Attempting to discern which member of the oodle family is used has proven to be a tad tricky, with each sample spitting back a result of [0] (Invalid/Unknown) as reported by Razor's Oodle Stream Scanner (oo2scan_7_win64.exe) utility. Attached is both a sample and the library in question. Since these streams are coming up as Invalid/Unknown is it not possible to re-compress them?

This oodle version is so old and might not be worth looking into, xtool supports v2.1.5+, anything older than that is considered ancient. An update in xtool might add support for this game but I don't plan on releasing anymore updates this year.

Information I gathered from the file:

Code:

Signature - 8 byte (0x53534552504D4F43)

Unpacked size - 8 bytes (70921828)

Packed size - 8 bytes (33767326)

repeated 256kb compressed oodle blocks

Code:

unpacked block size - 8 bytes

packed block size - 8 bytes

compressed block

Advanced configuration can be made from this information to collect the streams and that's needed is library that uses oodle_11_win64.dll for precompression.

IRAQIGHOST

10-10-2023 05:37

Horizon Zero Dawn Complete Edition V1.11
English, Arabic Only

*.bin

Quote:

oo2reck:3+srep_new:393b+LOLZ_ULTRA

*.bk2

Quote:

bpk

except bk2 files

Quote:

MQ1_Intro_at_the_Hovel.bk2
mq02_prepare.bk2
MQ06_07_DeathAndRebirth.bk2
MQ16_Epilogue1.bk2
MQ16_Victory.bk2
MQ030_YearsOfTraining.bk2
MQ050_ProvingCllimb.bk2

Rest files

Quote:

srep_new:393b+4x4:b64mb:lzma:ultra:bt4:fb273:lc8:m c1000000:64mb

Repack Size: 40 Gb
Final Size: 60 Gb

Masquerade

11-10-2023 02:48

Cricket 24

Code:

xtool_zstd+lolz

For XTool, use this:

Code:

-mzstd:l3 -df5p -dd5

Used libzstd v1.3.0.
Use XTool v0.7.9.hotfix1 (others will get stuck/crash).

67.4GB ---> 19.4GB

IRAQIGHOST

13-10-2023 16:12

Lords of the Fallen

Test files

Quote:

global.ucas
global.utoc
pakchunk0-Windows.pak

Quote:

xtool:mkraken:8:mzlib:mreflate:dd3+lzma2:d192m:fb2 73:lc4:mc1000000

Size:

Quote:

101 Mb --> 176.75 Mb --> 58 Mb

Tomorrow I will write the full repack

IRAQIGHOST

13-10-2023 22:02

Lords of the Fallen

Test files

Quote:

global.ucas
global.utoc
pakchunk0-Windows.pak

Quote:

oo2reck:8+srep_new:393b+lzma2:d192m:fb273:lc4:mc10 00000

Size:

Quote:

101 Mb --> 178.77 Mb --> 57 Mb

Better but slow installer

IRAQIGHOST

14-10-2023 06:05

Lords of the Fallen

Final result

Method

Quote:

oo2reck:8+srep_new:393b+lzma2:d256m:fb273:lc4:mc10 00000

Repack Size: 26 Gb
Game Size: 32 GB

Wanterlude

14-10-2023 06:56

Quote:

Originally Posted by IRAQIGHOST (Post 502823)

Lords of the Fallen

Repack Size: 26 Gb
Game Size: 32 GB

Quote:

xtool:kraken+dd5+lolz

33.9 gb > 23.67 gb
Inst.time: 17 min [11400F]

KaktoR

14-10-2023 09:25

There is mermaid codec aswell

Code:

Streams: 5305 / 5305

Time: 00:02:26 (CPU 00:04:09)



Size: 16.2 GB >> 16.4 GB

-- Edit --

I don't know if it makes any difference to use this totally not weird looking key, but nevertheless it got some additional streams.

Code:

ue5:k0x0200000003000000020000000200000002000000020000000300000003000000+kraken+mermaid



Streams: 779244 / 779255

Time: 00:29:10 (CPU 02:26:51)



Size: 16.2 GB >> 47.4 GB

oodle library 2.8.14 should be ok to use.

Maybe use zlib after that to get even more. In some cases if you precompress oodle streams, there are several zlib streams behind that aswell.

KaktoR

15-10-2023 07:33

Lords of the fallen

Code:

pakchunk0-Windows.ucas + pakchunk1-Windows.ucas



ue5:k0x0200000003000000020000000200000002000000020000000300000003000000+kraken+mermaid

Compressed 4 files, 33,824,177,351 => 77,882,524,309 bytes. Ratio 230.26%

Compression time: cpu 19.08 sec/real 2962.98 sec = 1%. Speed 11.42 mB/s

All OK



oo2reck+oo2recm

Compressed 4 files, 33,824,177,351 => 77,665,640,149 bytes. Ratio 229.62%

Compression time: cpu 44.33 sec/real 7305.07 sec = 1%. Speed 4.63 mB/s

All OK

Wanterlude

20-10-2023 01:49

Alaskan Road Truckers

Quote:

Unreal Plugin by Razor12911 (ue4) + dedup + lolz

Quote:

unreal key=0x6D5048F3C774F29BA20CFBAA92741FC4F4D7404D2D1D 770BCE19A337C3370467

31.3 gb > 8.97 gb

Danziel123

13-11-2023 18:18

Hello everyone how are you? After being unable to access this website for a long time, it is finally live

kuyhaa

13-11-2023 22:20

thanks for the administrator, long time no live, and now comeback, miss you Razor12911, kaktor, Masquerade, Cesar82, BLACKFIRE69 and all the contribute of this forums, stay healthy

Masquerade

13-11-2023 23:19

Thanks to the admins for bringing the site back online!

dixen

14-11-2023 00:39

Welcome back!!

BLACKFIRE69

14-11-2023 01:35

Ah, it's finally back! :)

FitGirl

14-11-2023 03:07

Whoo-hoooo! Was missing it, F5ed daily. Glad it's back!

KaktoR

14-11-2023 06:51

Yeah :D
https://i.imgur.com/VxsS8NM.jpg

KaktoR

15-11-2023 07:55

Time to fill up this topic again with usefull info.

Robocop Rogue City
kraken+zlib(reflate)
library v2.9.9 should be ok

The Talos Principle 2
kraken+zlib(reflate)
library v2.9.9 should be ok

The Lord of the Rings - Return to Moria
zlib

Danziel123

15-11-2023 08:15

Quote:

Originally Posted by KaktoR (Post 502921)

Sorry if I'm joining the discussion, but can you share the detail compress method for robocop? And maybe you know best compress method for COD - black ops clod war? Thank you:)

KaktoR

15-11-2023 08:43

Use dsg db

Danziel123

15-11-2023 17:26

Quote:

Originally Posted by KaktoR (Post 502929)

Use dsg db

Sorry didn't check in DSG database, what about COD - black ops cold war? Maybe you know best compress method for this game? because it doesn't exist in the database for this game. Thank you:)

dixen

15-11-2023 20:21

Quote:

Originally Posted by Danziel123 (Post 502926)

Sorry if I'm joining the discussion, but can you share the detail compress method for robocop? And maybe you know best compress method for COD - black ops clod war? Thank you:)

CoD BO Cold War = kraken

Danziel123

15-11-2023 21:19

Quote:

Originally Posted by dixen (Post 502938)

CoD BO Cold War = kraken

Which version should i use? is this right xtool:mkraken:8?

KaktoR

15-11-2023 22:27

Use xtoolui and check some files with different oo2core libraries (v8+).

Example how to use it

Danziel123

15-11-2023 22:54

Quote:

Originally Posted by KaktoR (Post 502940)

Use xtoolui and check some files with different oo2core libraries (v8+).

Example how to use it

Sorry for stupid question, but where i can find xtoolui?

KaktoR

15-11-2023 22:59

https://fileforums.com/showpost.php?...82&postcount=1

dixen

30-11-2023 12:53

Welcome Back! again...

Non Volatile Human

30-11-2023 14:02

I couldn't find any mentions of Uncharted, TLOU, or Marvel's Spider-Man/Miles Morales in the compression index.

Any ETA in sight?

Danziel123

30-11-2023 15:51

Glad to be back:)

KaktoR

03-12-2023 00:50

Quote:

Originally Posted by Non Volatile Human (Post 502985)

I couldn't find any mentions of Uncharted, TLOU, or Marvel's Spider-Man/Miles Morales in the compression index.

Any ETA in sight?

All of them are in the INDEX.

Non Volatile Human

03-12-2023 06:05

Yes, I found them. I should have used the search function instead of looking with my eyes. Thanks, Kaktor!

In TLOU, it doesn't specify which files are in archive "Data1a-01" ,and "Data1b-01", and I don't understand what it says in Uncharted:
"XTool (zlib+kraken*)+srep+lolz, (*Use oo2core_9_win64.dll from game folder)"
How can I use that?

KaktoR

03-12-2023 06:14

As for TLOU, use the xtool plugin for the all the *.psarc files.

For Uncharted game, use xtool kraken for all *.psarc files.

If you use DiskSpanGUI, load the game presets from the database.

Non Volatile Human

03-12-2023 06:46

Thank you for pointing out the database feature. Does it take care of the exclusions of certain files to be compressed by a certain algo?
or do I still have to do all that manually?

BTW, for future reference, does FileForums have a backup site/discord?
in case the site is down and somebody needs help.

KaktoR

03-12-2023 07:01

It does take care of all that stuff. Most of the games are tested by me. Just make sure to update the database from time to time.

And no, fileforums does not have a backup or discord.

Danziel123

16-12-2023 09:26

Hello everyone, how is everyone? I hope everything is fine. Finally I can visit this website again after the website has been down for a long time.

All times are GMT -7. The time now is 22:54.

Page 95 of 119

« First

105

Last »

Show 40 post(s) from this thread on one page