FileForums - Best Compression Methods for 'Specific' Games. Q&A

Page 73 of 119

« First

Last »

Show 40 post(s) from this thread on one page

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

KaktoR

11-03-2022 11:40

Quote:

Originally Posted by Masquerade (Post 496181)

This game uses LZ4, why preflate?

To be honest, I aplied preflate on pngs and pdfs without even checking the amount of files (it's from a preset).

Which files use lz4? Bundles? Because gfs nor xtool (old) do nothing on them.

Masquerade

11-03-2022 12:29

Quote:

Originally Posted by KaktoR (Post 496182)

Which files use lz4? Bundles? Because gfs nor xtool (old) do nothing on them.

Bundles, I am working on an XTool database for this one, nearly there with lz4hc but still got a way to go.

Code:

Streams: 262/923

Time: 00:00:01 (00:00:03)

Memory: 128 MB (128 MB)

You can discover this info by searching the magic number on Aluigi's site:

Code:

Xenko . Xenko / Stride Engine BUNDLE . lz4 . XKB1 [xenko.bms]

http://aluigi.altervista.org/quickbms_list.php

Masquerade

12-03-2022 02:50

The WAVE audio from Distant Worlds 2 does not compress with MSC:

Code:

Compressed 7 files, 143,350,258 => 143,350,271 bytes. Ratio 100.00%

Compression time: cpu 0.17 sec/real 16.29 sec = 1%. Speed 8.80 mB/s

All OK

Instead, use TAK which I posted here.

Code:

Compressed 7 files, 143,350,258 => 97,043,321 bytes. Ratio 67.70%

Compression time: cpu 0.14 sec/real 15.06 sec = 1%. Speed 9.52 mB/s

All OK

dixen

13-03-2022 07:49

Metro Exodus

*.Vfs## - vfsrec+srep+lolz
73 gb > 103 gb > 74 gb > 46 gb

audio .vfs## & video - srep+lzma2
2,7 gb > 2.4 gb

rest files
580 mb > 31 mb

Repack size - 48.5 gb

NOTE.
For decompession *.vfs## you need this tool
Thanks to Razor12911.

Edison007

13-03-2022 08:18

Quote:

Originally Posted by Masquerade (Post 496190)

The WAVE audio from Distant Worlds 2 does not compress with MSC:

https://krinkels.org/threads/msc-med...e-7#post-33954

Code:

msc:tak=9   - 92,5 MB (97 043 713 bytes)

msc:frog=9  - 91,3 MB (95 739 244 bytes)

msc:frog=9e - 91,2 MB (95 670 076 bytes)

pslove

13-03-2022 22:23

Hello everyone, What's the best method for State of Decay 2? Thank you!

:( Sad8669

15-03-2022 18:01

Sifu - version 4.26.2.0 + OST and Artbook

1 Attachment(s)

Code:

Method : xtool:ue4,key+srep:m3f:l512+lolz:normal

Compression Time: 5.96 Hours

Decompression Time : 6.5 Minutes

Initial Size : 19.1 GB

Final Size: 7.38 GB

Info : Use "-c512mb" for XTool, XTool 0.4.4 used

Ripped Files :

Code:

Engine/Binaries/Win64/CrashReportClient.pdb

Sifu/Binaries/Win64/Sifu-Win64-Shipping.pdb        

Engine/Content/SlateDebug/Fonts/LastResort.tps        

Engine/Content/SlateDebug/Fonts/LastResort.ttf

Thanks to Razor for unreal library, attached it below.

dixen

23-03-2022 12:47

Age of Empires III (3): Definitive Edition (100.12.54545.0)

*.bar - Xtool(v0.46)+SREP+LOLZ
44.4 gb > 75.1 gb > 52 gb > 23.5 gb

.bk2 - srep+lzma2

rest files - srep+lolz

Ripped all non-english voice files

Install size = 45.6 gb
RePack size = 24.3 gb

NOTE. Repack used a-lz4-plugin by Edison007. Thanks him for this.

Masquerade

25-03-2022 09:19

GhostWire Tokyo

Paks Folder:

For xtool, use -mgwtokyo -d1 for UCAS decryption. Oo2reck used for oodle kraken precompression since the older version of xtool (needed for gwtokyo database compatibility) is missing Razor's improvements to kraken precompression. Use a big chunk size for XTool because the encrypted streams are large.

Code:

xtool+oo2reck+srep+lolz

Everything else:

Code:

srep+razor

16.8GB ----> 13.4GB

KaktoR

27-03-2022 10:23

Tiny Tinas Wonderlands
pak = zlib

L33THAK0R

28-03-2022 03:48

Could anybody send me the decomp executable for ProFragers's "Media Stream Compressor (MSC)? Got a few thousand ".wav" files to sort through, as a handful are failing to decomp, would make troubleshooting heaps easier, cheers in advance.

Razor12911

28-03-2022 04:01

You can try to use the method -mtta in Freearc if sorting becomes a tedious job, most people don't know that Freearc does have wav file compressor but it only works if the audio files are not archived or in another container. Plus handing over files from that forum is against the rules.

Edit: I remember once having problems using msc on Left 4 Dead 2 which forced me to used Freearc's built in wav compressor.

left4dead2_dlc3\sound:
-mtta

Code:

Compressed 4,778 files, 1,315,603,487 => 649,582,676 bytes. Ratio 49.38%

Compression time: cpu 69.56 sec/real 142.00 sec = 49%. Speed 9.26 mB/s

L33THAK0R

28-03-2022 05:26

Quote:

Originally Posted by Razor12911 (Post 496303)

Code:

Compressed 4,778 files, 1,315,603,487 => 649,582,676 bytes. Ratio 49.38%

Compression time: cpu 69.56 sec/real 142.00 sec = 49%. Speed 9.26 mB/s

Ah cheers I'll give that a go, thankfully the archives are unpacked (as is required due to modding and fixing the titles numerous issues only being possible with unpacked archives) so this method should be viable, fingers crossed!

L33THAK0R

28-03-2022 06:33

Tried to update my previous post but seems the forum hates me. For some reason FreeArc spazzes out if I try to combine TTA with any other external compressors (ie. srep & lolz)

Code:

Srep + Lolz: 

335,573,882 -> 183,504,594



TTA:

335,573,882 -> 209,287,460

Seems like I'll just have to hunt around for that elusive MSC decomp executable, or wait until krinkels membership payment vendor comes back online.

Masquerade

28-03-2022 08:35

Quote:

Originally Posted by L33THAK0R (Post 496302)

Dude, I already told you about the Krinkels rules before in a different topic. You cannot ask for Krinkels content!!

Code:

Внимание! Если вы получили статус "Пользователи" и будете предоставлять материал тем, кто его ещё не получил (по их просьбам через ЛС), то тут же будете лишены данного статуса навсегда.



Attention! If you received the status of "Users" and will provide material to those who have not yet received it (at their request via PM), then you will immediately lose this status forever.

KaktoR

28-03-2022 08:50

msc resources were shared here way before krinkels decided to make their resources "non-public" behind their "rulez" (for whatever reason).

If you search for it here you will find it I guess.

Masquerade

28-03-2022 11:35

The Sims 4 [Deluxe Edition] (v1.85.203.1030 + All DLCs + Soundtrack)

Code:

xzlib+srep+lolz/$mp3=mpz

50GB ---> 30.3GB

18 hours needed.

kuyhaa

28-03-2022 14:51

Quote:

Originally Posted by Masquerade (Post 496315)

The Sims 4 [Deluxe Edition] (v1.85.203.1030 + All DLCs + Soundtrack)

Code:

xzlib+srep+lolz/$mp3=mpz

50GB ---> 30.3GB

18 hours needed.

bro, share please how you make repack Ghostwire with opotional 4kvideos and language, because i see only ucas and pak

L33THAK0R

28-03-2022 15:30

Quote:

Originally Posted by Masquerade (Post 496306)

You cannot ask for Krinkels content!!

Cheers for the repeated heads up, but thankfully in prior cases I've had users reach out to me with the relevant resources, allowing me to be a tad cheeky and grab a given tool.

Dragonis40

28-03-2022 23:15

Good morning everybody. As far as I know, one of the best settings to have a very high compression using lolz.exe is: dtb1:d512m:mtt1:mc1023. Is there any setting for higher compression? Maybe it's up to the files I want to compress, but are there any setting for higher compression? Thank you!!!

Masquerade

28-03-2022 23:57

Quote:

Originally Posted by kuyhaa (Post 496318)

bro, share please how you make repack Ghostwire with opotional 4kvideos and language, because i see only ucas and pak

4K Videos and language files are inside the PAKs. You can follow this tutorial.

kj911

29-03-2022 01:33

Quote:

Originally Posted by L33THAK0R (Post 496305)

Code:

Srep + Lolz: 

335,573,882 -> 183,504,594



TTA:

335,573,882 -> 209,287,460

Try it use TTA(MSC)+SREP+LOLZ combo? Or TTA+SREP+4x4 ? (msc+rep:256mb+4x4:tor:3:1mb+lzp:8mb:3:h22:d64mb)

L33THAK0R

29-03-2022 05:12

Quote:

Originally Posted by kj911 (Post 496324)

Try TTA(MSC)+SREP+LOLZ combo? Or TTA+SREP+4x4 ? (msc+rep:256mb+4x4:tor:3:1mb+lzp:8mb:3:h22:d64mb)

As far as I know MSC only supports OptimFrog & TAK for "WaveForm Audio" packing, TTA seems to be only available through in-built functionality within FreeArc, when talking about using TTA for a FreeArc-based packing method. I'm not sure if its the header(s) within my arc.ini but unfortunately TTA refuses to cooperate with any other packing tool, such as LOLZ & SREP.

Masquerade

01-04-2022 14:10

Death Stranding Director's Cut

1. Separate languages according to info here.

2. Remaining .bin files:

Code:

dst+oo2reck+srep+lolz

3. movies.mpk:

Code:

srep+zstd

Contains bink videos but not able to be patched out and back in afaik.

4. Languages:

Code:

dst+oo2reck+srep+zstd

69.1GB ---> 57.9GB (all languages)

Don't use srep v3.92b - crash during compression of main game bins.

kuyhaa

02-04-2022 05:17

Masquerade

share your xtool method for Weird West bro , are you modified .pak file ?

L33THAK0R

02-04-2022 09:34

2 Attachment(s)

Just making this post to make it easier for future pilgrims on their search for the elusive decoding executables, looking to debug their audio packings.

OGGRE v0.1.1 (Vorbis Audio Compressor) by Profragger
MSC (Media Stream Compressor) v0.064 by Profragger

Thank you kj911 for helping me find the MSC decoder app.

dixen

02-04-2022 13:25

1 Attachment(s)

Quote:

Originally Posted by kuyhaa (Post 496383)

Masquerade

share your xtool method for Weird West bro , are you modified .pak file ?

Quote:

for /f "tokens=*" %%i in ('dir /b /s /a *.mp4') do cd.>"%%i"

3. Reimport your zero-bytes .mp4 to .pak file (qbms -G -w -r -r ue4_27.bms ue4_27.bms <path_to_pak-file> <path for extracted files>)

kj911

02-04-2022 14:13

Any members tested the mp3HD-codec (encoder/decoder its available) from compress WAV's in losslessly mode? (My future searching from testing and compare other ones.) And again compressing with MSC/MPZ/PackMP3 from better compression?? One problems, this mp3HD-codec, put the lossy compressed MP3 streams via losslessly compressed parts to one MP3 file. Likely hacking and stripping lossy parts before any extra compression.

Is there any reality to this??

kuyhaa

02-04-2022 21:16

Quote:

Originally Posted by dixen (Post 496386)

Usual zlib compression + reimport zero-bytes .mp4 to pak (quickbms v0.11 + ue4_27,bms script to help)

1. Exctract .mp4 from .pak archive (qbms -f *.mp4 ue4_27.bms <path_to_pak-file> <path for extracted files>)
2. zero-byte build .mp4 cmd

3. Reimport your zero-bytes .mp4 to .pak file (qbms ue4_27.bms ue4_27.bms <path_to_pak-file> <path for extracted files>)

got it, thanks dude

btw, where are you get ue4_27.bms ? i didn't see on official

Masquerade

02-04-2022 22:30

Dixen's method is correct, but I actually patched those videos out manually (not entirely sure why :D) and put them back in with SFK.

As for the UE4 v4.27 script, you can grab that here: https://bayfiles.com/n2LfifT1x6/

I will post my data sheet today.

fabrieunko

02-04-2022 22:56

hello why when i type this command i get the following message?

Code:

for /f "tokens=*" %%i in ('dir /b /s /a *.mp4') do cd.>"%%i"

%%i was unexpected

Masquerade

03-04-2022 00:39

Quote:

Originally Posted by fabrieunko (Post 496393)

hello why when i type this command i get the following message?

Code:

for /f "tokens=*" %%i in ('dir /b /s /a *.mp4') do cd.>"%%i"

%%i was unexpected

You need to replace %%i with %i when using cmd. Double % is for batch files.

kuyhaa

03-04-2022 02:10

thanks bro, so i know the script from zenhax

Quote:

Originally Posted by Masquerade (Post 496392)

I will post my data sheet today.

gladly to wait

Masquerade

03-04-2022 10:51

For Tropico 6 v17, devs included PS5 and XBOX version audio inside Windows paks - using the dixen method with quickbms script v4.25, you can null this audio.

dixen

05-04-2022 08:34

Saints Row 4 (GOG)

*.vpp_pc - XTool(v0.47)+SREP+LOLZ
8.7 gb > 14.5 gb > 6.2 gb > 3.2 gb

*.bik - bpk
1 gb > 850 mb

Repack size - 4.05 gb

NOTE.
VPP_PC decompressed with reflate:l9 mode only (NOT ZLIB)

Quote:

[External compressor:xt47]
header = 0
packcmd = XT47\xtool precomp -mreflate:l9 -c32mb -t100p - - <stdin> <stdout>

dixen

05-04-2022 21:48

LEGO Star Wars: Skywalker. Saga (Fast repack)

*.DAT - XTool(v0.47 + Kraken)+SREP+LZMA2
29 gb > 70 gb > 48.5 gb > 22 gb

Rest files - SREP+LZMA2

Used oo2core_8_Win64.dll from game folder

Masquerade

06-04-2022 08:00

LEGO® Star Wars™: The Skywalker Saga

Main *.DAT archives:

Code:

xtool-kraken+srep+lolz

LP_* *.DAT archives:

Code:

oggre+srep

Remaining files:

Code:

srep+razor

English Only: 20.2GB

With all languages: 27.9GB

kj911

06-04-2022 13:05

Edison007/Kaktor (*.RAW files compression from MSTS): This post updated! (NEW2 results its wait few hour (next day) from finishing new compression.) In last during compression process time, cca. ~11hours! This new Delta+LOLZ compressed new archive (new DATA2a file) its compressed in ~3h 32mins! Yes, fastly LOLZ compressed! Delta+LZMA variant, use last Arc.exe (v0.67), requested CPU time 7578s / real time 6373s! (2h 6m 18s / 1h 46m 13s) Yes, ~2* time difference LOLZ vs. LZMA! Newest test compression barely slower. Size/difference gains?? See wait.

DATA2a (NEW): 605 216 276 byte (full archive size.)
DATA2a (NEW2): 602 222 733 byte (ful larchive size.)

Gains? Its minimal ~3 MB's size. Comp. time? ~9h 17s! 2.62* time difference than (NEW) versions.

And new WAVE compression records?? ~2400 million byte WAVE files compressed smaller than 440 million bytes! (The 21.4GB's game version.) Use MSC with raw=2 options. Testing again with raw=0. Secret compressor? Methods? Not! Use MSC+LOLZ! Older size 672 174 kB dropped to 428 997kb!

See the picture: https://i.kek.sh/Cjixz009jJA.png and https://i.kek.sh/2ASvOt3o64K.png

UPDATE: This WAVE files damaged??? Tested with TotalCommander and don't work!! (raw=2 comp. variant.) 700 file its ok, 4616 damaged! AAaarrghh! Retesting and researching now! Wait now!

UPDATE2: Error its found!! The shitty laptop, dont properly extracted the older arc file to "DATA" folder with all WAVE files, before last days compression! Memory, HDD-error?? Aaaarghh! Extract again and retesting now. (CRC's before compression.) Sorrry!!

More game:

Splinter Cell Pandora Tomorrow (Hungarian version):

MAPS.LM0 and MAPS.SM0 files compression.

Total size: 354 036 136 byte

Previous record: 70 415 096 byte
Methods:srep:m3f:a0+lolz:dt:dtb1:dtw1:dtm1:dto1:dt d1:mtt1:mt4:d128m:fba4096:tt32:mc1023

Newest record (reversed methods sequence from WAVE/Audio compression): 64 919 477 byte
Methods: SREP+MSC (!)
MSC use 0.0.6.4 with raw=2 switches. SREP 3.92 use -m3f -l32 switches. Decompress totally OK. Compression ratio, its verying hard and buggy, not easy reproducable. Yes. MSC its crashing now in during compression??? Or TTA methods dont compress in smaller size? Change SREP lxx settings! Use l512 or smaller to l64/l32 in various combination. And very recommended use -m3f options. Or change SREP to 3.93 or 3.2. (3.92 in minimally betterly compress than older.)

Or and funny methods: SREP+TTA (!)
Size: 64 411 339 byte, its best results from some testings.
This masked compressed package, don't decompresseable with Arc.exe file. (Decompress first file only.) Use unarc.exe and CLS-SREP.dll files its will decompressing properly in files, with error messages. "ERROR: archive data corrupted (decompression fails)" This extracted files CRC's checked via *.sha file (use SHA-1) from Total Commander its OK! WTF?? Yes!
Extra funny methods: Double compression, (not masked archive!) its totally work and good. Data files --> SREP comp. (put to compress files via to precompressed.arc file) --> compress again this precompressed.arc file use TTA methods to create packed.arc file.

Usage:
1. step: arc a -ed -msrep precompressed.arc files
2. step: arc a -ed -mtta packed.arc precompressed.arc

More results in posted in future time from the SCPT game. In last version smaller than 700MB's size. (BINK Videos dowgraded 433MB's to ~191MB's size.)

Mypko

06-04-2022 15:32

LEGO® Star Wars™: The Skywalker Saga

17:44:14 - Selected ARC/DS method for Data1a-01.bin was:
xtool:mkraken:8+srep_new+4x4:b64mb:lzma:ultra:64m: bt4:fb273:lc8:mc1000000
-----------------------------------------------------------------------------------------
23:30:17 - Getting size of the game: Unknown 1
23:30:17 - » Installation folder size: 29,05 GB
23:30:17 - » Compressed game size: 21,69 GB (Ratio 74.64%)

only english
use:

disc_span_gui
XTool 0.47
oo2core_8_Win64.dll from game folder

thanks dixen and Masquerade

pslove

06-04-2022 22:02

Quote:

Originally Posted by ZAZA4EVER (Post 488362)

Use this srep
https://uptobox.com/i50pu2cck4b3

Hello, can you re-upload this? The link is dead. Thank you.

All times are GMT -7. The time now is 00:41.

Page 73 of 119

« First

Last »

Show 40 post(s) from this thread on one page