Best Compression Methods for 'Specific' Games. Q&A - Page 194

Lord.Freddy · #1 15-09-2022, 08:35

Quote:

Originally Posted by KaktoR

While we on this discusion right now, what's a good method for text files btw? Such as txt, xml, ini, etc.

Code:

----‐--------‐-------------‐--------‐-------------‐--------‐---------
1) ' nanozip:cc ' => Ultra
2) ' bsc ' => maximum
3) ' dict:p+lzp+ppmd:20:500mb:r1 ' => High
----‐--------‐-------------‐--------‐-------------‐--------‐---------

Dragonis40 · #2 15-09-2022, 09:49

Good evening, I've extracted a .archive file and this is composed of several .bin files. Which is the best method to compress these .bin files? I've tried with precomp v0.4.7, then with xzlib, with no compression results at all. Is there a specific compressor or a mix of them? Thank you!

KaktoR · #3 15-09-2022, 09:58

You should know what these bin files include.

Dragonis40 · #4 15-09-2022, 23:17

Quote:

Originally Posted by KaktoR

You should know what these bin files include.

Thank you for your reply! The .archive file i've extracted is a file from Cyberpunk 2077 and it's a language file, so I think .bin files inside are audio file or sound file. Do you think I have to use MSC or similar tools to compress them?

Masquerade · #5 15-09-2022, 23:58

Quote:

Originally Posted by Dragonis40

Thank you for your reply! The .archive file i've extracted is a file from Cyberpunk 2077 and it's a language file, so I think .bin files inside are audio file or sound file. Do you think I have to use MSC or similar tools to compress them?

It's WWise Vorbis

Dragonis40 · #6 16-09-2022, 01:45

Quote:

Originally Posted by Masquerade

It's WWise Vorbis

You mean I should compress .bin files with "How to correctly process WWise Vorbis Audio | Guide + WemTool" guide?

Masquerade · #7 15-09-2022, 13:15

The Death

srep+lolz

7.4GB ----> 2.5GB

kj911 · #8 16-09-2022, 13:26

1GB's BMP compression test:

Code:

Original archive: bmp.arc (244,937,914 byte)
Methods: lzma:192mb:normal:bt4:128:lc8

Packed from grzip (with -mgrzip:256mb:h15:l2048:a):

Code:

5,483 files, 1,069,598,818 bytes, 320,784,780 compressed (not solid!)
tempfile+grzip..: 1,069,598,818 bytes, 321,101,123 compressed (solid!)

Packed from DLZ: 239,147,583 byte, Methods: -slp -d64m -lc8 -lp0 -fb337 -mc8192

Packed from bliz:

Code:

100m bytes dict. size: 258,506,104 byte
with 4096kB Dict size: 270,019,193 byte
tempfile+mm+bliz: 279,418,278 byte
mm+tempfile+bliz: 289,750,196 byte (not solid archive!)

Packed from MSC (BMF 2.0.1 with slow mode, bmf=9s) VERYSLOW:

Code:

Compressed 5,483 files, 1,069,598,818 => 340,840,020 bytes. Ratio 31.87%
Compression time: cpu 108.97 sec/real 17445.55 sec = 1%. Speed 0.06 mB/s

BMF Results:

Code:

<--------------------------- B M P ---------------------------->
Total founded BMP: 4549
BMP with not supported header value "bit_per_pixel": 0
BMP with not supported line size (should be line_size_bytes mod 4 = 0): 132
BMP filtered by size: 0

processed BMP: 4417 (919'082'710 bytes)

Packed again the MSC/BMF-packed previous archive:

Code:

7z/LZMA: 232 253 503 byte
DLZ only: 228 604 204 byte

Note: DLZ its finished in ~41 mins from compression. BLIZ its faster.

and any compressors:

RAZOR 1.03.7 x64 with 512m Dict. size: 195 443 238 byte

LOLZ v22c4b (Brute detect disabled!):

Code:

default lolz settings (ldmf1, 64MB dict ...): 187,784,213 byte
lolz:dt:mtt1:mt4:d160m:fba4096:tt16:mc1023 -> 187,109,257 byte

All compression tests, except RZ/LOLZ use only from very old x86 PC with 1GB RAM. RZ/LOLZ used x64 laptop with 8GB RAM.

Masquerade · #9 19-09-2022, 10:58

I belive the *.ggpack* archives in Return To Monkey Island are XOR encrypted. None of the current keys from this list appear to be correct.

L33THAK0R · #10 19-09-2022, 21:24

I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:

Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.

The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.

Lord.Freddy · #11 19-09-2022, 23:29

Quote:

Originally Posted by L33THAK0R

I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:

Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.

The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.

maybe you need to remove the level option, sometimes it works.

L33THAK0R · #12 20-09-2022, 00:10

Quote:

Originally Posted by Lord.Freddy

maybe you need to remove the level option, sometimes it works.

Unfortunately seems like some data actually got stripped away doing that, resulted in a 99.51% ratio

Edison007 · #13 20-09-2022, 08:01

Quote:

Originally Posted by L33THAK0R

I'm very new to lzo1x pre-compression, could anyone explain why XTool in this example is able to detect some streams but not able to process any? I've tried levels 1 - 10 and the same amount of streams are detected but none are able to be processed

Code:

Creating Archive Please Wait...

FreeArc 0.67 (March 15 2014) updating archive: Data.arc
Compressing 1 file, 38,255,712 bytes. Processed   0%
Compressing 38,255,712 bytes with "C:\Compressor_Resources\XTool_2020\xtool_0.6.5\XTool.exe" precomp -mlzo1x:l6 -c512mb -t95p $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
XTool is created by Razor12911

Streams: 0/2854
Time: 00:00:01 (00:00:03)
Memory: 128 MB (128 MB)

100%
Errorlevel=0
Compressed 1 file, 38,255,712 => 38,255,982 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 1.63 sec = 3%. Speed 23.44 mB/s
All OK

All done.

The algorithm used is definitely lzo1x, and creating a database with bms2xtl detects an additional ~5000 streams but alas none are detected. I've also not been able to find many other lzo libraries to test with so if its a library issue, if anyone could point me in the direction to look for others it'd be greatly appreciated.

Maybe used pro-functions. Upload example file for testing

L33THAK0R · #14 21-09-2022, 03:35

Quote:

Originally Posted by Edison007

Maybe used pro-functions. Upload example file for testing

Thanks for offering to have a looksie, really appreciate any insight you can offer, also in case its of any interest I've also got an LZ4 sample I've been having similar issues with, tried about a dozen libraries but no dice so far, xtool (0.6.5) is also detecting streams but unable to pick any up unfortunately.

KaktoR · #15 21-09-2022, 04:09

For your lz4 sample you have to use lz4f with level 2 and pick the right lz4 library

Code:

Compressed 1 file, 32,882,867 => 158,560,939 bytes. Ratio 482.20%
Compression time: cpu 0.08 sec/real 1.18 sec = 7%. Speed 27.85 mB/s
All OK

You have to look which level produces the closest recompressed size to the original size

However in a quick test there are still some streams left behind.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Games Are For Kids	JoyBoy	Chit Chat	83	16-11-2021 14:28
CorePack Compression methods ? Help	ramazan19833	Conversion Tutorials	34	09-08-2018 06:51
i got the email in the mail about copying ps2 games	EVOEvo	PS2 Games	7	21-11-2003 07:56
Self-booting games on an older Japanese DC?	Named	DC Games	1	26-09-2003 17:48
Having Problems Burning Numerous Recent Games....Help is Appreciated	Protosstic	PSX Games	2	15-01-2002 21:27

The Following User Says Thank You to Lord.Freddy For This Useful Post:
KaktoR (15-09-2022)

The Following 2 Users Say Thank You to Masquerade For This Useful Post:
dixen (15-09-2022), JustFun (06-10-2022)

The Following User Says Thank You to kj911 For This Useful Post:
Lord.Freddy (17-09-2022)

The Following User Says Thank You to Edison007 For This Useful Post:
L33THAK0R (21-09-2022)