Best Compression Methods for 'Specific' Games. Q&A

[dixen]

Originally Posted by prince55

xtool 32 , i think 0.9

Edit
when i used xtool 64 , it stuck on 1.3 % for 8 hours !!

Hmm..
XTool 0.12 - All OK

d:\xtool_v012\FA_example>arc.exe a -ep1 -r -ed -s; -w.\temp -mxprecomp data.arc "pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 228,816,703 => 250,757,603 bytes. Ratio 109.59%
Compression time: cpu 0.25 sec/real 6.75 sec = 4%. Speed 33.87 mB/s
All OK

[IRAQIGHOST]

Hi
New way to compress Call of Duty Black Ops 3
SP+MP+ZM (with bots)

Repack Size: 76 Gb
Final Size: 124 Gb

*.xpak
srep_new:3+razor_stdio

*.ff + *.fd
xt_zlib+srep_new:3+LOLZ_NORMAL

*.sabl + *.sabs
srep_new:3+razor_stdio

rest of files
srep_new:3+LZMA-MT*

[78372]

I use my own masks dude. Razor and nanozip compressors are too slow while compressing, so I do not use them. But you may get about 14.x gb or less by razor I think.

[felice2011]

Originally Posted by 78372

I use my own masks dude. Razor and nanozip compressors are too slow while compressing, so I do not use them. But you may get about 14.x gb or less by razor I think.

OK, But did you test the compression time on the 30 gb sample, with your method, and with the use of nz or rz?

[78372]

No, didn't tried with them.

[felice2011]

Originally Posted by 78372

No, didn't tried with them.

Ok

[78372]

This doesn't makes pzlib non-applicable, try yourself Take two same zlibbed file with different names, use srep+pzlib, you will see.

[Chayan Manna]

Max Payne 3 The Complete Edition:
From 32.47 GB ->> 16.4 GB

Used Method:
For zlib files: pZLib+Srep+delta+lzma
Parameter: pzlib+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8
For audio files: msc(tak)+Srep+delta+lzma
Parameter: msc+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8
For video files: delta+lzma
Parameter: delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8

Took a lot of time to process srep, because my RAM is 8 GB.

The latest version of pZLib is used with latest reflate libs.

Note: If you increase the RAM usage of LZMA the ratio will be better, but it will take more ram to compress & decompress also.... But decompression speed will increase.
For example: in this parameter "lzma:512mb:normal:bt4:27 3:mc1000:lc8" the RAM usage is 512 MB (at decompression) & it will take 5384 MB (approx) RAM to compress.

[elit]

Originally Posted by Chayan Manna

Max Payne 3 The Complete Edition:
Parameter: msc+srep:m3f:l256+delta+lzma:512mb:normal:bt4:27 3:mc1000:lc8

I see you use highest "lc" parameter for lzma. Can you tell me your general experience with it? Is it much better in general game compression usage or all usages in general? And what gain can be expected from it vs default?
Thank you

[Chayan Manna]

Originally Posted by elit

I see you use highest "lc" parameter for lzma. Can you tell me your general experience with it? Is it much better in general game compression usage or all usages in general? And what gain can be expected from it vs default?
Thank you

There may be LZMA1 streams that have lc>3 which is default. So, better compression ratio may be gained by lc8. But using highest lc may increase the compression time a bit.
I tested it with several files & almost every time I got the best ratio with lc8.

[78372]

Just Cause 2

Game Size: 3.97GB after removing unnecessary audio files
Final Size: 1.1GB(Approx)
Method: pZlib:m2+srep:m3f+lzma:177mb:ultra:bt4:fb273:mc100 0000:lc8



@Moderators
What about creating an index for this thread at the first post?

[KaktoR]

I don't think mods would update a third index, it'a alot of work.

Maybe someone (you?) could get ownership of first post and update it from time to time.

[78372]

:3 Nah, I am just asking for this if possible, I seriously have no time for do so :P

[Razor12911]

I think putting games and their methods here is a terrible idea because there are so many of them, the wise solution to this is narrowing down the field, game engines for example or picking games as a series. for example, all Assassins Creed games are lzo compressed, use the method plzo+srep+lzma for all, because listing all the AC series just makes the thread difficult to read or the index you're suggesting.
For example I already see GTAIV and Max Payne 3, next we'll probably see GTAV, what we could have said all in all is pzlib+srep+lzma for all games that use the RAGE Engine which is what they use.
https://en.wikipedia.org/wiki/Rockst...ed_Game_Engine
there is the list of games, what people could do is
put an engine with the link on a site like wikipedia that has list of games then put the method that should be used.

[elit]

Most of major Ubisoft games: -plzo(+pzlib)+srep+lzma
Most of major past EA games: -plz4(+pzlib)+srep+lzma
Most of major recent EA games: -pzstd(+pzlib)+srep+lzma

Or I will simplify it further:
Almost-everything-out-there: -ztool(x2)+srep+lzma

Case closed