FileForums - Best Compression Methods for 'Specific' Games. Q&A

Used precomp042+srep+lolz on main game .pcc files.
srep+lolz on audio files
srep+lzma on .sfar dlc files
bpk +srep on bibk video files
and srep+exe2+delta+lolz on remaining files

Someone here compressed ME3 from 24.3Gb to 8gb.He doesnt mention how the hell he extracted .sfar dlc files.
After extraction r files md5 perfect.
Here, we share methods not conceil it, this thread is ment to provide info, how to achieve this size. I tried to contact hime but he didnt responded.
I tried to use dlc extractor and xdelta to make it work but after comparing (recreated .sfar )files with orginal, xdelta produces orginal size patch which is useless. if anyone know how to do this let me know.
My theory about how (i guess is his doofoo) compressed it from 24.3gb to 8gb is he extracted .Sfar files and then recreated .sFar from extracted content without useing lzma compression (hence the game size 24.3gb).
Cp has also compressed mE3 from 16.5gb to 11.5gb (compression ratio of around 70%) which is same as mine that means they have encoded videos.
My orginal game size was 24gb after removing French, Italian and German languages, it came down to 19.2 (with single int(english) language).

Someone here suggested using lzma precompressor by shelwain, it has a issue, it doesnt allow using external compressors like srep lolz on precompressed file. what it does is, it first precompresse lzma files, then uses lzma compression with high setting on precompressed files.
BTW it supports stdin stdout(someone might want to try).

KaktoR

04-05-2018 02:25

Is precomp042 better than pzlib in this case?

ZakirAhmad

04-05-2018 04:06

Quote:

Originally Posted by KaktoR (Post 470700)

Is precomp042 better than pzlib in this case?

I tried xtool on .pcc files but it game me error on some file during precompression. same was the case with ztool.
however precomp took 1 hour to precompress and only 13minutes to decompress.

ZakirAhmad

05-05-2018 05:31

Quote:

Originally Posted by doofoo24 (Post 470718)

WHAT THE F*UCK you talking about :mad:
i don't remember which sfar extractor i used it probably the one with the mod, use f*cking google and BTW STOP SPAMMING my inbox :D

How the hell i spamed ur inbox. I only massaged twice to u about sFar.

Nevermind, I spent too much time on this repack. I am fed up with it.

KaktoR

05-05-2018 06:44

I used https://www.nexusmods.com/masseffect3/mods/409 to rip out other language out of sfar files.

Saves you a few GB for english only.

Mini	05-05-2018 06:53

mad max
xprecomp+srep:l512:a2:c64:m3f+lolz:d1024:al1:dto0: dm00:mc1023:lm0:dtb0:x0:mtb64:tt16:rt0:mtt0:dt1

3.63 GB

KaktoR

05-05-2018 08:35

Just Cause 3

xtool:c32m,t4:zlib+srep+lzma for the following files

Code:

archives_win64\game3.arc

archives_win64\game12.arc

archives_win64\game13.arc

archives_win64\game14.arc

archives_win64\game15.arc

archives_win64\game16.arc

archives_win64\game17.arc

archives_win64\game18.arc

archives_win64\game19.arc

archives_win64\game20.arc

archives_win64\game25.arc

archives_win64\game26.arc

archives_win64\game27.arc

archives_win64\game28.arc

archives_win64\game29.arc

archives_win64\game30.arc

archives_win64\game31.arc

archives_win64\game32.arc

archives_win64\game35.arc

archives_win64\game39.arc

archives_win64\game40.arc

archives_win64\game41.arc

archives_win64\game42.arc

archives_win64\game43.arc

archives_win64\game44.arc

archives_win64\game45.arc

archives_win64\game46.arc

archives_win64\game47.arc

archives_win64\game48.arc

archives_win64\game49.arc

archives_win64\game50.arc

dlc_win64\bavarium_sea_heist\arc\game0.arc

dlc_win64\mech_land_assault\arc\game0.arc

dlc_win64\mech_land_assault\arc\game1.arc

dlc_win64\mech_land_assault\arc\game4.arc

dlc_win64\mech_land_assault\arc\game5.arc

dlc_win64\skin_flame\game0.arc

dlc_win64\sky_fortress\game0.arc

dlc_win64\v0805_sportmech\arc\game0.arc

dlc_win64\w901_scorpiongun\arc\game0.arc

patch_win64\game1.arc

There are some other files that contain many zlib streams but gave crc error on unpacking (no matter what options).

Code:

archives_win64\game1.arc

archives_win64\game2.arc

archives_win64\game5.arc

and some other

All other files srep+lzma

One language only!
Original size: 52.8GB
Final size: 19.5GB

JustFun

05-05-2018 08:39

I think that we now have 200 or more methods in Index, thx to everyone involved!!!
Sry cant check, I can only count to 100 lol, nah I am just too sleepy to do so!!

Grumpy

05-05-2018 09:17

Quote:

Originally Posted by justfun (Post 470725)

i think that we now have 200 or more methods in index, thx to everyone involved!!!
Sry cant check, i can only count to 100 lol, nah i am just too sleepy to do so!!

202 ;)

JustFun

05-05-2018 10:41

Haha, thx mate!!!

ShivShubh

07-05-2018 06:23

Quote:

Originally Posted by ZakirAhmad (Post 470699)

Someone here compressed ME3 from 24.3Gb to 8gb.He doesnt mention how the hell he extracted .sfar dlc files.
After extraction r files md5 perfect.
Here, we share methods not conceil it, this thread is ment to provide info, how to achieve this size. I tried to contact hime but he didnt responded.
I tried to use dlc extractor and xdelta to make it work but after comparing (recreated .sfar )files with orginal, xdelta produces orginal size patch which is useless. if anyone know how to do this let me know.
My theory about how (i guess is his doofoo) compressed it from 24.3gb to 8gb is he extracted .Sfar files and then recreated .sFar from extracted content without useing lzma compression (hence the game size 24.3gb).
Cp has also compressed mE3 from 16.5gb to 11.5gb (compression ratio of around 70%) which is same as mine that means they have encoded videos.
My orginal game size was 24gb after removing French, Italian and German languages, it came down to 19.2 (with single int(english) language)

.SFAR files used in Mass Effect 3 uses LZMA compression. Normally it is a very very stupid idea to do precompression of LZMA because you know its going to be very slow unless you have a proper way of doing it in MT. To match the data/size with originals so that you dont get large xdelta patches, you have to match the LZMA parameters,block size etc... as it was used in the originals.

And for Shelwien's tool, you are confusing plzma. He has also created a lzma recompressor with no internal compression so that you can apply further compression but its very very slow and for advanced users.

78372

07-05-2018 09:51

^^He is right, LZMA is slow AF, you can use lzmadump for recompressing them, but it's a tool like old reflate, and very much slow.

darkwolves

07-05-2018 11:21

Quote:

Originally Posted by KaktoR (Post 470700)

Is precomp042 better than pzlib in this case?

gotta love multithreaded precomp lol i would not use it if not for that

darkwolves

07-05-2018 11:24

Quote:

Originally Posted by JustFun (Post 470725)

I think that we now have 200 or more methods in Index, thx to everyone involved!!!
Sry cant check, I can only count to 100 lol, nah I am just too sleepy to do so!!

i have more just waiting to see what razor does with xtool
i hope he adds vp6

doofoo24

10-05-2018 23:37

just cause 2

pzlib:m2:c16m+srep:m3f:a2+lolz:d64 size 4.01gb to 1.05gb english only...

kassane

11-05-2018 04:33

Divinity Original Sin 2

I tested quickly using this combination:

Code:

srep:m5f:l128:a1+lolz:mtt1:mt4:fba2:mc2:cm1

Original Size: 32GB
Final Size: 23.4GB

Two languages : english and spanish only

doofoo24

11-05-2018 07:43

Mirrors Edge Catalyst 16.5gb

ztool:plz4+srep:m3f:a2+lolz:d64m english only

doofoo24

11-05-2018 07:44

Battlefield Hardline 22.7gb

ztool:plz4+srep:m3f:a2+lolz:d64 all loc+mp

ZakirAhmad

12-05-2018 01:03

Compressed Tom clancy's splinter cell Blacklist Deluxe Edition from 18.1gb to 10.7gb

used xtool + srep+ lolz on zlib files.
bpk + srep on bik files.
srep+ lz77 on sound files (as always oggre failes on them)
srep+ lolz on bin + bundle files
and srep + exe +delta +lolz on rest files.
xtool improves compression around 200mb than pzlib. xtool version is v03.

All creadit goes to Razor.
Extaction time reduced by 14minutes.
FGs version took 44minutes while mine without binkpack took 28minutes, that adds only 2 minutes for bik videos.

doofoo24

12-05-2018 03:44

need for speed payback 13.5gb

precomp:c32mb,t100p:lz4+srep:m3f:a2+lolz:d64 from 27.gb
*use xtool

doofoo24

12-05-2018 06:49

battlefield 4 14.2gb

precomp:c32mb,t100p:lz4+srep:m3f:a2+lolz:d64 from 23.7gb sp only with en without mp/xp filles...
*use xtool

Sergey3695

14-05-2018 02:19

Borderlands: Game of The Year Edition (5.37 Gb) (RUS|ENG) (5.2 Gb) (RUS) (5.28 Gb) (ENG)
Binaries
Engine
Data_3.bin (12,5 Mb)

Code:

-mexe2+delta+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

RUS / ENG interface
Data_2.bin (336 Mb) or (Data_ENG.bin (250 Mb) and Data_RUS.bin (164 Mb))

Code:

-msrep:m3f:l1024:c64+lolz:tt16:mtb32:d512m:oh14:fba256:mc1023

WillowGame
Data_1.bin (2.58 Gb)

Code:

-muelr+srep:m5f:l2048:c64+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

arc.ini

Code:

[External compressor:uelr]

header = 0

packcmd   = uelr.exe ulv $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:srep]

header = 0

packcmd   = srep {options} -slp- -s35000000000 -a0/0 -hash- $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

unpackcmd = srep -d -s <stdin> <stdout>

Data_Movies.bin (2.44 Gb) (*.bik)

Code:

-mbpk

p.s. deleted tracks

Code:

for %%i in (*.bik) do (

start /WAIT binkmix %%i - %%i  /o /t2 /#

start /WAIT binkmix %%i - %%i  /o /t3 /#

start /WAIT binkmix %%i - %%i  /o /t4 /#

start /WAIT binkmix %%i - %%i  /o /t5 /#

)

pause

Installation time: ~12 min on HDD 5400.

Simorq

14-05-2018 08:17

Quote:

Originally Posted by darkwolves (Post 470981)

http://fileforums.com/showpost.php?p...&postcount=259

batman arkham knight premium edition

26.2 gb new size

previous repack size

27.4

previous compression method was removed due to the quality
and the decompression speed differences

Compression Time?

darkwolves

14-05-2018 11:50

Quote:

Originally Posted by Simorq (Post 470987)

Compression Time?

time on compression to me does not matter to me besides i did not keep track
i was at work while it repacked and my compressor does 3 data files
it only showed the timeframe for the final file
decompression takes around 30 minutes though
previous method with lzma took around an hour and a half
to decompress

doofoo24

15-05-2018 16:31

rime 4.33gb

pzlib:c16m+srep:m3f:a2+lolz:d64 from 7.26gb

LuzhinE

16-05-2018 16:14

There is some new method for METAL GEAR SOLID V: THE PHANTOM PAIN

darkwolves

17-05-2018 10:44

glad i posted so many compression methods here...
had a tornado last night power went poof and so did my hard drive...
now i have to go through steam to get everythng back
and have alot of repacking to do....blah :rolleyes:

KaktoR

17-05-2018 11:59

Final Fantasy XIII
Only US files (JP ripped)

xtool:zlib+srep+lzma

Code:

\white_data\sys\white_imgu.win32.bin

\white_data\sys\white_scru.win32.bin

\white_data\sys\white_scru.win32.sdat

\white_data\zone\*img.win32.bin

storing (wmp files)

Code:

\white_data\movie\*

rest of the files srep+lzma

23.6GB

KaktoR

17-05-2018 14:10

Final Fantasy XIII-2
Only US files (JP ripped)

ztool:max:t100p+srep+lzma

Code:

\alba_data\sys\white_imgu.win32.bin

\alba_data\sys\white_scru.win32.bin

\alba_data\udp\white_patch_scr_u.win32.bin

\alba_data\udp\white_patch_u.win32.bin

\alba_data\zone\white_z0010u_img.win32.bin

\alba_data\zone\white_z0160u_img.win32.bin

\alba_data\zone\white_z0114u_img.win32.bin

\alba_data\zone\white_z0030u_img.win32.bin

\alba_data\zone\white_z0020u_img.win32.bin

\alba_data\zone\white_z0052u_img.win32.bin

\alba_data\zone\white_z0130u_img.win32.bin

\alba_data\zone\white_z0210u_img.win32.bin

\alba_data\zone\white_z0157u_img.win32.bin

\alba_data\zone\white_z0092u_img.win32.bin

\alba_data\zone\white_z0043u_img.win32.bin

\alba_data\zone\white_z0080u_img.win32.bin

\alba_data\zone\white_z0060u_img.win32.bin

\alba_data\zone\white_z0191u_img.win32.bin

\alba_data\zone\white_z0070u_img.win32.bin

xtool gave crc error on \alba_data\sys\ folder, no matter what options (and t1 unpacking is too slow), that's why i used ztool on this.

storing (movies)

Code:

alba_data\movie\

rest of the files srep+lzma

9.5GB

KaktoR

17-05-2018 16:01

Lightning Returns: Final Fantasy XIII
Only US files (JP ripped)

ztool:max:t100p+srep+lzma

Code:

weiss_data\sys\white_img2a.win32.bin

weiss_data\sys\white_imga.win32.bin

weiss_data\sys\white_scra.win32.bin

weiss_data\zone\white_z0100a_img.win32.bin

weiss_data\zone\white_z0110a_img.win32.bin

xtool gave crc error

storing (movies)

Code:

weiss_data\movie\

rest of the files srep+lzma

7.7GB

darkwolves

17-05-2018 22:38

Quote:

Originally Posted by doofoo24 (Post 471036)

:confused:
there is or is there that is the question ;)

i think it's a question we talked for a bit
when i helped through the srep issue
that they posted

Sergey3695

18-05-2018 07:30

Borderlands The Pre-Sequel (8.01 -> 4.29 Gb) (RUS|ENG)
Binaries
Data_2.bin (16,4 Mb)

Code:

-mexe2+delta+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

Data_Movies.bin (1.08 Gb) (*.bik)

Code:

-mbpk

p.s. deleted tracks

Code:

for %%i in (*.bik) do (

start /WAIT binkmix %%i - %%i  /o /t2 /#

start /WAIT binkmix %%i - %%i  /o /t3 /#

start /WAIT binkmix %%i - %%i  /o /t4 /#

start /WAIT binkmix %%i - %%i  /o /t5 /#

)

pause

Data_1.bin (3.18 Gb) (ALL)

Code:

-muelr+srep:m3f:l1024:c64+lolz:tt16:mtb32:d512m:oh14:fba256:mc1023:dtm1:dto1:dtd1:dtw1

arc.ini (srep {options} -a0/0 -hash-)

Code:

[External compressor:lolz]

header = 0

packcmd = lolz {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:uelr]

header = 0

packcmd   = uelr.exe ulv $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:srep]

header = 0

packcmd   = srep {options} -a0/0 -hash- $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Installation time: ~8 min on HDD 5400.

Sergey3695

19-05-2018 01:38

add Data_ENG.bin (250 Mb) and Data_RUS.bin (164 Mb) for Borderlands: Game of The Year Edition.

darkwolves

19-05-2018 13:52

Guardians Of The Galaxy Telltale Series

Guardians Of The Galaxy Telltale Series
(method) decrypted files and used xtool with only a zlib codec
xprecomp+srep:m5f:a2+lolz:dt1:dtp1:dto1:dtm1:dtw1: dtd1:mtt1:mt4:d64m:tt4
Initial Size 17 gb
Repack Size 7.03 gb

---------note
using the zlib codec alone prevents crc error

doofoo24

20-05-2018 00:58

assassin's creed 1.51gb

afr+srep:m3f:d1g:a2+lolz:d16 from 6.49gb, en only all bk removed because they useless to the game...

oltjon

20-05-2018 01:12

The Walking Dead A New Frontier original size 16.2 Gb repacked size 4.90 Gb
(method) decrypted

-mexe2+delta+lolz
file.dll and file.exe

-xprecomp:zlib+srep:m3f+lolz
Archives folder

unpack time 45 min +-

thanks razor12911, bulat, profrager and Simorq

PsYcHo_RaGE

20-05-2018 20:40

Aragami 6.75 GB > 1.62 GB

Create two data files for this game like i did

in first data file---for .resS and .file files----majority of game
in arc.ini while repacking, using srep64+lolz

Code:

[External compressor:srep64]

header = 0

packcmd   = srep64 {options} -m3f -l512 -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -d256m -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

in second data file--for .resource, .assets, mp4, .dll, .exe etc
in arc.ini while repacking, using srep64+dispack+lolz

Code:

[External compressor:srep64]

header = 0

packcmd   = srep64 {options} -m3f -l512 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -d256m -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

you can also use pzlib+srep+lolz to create a single data file but i didn't used it for some reasons.
Have fun playing.....any suggestions will be appreciated

Sergey3695

24-05-2018 05:03

Borderlands 2 (11.1 -> 5.25 Gb) (ENG only)
Binaries
Data_4.bin (15,4 Mb)

Code:

-mexe2+delta+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

Data_Movies.bin (1.26 Gb) (*.bik)

Code:

-mbpk

p.s. deleted tracks

Code:

for %%i in (*.bik) do (

start /WAIT binkmix %%i - %%i  /o /t2 /#

start /WAIT binkmix %%i - %%i  /o /t3 /#

start /WAIT binkmix %%i - %%i  /o /t4 /#

start /WAIT binkmix %%i - %%i  /o /t5 /#

start /WAIT binkmix %%i - %%i  /o /t6 /#

)

pause

Eng voice + Eng Text
Data_3.bin (792 Mb)

Code:

-msrep:m3f:l1024:c64+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

DLC
Data_2.bin (1.64 Gb)

Code:

-muelr+srep:m3f:l1024:c64+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

Engine
WillowGame
Data_1.bin (1.53 Gb)

Code:

-muelr+srep:m3f:l1024:c64+lolz:tt16:mtb128:d512m:oh14:fba256:mc1023

arc.ini (srep {options} -s35000000000 -a0/0 -hash-)

Code:

[External compressor:lolz]

header = 0

packcmd = lolz {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:uelr]

header = 0

packcmd   = uelr.exe ulv $$arcdatafile$$.tmp $$arcpackedfile$$.tmp



[External compressor:srep]

header = 0

packcmd   = srep {options} srep {options} -s35000000000 -a0/0 -hash- $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Installation time: ~12 min on HDD 5400.

KaktoR

26-05-2018 02:39

Assassin's Creed: Origins
v1.5.1 incl all DLC's (Gold Edition)
1 language

afr:a2+srep+lzma

Code:

*.forge

bpk

Code:

*.bk2

srep+lzma

Code:

rest of the files