Best Compression Methods for 'Specific' Games. Q&A

[:( Sad8669]

Method : SREP+LZMA
Based On : Free Weekend Version.
Decompression Time : 1.3 hours (4T)
Initial Size : 83.6 GB
Final Size : 54.1 GB

[dixen]

Borderlands 3. Director's Cut (Only English Voice)

*.pak - ue4d plugin by Shegorat + XTool v0.39 + Srep + LOLZ
100 gb > 210 gb > 130 gb > 64.8 gb

Rest files - SREP+LZMA
700 mb > 531 mb

RePack size - 65.3 gb
Install time - 29 min. on Ryzen 5 3600, HDD>HDD (19 min. without DLC content)

Note.
Non-English audio cutting from DLC *.pak and rebuilded with QuickBMS


Thanks to Shegorat for unreal engine 4 decrypt FreeArc-Plugin, Razor12911 for XTool and ProFrager for LOLZ Compressor)))

[Hexagon123]

Originally Posted by :( Sad8669

Method : SREP+LZMA
Compression Time : x
Decompression Time : 1.3 hours (4T)
Initial Size : 83.6 GB
Final Size : 54.1 GB

Should've used XTool for that?

[:( Sad8669]

Originally Posted by Hexagon123

Should've used XTool for that?

I am still testing the XTool method, because you see there is a plugin for WDL but i had no luck recently with that. Since it uses the lz4 plugin, i used various .dll just in case i hit something.

The liblz4.dll ( 136 ) KB was the one the was giving the best results of them all.

But when i precompressed the game it was somthing like 89,344,643,34 > 93,456,234,56.

Ofcourse the values other than first two digits are just predicted as i am writing the message but you can say 89 > 93.

Thanks for your concern though.

Edit : Check post : https://fileforums.com/showpost.php?...5&postcount=96

[KaktoR]

Originally Posted by :( Sad8669

I am still testing the XTool method, because you see there is a plugin for WDL but i had no luck recently with that. Since it uses the lz4 plugin, i used various .dll just in case i hit something.

The liblz4.dll ( 136 ) KB was the one the was giving the best results of them all.

But when i precompressed the game it was somthing like 89,344,643,34 > 93,456,234,56.

Ofcourse the values other than first two digits are just predicted as i am writing the message but you can say 89 > 93.

Thanks for your concern though.

Edit : Check post : https://fileforums.com/showpost.php?...5&postcount=96

Seems to me like a good known bug for most of the plugins from xtool.

[:( Sad8669]

Originally Posted by KaktoR

Seems to me like a good known bug for most of the plugins from xtool.

Yeah, the same thing happens with Hitman 3 (Only individual files can be precompressed properly).
And FIFA 20 (XTool would use no CPU on files greater than 1.5 GB or some times 2.0 GB)

These are the ones i tested so far along with WDL.

Edit : Unravel Two post has been updated.

[KaktoR]

Originally Posted by :( Sad8669

Yeah, the same thing happens with Hitman 3 (Only individual files can be precompressed properly).
And FIFA 20 (XTool would use no CPU on files greater than 1.5 GB or some times 2.0 GB)

These are the ones i tested so far along with WDL.

Edit : Unravel Two post has been updated.

Bethesda plugin the same

[Masquerade]

xreflate+srep+lolz

Beware on using high chunk sizes due to huge streams being decompressed in XTool.

Reflate used since it gives best ratio.

6.6GB ----> 3.8GB

[L33THAK0R]

Originally Posted by dixen

XCOM 2 + War of the Chosen (RUS+ENG) [GOG] Re-Repack

*.upk + *.tfc (without _XPACK_) - uelr+xtool+oo2reck+srep+lolz
44 > 80 > 23 > 9.4 gb

*.tfc (_XPACK_) - oo2reck+srep+lolz
9 > 17 > 14 > 6.8 gb

*.bik + *.bk2 (not all files) - bpk+srep
9 > 8 gb

*.wem + *.bnk - srep+pmt(razor)
6 > 3.3 gb

Rest files - srep+lolz
600 mb > 70 mb

Repack size - 27.8 gb (without Long War 2 mod)
Game Size - 70 gb

Install time - 35 min.

sorry if these are a silly couple of questions but with xtool what codecs did you use? The "Game File Scanner" tool shows zlib and lzo strems but I'm not sure if there are others. Also what's pmt? Never used the razor tools before sorry if thats got an obvious answer.

[Masquerade]

L33THAK0R
uelr processes the lzo streams, xtool will process the zlib streams.

PMT = parallel multithreaded tool

RZ is a single threaded compressor, so PMT splits the data input into chunks and compresses those chunks in parallel to essentially harness multithreaded operations and speed up encoding / decoding.

[dixen]

Originally Posted by L33THAK0R

what codecs did you use?

XTool v0.12 + Zlib Codec

[L33THAK0R]

Originally Posted by Masquerade

L33THAK0R
uelr processes the lzo streams, xtool will process the zlib streams.

PMT = parallel multithreaded tool

RZ is a single threaded compressor, so PMT splits the data input into chunks and compresses those chunks in parallel to essentially harness multithreaded operations and speed up encoding / decoding.

Ah, thanks for clearing that up with UELR, I got distracted to properly figure out what it does and wasn't sure if it handles LZO streams or did something like unpack UE3 archives. Thank you for explaining what PMT does, saved me a lot of time! It's fascinating how people are able to come up with these solutions honestly.

[Masquerade]

English Only.

uelr+srep+lolz

*.bik, *.pck (videos / sound paks)

srep+LZMA2

11.5GB ----> 4.3GB

With all other languages:

13.2GB ----> 5.9GB

[L33THAK0R]

Hi all,

Could anyone share how to structure the compressor header for the Oodle precompressors? The only one I could find was from diskspan:

[External compressor:oo2reck3,oo2reck4,oo2reck5,oo2reck6,oo2reck7,oo2reck8]
header    = 0
unpackcmd = "Resources\OodleRec\oo2reck.exe" d $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:oo2recm3,oo2recm4,oo2recm5,oo2recm6,oo2recm7,oo2recm8]
header    = 0
unpackcmd = "Resources\OodleRec\oo2recm.exe" d $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:oo2recs3,oo2recs4,oo2recs5,oo2recs6,oo2recs7,oo2recs8]
header    = 0
unpackcmd = "Resources\OodleRec\oo2recs.exe" d $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

However I'm fairly sure you're meant to reference which .ddl for the application to use but I'm not sure how to go about this. As a side question that's not as appropriate for this thread, if anyone could tell me the correct syntax for the header for use with ASIS, I'd greatly appreciate it.

[Masquerade]

You can use the {compressor} constant (freearc constant, not inno constant) to fit multiple tools with the same packcmd into one command:

[External compressor:oodlereck, oodlrecm, oodlerecs] 
header = 0
packcmd = {compressor} e <stdin> <stdout>
unpackcmd = {compressor} d <stdin> <stdout>

Precompress the game using the Oodle core dll that the game comes with. Only some games require a different core to the one that ships (like Sekiro). Same dll used for precomp is also needed for decomp.