Best Compression Methods for 'Specific' Games. Q&A

[Ele]

Battlefield 3 + Eng Only

* Total size: 11.2 GB
* Final size: 7.71 GB

Methods

*.sb, *.cas == xtool (2020) or xtool (v9) / {zlib} + srep + lolz
*.exe, *.dll == srep + delta + nanozip
*.txt, *.rtf == srep + dict + nanozip
remaining == srep + nanozip

Coming Up:

1. Battlefield 4
2. Battlefield Hardline
3. Battlefield 5.

Edit : and Battlefield 1

[Mortal Lord]

Ori and the Will of the Wisps
Version: 3.1

Total start size: 11.86 GB

*.resS, *.assets, *.(no extension)

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=log.log
Creating archive: D:\Arc\Output\Data1.BKR using msc+srep+lolz:d32:mtt1:mt4:mc1023
Memory for compression 0b, decompression 0b, cache 0b
Compressed 1,230 files, 10,739,723,477 => 1,995,714,064 bytes. Ratio 18.58%
Compression time: cpu 443.25 sec/real 19150.46 sec = 2%. Speed 0.56 mB/s
All OK

MSC:
10,739,723,477 bytes -> 10,718,501,946 bytes
SREP:
10,718,501,946 bytes -> 6,709,793,522 bytes
Lolz:
6,709,793,522 bytes -> 1,995,714,064 bytes

Start Time: 3:09:58 PM   12/8/2020
End Time: 8:29:16 PM  12/8/2020

Size: 1.85 GB

Other files

FreeArc 0.67 (March 15 2014) Using additional options: --cache=0 --logfile=log.log
Creating archive: D:\Arc\Output\Data2.BKR using msc+srep
Memory for compression 0b, decompression 0b, cache 0b
Compressed 3,159 files, 2,002,143,271 => 1,814,558,675 bytes. Ratio 90.63% 
Compression time: cpu 11.73 sec/real 433.13 sec = 3%. Speed 4.62 mB/s
All OK

Start Time: 9:13:24 PM   12/8/2020
End Time: 9:20:50 PM  12/8/2020

Size: 1.68 GB

Final Size: 3.54 GB

[KaktoR]

Assassin's Creed Valhalla
v1.04, 1 language

oo2recm(oo7)+srep+LZMA-MT

 19:00:36 - Starting "Data1.bin" Archive Creation.
 00:20:07 - Archive "Data1.bin" Creation Complete.

Input Size: 49.23 GB.
Output Size: 28.01 GB.

[Masquerade]

Anyone knows how long it takes for oodlrec to parse cyberpunk?

It's really damn slow, was wondering if anyone knows how long it's expected to go for.

Update: takes scooter ~4 hrs to get to 4.2%

[parnexcodes]

Cyberpunk 2077 (Based on Codex) English Only

Original Size : 59GB (Excluding 3 GB Bonus Content)
Repack Size : 39.5 GB

Method : oo2reck+srep+xz (LOLZ much better but very slow)

Use oodle7 file from \bin\x64\

Compression time : 18hours
Decompression time : 2hr50m on 4core 8gb ram HDD

[Gehrman]

English Only

Original Size : 59.6GB
Repack Size : 40.1 GB >>>>> 59.6GB> 125GB > 84.5GB > 40.1GB

Method : xtool+srep:m3f:l512:m512+4x4:lzma:a1:mfbt4:32m:fb2 73:mc10000:lc8+diskspan:4.25GB:4.32GB

Use oodle7 file from \bin\x64\

Compression Time : 4Hours
Decompression Time : 70Min on 6Core 16GB Ram |RZ1600

Arc:

[External compressor:xtool]
header    = 0
packcmd   = XTool.exe precomp -mcp2077 -c128mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = XTool.exe decode -t100p - - <stdin> <stdout>

[Masquerade]

Spent ages patching videos out of Cyberpunk 2077 just for bpk to do that endless extraction thing.

What a waste of time

Managed to get it to 36.9GB by patched out videos but since bpk does that thing you can only use srep leading to a 37.5GB repack (xtool + srep + lolz).

For the audio packs, xtool+srep+lzma2 (lolz is not worth it)

I am going to post my data sheet, here's all the videos with their decimal locations from the game ranging from largest size to smallest size (40mb) - all smaller ones were ignored.

basegame_5_video.archive

938983424 - 1683451019 - 00000000000001ea.kb2

3865538560 - 4011937979 - 000000000000012f.kb2

2924453888 - 3061543279 - 0000000000000176.kb2

6979723264 - 7100791887 - 000000000000014c.kb2

7572389888 - 7688552327 - 000000000000013a.kb2

7688552448 - 7804532159 - 00000000000000dd.kb2

3727880192 - 3843607171 - 000000000000001a.kb2

7390752768 - 7504962763 - 000000000000009a.kb2

4080529408 - 4190263323 - 00000000000001f5.kb2

3061547008 - 3157061311 - 0000000000000025.kb2

6622117888 - 6717121191 - 000000000000012c.kb2

6840016896 - 6918851327 - 000000000000005e.kb2

4536360960 - 4627345415 - 0000000000000153.kb2

7869325312 - 7959684047 - 000000000000009c.kb2

8103661568 - 8193355355 - 0000000000000001.kb2

8013971456 - 8103657939 - 0000000000000220.kb2

3157061632 - 3243022439 - 00000000000000ea.kb2

4990582784 - 5068423239 - 000000000000008a.kb2

332349440 - 406449271 - 00000000000000a5.kb2

1815740416 - 1889706651 - 00000000000000e3.kb2

7317245952 - 7390749839 - 00000000000001f6.kb2

261668864 - 332348067 - 00000000000001c8.kb2

3477536768 - 3546653107 - 0000000000000035.kb2

4190265344 - 4259151603 - 0000000000000187.kb2

4011941888 - 4080526847 - 0000000000000006.kb2

7504965632 - 7572386623 - 00000000000000a4.kb2

3410862080 - 3477533547 - 00000000000000e0.kb2

4439044096 - 4505519859 - 000000000000008c.kb2

6717124608 - 6783207623 - 000000000000021f.kb2

6167703552 - 6232610759 - 000000000000019f.kb2

7804534784 - 7869321931 - 000000000000017a.kb2

5819109376 - 5881040687 - 000000000000004f.kb2

58392576 - 119832895 - 00000000000000ec.kb2

7256686592 - 7317243491 - 00000000000001c4.kb2

4685377536 - 4745411375 - 0000000000000017.kb2

3600072704 - 3659929931 - 00000000000000b3.kb2

6397444096 - 6456784187 - 0000000000000119.kb2

4096 - 58388843 - 0000000000000169.kb2

4627349504 - 4685375843 - 00000000000001c0.kb2

1901895680 - 1959742587 - 00000000000000f1.kb2

1697021952 - 1754661895 - 00000000000001d3.kb2

3354673152 - 3410859227 - 00000000000001b4.kb2

4868861952 - 4924448247 - 00000000000000db.kb2

7959687168 - 8013970607 - 000000000000013f.kb2

5758160896 - 5812178115 - 00000000000000f8.kb2

3546656768 - 3600069203 - 00000000000001f7.kb2

820768768 - 874167455 - 0000000000000022.kb2

5707190272 - 5758158895 - 0000000000000020.kb2

4259151872 - 4309797919 - 0000000000000095.kb2

6571778048 - 6622114639 - 00000000000001af.kb2

6500806656 - 6551024559 - 00000000000000b2.kb2

4333166592 - 4382905099 - 0000000000000067.kb2

5314310144 - 5363969939 - 0000000000000105.kb2

3281571840 - 3330435919 - 0000000000000051.kb2

8464351232 - 8510832983 - 000000000000020a.kb2

5183967232 - 5229091915 - 00000000000001d5.kb2

406450176 - 450814239 - 0000000000000192.kb2

6456786944 - 6500805147 - 0000000000000130.kb2

8744194048 - 8788206363 - 000000000000007a.kb2

5271851008 - 5314310055 - 00000000000000e6.kb2

[mausschieber]

Originally Posted by Gehrman

English Only

Original Size : 59.6GB
Repack Size : 40.1 GB >>>>> 59.6GB> 125GB > 84.5GB > 40.1GB

Method : xtool+srep:m3f:l512:m512+4x4:lzma:a1:mfbt4:32m:fb2 73:mc10000:lc8+diskspan:4.25GB:4.32GB

Use oodle7 file from \bin\x64\

Compression Time : 4Hours
Decompression Time : 70Min on 6Core 16GB Ram |RZ1600

Arc:

[External compressor:xtool]
header    = 0
packcmd   = XTool.exe precomp -mcp2077 -c128mb -t100p --dbase - - <stdin> <stdout>
unpackcmd = XTool.exe decode -t100p - - <stdin> <stdout>

is this a typo

:4.25GB:4.32GB

[Cesar82]

Originally Posted by mausschieber

is this a typo

:4.25GB:4.32GB

It is the definition of the size of the slices of the diskspan of 4.25GB for the first disc and 4.32GB for the other discs (Configuration for DVD5 media).
P.S: If you use DiskSpan_GUI this is done automatically (value in bytes) based on the options on the CONFIG page of DiskSpan_GUI and selected tab of media type when making the compression.
Then the method adapted for DiskSpan_GUI can be used in this way:

xtool_cp2077+srep_new:m3f:l512:m512+4x4:lzma:a1:mfbt4:32m:fb273:mc10000:lc8

P.S: The chunk size on DiskSpan_GUI is set to "-c32mb", but if you want, just edit the "DiskSpan_x64.ini" file in the "Resources" folder on DiskSpan_GUI and change to "-c128mb" in section to "xtool_cp2077" method so that the method is exactly the same as the method informed by the user (I don't know if you will a lot of difference thid change)

[KaktoR]

@Masquerade

0000000000000017.kb2

Compressed 1 file, 60,033,840 => 50,479,677 bytes. Ratio 84.09%
Compression time: cpu 0.02 sec/real 4.31 sec = 0%. Speed 13.93 mB/s
All OK

Extracted 1 file, 50,479,677 => 60,033,840 bytes. Ratio 84.09%
Extraction time: cpu 0.05 sec/real 4.75 sec = 1%. Speed 12.64 mB/s
All OK

Edit: After extracting all files from the archive and test binkpack again on all at once, you get some error warnings like "MotionData_warn". So I guess you have to separate all the "faulty" files (I guess they contain alpha channel or something). Hopefully someday profrager will update this tool and add at least a switch for this kind of files to skip them...

[Masquerade]

@kaktor I get no such "motion data warn" on the files I've patched.

And the file you tried works also for me, but on the credits video, example:

00000000000001ea.kb2

It's stuck

[KaktoR]

Yeah then it's something like a bug inside bpk or something. I compared two videos from this (0000000000000017.kb2 + 00000000000001ea.kb2) with RADTools but they seem to be identical (except for the duration and w/h ofcourse).

I'm corious: Did you test it with the exe file from binkpack?

[Masquerade]

Originally Posted by KaktoR

I'm corious: Did you test it with the exe file from binkpack?

I haven't used bink_pack.exe since many months ago since it would always fail to pack the files properly. I could try again now.

[Snapppr6]

Originally Posted by Masquerade

I haven't used bink_pack.exe since many months ago since it would always fail to pack the files properly. I could try again now.

can iget .exe version of binkpack and binkunpack.exe and thx your repack site look amzing

[78372]

1. Audio files (x64\audio\*) 16.6Gb>15.6GB : lzt:49
2. Other rpf files except x64d.rpf 42GB> 16.2GB : xtool:mzlib+preflate:c256mb+srep:m2f:l1024+4x4:lzm a:64mb:normal:bt4:273:mc1000:lc8
3. x64d.rpf 1.68GB>1.31GB : bpk
4. Everything else 100MB>70.1MB : -mx

Total: 60.4GB > 33.3GB