Best Compression Methods for 'Specific' Games. Q&A

[Andu21]

Originally Posted by darkwolves

using to pack back up unreal engine 4 files after extractng

u4pak

[bunti_o4u]

Originally Posted by KaktoR

lz4

PS: According to this https://fileforums.com/showpost.php?...20&postcount=9 there is only a small difference (xtool did inflate the files up to ~160% or so If I remember right).

the reference post used only srep and lolz for compression.. no lz4

Originally Posted by Danziel123

Thank you Mausschieber for working my request.
Compress using srep & lolz get 6x dvd5

Test install & play work perfect

I am using below settings in arc.ini. can you check whether setting are correct?

[External compressor:xlz4]
header = 0
packcmd = xtool erecomp:c128m,t8:lz4 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = xtool drecomp:t100p - - <stdin> <stdout>

if these setting are correct, still files are not getting inflate..

[KaktoR]

^ Read my post more carefully.

I used lz4 for precompression. And I said that the difference is not that big (~500mb) and that ratio for xtool was about ~160%.

[bunti_o4u]

Originally Posted by KaktoR

^ Read my post more carefully.

I used lz4 for precompression. And I said that the difference is not that big (~500mb) and that ratio for xtool was about ~160%.

My only concern is that I am using lz4 for precompression but the ratio is 100% not 160% as you mentioned. So I am wondering what's going wrong?

And I asked the same thing in my earlier post...

[Andu21]

Originally Posted by bunti_o4u

My only concern is that I am using lz4 for precompression but the ratio is 100% not 160% as you mentioned. So I am wondering what's going wrong?

Check if liblz4.dll is present and loaded by xtool. If not, put the one with the correct architecture.

[Snake288]

A little observation on the last XTool(v011) (Far Cry New Dawn)
Code:
[Dunia2]
BaseDir=pack\data_final\pc
File1=common.dat
File2=patch.dat
File3=patchshadersobj.dat
File4=shadersobj.dat
File5=worlds\fcbworlds.dat
File6=worlds\installpkg.dat
Code:
-m=xtool:c16mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 19,956,114,780 bytes. Ratio 102.04%

-m=xtool:c32mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,674,136 bytes. Ratio 143.72%

-m=xtool:c64mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,669,872 bytes. Ratio 143.72%

-m=xtool:c128mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,960 bytes. Ratio 143.72%

-m=xtool:c512mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,088 bytes. Ratio 143.72%

[bunti_o4u]

Originally Posted by Snake288

A little observation on the last XTool(v011) (Far Cry New Dawn)
Code:
[Dunia2]
BaseDir=pack\data_final\pc
File1=common.dat
File2=patch.dat
File3=patchshadersobj.dat
File4=shadersobj.dat
File5=worlds\fcbworlds.dat
File6=worlds\installpkg.dat
Code:
-m=xtool:c16mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 19,956,114,780 bytes. Ratio 102.04%

-m=xtool:c32mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,674,136 bytes. Ratio 143.72%

-m=xtool:c64mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,669,872 bytes. Ratio 143.72%

-m=xtool:c128mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,960 bytes. Ratio 143.72%

-m=xtool:c512mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,088 bytes. Ratio 143.72%

Did everything but files are not getting inflated...

I am uploading the compressor I am using. If you can point the mistake I am doing it would be helpful..

https://fileforums.com/showpost.php?...23&postcount=1

[panker1992]

Sekiro Shadows Die Twice:

Break Game into 3 Section:
Section 1:
Videos: BPK
openingmovie.bk2 copy this file one more time and rename it to "openingmovie_hi.bk2"
stafflistmovie.bk2 use my BINK encoder to encode the first 6~7 Megabytes
This will result into popping the First 2 3 seconds in the end with Sekiro Display
End file = 221.mb

Section 2:
Audio and Executables use this:
7Zip_Shelwien Bat

You end up with 564MB file.

Section 3:
Game files:
arc\Arc a -ma9 -ds -lc4096 -ld4096 -di -i1 -ep1 -ed -r -w.\ Setup-3.xarc ^
-mpoodle+srep:m3f:a2:l256+lolzi:d128m:mt2:ldmf1:ldc 0:mc1023:mtb64:x0 "D:\Games\Sekiro Shadows Die Twice\3\*"

End File=7.95GB

Total: 8.72 GB

You can do a bit more if you absolutely MUST

Use Bink2 encoder, to lower 720p the videos,
Use higher and single thread lolz to squeeze a few more MB
Enjoy

Tools are here: https://fileforums.com/showthread.php?t=102689

[exorc]

Originally Posted by panker1992

Sekiro Shadows Die Twice:

Break Game into 3 Section:
Section 1:
Videos: BPK
openingmovie.bk2 copy this file one more time and rename it to "openingmovie_hi.bk2"
stafflistmovie.bk2 use my BINK encoder to encode the first 6~7 Megabytes
This will result into popping the First 2 3 seconds in the end with Sekiro Display
End file = 221.mb

Section 2:
Audio and Executables use this:
7Zip_Shelwien Bat

You end up with 564MB file.

Section 3:
Game files:
arc\Arc a -ma9 -ds -lc4096 -ld4096 -di -i1 -ep1 -ed -r -w.\ Setup-3.xarc ^
-mpoodle+srep:m3f:a2:l256+lolzi:d128m:mt2:ldmf1:ldc 0:mc1023:mtb64:x0 "D:\Games\Sekiro Shadows Die Twice\3\*"

End File=7.95GB

Total: 8.72 GB

You can do a bit more if you absolutely MUST

Use Bink2 encoder, to lower 720p the videos,
Use higher and single thread lolz to squeeze a few more MB
Enjoy

Tools are here: https://fileforums.com/showthread.php?t=102689

How to use with Ultraarc?

[darkwolves]

Xtool update 12 required contains oodle streams
removed non english files
size before removal 64.2 gb

size after removal and packing 48.6 gb

method

xoodle+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt1 :mt6:d200m:tt10

[yasitha]

I Need HELP!

I want to Repack Call of Duty Balck Ops 3
I try finding Precompressor. But i didn't find anything.

Can anyone help me?

[ShivShubh]

Originally Posted by yasitha

I Need HELP!

I want to Repack Call of Duty Balck Ops 3
I try finding Precompressor. But i didn't find anything.

Can anyone help me?

Majority of the files are packed using lz4hc for which no public precompressors exist.

[yasitha]

Originally Posted by ShivShubh

Majority of the files are packed using lz4hc for which no public precompressors exist.

so there's no way to Precompressor that game?

[panker1992]

Yasitha, lz4HC only works this way, find a way to unpack game files manually by searching the net for tools, find what method was used to actually compress the game
lz4hc -12 -B7 or lz4hc -11 -B7

then pack the game with that same method and run a xdelta to check for differences

enjoy

[KaktoR]

Some test for AC Liberation Remastered
(use afr without -a2)

DataPC_ACV_Chichen_Itza.forge
301.596.672 Bytes

afr+srep:m3f+

lolz:dtb1:mtt1:mt6:d128m:mc1023
Compressed 1 file, 301,596,672 => 24,798,849 bytes. Ratio 8.22%
Compression time: cpu 0.89 sec/real 245.85 sec = 0%. Speed 1.23 mB/s
All OK

4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
Compressed 1 file, 301,596,672 => 27,686,068 bytes. Ratio 9.18%
Compression time: cpu 0.73 sec/real 55.38 sec = 1%. Speed 5.45 mB/s
All OK

lzma:a1:mfbt4:d256m:fb273:mc1000000000:lc8
Compressed 1 file, 301,596,672 => 27,596,500 bytes. Ratio 9.15%
Compression time: cpu 0.36 sec/real 50.47 sec = 1%. Speed 5.98 mB/s
All OK

zstd -22 --ultra -T2
Compressed 1 file, 301,596,672 => 31,890,007 bytes. Ratio 10.57%
Compression time: cpu 0.33 sec/real 91.99 sec = 0%. Speed 3.28 mB/s
All OK

Edit:

ACIII:R+L:R

Compressed block count (subblocks) = 353022 (2186139)
LZO1X-W3(15) subblocks count       = 1480503
LZO1X-999 subblocks count          = 0
LZO2A-999 subblocks count          = 0
LZO1C-999 subblocks count          = 0
OODLE subblocks count              = 0
ZSTD  subblocks count              = 0
Uncompressed subblocks count       = 705636

Compressed subblocks size:   19522484316 -> 44694970389
Uncompressed subblocks size: 17468349094
Other data size:             315047570

Total data+table:            37314625536 -> 62498687973

WARNING! In file found corrupted LZO-streams. Check your data!

Time: 2967.089 secs

Edit:

17:42:22 - Starting Data1.bin.001 creation
23:41:59 - Finished Data1.bin.001 creation
23:42:00 - Starting Data2.bin.001 creation
 0:50:03 - Finished Data2.bin.001 creation
 Input size:  39.510g
 Output size: 13.537g