How can I compress much smaller than LZMA, that I want repack games?

[Unjk223]

Hello, everybody. I have problem with repack games.

Explanation:
I want to compress smaller than 7z, zip, rar, because I want to make same repack size smaller than others, let's say that I want compress Hedon.ipk3 original file to my repack file (.bin).

Here are about insignificant details: Percent is ratio.
Original before compress: 595 136 KB (100%)
LZMA: 560 360 KB (94%)
Zstandard: 555 498 KB (93%)
Brotli: 555 365 KB (93%)
LZ4: 562 922 KB (95%)
LZ5: 564 075 KB (95%)
Lizard, FastLZ4: 563 373 KB (95%)
Lizard, LlZv1: 560 592 KB (94%)
Lizard, FastLZ4 + Huffman: 562 747 KB (95%)
Lizard, LlZv1 + Huffman: 560 040 KB (94%)
My repack choice (command: precompmt+reflate+xpzlib+xcrilayla+lolz, including oodle7 (Selkie) using Knight Compressor v1.0): 530 846 KB (89%)
Xtool FitGirl Repack: 492 634 KB (all files except DirectX) (82%)

NOTE: Solid on, Thread 1, Word Size 273 of 7Z 21.07 and 7Z 21.03 ZS Standard

I tried everything, but it did not work, however I tried using Knight Compressor v1.0, using command of precompmt+reflate+xpzlib+xcrilayla+lolz (including oodlev7, s), but it did well :/ : 530 846 KB.
However, I want to make my repack smaller as/than FitGirl.
Is there any I can make smaller my repack than LZMA?

Thanks,
Unjk223

[KaktoR]

Your chain doesn't make any sense.

I recommmend you find out first what compression is used in input file.

[:( Sad8669]

Using alot of mixed compressors and precompressors won't help achieve a better result, it just gets worse.

[Unjk223]

Oh.... okay, that is weird. How can I avoid worst? I think most repackers using Xtool only, not the Knight Compressor any like that, I looked FitGirl temp files of Hedon Bloodrite.

[KaktoR]

XTool is a precompressor. Simply said, it unpacks files to get better compression with lzma or lolz afterwards. srep between them removes duplicates from the inputs.

[:( Sad8669]

Use xt_zlib+reflate and rip the bonus soundtrack.
I will post the results after 15 minutes.

Hedon.ipk3 | (541 MB) -> (1.98 GB) |

[Unjk223]

Originally Posted by :( Sad8669

Use xt_zlib+reflate and rip the bonus soundtrack.
I will post the results after 15 minutes.

Okay, during your 15 minutes, I just looked up, that FitGirl explained everything about her repack on Reddit: https://reddit.com/r/CrackWatch/comm...anion/gyhkgp5/

Some games FitGirl don't use Xtool like Home Behind 2, which does not say repack tool library by Xtool... like Unity, others game engine will be Xtool.

Regards
- Unjk223

[Unjk223]

Originally Posted by :( Sad8669

Use xt_zlib+reflate and rip the bonus soundtrack.
I will post the results after 15 minutes.

Hedon.ipk3 | (541 MB) -> (1.98 GB) |

366% ratio? I made math calculation to measure your ratio compressed:

1980 MB / 541 MB * 100 = 365,9889094269871

I think compressed file is bigger (1.98 GB) than original file (541 MB)

- Unjk223

[KaktoR]

Originally Posted by Unjk223

I wanna make sure what version are you using of Xtool, so I will compress next time? Example Xtool v0.9.

The newest
https://fileforums.com/showthread.php?t=102832

Originally Posted by Unjk223

366% ratio? I made math calculation to measure your ratio compressed:

1980 MB / 541 MB * 100 = 365,9889094269871

I think compressed file is bigger (1.98 GB) than original file (541 MB)

- Unjk223

Game devs compressed this file with zlib/reflate. Like I said, xtool is a precompressor; it unpacks inputs to compress them better afterwards. Even FitGirl explained it in the link from reddit you posted. This is the main behavior of xtool.

[Unjk223]

Originally Posted by KaktoR

The newest
https://fileforums.com/showthread.php?t=102832



Game devs compressed this file with zlib/reflate. Like I said, xtool is a precompressor; it unpacks inputs to compress them better afterwards. Even FitGirl explained it in the link from reddit you posted. This is the main behavior of xtool.

Okay, but I definetely confused. I haven't read yet, so I have to must read FitGirl instructions on Reddit about 2-3 times to understand.

- Unjk223

[KaktoR]

Input: Hedon.ipk3 (568.033.789 Bytes)

Method: xtool:zlib+xtool:reflate+srep:m3f+lzma

Compressed 1 file, 568,033,789 => 529,491,980 bytes. Ratio 93.21%
Compression time: cpu 2.13 sec/real 376.67 sec = 1%. Speed 1.51 mB/s
All OK

You probably will get slightly better output with lolz instead of lzma, but it is much more time and cpu resources consuming. Keep that in mind.

If you want you can compress the soundtrack mp3's with srep+mpz

Edit:
Input: Soundtrack mp3's (unpacked zip file)
Method: mpz

Compressed 39 files, 469,898,266 => 369,460,114 bytes. Ratio 78.63%
Compression time: cpu 0.39 sec/real 64.55 sec = 1%. Speed 7.28 mB/s
All OK

[Unjk223]

Originally Posted by KaktoR

Input: Hedon.ipk3 (568.033.789 Bytes)

Method: xtool:zlib+xtool:reflate+srep:m3f+lzma

Compressed 1 file, 568,033,789 => 529,491,980 bytes. Ratio 93.21%
Compression time: cpu 2.13 sec/real 376.67 sec = 1%. Speed 1.51 mB/s
All OK

You probably will get slightly better output with lolz instead of lzma, but it is much more time and cpu resources consuming. Keep that in mind.

If you want you can compress the soundtrack mp3's with srep+mpz

Thanks for information, but I'm gonna test compress only one file of Hedon.ipk3 with my command method: precompmt+reflate+xpzlib+srep:m5f:a64+lolz with Knight Compressor v1.0.

About MP3 soundtracks, this is easy .

I wanna make sure what version are you using of Xtool, so I will compress next time? Example Xtool v0.9.

I make sure post my result, it will take about 0.5-1 hour.

[:( Sad8669]

Games come with compression like zlib,oodle etc, xtool expands the streams and srep removes the duplicates, then comes the lolz which finishes things up.

Ofcourse FG explained it more, it doesn't matter if someones explains it, if you spend enough time here and make enough mistakes, you will get it.

PS:- It's gonna take time, 15 minutes was a wrong call.

[kj911]

Unjk223: Trying testing to switches:

xZlib+msc+srep:m3f:a0+lolz
xtool:zlib+xtool:reflate+msc+srep:m3f:a0+lolz

or replace msc to mpz. and add delta before srep. Use lolz 128/256mb dictionary and fba4096, lc1023 and many switches.

[Unjk223]

Originally Posted by kj911

Unjk223: Trying testing to switches:

xZlib+msc+srep:m3f:a0+lolz
xtool:zlib+xtool:reflate+msc+srep:m3f:a0+lolz

or replace msc to mpz. and add delta before srep. Use lolz 128/256mb dictionary and fba4096, lc1023 and many switches.

I make sure switches compressions possible until I get same repack size of FitGirl repack.