Precomp+Reflate+Srep+LZMA

[Rahmani1811]

can we use precomp+Reflate with Installer Creator

[gozarck]

Reflate is the old method. RamiroCruzo method its better. Its the new method. Raw precomp srep lzma. Use precomp in brute mode (take long time) and ppx2 use only one core (P 1) because temp files *.dat of precomp have a conflict.

[chum]

Gozarck, i tried your reflate v2 into GTA 5 file, but it give me bad results, a 2gb original game file is inflated to 35gb with reflate v2 then i dont get good result compressing it.

I see many guys saying they compressed GTA 5 from 60gb to 30gb~ with reflate, but i think they using a different version?

[1234567890123]

but brute mode is too slow (more than a minute even for filesizes around 10 KB) i waited 1.5gb raw precomp srep lzma compression 2 hours but it wasn't finished .sometimes after reflate there are too many raw files so compression time is big.

[pakrat2k2]

then edit arc.ini & change it

[gozarck]

yes brute mode is really slow, and a hate precomp for this and other things too, but the result of the final compression size is very small. i dont have all the answers for specific games, but if each one of you bother to compress a game and post the results with raw + precomp we would help among all together.
------------------------

BY RamiroCruzo IDEA
raw+precomp+arc example

[RamiroCruzo]

Originally Posted by chum

Gozarck, i tried your reflate v2 into GTA 5 file, but it give me bad results, a 2gb original game file is inflated to 35gb with reflate v2 then i dont get good result compressing it.

I see many guys saying they compressed GTA 5 from 60gb to 30gb~ with reflate, but i think they using a different version?

Amigos don't blame anyone You must know if you use strong inflating methods....Must must use even stronger compression method afterwards...

Originally Posted by 1234567890123

but brute mode is too slow (more than a minute even for filesizes around 10 KB) i waited 1.5gb raw precomp srep lzma compression 2 hours but it wasn't finished .sometimes after reflate there are too many raw files so compression time is big.

Good results come to those who wait amigo........

[chum]

I blaming no one, just asking for some advice. I tested the same gta file 900mb with Gozarck V1 and V2.

V1 inflated the file to 2gb then compressed to 500mb.

V2 inflated the file to 3gb then compressed to 770mb.

V1 and V2 have different settings for reflate. I just wanted to get V1 with Reflate only without compressing like Reflate only V2.

[1234567890123]

both of them (V1 and V2) is same.v2 is using more core,cpu.i think you used different levels V1=level 6 but in V2 you can change reflate level.I'm using reflate only and ultraarc (srep+delta+lzma) for better result.

[GBT repack]

I encountered a difficult problem, with the "precomp_reflate_srep_lzma" compressed file in the user's computer in the execution of decompression, but the decompression out of the game file...

[ShadowEagle]

Originally Posted by gozarck

yes brute mode is really slow, and a hate precomp for this and other things too, but the result of the final compression size is very small. i dont have all the answers for specific games, but if each one of you bother to compress a game and post the results with raw + precomp we would help among all together.
------------------------

BY RamiroCruzo IDEA
raw+precomp+arc example

Nice bat files

So, how to integrate that into an inno script? Your C.bat is creating *.pcf
and a .str file/s. After that the bat compresses to final archive using srep+lzma. Possible to use UltraARC for the final archive compressing?

[GBT repack]

Originally Posted by gozarck

Reflate Method of Compression

Hello everyones
:POST
--------------------------------------------------------------------------


This is an example to compress games and install via command line.

--------------------------------------------------------------------------

precomp+reflate+srep+lzma
or
reflate+srep+lzma

--------------------------------------------------------------------------


Reflate (By Shelwein) modify to integrate precomp+srep+lzma (by gozarck)

Reflate = (raw2hif.exe + rawdet.exe +rawres.exe):

Reflate, is not a compiled program, but is a
compression method by using the command line in combination
with three programs (raw2hif.exe + rawdet.exe +rawres.exe) .

Acts like precomp, inflating preparing them to compress files with Srep + lzma

but if you want more compression you must use this form precomp+reflate+Srep+LZMA

Precomp inflate the files then reflate makes more bigger, the SREP will compress improve some bytes and LZMA finish the job.

--------------------------------------------------------------------------


all you need to pack games with this methods.

Download => Attachment 9501


--------------------------------------------------------------------------


PD:

seen in some post eh this compression method

arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r   -msrep+delta+lzma:a1:mfbt4:d200m:fb128:mc10000:lc8

and prompt some users say
ERROR: can't allocate memory required for (de)compression

and the compression stop

the problem is this part of command "d200m"

this option is the dictionary size, so if you use
"d200m" you need 2100MB of ram

How to know?, is simple.
multiply 200*10.5 = 2100mb of ram
if you don´t have enough memory change "d64m"
multiply 64*10.5 = 672mb of ram

but you can limit the use of ram to compression in this seccion of command:

arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r

change to

arc.exe a -ep1 -dses --dirs -s; -lc512 -di -i2 -r

or any number you need

-lc (limit ram to compresion)

-ld (limit ram to decompression)

arc.exe a -ep1 -dses --dirs -s; -lc512 -ld512 -di -i2 -r

--------------------------------------------------------------------------

:ENDPOST
--------------------------------------------------------------------------

.

====================

My English is poor.Please don't laugh at me.


Ask GOZARCK for a simple version of the "precomp_reflate_srep_lzma".
Every step can be intuitive, can make the rookie clearly understand.
I admit that this is a very good compression tool, with a breakthrough good tool!!
But I was extracting the time, an error, extracting the file out of thin air... I do not know where there is trouble, I was using Notepad to edit.
Thanks to the members of the forum, you have a better world!
Again, thanks to GOZARCK!

[GBT repack]

if not ShowChangeDiskWindow ('请找到分卷data0.bin，等待初始化并继续安装...', ExpandConstant('{src}'),'data0.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data0.bin'), ExpandConstant('{app}'), '', false, '', '', ExpandConstant('{app}'), notPCFonFLY {PCFonFLY}) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\dlc_win64\ripper\game0.arc.d at'), ExpandConstant('{app}\dlc_win64\ripper\'), true) then break;


if not ShowChangeDiskWindow ('请插入下一个分卷data1.bin，等待初始化并继续安装...', ExpandConstant('{src}'),'data1.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data1.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game10.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game11.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game12.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game14.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game15.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game16.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game17.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game18.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game19.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game20.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game21.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game22.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game23.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game24.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game25.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game26.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game27.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game28.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game29.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game30.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game31.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game32.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game33.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game34.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game35.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game36.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game38.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ShowChangeDiskWindow ('请插入下一个分卷data2.bin，等待初始化并继续安装...', ExpandConstant('{src}'),'data2.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data2.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;
//run bat: Compression it with "precomp_reflate_srep_lzma"
if not ISExec ( 0, 0, 0, ExpandConstant('{app}\archives_win64\data2\Reflate Unpack.bat'), ExpandConstant(''), ExpandConstant('{app}\archives_win64\data2\'), '...',true) then break;
//DELTREE——Delete all files and folders
//DelTree(ExpandConstant('{app}\archives_win64\data2 '), True, True, True);
//DeleteFile(ExpandConstant('{app}\data_01.bin')); //test

if not ShowChangeDiskWindow ('请插入下一个分卷data3.bin，等待初始化并继续安装...', ExpandConstant('{src}'),'data3.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data3.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;
//run bat; Compression it with "Reflate_v2"
if not ISExec ( 0, 0, 0, ExpandConstant('{app}\archives_win64\data3\Unpack. bat'), ExpandConstant(''), ExpandConstant('{app}\archives_win64\data3\'), '...',true) then break;
//DelTree(ExpandConstant('{app}\archives_win64\data3 '), True, True, True); //test





This is the "mad max" decompression process

User run the "ReflateUnpack.bat" and "Unpack.bat" alone, and they are all out of the file is gone, very strange...
Is not the user's system lacks the reasons for extracting the plug?
My own computer to install all normal！！！

[RamiroCruzo]

Originally Posted by ShadowEagle

Nice bat files

So, how to integrate that into an inno script? Your C.bat is creating *.pcf
and a .str file/s. After that the bat compresses to final archive using srep+lzma. Possible to use UltraARC for the final archive compressing?

Here's the v2 of it amigo...... You can find all the .pcf files in data folder to compress them externally

Change log :

-Increased speed
-All .pcf files are now left untouched to compress externally

Well.... Its a drag

[ShadowEagle]

Very very good. thanks a lot man!

Now we all have to find a way to show up the progress in inno setup for restoring. I hate cmds so much

Maybe Maste Razor can help us? Cheers