Masked Compression (Ultimate compression in one go)

[RamiroCruzo]

Originally Posted by vint56

RamiroCruzo

and after processing precomp output size changed

Yup amigo...Gave way better result in compression....Although only -brute method worked...

[vint56]

RamiroCruzo
I and thought that you used - brute method because - slow and - intense do not work at the GTA5 files

[panker1992]

i dont have the file to test it, tho i have something in my mind

drag and drop the file on precomp42 and precomp43 to verify

it should give you the file.pcf, i dont own the GTAV to test it

can someone upload the rpf file so i can test it ?

[vint56]

panker1992 file is in the pack
x64a.rpf download http://rghost.ru/64MHHKGTy

[panker1992]

it works correctly with reflate

with precomp 4.2 and 4.3 versions i encounter errors

the test that took place was on linux arch

but i tried without masks.....so masked compression has nothing to do with this

will try on windows now and link photos

no luck on windows too

see all photos and the commends are yours
rpf files cannot be pipelined through arc.exe, this problem is with precomp.exe

the only part i feel sorry about is that precomp is a project no longer supported

you can mask *.rpf files no to go through precomp mask


open arc groups create

$nonprecomped
*.rpf

in the end of the file
make sure *.rpf isnt anywhere else

and see photos below what to do inside masked compression.bat

[Lucas65]

Originally Posted by panker1992

Lucas i believe that it is your OS that makes the problem since all else use my utility and they dont have the same error .......


What can i say i am sorry it didnt work you, one last test is to remove masks and use it normall

-mprecomp+msc+srep64+delta+exe+xz
or

-mprecomp+msc+srep64+delta+exe+lz77

this will use the normal procedure and no mask will be applied

so test this normally and please feedback

thanks in advance !!

Hello Panker. I used the normal method (-mprecomp+msc+srep64+delta+exe+lz77) and I have found no errors. I used it on GTA San Andreas where before I received the error.
Any idea for my annoying problem?

[panker1992]

There is an update in front page with 2 zlibs try with old and feedback I had error too and it solved after using zlib old

[Lucas65]

Hello panker. I'm reaching good results. I can run precomp if use this line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=msc+srep64+rep:512+delta+exe+lz77"
But I have a doubt: with this method the "Masked compression" working?

But if I use this other line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77" decompression me error: "unsupported method reflate".
Files "RPF" precomp I think that does not work then use this command line: "-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77 " but I can not decompress if I use "reflate".
Reflate can decompress?

Thank you Panker!

[panker1992]

if you use this line
"-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq"

you dont need to have masked $precomp=precomp+msc+srep64+delta+exe+lz77

reflate can only decompress at commandline (cmd) it doesnt work on inno for some reason i dont yet know

and use this -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz77

check the image below and try to send me some pictures

there are 5 boxes that show you how your data was processed
Method box is the mask used for, can you show me your info of your data files ?

i get a feeling that you miss something but you are doing good job on it

[vint56]

panker1992
I looked at the line precomp + msc + srep64 + rep: 800mb + delta + lz77 where winning 387 megabytes of why or where enough srep and lzma compression process takes less time for

[panker1992]

@Vint56
you mean that you won 387 megabytes without using masks and only this line above ?? :/

i am trying to implement nanozip in the process but i am afraid it will take just about 1 month to compress data on nowadays games

[Lucas65]

Originally Posted by panker1992

if you use this line
"-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq"

you dont need to have masked $precomp=precomp+msc+srep64+delta+exe+lz77

reflate can only decompress at commandline (cmd) it doesnt work on inno for some reason i dont yet know

and use this -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz77

check the image below and try to send me some pictures

there are 5 boxes that show you how your data was processed
Method box is the mask used for, can you show me your info of your data files ?

i get a feeling that you miss something but you are doing good job on it

If I use this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz7 I get the usual mistake ever. The problem (I do not know why) is here: $precomp=reflate+precomp+msc+srep64+delta+exe+lz77
Here are two photos using this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+delta+exe+lz77





Is there anything missing that you see?

[vint56]

panker1992
not from your full screenshot


Another example can be useful to someone

http://rghost.ru/6vkvLhMqw

[panker1992]

@Lucas its fine to use reflate only, tho as i said this version of inno setup i use refuses to see reflating as external compressor.
but if you have found a way to use it that is good news

did you notice any difference in ratio or speed while using the Masks ?? will be glad to know

@vint i saw that now i only check the entire data.bin for ratio

this is because some data are non compressible

in this case there are 3 scenarios
1) turn precomp to brute mode from intensive
2) lossy compress the files manually
3) if it is a packed format of games for example .pack formats used by all Total Wars
then you extract the content and compress it and then make a bat to restore it

[Lucas65]

Originally Posted by panker1992

@Lucas its fine to use reflate only, tho as i said this version of inno setup i use refuses to see reflating as external compressor.
but if you have found a way to use it that is good news

did you notice any difference in ratio or speed while using the Masks ?? will be glad to know

This type of compression is very good and also very fast. In my case I have that problem with precomp but fortunately I have, more or less, solved.
With reflate I only did the test and it would be really great if you could find a way to decompress in inno because in many cases exceptional results.
I need another help if you can: if for example use reflate alone, with this line arc.exe a -ep1 -r -ed -s; -mreflate data.arc "D:\Giochi\Gta san andreas\*, then how can I decompress with a bat file? I honestly have no idea.
I thank you in advance Panker!