Masked Compression (Ultimate compression in one go)

[Lucas65]

Sorry Panker but I have this error with precomp:



Have you got any idea? Thanks in advance.

[RamiroCruzo]

Might I suggest you something amigo...The .bik to .bk2 encoding batch you are using might be a troublesome one...

Your batch file will just delete all the .bik files after the encoding...But its a common error that some .bik files aren't supported then your encoder will simply delete it too...

Use this :

FOR /F "usebackq delims=" %%i in ( `dir /b /s *.bik` ) do (     IF EXIST "%%~dpni.bk2" (         DEL "%%i"     ) )

Instead of:

Del /F /Q %%i

[panker1992]

@Lucas delete temporary files and rename data1.bin to data2.bin in Masked Compression.bat

if precomp finds same data it pops up errorss like these :P
please do not hesitate to contact if the problem persists


@Ramiro this is not a *.bik to *.bk2
this is a bik and bk2 RE-ENCODER

it scans for bik and bk2 files and it downgrades them to 50% and 70% respectively :P

sorry i didnt write that above

[Amsal]

Originally Posted by panker1992

-mprecomp+msc+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

text and uncompressible only :P for Amsal

I mean bro, I don't need the JPG compression which is used in MSC

[Amsal]

Originally Posted by panker1992

-mprecomp+msc+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

text and uncompressible only :P for Amsal

I mean bro, I don't need to use Precomp PACKJPG And MSC compression! Can you please give the algorithm with these two algo!
Remember, I want to use Precomp, but I don't want to use PACKJPG and MSC!
Thanks in Advance!

[Kazamnuk]

Awesome stuff panker1992, hats off. looking forward with great anticipation!

Myself as a rookie, I mainly use UltraArc cuz of its reasonable GUI, any chance to see any simliar attempt, implementation?


Keep up the good work, cheers!

[panker1992]

@Amsal i dont understand what you want to do exactly ....
maksed compression is all about masks and different algorithms
if you want to skip a program simple edit this line

-mprecomp+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

this is the command to skip MSC ......MSC only compresses textures wav sound mp3 sound and bmf format

packjpg compresses jpg format completely different things

@Kazamnuk

i dont like GUI at all ....
because i dont like GUI i am able to contribute projects like this

i experiment i use many programs that i find

i constantly update my entire Repack library

BUT... Felice has made a nice effort to make a full yet user friendly GUI for newbies he will update to masks eventually so keep an eye out

Peace !!

[Lucas65]

Originally Posted by panker1992

@Lucas delete temporary files and rename data1.bin to data2.bin in Masked Compression.bat

if precomp finds same data it pops up errorss like these :P
please do not hesitate to contact if the problem persists

I delete temporary file and change the name of the output file
but I get the same error. I'm sorry for the trouble.
I also disabled the antivirus but nothing.

Thanks for your help.

[panker1992]

Lucas it seems that you are the only with this kind of trouble,
try to disable precomp for the test utilize all except precomp
really wanna see if this is general or precomp specific problem.

also move the Folder to an external drive and pack something small for this test
dont use this in C:/ drive because almost everytime it will fail

Upload a photo with the folder + the cmd with the problem please

[felice2011]

Hey panker i''m trying to test your new method all in one, so you called, with different titles small, to speed up the test, but it seems impossible not to have managed to compress a title, with each change of line gives me an error different: error in precomp, error in LZ77, the last error "disk full in delta compression algorithm"



I think you have to redefine your new method so that it fits in most of the data files.
I also noticed that most different algorithms are added to the mask, it is more subject to error.

P.S the same titles that are not able to test with your method, I have successfully compressed using the common methods known "-mmsc+precomp+srep64+xz", "-mmsc+srep64+zstd" or "-mreflate+precomp+srep+delta+lzma".

I hope for a solution..

[panker1992]

Originally Posted by felice2011

Hey panker i''m trying to test your new method all in one, so you called, with different titles small, to speed up the test, but it seems impossible not to have managed to compress a title, with each change of line gives me an error different: error in precomp, error in LZ77, the last error "disk full in delta compression algorithm"

I think you have to redefine your new method so that it fits in most of the data files.
I also noticed that most different algorithms are added to the mask, it is more subject to error.

P.S the same titles that are not able to test with your method, I have successfully compressed using the common methods known "-mmsc+precomp+srep64+xz", "-mmsc+srep64+zstd" or "-mreflate+precomp+srep+delta+lzma".

I hope for a solution..

all in all i havent told you how it works and how to chain a compressor with another compressor

This is the method i have used most of the time

-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq

the method i provided is absolutely made with 16 gigs of ram in mind
personally i got 12 gigs, running many compressos all at once does an impact on cpu too

i am posting a photo to show you my results, as well as i try to optimize it for lower spec PCs

From personal exp. i have found that 4G ram PCs will never make it and produces many errors
also zstd.exe, 7z.exe and many others are 64 bit only so

Check Method in photo for Masks
and see the results

[Lucas65]

This is the file for compression:



This is error in cmd:



I also tried to compress GTA San Andreas with the same error.
I really like the method and I'm sorry for those errors. However, I have 8 gb ram and I amended the parameters in arc.ini. Without trying precomp all goes well until the end.

[Kazamnuk]

Originally Posted by panker1992

i dont like GUI at all ....
because i dont like GUI i am able to contribute projects like this

i experiment i use many programs that i find

i constantly update my entire Repack library

BUT... Felice has made a nice effort to make a full yet user friendly GUI for newbies he will update to masks eventually so keep an eye out

Peace !!

Alright, thanks mate!

I'm a bit confused, on UltraArc I used always srep + Izma for the data.arc archives. Since, I have 16 GB of Ram available, zstd and lzham would be preferable now.

However, in Felice tool some of the methods are listed, but I can't figure out which would be the one above. Could please advise me?

Thanks a lot, cheers!

[vint56]

Lucas65
Sorry for my bad English
Error because Precomp not find zlib streams
and about h64b.rpf Reflate will help you create an archive and unpacking very long

[panker1992]

Lucas i am trying to remember when i had seen that error again !!!!

what os are you using ??? i use win 8.1 and Arch linux kernel 4.2 latest

and i compress with masks in both without any errors

will try to fix this because its starting to get in my nerves that it refuses to compress like a good file :P


Lucas here is it your error
put this into precomp.exe

@Kazamnuk

This is the arc.ini that will give you max compression for 16 gigs of ram