Masked Compression (Ultimate compression in one go)

[panker1992]

~~~~~~~~~~~{Intro}~~~~~~~~~~~

In compression its all about algorithms
there are tons of algorithms that are suited all for a specific different purpose

this project is all about utilizing the correct compressor on specific type of files thus gaining the upper hand on compression and decompression

(example) there are types of data that compress better or doesnt compress at all
so why use lzma or even reflate and precomp even if you gain nothing from doing so ??

masked compression will use specific compressors per file types
it will gather all text files using extensions *.ini *.rtf *.txt
and it will perform the right compressor to compress the better of them

the same will happen with movies files and precomp file
in the latter using precomp.exe to process only files that benefit from it
on movies zstd will be used for maximum decompression

~~~~~~~~~~~{Tiny SFX Packing}~~~~~~~~~~~

1)Choose you Program or Game make sure it is small to begin with
: Tiny Tools cannot support large number of Files
2) Put it inside Tiny_SFX_Compressor.bat and choose whatever compression method you want
: As I said all works Including Precomp, you can leave it as is its very Optimal
3) Run the bat and wait for magic
4) after you have the data.bin run make sfx.bat
5) the exe that is produced is ready to work without anything it will automatically Unpack whatever method i have provided so far
6) This tool is provided as is, it worked for me and i gladly share, further than that i cant guarantee that it work for you!!!

~~~~~~~~~~~{Bik, Bk2 Re-encoding}~~~~~~~~~~~

Read the Readme.log i provided, it has everything you need to know


~~~~~~~~~~~{Update log}~~~~~~~~~~~

[Update 1]

Added new Zstd Compressor for windows, I splited this into 2 different compression settings
Zstd ultra compression = srep + zstd used a pipeline and offer great compression similar to lzma2 max and even bypass ultra on >5gb files
Zstd fast compression = pure zstd offering very very fast compression ideal for fast travel data
Important: If you used my previous tools, you need to download Zstd Ultra Compression to maintain support,
all your data that you have already compressed by this tool will be usable only with this option

[Masked Compression 2.5]

masks 2.5 are here but this time a minor release

1) third mask was beta last time, now it aint ...it works out of the box with great success

2)precomp 038 remade, and optimized from scratch, precomp 0.38 is custom
and it is faster than all other precomp, on my test precomp 0.45 took 9 minues almost
and precomp0.38 took 5 minutes and 35 seconds ( test file was 700 mb file )

precomp038 set to slow mode and prrecomp 0.43 for brute mode, more of this in arc.ini

3) legacy2 works again since precomp038 is added again

4) msc is disabled, but you can enable it yourself, i did a proper test with this and reflate doesnt work with msc

plus the ratio was increased and not decreased (if you dont believe me i can post results and you can always test yourself)

5) zstd doesnt work with my config anymore... it took errors i had to reformat entire pc and again didnt ( that was enough for me to cast it aside tho i left the sonido )
and the option for you to re-enable it

6) msrsolid mask and void mask are better optimized !!!

Masked Compression Archive Added including all masks up to 2.5

Masked Compression x86 Support

Masked Compression Manual
Stay tuned :)



~~~~~~~~~~~{Special Thanks}~~~~~~~~~~~

Special thanks to Razor for reflate and Inno(WPI) and Gozarck for his inspiration and tweaks :)

[felice2011]

I understood, in fact we all understand that your methods "LZ77", "XZ" are best of the old and obsolete method LZMA, thou hast repeated a hundred times in my and in your thread, but the file you posted www.fileforums.com/showthread.php?t=97303&page=5#67 changing folder "resource" sends error in my utility with different methods of choice, if we want to change something in my utility we can do together I hope you understand this you.:rolleyes:;)

[panker1992]

i know what you mean Felice :) the file i uploaded was to show you the removed dll files and the updated srep that went to 3.93 just keep those files ..... i didnt update overall you work :P

I dont know if you need the dlls for your exe to work by the way ..... because i use commandline and you interface :)

[felice2011]

My utility uses a variety of combinations for different methods, and the files placed in the folder 'resource' are not included by chance..:)
I checked the files included in your 'Masked Compression' method bat console and arc.ini files modified, it is not difficult to insert and update all in my utility, but the combinations of choice increased considerably, and this may be a problem ...:rolleyes::D:p

[panker1992]

Felice if each compressor uses from 2~5 different switches then if you combine 5 programs
the amount of switches dramatically change and even a single modification is chained :P

i suggest you toy with my bat file before you try to combine it in DLG :P

I want to hear some thoughts on it ..... did you find it better ?? or worse ?? something that will help me too

as you can see clearly decompression is still the same nothing will change there at this point
masks only help the compression part :) hope you like this far

i have some nasty ideas on compression but only razor can help me on this because i work solo i dont have any help besides this community.
packjpg that is included in there is the exe from the latest release, i can also compile it in dll but cannot inject in precomp in order to upgrade it, if razor can inject it or better make the code use multithreading it would be great
packjpg is GPL program by the way all can get its source !!

[felice2011]

Ok I will be working on the 'Masked Compression' I have a couple of titles to be compressed and are curious to know how it acts..:D
Meantime remove the zip file that you posted in my thread, if it is used by users and give error, by me come to break the balls for to malfunction..:D;):)

[panker1992]

ops you are right i assume you got the updates especially on srep you will need them :D

[felice2011]

ops you are right i assume you got the updates especially on srep you will need them :D

Do not worry...;)

[oltjon]

:eek:truly the best so far

[panker1992]

@oltjon if you have weak computer the compression speed will be like half or even better
the same goes for high end computers but it can run parallel

hope you like it :)

[Amsal]

@PANKER1992, Really THANKS A LOT FOR THIS! ONLY one question, how to extract the archives in inno script?
And Bro, tell me with reflate and without reflate. I know how to compress with reflate and with reflate, only I am asking, how to decompress the files with an inno script.
Please answer in detail!

Again thanks for the Masked Compressor, it is really very fast

[panker1992]

@Amsal really thanks, i will update decomp tomorrow so no worries

generally in decomp nothing changes, masks only exist to instruct how a compressor behaves


example: all text files are compressed next to each other and movies the same and so on
thus gaining an upper hand in everything, trying to apply the best settings in each case
so it doesnt affect decompression because decomp doesnt care what it extracts as long as it extracts :)


DETAILS TOMORROW :) its 4 morning here :P

[Amsal]

@Amsal really thanks, i will update decomp tomorrow so no worries

generally in decomp nothing changes, masks only exist to instruct how a compressor behaves


example: all text files are compressed next to each other and movies the same and so on
thus gaining an upper hand in everything, trying to apply the best settings in each case
so it doesnt affect decompression because decomp doesnt care what it extracts as long as it extracts :)


DETAILS TOMORROW :) its 4 morning here :P
Bro, here is also morning, from INDIA, you know I compressed from 1.61gb to only 98.4mb with this method, and from compressing in ultraarc it gives 1.2gb!!

That mean, your compressor is amazing, i am shocked with results!! Please post the decompression method soon as possible? I will go on vacation in 2 days, so please post as soon as possible!

[panker1992]

now that is what i want all of you to do :)

very nice feedback

copy all files from my 7z somewhere and make a unpack.bat file

write inside unpack.bat

arc.exe x data1.bin -y -pYourpassword

and save this


now see how fast truly gets :)


Inno is coming up tomorrow ..... it works ok so no worries :)

[Amsal]

now that is what i want all of you to do :)

very nice feedback

copy all files from my 7z somewhere and make a unpack.bat file

write inside unpack.bat

arc.exe x data1.bin -y -pYourpassword

and save this


now see how fast truly gets :)


Inno is coming up tomorrow ..... it works ok so no worries :)

Bro, I used this method, but it only creates the folder, it doesn't extract all the files, I tried, but it only made folder! Listen, Complete your decompression process/script/bat and then give all the required bat/files to us with the method to use in inno! But bro, if possible complete these all test till today night

[panker1992]

There it goes :P Inno is up

As i uploaded right now i cant know for sure
if you get errors tomorrow i will help !!!

[rinaldo]

10++

[Amsal]

There it goes :P Inno is up

As i uploaded right now i cant know for sure
if you get errors tomorrow i will help !!!

Bro, I am the biggest fan of your's from now!

[Amsal]

There it goes :P Inno is up

As i uploaded right now i cant know for sure
if you get errors tomorrow i will help !!!

Bro, there is error which I got on 4.5% while decompressing -

An error occurred while unpacking: Unable to write data on disk!
Unarc.dll returned an error code: 11
ERROR: archive data corrupted (decompression fails)

[1234567890123]

http://i.hizliresim.com/orQRZ9.png how can i fix this?
edit:i have got same error in Split_Kompress_v1.3d lz77

[Rahmani1811]

panker1992 amazing work bro i compress in 1/3 with this method. now only waiting for decompression i tried with inno and it is successfully decompressed too but getting some problem with some games. by the way thanks for the method.

[Amsal]

http://i.hizliresim.com/orQRZ9.png how can i fix this?
edit:i have got same error in Split_Kompress_v1.3d lz77

Bro , remove the 'lz77' from the end of the compression algorithm

[panker1992]

1234567890123 the error you get is probably because you have to little ram try to lower dictionary a little

lz77 is set to use 9 gigs of ram
any less produces this error so

use d:512m for 5~5.5 gigs of ram and respectively d:256m for 2~3 gigs of ram required


@Amsal if you downloaded the split compress from felice post it doesnt work that was only for felice to update srep and see how dll work

lz77 only exists and allows for 7z.exe to use bigger dictionary for precompressed and reflated data for maximum results

it uses 10 gigs of ram so carefully change dictionary

[Amsal]

Bro, there is error which I got on 4.5% while decompressing -

An error occurred while unpacking: Unable to write data on disk!
Unarc.dll returned an error code: 11
ERROR: archive data corrupted (decompression fails)

Bro, I didn't downloaded felice post!

And can you give me a attachment of the .bat file where the dictionary size is changed to 256mb, because my PC RAM is only 4gb!

[panker1992]

if your computer has 4G ram then use this

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d200m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d100m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>


if your computer has 8G ram then use this

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d256m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[1234567890123]

thanks it works now :)

[panker1992]

make sure you update to the Inno v2.... also i am posting other useful stuff here like lossy compression as well

enjoy !! :)

[Amsal]

Bro, if I didn't want to use PackJPG at all, then what I have to do?

[panker1992]

-mprecomp+msc+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

text and uncompressible only :P for Amsal

[Lucas65]

Sorry Panker but i have this error with precomp:

http://i.imgur.com/WCM1ULW.png

Have you got any idea? Thanks in advance.

[Lucas65]

Sorry Panker but I have this error with precomp:

http://i.imgur.com/WCM1ULW.png

Have you got any idea? Thanks in advance.

[RamiroCruzo]

Might I suggest you something amigo...The .bik to .bk2 encoding batch you are using might be a troublesome one...

Your batch file will just delete all the .bik files after the encoding...But its a common error that some .bik files aren't supported then your encoder will simply delete it too...

Use this :
FOR /F "usebackq delims=" %%i in ( `dir /b /s *.bik` ) do ( IF EXIST "%%~dpni.bk2" ( DEL "%%i" ) )Instead of:
Del /F /Q %%i

[panker1992]

@Lucas delete temporary files and rename data1.bin to data2.bin in Masked Compression.bat

if precomp finds same data it pops up errorss like these :P
please do not hesitate to contact if the problem persists


@Ramiro this is not a *.bik to *.bk2
this is a bik and bk2 RE-ENCODER

it scans for bik and bk2 files and it downgrades them to 50% and 70% respectively :P

sorry i didnt write that above :)

[Amsal]

-mprecomp+msc+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

text and uncompressible only :P for Amsal

I mean bro, I don't need the JPG compression which is used in MSC

[Amsal]

-mprecomp+msc+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

text and uncompressible only :P for Amsal

I mean bro, I don't need to use Precomp PACKJPG And MSC compression! Can you please give the algorithm with these two algo!
Remember, I want to use Precomp, but I don't want to use PACKJPG and MSC!
Thanks in Advance!

[Kazamnuk]

Awesome stuff panker1992, hats off. looking forward with great anticipation!

Myself as a rookie, I mainly use UltraArc cuz of its reasonable GUI, any chance to see any simliar attempt, implementation?


Keep up the good work, cheers!

[panker1992]

@Amsal i dont understand what you want to do exactly ....
maksed compression is all about masks and different algorithms
if you want to skip a program simple edit this line

-mprecomp+srep64+rep:512+delta+exe+xz/$void=srep64+zstd/$text=srep64+zpaq

this is the command to skip MSC ......MSC only compresses textures wav sound mp3 sound and bmf format

packjpg compresses jpg format completely different things

@Kazamnuk

i dont like GUI at all ....
because i dont like GUI i am able to contribute projects like this

i experiment i use many programs that i find

i constantly update my entire Repack library

BUT... Felice has made a nice effort to make a full yet user friendly GUI for newbies he will update to masks eventually so keep an eye out :)

Peace !! :)

[Lucas65]

@Lucas delete temporary files and rename data1.bin to data2.bin in Masked Compression.bat

if precomp finds same data it pops up errorss like these :P
please do not hesitate to contact if the problem persists


I delete temporary file and change the name of the output file
but I get the same error. I'm sorry for the trouble.
I also disabled the antivirus but nothing.

Thanks for your help.

[panker1992]

Lucas it seems that you are the only with this kind of trouble,
try to disable precomp for the test utilize all except precomp
really wanna see if this is general or precomp specific problem.

also move the Folder to an external drive and pack something small for this test
dont use this in C:/ drive because almost everytime it will fail

Upload a photo with the folder + the cmd with the problem please

[felice2011]

Hey panker i''m trying to test your new method all in one, so you called, with different titles small, to speed up the test, but it seems impossible not to have managed to compress a title, with each change of line gives me an error different: error in precomp, error in LZ77, the last error "disk full in delta compression algorithm":o

http://i63.tinypic.com/34grsia.png

I think you have to redefine your new method so that it fits in most of the data files.:)
I also noticed that most different algorithms are added to the mask, it is more subject to error.:cool:

P.S the same titles that are not able to test with your method, I have successfully compressed using the common methods known "-mmsc+precomp+srep64+xz", "-mmsc+srep64+zstd" or "-mreflate+precomp+srep+delta+lzma".

I hope for a solution..:rolleyes:

[panker1992]

Hey panker i''m trying to test your new method all in one, so you called, with different titles small, to speed up the test, but it seems impossible not to have managed to compress a title, with each change of line gives me an error different: error in precomp, error in LZ77, the last error "disk full in delta compression algorithm":o

I think you have to redefine your new method so that it fits in most of the data files.:)
I also noticed that most different algorithms are added to the mask, it is more subject to error.:cool:

P.S the same titles that are not able to test with your method, I have successfully compressed using the common methods known "-mmsc+precomp+srep64+xz", "-mmsc+srep64+zstd" or "-mreflate+precomp+srep+delta+lzma".

I hope for a solution..:rolleyes:

all in all i havent told you how it works and how to chain a compressor with another compressor

This is the method i have used most of the time

-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq

the method i provided is absolutely made with 16 gigs of ram in mind
personally i got 12 gigs, running many compressos all at once does an impact on cpu too

i am posting a photo to show you my results, as well as i try to optimize it for lower spec PCs

From personal exp. i have found that 4G ram PCs will never make it and produces many errors
also zstd.exe, 7z.exe and many others are 64 bit only so

Check Method in photo for Masks
and see the results

[Lucas65]

This is the file for compression:

http://i.imgur.com/TzGvtUg.png

This is error in cmd:

http://i.imgur.com/gBcowuN.png

I also tried to compress GTA San Andreas with the same error.
I really like the method and I'm sorry for those errors. However, I have 8 gb ram and I amended the parameters in arc.ini. Without trying precomp all goes well until the end.

[Kazamnuk]

i dont like GUI at all ....
because i dont like GUI i am able to contribute projects like this

i experiment i use many programs that i find

i constantly update my entire Repack library

BUT... Felice has made a nice effort to make a full yet user friendly GUI for newbies he will update to masks eventually so keep an eye out :)

Peace !! :)

Alright, thanks mate!

I'm a bit confused, on UltraArc I used always srep + Izma for the data.arc archives. Since, I have 16 GB of Ram available, zstd and lzham would be preferable now.

However, in Felice tool some of the methods are listed, but I can't figure out which would be the one above. Could please advise me?

Thanks a lot, cheers! :)

[vint56]

Lucas65
Sorry for my bad English
Error because Precomp not find zlib streams
and about h64b.rpf Reflate will help you create an archive and unpacking very long

[panker1992]

Lucas i am trying to remember when i had seen that error again !!!!

what os are you using ??? i use win 8.1 and Arch linux kernel 4.2 latest

and i compress with masks in both without any errors

will try to fix this because its starting to get in my nerves that it refuses to compress like a good file :P


Lucas here is it your error
put this into precomp.exe

@Kazamnuk

This is the arc.ini that will give you max compression for 16 gigs of ram

[Lucas65]

Lucas i am trying to remember when i had seen that error again !!!!

what os are you using ??? i use win 8.1 and Arch linux kernel 4.2 latest

and i compress with masks in both without any errors

will try to fix this because its starting to get in my nerves that it refuses to compress like a good file :P

I use Windows 7 64bit ICE.
It may be due to this operating system that keep getting these errors?

I saw now the file zlib.
I did not understand "put this into precomp.exe", sorry.

[panker1992]

if you used windows 10 i wouldnt be surprised ....

copy paste the zlib1.dll i gave you its the 105 kilobyte edition

if you get the error again i will post the 59 bit dll


lets see .... !! i perform test alongside and i get no errors

i have compressed all my library with masks and no errors at all :/

[Lucas65]

Nothing. Same error ...

[panker1992]

please make a photo of the directory that all tools are in a photo of arc.ini and a photo of the masked compression.bat :P i will have this solved no matter what :P

[vint56]

The point in the file not found precomp zlib molasses and therefore error

[panker1992]

@Vint his problem isnt masks, masks merely instruct how a compressor will behave on files

to make this more simple

you dont have to apply precomp on *.txt files and *.bik files

that is what a mask do ..prevent files that dont benefit from a compressor to be processed by it


so i am trying to guess what he misses :/

[Lucas65]

Wait wait ... Out of curiosity I tried it on virtual machines with win7 64bit normal and it worked on this file and the zlib.dll from 59Kb
http://i.imgur.com/TzGvtUg.png

I tried on file tool razor and error reappeared trying both the zlib.dll
http://i.imgur.com/tMvbvJp.png
This is arc.ini and bat file (of course there is not the newline ...)

http://i.imgur.com/fwMsheh.png

http://i.imgur.com/N8RSkMI.png

[panker1992]

you miss a 7z.exe and fazip.exe and decompress.dll and decompress_mt.dll from fazip's environment


generally :P you miss programs how can this work ??

[Lucas65]

I'm sorry. I forgot to put this image:

http://i.imgur.com/YxyTGq8.png

[panker1992]

take this file and extract in there replacing the arc.groups

i also advise against compressing 1 file with masked compression

its made from the ground up to handle many files and many filetypes

[Lucas65]

Hello Panker, I have other tests but the error persists. Your job is ok and certainly something my wrong. Maybe it is SO ICE that I've never been inspired since I installed or do not know.
I changed the file arc.groups, and to try change the file precomp.exe but nothing. I do not know what to say. Thanks anyway for the help you have given me so far.

[panker1992]

Lucas i believe that it is your OS that makes the problem since all else use my utility and they dont have the same error .......


What can i say i am sorry it didnt work you, one last test is to remove masks and use it normall

-mprecomp+msc+srep64+delta+exe+xz
or

-mprecomp+msc+srep64+delta+exe+lz77

this will use the normal procedure and no mask will be applied

so test this normally and please feedback

thanks in advance !!

[vint56]

panker1992
Try it yourself to process this file
Lucas65
Try PrecompInside, and you will see the same error
x64a.rpf This file can be processed only Reflate
Example Reflate
http://rghost.ru/64MHHKGTy

[RamiroCruzo]

panker1992
Try it yourself to process this file
Lucas65
Try PrecompInside, and you will see the same error
x64a.rpf This file can be processed only Reflate
Example Reflate
http://rghost.ru/64MHHKGTy

Me used all types of precomp on x64a.rpf...It worked for me all the times...

I don't know the particular reason why but if you use the PrecompInside they won't run on it [Run but show error if there is no benefit in precomping]....

[vint56]

RamiroCruzo

Me used all types of precomp on x64a.rpf...It worked for me all the times...

and after processing precomp output size changed

[RamiroCruzo]

RamiroCruzo

and after processing precomp output size changed

Yup amigo...Gave way better result in compression....Although only -brute method worked...

[vint56]

RamiroCruzo
I and thought that you used - brute method because - slow and - intense do not work at the GTA5 files

[panker1992]

i dont have the file to test it, tho i have something in my mind

drag and drop the file on precomp42 and precomp43 to verify

it should give you the file.pcf, i dont own the GTAV to test it

can someone upload the rpf file so i can test it ?

[vint56]

panker1992 file is in the pack
x64a.rpf download http://rghost.ru/64MHHKGTy

[panker1992]

it works correctly with reflate

with precomp 4.2 and 4.3 versions i encounter errors

the test that took place was on linux arch

but i tried without masks.....so masked compression has nothing to do with this

will try on windows now and link photos

no luck on windows too

see all photos and the commends are yours
rpf files cannot be pipelined through arc.exe, this problem is with precomp.exe

the only part i feel sorry about is that precomp is a project no longer supported

you can mask *.rpf files no to go through precomp mask


open arc groups create

$nonprecomped
*.rpf

in the end of the file
make sure *.rpf isnt anywhere else

and see photos below what to do inside masked compression.bat

[Lucas65]

Lucas i believe that it is your OS that makes the problem since all else use my utility and they dont have the same error .......


What can i say i am sorry it didnt work you, one last test is to remove masks and use it normall

-mprecomp+msc+srep64+delta+exe+xz
or

-mprecomp+msc+srep64+delta+exe+lz77

this will use the normal procedure and no mask will be applied

so test this normally and please feedback

thanks in advance !!

Hello Panker. I used the normal method (-mprecomp+msc+srep64+delta+exe+lz77) and I have found no errors. I used it on GTA San Andreas where before I received the error.
Any idea for my annoying problem?

[panker1992]

There is an update in front page with 2 zlibs try with old and feedback I had error too and it solved after using zlib old

[Lucas65]

Hello panker. I'm reaching good results. I can run precomp if use this line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=msc+srep64+rep:512+delta+exe+lz77"
But I have a doubt: with this method the "Masked compression" working?

But if I use this other line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77" decompression me error: "unsupported method reflate".
Files "RPF" precomp I think that does not work then use this command line: "-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77" but I can not decompress if I use "reflate".
Reflate can decompress?

Thank you Panker!

[panker1992]

if you use this line
"-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq"

you dont need to have masked $precomp=precomp+msc+srep64+delta+exe+lz77

reflate can only decompress at commandline (cmd) it doesnt work on inno for some reason i dont yet know

and use this -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz77

check the image below and try to send me some pictures

there are 5 boxes that show you how your data was processed
Method box is the mask used for, can you show me your info of your data files ?

i get a feeling that you miss something but you are doing good job on it :)

[vint56]

panker1992
I looked at the line precomp + msc + srep64 + rep: 800mb + delta + lz77 where winning 387 megabytes of why or where enough srep and lzma compression process takes less time for

[panker1992]

@Vint56
you mean that you won 387 megabytes without using masks and only this line above ?? :/

i am trying to implement nanozip in the process but i am afraid it will take just about 1 month to compress data on nowadays games

[Lucas65]

if you use this line
"-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq"

you dont need to have masked $precomp=precomp+msc+srep64+delta+exe+lz77

reflate can only decompress at commandline (cmd) it doesnt work on inno for some reason i dont yet know

and use this -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz77

check the image below and try to send me some pictures

there are 5 boxes that show you how your data was processed
Method box is the mask used for, can you show me your info of your data files ?

i get a feeling that you miss something but you are doing good job on it :)

If I use this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz7 I get the usual mistake ever. The problem (I do not know why) is here: $precomp=reflate+precomp+msc+srep64+delta+exe+lz77
Here are two photos using this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+delta+exe+lz77

http://i.imgur.com/Li64bPU.png

http://i.imgur.com/sR9V2Kf.png

Is there anything missing that you see?

[vint56]

panker1992
not from your full screenshot
http://s019.radikal.ru/i633/1512/dc/2c78570a5c77.png

Another example can be useful to someone

http://rghost.ru/6vkvLhMqw

http://s017.radikal.ru/i433/1512/9d/57b1173256cb.png
http://s020.radikal.ru/i718/1512/99/543b6408a91c.png

[panker1992]

@Lucas its fine to use reflate only, tho as i said this version of inno setup i use refuses to see reflating as external compressor.
but if you have found a way to use it that is good news

did you notice any difference in ratio or speed while using the Masks ?? will be glad to know

@vint i saw that now i only check the entire data.bin for ratio

this is because some data are non compressible

in this case there are 3 scenarios
1) turn precomp to brute mode from intensive
2) lossy compress the files manually
3) if it is a packed format of games for example .pack formats used by all Total Wars
then you extract the content and compress it and then make a bat to restore it

[Lucas65]

@Lucas its fine to use reflate only, tho as i said this version of inno setup i use refuses to see reflating as external compressor.
but if you have found a way to use it that is good news

did you notice any difference in ratio or speed while using the Masks ?? will be glad to know

This type of compression is very good and also very fast. In my case I have that problem with precomp but fortunately I have, more or less, solved.
With reflate I only did the test and it would be really great if you could find a way to decompress in inno because in many cases exceptional results.
I need another help if you can: if for example use reflate alone, with this line arc.exe a -ep1 -r -ed -s; -mreflate data.arc "D:\Giochi\Gta san andreas\*, then how can I decompress with a bat file? I honestly have no idea.
I thank you in advance Panker!

[panker1992]

I haven't tested -mreflate alone I mean without srep and lzma or lzma2

But I have found a glitch
Download my decompress for ripping and masked compression

Copy arc.ini from my masked compression zip to decompress for ripping and replace it

Then try to decompress
The error that didn't let rwflate work is solved :P

[Lucas65]

Great. Now I work in almost all ... It seems also precomp. Thank you very much for all your help and for the work you've done!

[panker1992]

Lucas your welcome :D

i always try to troubleshoot, and try to know how the programs work so when i see errors
i know where they come from

you seemed to have the most difficult situation in the forum, i am really glad you managed to get it right :)

any feedback would be nice on the methods, have you seen ratio or at least speed improvements ??? has masked comp/decomp worked well ??

[hans314]

Dear Panker,

I would also like to thank you for your great script+grouping of files! The idea is great!

I´m having a little problem with some files, getting the message:
##################
Recompressed streams: 0/6
PNG streams (multi): 0/1
zLib streams (intense mode): 0/5

None of the given compression and memory levels could be used.
There will be no gain compressing the output file.

ERROR: general (de)compression error in precomp
##################
it occurs on Win8.1+Win10+VMWare (blank installation of Win8.1)

I just remarked, that it hungs up by converting a bnk file (but other bnk files worked) and in another case an ico and a wmv file has caused the problem.

Should I need to sort them out or change anything in the precomp settings?

Thanks for your help!

[panker1992]

thanks for feedback :D

dear friend all files and how they get compressed are chosen by the file named arc.groups

the name of the filter starts with $text for example
and then all *.txt *.ini and all files that are text alike will be compressed by what you put in front of /$text=rep:500+zstd for example this will take all texts and compress them separetaly then put them back in the entire arc or bin or cab whatever :)

now there is a filter that takes all files that are unknown to the mask and compresses them generally by the usage of the

-mmsc+srep64+...+lz77 for example


if you open your arc.group you will find that wmv files are under void = uncompressible data

if you want add *.bnk files under void too
and replace this line in general comp /$void=msc+srep64+zstd thus ensuring that precomp will never see bnk files

bnk is uncompressible data format is has nothing to do with precomp.exe

i hope that you got me :D
sorry for long text

[hans314]

Dear Panker,

thanks for your fast reply, unfortunately it doesn´t work for me, he still thinks that he needs to use precomp, altough I´ve added a wmv and ico entry in the $void section... (the wmv entry was already there like you said). For example when I try to compress only one wmv file, it still uses precomp.

Thanks again!

P.S. you can test it with the attached icon

[panker1992]

[External compressor:precomp]
header = 0
packcmd = precomp -slow -t-j -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp


i had already began to test precomp 3.8 as a replacement for 4.2 which made it little bit easier

i will update all projects to precomp 3.8 as it is more stble

[hans314]

Great it works thanks a lot! Maybe one idea: what about a "comparing" tool with all precomp versions? Maybe you can integrate it in your great script ;):D

I also had the idea, that the batch finds out the biggest files and do some compressing tests with intense or brute method (to also get GTA5 files compressed). After the test run, there will be a short message saying for example" Precomp 4.2 with intense mode" is the best option.

I think it will be hard to implement automatically, but you could do a big script for all precomp versions and options so that you will be able to test it on one big file which you manually choose. Then you can compare the results and set the best option.

I hope you understand what I mean :D:D:D

[panker1992]

precomp takes a lot of time but what you say i can do it with some help :D

it was the 9 hours that precomp takes that forced to make zstd part of my project then xz and then masks :) just wait a little longer

i have been working 40 hours straight to get a working Inno setup with

precomp + reflate + srep64 + fazip with all goodies + nanozip + zpaq + zstd ......i can go on forever :D i am almost done


Here take a look <3

[hans314]

Wow this sounds quite good, I appreciate your good and hard work!

I love the idea of masking files and bringing a tool to handle every compression method and I will test it a lot :) but I also like the scripts, so if both could be possible we will have a new wonder of the world :D

[panker1992]

hans i assure you that by the end of this year i will be "Panker the Compression Manipulator "

just kidding :)

razor went and created a damn hard program again but it's so appealing that i decided to work on it and maybe have Inno + masks altogether :)

hope you enjoy it when i give it to public :)

[hans314]

Hehe:D

I´m sure I will enjoy it :) cannot keep waiting for it:D

[panker1992]

alright brand new Update Inno_v3 is up

big thanks to razor as i couldnt have done it without him :)

[ramazan19833]

Helo
Inno_v3 Splash music Help

[RamiroCruzo]

Bro, I used this method, but it only creates the folder, it doesn't extract all the files, I tried, but it only made folder! Listen, Complete your decompression process/script/bat and then give all the required bat/files to us with the method to use in inno! But bro, if possible complete these all test till today night

It works finely amigo...Make sure you enter the password correctly... Also, you don't use any compression method i.e. not included in the extracting arc.ini...

[RamiroCruzo]

I now get it Mr panker1992 what all the masks are about... Grouping files for better & faster compression...

Hmmmm....Its familiar method but we did that on small scale...Hats off to you hermano...Means how much time did it require to type all those masks????

[panker1992]

i compress with masks for about 8 9 months this method to me is known to some time :D

it took me 5 months to optimize this :D with tests and i got membership in this site in octomber :P

making something for example xz took me a lot :D good that it works btw

[RamiroCruzo]

Well to be honest I came to know this method when I was first using FreeArc...Just compressed a game normally with FreeArc GUI & when I saw its blocks..Each block has its different compression method which were specific for file types...

[panker1992]

yes but you didnt know how to use this externally ?? ;)

also i didnt use freearc but only the smaller "child" arc.exe

Freearc and its "child"(:arc.exe) are vary capable compressors
with that said i wonder what else they are capable of ??
do they still have something we didnt see ??

hope you find it and deliver it to us Ramiro :) or even create something using delphi

[RamiroCruzo]

hope you find it and deliver it to us Ramiro :) or even create something using delphi

You know...Its funny but just to understand what Mr Razor gave me was in Delphi...It took me a week...So, I thought I would learn it...;)

[panker1992]

Patches and Hot fixes for scripts and the image where it didnt show properly when installing

Enjoy, i will keep updating this post for as long as i see that people actually care

i also hope razor will keep updating his windows 8 phone script despite his personal reasons not to :)

[ramazan19833]

An error occurred while decompressing: Invalid password!%nUnarc.dll returned an error code

[panker1992]

if you used a password when compressing

then see the pic below and go there and place your password

[hans314]

Dear Panker,
just a short question, how can I compress with empty folders? ATM it doesn't, I'm talking about 'Advanced-Data-Comp.bat'

Thanks for your help

[panker1992]

@hans314 i dont understand your question, at least not completely

do you want to compress an empty and arc.exe doesnt grab it ?

please tell some details so i can help you with your problem

:D

[hans314]

Ok, so one example. I've got a game with a subfolder called 'mods' but normally its emtpy. The folder has not been compressed, so in the final decompressing, the folder is missing so I don't have the same CRC hash on the whole folder.

I've tried already to set the option --dirs but it doens't work for me (maybe I set it on the wrong position?!). Normally it is enough to compress '*' but it seems not working on your masked script.

Thanks again for your help

[panker1992]

arc.exe a -s12g --cache1024 -maxs -dm0 -di+$ -ep1 -r -ed -i0 -lc- -ld1024 -mt%NUMBER_OF_PROCESSORS% -w./ data1.bin -m{options} "D:\Game\*"




use this for testing and feedback if this helped with the problem :D

[ramazan19833]

Hello utra compression panker1992 games you how do I know ? for the opening and slides back and opens, allowing you to load a setup video in the form of how do I know I can do

[panker1992]

Hello ramazan :)

if you want slices and back ground video in Inno setup you will have to visit razor's
WPI inno setup,

http://fileforums.com/showthread.php?t=96242

and see if there is such kind of support.

[ramazan19833]

games ultra-high jammed in the way we can suggest what I need.

[panker1992]

what do you mean jammed ???


can you post a picture ??

[ramazan19833]

http://i.hizliresim.com/O7B4l5.jpg (http://hizliresim.com/O7B4l5)

[panker1992]

ahaa :)

max payne 3 the best you can compress it is 15.6 gigs

at least from what i have seen (havent tested the title myself )

use -precomp+srep64+rep:512mb+exe2+delta+xz to maximize its compression

or use my masks as an alternative to get better ratio and speed

[ramazan19833]

http://i.hizliresim.com/E5p4gZ.jpg (http://hizliresim.com/E5p4gZ)

[ramazan19833]

I want to prepare the game setup. Help. ( video and picture slide game setup game logo )

[panker1992]

copy all those *.bik files into a folder then download bink_bk2.7z and extract the bink.exe and bik.bat files into that folder as well


run the bik.bat and let it reduce the bik files :D good luck

[1234567890123]

ramazan are you turk? :D me too i can explain what are you want.http://fileforums.com/showthread.php?t=94425 in this script you can use splash video-pic in your setup

(http://fileforums.com/showthread.php?t=94425 burdaki scripte splash video-resim desteği var)

panker19992 i don't like lossy compression.but there is not lossless bik compression.reducing bik quality can't return original bik in the same quality i think in repack there shouldn't lossy compression.rip and repack is different things

[ramazan19833]

panker1992

-precomp+srep64+rep:512mb+exe2+delta+xz

control but have

[ramazan19833]

panker1992
you how Max Payne 3 15.6 Data Compressor

[panker1992]

razaman you can make the game 15.6 gigs if you remove foreign content like french and spanish audio and such and then use

-mprecomp+srep64+rep:800mb+exe2+delta+xz easily

then you can use bik.bat to further reduce the game (this is optional )

@1234567890123 i have reduced my bik bk2 games by around 25 - 30% and there is nothing changed not so much difference that an eye can possibly see, and the reason is that game developers put higher bit rate and higher frames for no reason.


my friend once gave me a copy, probably a year ago with Resident Evil Original Remaster
only to find out that it was 17 gigs with 3 sets of 1080p 720p and 480p
same videos that had 30.000 kbps rate. a typical HD movie has 2.000 kbps maybe 2.500 kbps no more than that :P

[ramazan19833]

panker1992

Max.Payne.3-Black.Box 10.0 gb I don't understand how they do it dropped

[hasandgn34]

panker1992

Max.Payne.3-Black.Box 10.0 gb I don't understand how they do it dropped

videos are LOSSY (yani video kalitesi düşürülmüş)

[panker1992]

Ramazan

they must have re-encoded the bik files, the other repacks i saw was 15.6 something like that

what is the best try you ever made on max payne 3 ??

[RamiroCruzo]

what is the best try you ever made on max payne 3 ??
Mines 9.2 GB...:p:p

[Razor12911]

i've been wanting to raise this question, why are you using srep and rep, one of them is one, rep is only good for anything less than 1gb, but anything above, you start seeing difference is size, secondly, i think rep should be drop out of the method line. Reflate works using 7z.dll, and not 7z.exe, 7z.dll must be 32-bit. Concepts of exe using a dll is the architecture must be the same else errors. Result when using both srep and rep athe same time was bigger by 7kb, and probably compression duration increased as well.

[panker1992]

Razor did it again :D
thanks for this
so 7z.dll 15.5 edition 32 bit should suffice or i can get the copy of 15.14 latest edition ??

i have 7z.exe to extract xz format and lz77 format (as dictated by arc.ini :external compression)

compression duration is not affected by rep:800mb but it uses 1 gig more ram during the entire process :P

so as by now lets call rep obsolete, so the entire rep+exe is skipped or replaced by the universal exe2 or as bulat call it dispack070

[ramazan19833]

panker1992 HELP

arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -mmsc+srep64+rep:512+delta+exe+xz/$bink:zm+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=precomp+msc+srep64+rep:512+delta+exe+lz77 "C:\Max Payne 3\*"

Eror : disk full eror help

[panker1992]

how much ram you have ?? :D

you need to optimize it for your ram post your RAM

and i will do it for you

[ramazan19833]

http://i.hizliresim.com/L1gWVa.jpg (http://hizliresim.com/L1gWVa)

[ramazan19833]

I WOULD THANKS IN ADVANCE

panker1992

[panker1992]

Code :

[External compressor:xz]
header = 0
packcmd = xz a -txz -an -mcrc=0 -m1=lzma2:d600m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d1200m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>


Change these settings in arc.ini and let shine :D hope ti works

[ramazan19833]

@echo off
color 0c
Title Compressor - by Panker1992
echo. ************************************************** ************************
echo. * External Options for Compressor By Panker1992 *
echo. * lzma2=4x4:lzma:a1:mfbt4:d256m:fb273:mc1000:lc8 (alt) *
echo. * Mask1: $jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq *
echo. * Mask2: $precomp=reflate+precomp+msc+srep64+rep:512+delta+ exe+xz *
echo. * Mask3: $bink=zm+zstd *
echo. * Old: $text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m *
echo. ************************************************** ************************
pause
@echo Recompressing Data...
arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=precomp+msc+srep64+rep:512+delta+exe+lz77 "C:\Program Files (x86)\Adobe\*"
echo ************************************************** *****************************
echo.
echo Compressing is Completed
echo.
echo ************************************************** *****************************
pause

http://i.hizliresim.com/W19O7Q.jpg (http://hizliresim.com/W19O7Q)

[ramazan19833]

[External compressor:nz]
;options a) -cc=best -cO=optimal -cDP=fast b) -m6g -nm c) -p3 = cores
packcmd = nz a -cc -m1700m -p2 -t0 -br128m -bw128m -r -v $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m512g -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz

[External compressor:srep64]
;options = l%d (minimal match length, default=512)
header = 0
packcmd = srep64 {options} -m3f -d1g -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep64 -d -s -- <stdin> <stdout>

[External compressor:xz]
header = 0
packcmd = xz a -txz -an -mcrc=0 -m1=lzma2:d600m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:precomp]
header = 0
packcmd = precomp -intense0 -c- -t-j {options} -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:msc]
;Alt: c -v -f Forced //-frog=9 use this instead of -tak=9
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:lzham]
packcmd = lzham -m4 -d29 c $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzham -c d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:reflate]
header = 0
packcmd = reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:zstd]
header = 0
packcmd = zstd -f -8 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = zstd -d -f <stdin> <stdout>

[External compressor:rep,lzma,4x4,delta,exe]

header = 0

packcmd = fazip -i0 compress:{compressor}{:option} <stdin> <stdout>

unpackcmd = fazip -i0 decompress:{compressor}{:option} <stdin> <stdout>


[External compressor:jpg]
mem = 10
packcmd = packjpg -np $$arcdatafile$$.jpg
unpackcmd = packjpg -np $$arcdatafile$$.pjg
datafile = $$arcdatafile$$.jpg
packedfile = $$arcdatafile$$.pjg
solid = 0

[External compressor:zpaq]
;-method s4.3ci1 -method 46,36,26
packcmd = zpaq64.exe a $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -method 46,36,26
unpackcmd = zpaq64.exe x $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -summary
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d1200m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[panker1992]

-mprecomp+msc+srep64+delta+exe+lz77/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz

Use this, its more universal :) Windows 10 i saw above .... hmm i love troubleshooting

[panker1992]

Code :

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d600m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d1200m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>


Change these settings in arc.ini and let shine :D hope ti works


my mistake sorry :P copy this

[ramazan19833]

http://i.hizliresim.com/PP6mDv.jpg (http://hizliresim.com/PP6mDv)
http://i.hizliresim.com/bJMmVY.jpg (http://hizliresim.com/bJMmVY)
http://i.hizliresim.com/or8oVo.jpg (http://hizliresim.com/or8oVo)
http://i.hizliresim.com/nLmZQ1.jpg (http://hizliresim.com/nLmZQ1)

Advanced-Data-Comp.bat

@echo off
color 0c
Title Compressor - by Panker1992
echo. ************************************************** ************************
echo. * External Options for Compressor By Panker1992 *
echo. * lzma2=4x4:lzma:a1:mfbt4:d256m:fb273:mc1000:lc8 (alt) *
echo. * Mask1: $jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq *
echo. * Mask2: $precomp=reflate+precomp+msc+srep64+rep:512+delta+ exe+xz *
echo. * Mask3: $bink=zm+zstd *
echo. * Old: $text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m *
echo. ************************************************** ************************
pause
@echo Recompressing Data...
arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -mmsc+srep64+rep:512+delta+exe+xz/$bink:zm+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=precomp+msc+srep64+rep:512+delta+exe+lz77 "C:\Max Payne 3\*"
echo ************************************************** *****************************
echo.
echo Compressing is Completed
echo.
echo ************************************************** *****************************

arc.ini

[External compressor:nz]
;options a) -cc=best -cO=optimal -cDP=fast b) -m6g -nm c) -p3 = cores
packcmd = nz a -cc -m1700m -p2 -t0 -br128m -bw128m -r -v $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m512g -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz

[External compressor:srep64]
;options = l%d (minimal match length, default=512)
header = 0
packcmd = srep64 {options} -m3f -d1g -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep64 -d -s -- <stdin> <stdout>

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d600m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:precomp]
header = 0
packcmd = precomp -intense0 -c- -t-j {options} -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:msc]
;Alt: c -v -f Forced //-frog=9 use this instead of -tak=9
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:lzham]
packcmd = lzham -m4 -d29 c $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzham -c d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:reflate]
header = 0
packcmd = reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:zstd]
header = 0
packcmd = zstd -f -8 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = zstd -d -f <stdin> <stdout>

[External compressor:rep,lzma,4x4,delta,exe]

header = 0

packcmd = fazip -i0 compress:{compressor}{:option} <stdin> <stdout>

unpackcmd = fazip -i0 decompress:{compressor}{:option} <stdin> <stdout>


[External compressor:jpg]
mem = 10
packcmd = packjpg -np $$arcdatafile$$.jpg
unpackcmd = packjpg -np $$arcdatafile$$.pjg
datafile = $$arcdatafile$$.jpg
packedfile = $$arcdatafile$$.pjg
solid = 0

[External compressor:zpaq]
;-method s4.3ci1 -method 46,36,26
packcmd = zpaq64.exe a $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -method 46,36,26
unpackcmd = zpaq64.exe x $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -summary
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d1200m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[Rahmani1811]

Panker bro getting this error
Genral (de) compreson error in precomp
http://imgur.com/ICiLtV8http://

[panker1992]

Program Version
7z.exe = 15.12
zstd.exe = 4.5
lzham.exe = 1.1
zpaq64.exe = 7.05
srep64.exe = 3.93
zlib1.dll = use precomp 0.38 no errors better compression use zlib1.dll 105 kilobytes edition works flawlessly


This is all thanks to Razor i couldnt have done without him :)

Full Support on all Compressors, except reflate its the only one that doesnt work in inno yet

The image on Background i made it quite some time ago using GIMP
hope you like it.

**** Patch 1 download the new scripts use whatever you wish v0.38 or v4.2 precomp

best choice is 0.38 precomp

**** Patch 2 fixed where it didnt properly show the application and the folder wasnt quoted

**** Ripping Decomp v3 fixed decomp error also removed some exe that are not needed for decomp such as msc.exe and pack*.exe since cls-msc.dll exsists

**** Updated Zstd for Windows added 32bit support, this compressor along with 64 bit one pipeline srep and zstd for fast compression and even faster decomp.





Ladies and Gentlemen because i support and i troubleshoot frequently,
i also update my tools regularly or post updates and solutions as they come up
please consider reading them before double posting same problems over and over

Enjoy :)

Precomp 0.38 Eliminates all errors change from 0.42 please

[Razor12911]

Ladies and Gentlemen because i support and i troubleshoot frequently,
i also update my tools regularly or post updates and solutions as they come up
please consider reading them before double posting same problems over and over

Enjoy :)

Precomp 0.38 Eliminates all errors change from 0.42 please

people should just work with 0.38, 0.40 and 0.43. 0.42 has a tendency of freezing and 0.41 is the black sheep of all.

And reflate does work in inno, it should work.

[panker1992]

And reflate does work in inno, it should work.

Razor i cannot make it work in Inno :(
i have tried all your tools only, your inno setup (WPI).
simply refuses to work
when i RIP games (no Inno) just CMD everything works even your 7z.dll doesnt have to be present to decompress,
can you post us some pictures or anyone that had success with it ??

Thanks in advance

[Razor12911]

rawrest.exe, reflate.exe, 7z.dll (x86) and raw2hif.exe are the files needed for decompression.

[ramazan19833]

http://i.hizliresim.com/JnnDPY.jpg (http://hizliresim.com/JnnDPY)

[panker1992]

[External compressor:precomp]
header = 0
packcmd = precomp -slow -t-j -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

Edit 1) Masked Compression in Action

How to compress Max Payne 3

This all process took 6 hours because of precomp

lzma2 used 8 thread and dictionary size was 100 mb

[ramazan19833]

http://i.hizliresim.com/1MM1EA.jpg (http://hizliresim.com/1MM1EA)

[ramazan19833]

http://s8.dosya.tc/server/yjf9ih/Masked_Data_Compression.rar.html
http://s8.dosya.tc/server/4tkduj/Black_Box_Sentinelk.rar.html

[panker1992]

i am looking into your problem :D
@ramazan i hope i can fix this for you really i even Downloaded and repacked the game just to see if this works and it did for me


Edit1 :

Ramazan the folder was a mess up, all tools inside the folder including packjpg_dll1.dll which was creating the problems

At any Rate a created a new folder with the best combo for Max payne 3 the same one i used for myself as you can see above.

Check back i will post update on Inno setup soon

Edit 2) The setup that you provided man is unreadable at least by my skill at coding :/ so sorry
Though You can always ask most advanced coders and programmers Like Razor who also happened to create the one i provided in this page and Rinaldo who also is very advanced

But to offer proper solution first reduce the game then use the inno i provided and you will be good :)

[panker1992]

What is the method of compression ??
if you compressed with nanozip then you will have to wait for it :D
it takes time, to check if it works open control-alt-delete and see there

please post some pictures about method, tools and ini files so i can help with details

[panker1992]

i only Created that for Max payne 3, Use the original in my main post :P

[ramazan19833]

what I ask of you panker1992 the ultimate Box v. 1 study (Masked Compression you can make it compatible with V2. ?

I sent them a few videos in the works and the slide can you look at whether it is positive desdeg available here

Ultimate Box V.1
http://i.hizliresim.com/or344X.jpg (http://hizliresim.com/or344X)
http://www.dosya.tc/server6/ozjxzp/Ultimate_Box_V.1.rar.html
Dark Blue
http://i.hizliresim.com/RokAO7.jpg (http://hizliresim.com/RokAO7)
http://s6.dosya.tc/server5/e5xrhy/Yeni_klasor.rar.html
Black_Box_Script_By_Kurutucu_V1.8
http://i.hizliresim.com/4brvR4.jpg (http://hizliresim.com/4brvR4)
http://www.dosya.tc/server6/gj8m34/Black_Box_Script_By_Kurutucu_V1.8.rar.html

[ramazan19833]

Thank you so much in advance for your help

[coveiro]

ultimate Box v1

http://s8.dosya.tc/server/txtzgh/Ultimate_Box_V.1.rar.html

:D

[ramazan19833]

Ultimate Box V. 1, Dark Blue, Black_Box_Script_By_Kurutucu_V1.8 the files I gave (compatible masked compression can we make ?

[coveiro]

Ultimate Box V. 1, Dark Blue, Black_Box_Script_By_Kurutucu_V1.8 the files I gave (compatible masked compression can we make ?

Here it works with this compressor

Masked Compression V2 Max Payne Edition (http://fileforums.com/attachment.php?attachmentid=13237&d=1452048224)

[panker1992]

As i said before guys Masked compression project takes place only in compression

thus in decompression nothing is changed, the only thing to make this compatible with everything is arc.ini with all additional programs

i added nz(nanozip) zpaq and lzham xz and zstd :) copy them along with arc.ini inside resources folder for inno and add them inside inno both to #include and extract section :D

Just to be Clear on this one, i gave an Inno support from Razor so if your abilities to modify script is limited please save the trouble and use it instead

[panker1992]

Masked compression Massive Update !!!

this project far exceeded my expectations, i wouldnt have believed that it would make even a scratch but it did.

since you guys give something so do i, with almost 500 downloads i decided to give this project another go but before i go ahead and name the changes,
I will have to thank Razor, Gozarck, Felice, Ramiro and many others that helped, troubleshooted and made inno for this project :)

[B]
Changes Log :

Updates on Inno, Decompression Tool and Masked Compression

1) bug fixes and corrections made on inno

2) all modes tested and working on decompression tool

3) removed zpaq to add nanozip stronger, denser and faster

4) added secondary support on nanozip now you can max compress with it entires games
small note : doesnt show progress on Inno but it decomps successfully :)

5) removed lzham to add lzturbo (aka: lzt) inside. No reason, lzt is nice but needs work with stdin and stdout, i tried to add back in october but it didnt work

6) added Tiny Game Packer Script inside masked compression more of this in main post ( masks precomp msc srep all working flawlessly )

7) precomp 0.42 support is now obsolete, precomp 0.42 is messy program, unstable and at some point unusable half the problems in this threads are from bad precomp management

8) reflate support is dropped as well, reflate as Razor stated 2 days ago
is still under development even at this moment a working cls-reflate.dll doesnt exsist. Inno doesnt support reflate extraction !!
Note: it works flawlessly if you rip games like i do !!



Future Updates:

1) add reflate method in Inno
2) use the new precomp 4.4
3) add stdin and stdout to lzt
4) update bink Re-encoder, fix better menu , also add better options with some kind of help side by side
5) update zstd for windows Compression

[Amsal]

Panker1992, can you continue to give that last in no, which look like blackbox, I don't like WPI, and there are some people who also don't like, so can you please give me the in no which look like blackbox and which is supporting the updates you have done in the compression etc.

[panker1992]

Of course i can :D

I will Upload it right away give me 5 minutes !!!



i am preparing to release something new again

It's very experimental but i like it :)


Edit 1 ) black box inno is up

i did it in haste let me know if it works :D

[Amsal]

Of course i can :D

I will Upload it right away give me 5 minutes !!!


i am preparing to release something new again

It's very experimental but i like it :)


Edit 1 ) black box inno is up

i did it in haste let me know if it works :D

Bro, just asking, can you make any script compatible with this.

And one suggestion - add the code on first page/post for the ram 4gb(I have this one), 6gb, 8gb for arc.ini

[panker1992]

Sorry as i said before i am not Inno Expert

i didnt make any of the Inno that i provided actually Razor did WPI and Kurutucu did the one you asked for.

i can only make some modifications :/

Rinaldo and Razor are Script Experts, You can ask them

although the scripts support my masked compression


I will upload arc.ini with 4 8 12 and 16 gigs of ram so no worries :D

[Amsal]

Sorry as i said before i am not Inno Expert

i didnt make any of the Inno that i provided actually Razor did WPI and Kurutucu did the one you asked for.

i can only make some modifications :/

Rinaldo and Razor are Script Experts, You can ask them

although the scripts support my masked compression


I will upload arc.ini with 4 8 12 and 16 gigs of ram so no worries :D

Bro, is the inno v3 and black box v2 are same?

[panker1992]

yeah they are the same although download the newest ones just to be sure

the ones i uploaded today because i have uploaded updates on masked compression download everything new you see

just to make sure you are compatible to every tool :D



There goes the ini files with all optimizations

[Amsal]

yeah they are the same although download the newest ones just to be sure

the ones i uploaded today because i have uploaded updates on masked compression download everything new you see

just to make sure you are compatible to every tool :D



There goes the ini files with all optimizations

I have to replace the arc.ini to the masked compression method right?

[panker1992]

i have uploaded ram optimizations, check on them above

the files i provide are optimized for 12 gigs of ram so

the error you get is ram related !!

[panker1992]

you need to rename 4.ini ~> arc.ini

ahaa so a freearc remains, its from nanozip text compression, if it annoys you much you can dispose of it

test either $text=nz without srep and rep or replace nz entirely with txtold although you will get worse compression

in either case its your choice :)


Solved by using nz alone

so here it is $text=srep+rep:77mb+nz gets replaced by $text=nz positive is that ratio with nz alone is better so :)

[ramazan19833]

Masked Compression (Ultimate compression

http://i.hizliresim.com/4bllPY.jpg (http://hizliresim.com/4bllPY)
COMPUTER SPECIFICATIONS
http://i.hizliresim.com/7MvvDm.jpg (http://hizliresim.com/7MvvDm)

arc.ini

[Compression methods]
; For Tiny SFX usage, dont use anything else other than that !!!
sfx = msc+srep+delta+exe2+4x4:lzma:max/$text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m
smartsfx = msc+srep+delta+exe2+4x4:lzma:max/$text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m/$precomp=precomp+msc+srep+delta+exe2+4x4:lzma:max
lzma2 = 4x4:lzma:a1:mfbt4:d256m:fb273:mc1000:lc8
oldtxt = dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12:192m
; For Masked Compression Usage
legacy = msc+srep+delta+exe2+lzma
max = precomp:zl98:d1+msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
optimal = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
sonido = msc+srep64+delta+exe2+zstd/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
smartmax = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz/$precomp=precomp:zl98:d1+msc+srep64+delta+lz77
smartlzt = msc+srep64+delta+exe2+lzt/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz/$precomp=precomp:zl98:d1+msc+srep64+delta+lzt
devastate = precomp:zl98:d1+msc+srep64+delta+exe2+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
; if you want to add them for custom usage
txt = srep64+nz
void = srep64+zstd
jpeg = jpg+zstd

[External compressor:srep]
header = 0
packcmd = srep -m3f -a1 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep -d -s -- <stdin> <stdout>

[External compressor:srep64]
header = 0
packcmd = srep64 {options} -m3f -d1g -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep64 -d -s -- <stdin> <stdout>

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d450m:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:precomp]
header = 0
packcmd = precomp -slow -t-j -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:reflate]
header = 0
packcmd = reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:zstd]
header = 0
packcmd = zstd -f -9 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = zstd -d -f <stdin> <stdout>

[External compressor:rep,lzma,4x4,delta,exe]

header = 0

packcmd = fazip -i0 compress:{compressor}{:option} <stdin> <stdout>

unpackcmd = fazip -i0 decompress:{compressor}{:option} <stdin> <stdout>


[External compressor:jpg]
mem = 10
packcmd = packjpg -np $$arcdatafile$$.jpg
unpackcmd = packjpg -np $$arcdatafile$$.pjg
datafile = $$arcdatafile$$.jpg
packedfile = $$arcdatafile$$.pjg
solid = 0

[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d900m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

[External compressor:msc]
;Alt: c -v -f Forced //-frog=9 use this instead of -tak=9
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:nz]
;options -cc=best -m3g=memory -nm
packcmd = nz a -r -v -cc -m3g -br128m -bw128m -p2 -t0 -nm $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m1400m -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz

[External compressor:lzt]
;x64 version ;fast: -32 ;max:-p1 -49 -b200
packcmd = lzt -p1 -49 -b200 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzt -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:nzmax]
;options -cc=best CM algo -m3g=memory -nm ; -cO fast option BWT algo
packcmd = nz a -r -v -cc -m8g -br128m -bw128m -p4 -t0 -nm $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m1400m -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz

[panker1992]

it only appears in windows 10 guys, i have no problems in windows 8.1

ramazan and lolaya both your windows 10 produce this error

test method -mmax or reverse exe2 and delta experiment with this i dont have windows 10 to try :(


Edit 1) there you go it works perfectly ....... what are you doing wrong ?

edit 2) Both of you and windows 10 user try devastate just to clarify if this works

[ramazan19833]

I have a great interest in their work panker1992 in the work that I'm trying to follow the forum who is in a lot of Labor and help you the friends who I owe a debt of thanks to updates and future updates that you're giving a place in gelek: I'm interested to know when Deni....

1) Add a method in the related Inno
2) use the new building the meta-DTD 4.4
3) add the string to stdout and lzt
4) update the bin Re-encoder, fix better menu , better options with the help of some kind should also add side by side
5) update for Windows zstd Compression

[panker1992]

windows defender makes this problem ??



good to know

[panker1992]

generally windows defender is useless, self compiled programs are scanned and killed


programs i have compiled myself
7z.exe and reduced version
zstd
packjpg
lz77 custom version
lzham
maybe more

most of them are found inside my compression pack
so no wonder that is doent work :/

small bug fix, extract this to the v2 folder and replace precomp.exe

edit update 1 moved to main post :)

[ramazan19833]

Hello,Help

http://i.hizliresim.com/knvW6m.jpg (http://hizliresim.com/knvW6m)

Mask Data Compression

@echo off
color 0c
Title Compressor - by Panker1992
echo. ************************************************** ************************
echo. * External Options for Compressor By Panker1992 *
echo. * Modes: Options stored in arc.ini see below for best results *
echo. * 1) sonido =super fast, optimal =best w/o precomp, max =optimal+precomp *
echo. * smartmax =masked precomp, smartlzt =smartmax + lzt, legacy =oldmethod *
echo. * devastate = heavy duty comp, will take so much time you will freak *
echo. * 2) I added txt, void and jpeg as external for custom made bat files *
echo. ************************************************** ************************
pause
@echo Recompressing Data...
arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -moptimal "C:\Program Files (x86)\Adobe\*"
::examples, I recommend optimal and smartmax for ultimate results
::devastate has ultimate compression but its so slow that its best only when you store long term
::arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -msonido "D:\Games\Steam\*"
::arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -msmartmax "D:\Games\Steam\*"
::arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -mdevastate "D:\Games\Steam\*"
::arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -mlegacy "D:\Games\Steam\*"
echo ************************************************** *****************************
echo.
echo Compressing is Completed
echo.
echo ************************************************** *****************************
pause


MainScriptEnglish.iss
arc.ini

[External compressor:reflate]
header = 0
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:lz77]
header = 0
unpackcmd = lz77 d -si -so <stdin> <stdout>
[External compressor:precomp]
header = 0
packcmd = precomp -intense0 -c- {options} -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:srep]
header = 0
packcmd = srep {options} -m3f -d1g -a2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = srep {options} -d -s - - <stdin> <stdout>

[External compressor:lzmh]
packcmd = 7z.exe a -t7z -mcrc=0 -m0=bcj2 -m1=lzmh:{option}:fb256 -mx $$arcpackedfile$$.7z $$arcdatafile$$.dll
unpackcmd = 7z.exe x -y $$arcpackedfile$$.7z $$arcdatafile$$.dll
packedfile = $$arcpackedfile$$.7z
datafile = $$arcdatafile$$.dll

[External compressor:7z]
packcmd = 7z.exe a -t7z -mcrc=0 -m0=bcj2 -m1=lzma:fb256 -mx9 $$arcpackedfile$$.7z $$arcdatafile$$.dll
unpackcmd = 7z.exe x -y $$arcpackedfile$$.7z $$arcdatafile$$.dll
packedfile = $$arcpackedfile$$.7z
datafile = $$arcdatafile$$.dll

[External compressor:bcj2]
packcmd = 7z.exe a -mcrc=0 -m0=bcj2 $$arcpackedfile$$.7z $$arcdatafile$$.dll
unpackcmd = 7z.exe x -y $$arcpackedfile$$.7z $$arcdatafile$$.dll
packedfile = $$arcpackedfile$$.7z
datafile = $$arcdatafile$$.dll


[External compressor:rar]
;-m5:1024
;-md512m
cmem = 130
dmem = 130
default=32
packcmd = rar a -s -m5 -ma5 -md1024m -mt4 $$arcpackedfile$$.tmp.rar $$arcdatafile$$.tmp
unpackcmd = rar e -mt4 $$arcpackedfile$$.tmp.rar
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.rar

[External compressor:packet]
;x64 version
packcmd = packet.exe a -v -r -mx -b512 -h4 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
unpackcmd = packet.exe x -v $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:split]
;x64 version
packcmd = split.exe s $$arcpackedfile$$.tmp 1024 $$arcdatafile$$.tmp
unpackcmd = split.exe m $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:zm]

packcmd = zmolly64.exe -b99 -e $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = zmolly64.exe -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:plzma]
;x64 version
packcmd = plzma c2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp 26 1024 273 8 0 0 4096 128 16 272
unpackcmd = plzma d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:bssc]
;x64 version
packcmd = bssc.exe e $$arcdatafile$$.tmp $$arcpackedfile$$.tmp -b1024aeflzrs
unpackcmd = bssc.exe d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:rzm]
;x64 version
packcmd = rzm.exe c $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = rzm.exe d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:smoke]
;x64 version
packcmd = smoke.exe $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:pause]
;x64 version
packcmd = cmd.exe "type exit and press ENTER please"

[External compressor:cls]
;x64 version
packcmd = start /b cmd.exe cls


[External compressor:lzturbo]
;x64 version
packcmd = lzturbo {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzturbo -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp


[External compressor:exdupe]
;x64 version
packcmd = exdupe.exe -x0 -m512 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = exdupe.exe -R $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:zpaq]
;-method s4.3ci1
;x64 version
packcmd = zpaq64.exe a $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -method 46,36,26
unpackcmd = zpaq64.exe x $$arcpackedfile$$.tmp $$arcdatafile$$.tmp -summary
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:xdelta3]
;x64 version
;-S djw9
packcmd = xdelta3.exe -0 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = xdelta3.exe -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:bro]
;brotli google compressor
packcmd = bro.exe -q 9 -v -f -i $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp
unpackcmd = bro.exe -d -i $$arcpackedfile$$.tmp -o $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp


[External compressor:zh]
;x64 version
packcmd = zhuff.exe -c2t2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = zhuff.exe -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

[External compressor:nz]
;x64 version
packcmd = nz.exe a -r -v -cc -m512m -t0 -br128m -bw128m -p2 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz.exe x -m256m -t0 -p4 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz

http://www.dosya.tc/server6/npl0gb/Dark_Blue.rar.html

[panker1992]

razaman i didnt provide the above files, i have uploaded a blackbox Inno in page 1 for you to download

i cannot rewrite this sorry :/ no time

[Amsal]

I am stuck from 1 day in MSC, Panker1992 can you tell the solution for this? I am repacking SIMS 4 game!
http://i.imgur.com/zI6Azdc.png

[panker1992]

my first impression is that you have -f switch inside arc.ini

-f switch is no limit on input size
then msc tries to compress something very big and fails

try to disable the command

here is the correct one
[External compressor:msc]
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

if this doent solve the case then disable msc and leave everything else alone to do the job :D

i havent tested sims myself, and i am not the author of msc
Though i hope Shegorat will make a new msc sometime in the future :)

[Amsal]

my first impression is that you have -f switch inside arc.ini

-f switch is no limit on input size
then msc tries to compress something very big and fails

try to disable the command

here is the correct one
[External compressor:msc]
header = 0
packcmd = MSC c -v -wav=1 -raw=1 -bmp=1 -ddsraw=1 -ddsdxt=1 -mp3=1 -bmf=9s -tak=9 -dxt=1 -lzma=hc4,lc8,lp2,pb2,fb273,mc1000 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

if this doent solve the case then disable msc and leave everything else alone to do the job :D

i havent tested sims myself, and i am not the author of msc
Though i hope Shegorat will make a new msc sometime in the future :)

It is still stuck there after doing this modification

[panker1992]

I am constantly asked about MSC problems, so i decided to give some kind of guide ( troubleshooting) !!!!


First things first i am not the author of msc , nor i can make it magically work
many of these programs arent easy to use on Windows 10 especially !!

I myself have tested windows 10 and i had many errors/warnings etc so i had to roll back to win 8.1 !!! :cool:

From here on I will not help/troubleshoot anything that i havent provided,
there are people here that ask for help with tools and methods that someone else has provided,

Here is a troubleshooting guide, Do those before you decide to post an error!!

1) disable all kinds of antivirus
2) disable the -f switch in msc if you have it on
3) windows defender reported to be delivering many errors on precomp, xz , and msc disable it for good and forget that it ever excisted
4)when a method gives an error, try a different approach

5) Do not by any means mix tools together, from different methods the only sure is that it will break
every author has different approach if you mix them all together it will never work

[truerepacks]

latest version of msc can't use bmf compression, even cls-msc.dll can't extract it
for more information visit http://krinkels.org/threads/msc-media-streams-compressor.1587/

[panker1992]

truerepacks thanks for this info ....

unfortunately i dont speak russian nor i can read or understand them,

krinkels.org is a treasure forum in which i cannot participate

please if you have info regarding msc or any other tool that is used inform us like you did just now

[panker1992]

lolaya this sovles your problem ....


remove msc until we get an update on this , i hope in 2016 Shegorat will give us a new one

about your other problem i have found a nice alternative

use lzma:max:512m

this will give you about the same compress ratio as my method xz and lz77 but its gonna be so slow.

xz method uses 4 cores as i have provided making it super fast (lzma2)


post some feedback to let me know if lzma:max:512m worked !!!

[hans314]

Dear Panker,

are you going to update your Masked Data Compression tool with the new Precomp 0.44 version (decomp as well)? I am wondering if there is a better performance + ratio

[panker1992]

Hello Hans,

I will update it in time, i properly havent tested it myself yet.

Christian the author of precomp is working on Multithreaded bruteforce to make this process faster,

Now to make this clear, precomp 0.44 doesnt support stdin to stdout support
until a proper stdin and stdout are implemented, or a cls-precomp.dll is written
i will stay with 0.38 because its faster.

Up untill now i havent seen any improvements on precomp, my tests took the same time with 0.38 and 0.44.

if you want to update your tools you will have to
1) download my alpha precomp i posted it.
2) delete old precomp.exe and packjpg_dll.dll and copy-paste new
3) change the line in arc.ini from -slow -t-j ~~~> -intense0 -cn

Inno changes are
1) delete precomp.exe both packjpg_dll.dll and packjpg_dll1.dll and cls-precomp.dll
2) copy paste new precomp and leave arc.ini as it is :) it will work

NOTE:Due to the lack of proper stdin - stdout and cls-precomp.dll it will never show progress in Inno, and will take x2 time to unpack

Good luck :)

[Amsal]

And panker, give a new arc.ini for 4gb ram,6gb ram, 8gb ram, because you added update 1, which will change the arc.ini, so upload the arc.ini for 4gb ram, 6gb ram, 8gb ram AGAIN!

Do it fast as possible

[panker1992]

And panker, give a new arc.ini for 4gb ram,6gb ram, 8gb ram, because you added update 1, which will change the arc.ini, so upload the arc.ini for 4gb ram, 6gb ram, 8gb ram AGAIN!

Do it fast as possible

Just like lightning, i strike again :P .. . . . . . just kidding


New arc.ini for 8G of ram, 12G and 16G

Best optimizations for those ram

i decided to drop 4G ram support because it doesnt worth it,
i dont think that anyone has 4G of ram !!!

you will not find a 12G.7z because i have 12G of ram so it comes optimized for it.

enjoy :)

[Amsal]

Just like lightning, i strike again :P .. . . . . . just kidding


New arc.ini for 8G of ram, 12G and 16G

Best optimizations for those ram

i decided to drop 4G ram support because it doesnt worth it,
i dont think that anyone has 4G of ram !!!

you will not find a 12G.7z because i have 12G of ram so it comes optimized for it.

enjoy :)

Bro, I has 4gb ram, and in other pc 6gb ram, so please please upload that!

[panker1992]

i will write you for 6G ram :)

your 4G pc will most likely crash :(

lzt(lzturbo) uses minimum 5G

it's up and running

6G ram added per requested :)

anything less than that will freeze, and probably crash your pc to death :(

[Amsal]

http://i.imgur.com/41o2OU7.png?1
http://i.imgur.com/9cDpn3H.png?1

VirtualAlloc failed!

Please tell me a solution for it

[panker1992]

Not enough ram amsal :(

this is error related to not enough ram to allocate :(

let me see if i can lower a bit more ram allocation will post in few minutes

edit

[External compressor:lzt]
;x64 version ;fast: -32 ;max:-p1 -49 -b200
packcmd = lzt -32 -b200 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzt -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

@Amsal

lzt doesnt have a direct memory allocation limitation
try this here

and wish for success

[Amsal]

Not enough ram amsal :(

this is error related to not enough ram to allocate :(

let me see if i can lower a bit more ram allocation will post in few minutes

edit

[External compressor:lzt]
;x64 version ;fast: -32 ;max:-p1 -49 -b200
packcmd = lzt -32 -b200 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = lzt -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp

@Amsal

lzt doesnt have a direct memory allocation limitation
try this here

and wish for success

Bro, thanks a lot, it works now THANKS THANKS!! bro, also change this update to the 6G arc.ini, which you uploaded on first page

[panker1992]

i will try to test this, a bit more before i post it on 6G ram

lzt is hard program to control, due to not having direct memory allocation control like lzma and lzma2 and nanozip

[felice2011]

Hey Panker, as always it is discriminated those under of 4GB of RAM...:(:o:D
If you want to test your masks quickly and work with white gloves, I can send you in private, something useful preview, still under development, I need some consulting on your part before you finish the job..;)
I also intend to to give the possibility of choosing quickly in choosing the quantity of RAM to be used during compression (4,8,12,16 and 32gb) instead of modifying the ini file manually.
Something like this..

http://i65.tinypic.com/34tbg54.png

But you need a few days to finish the demo.:)

[panker1992]

i always try to optimize for all ram systems, problem is that some programs refuse to work especially the closed source x64 bit lzturbo :(


Send me the review :D I like the colour already

i will help you as best as i can

rep:512m is obsolete, no need to be used razor kindly explained why :)

zpaq is replaced by nanozip due to better handling on text files, i can always recompile zpaq to test it of course also nanozip uses less ram, 4G ram users can compress with nanozip easily

[hans314]

@Panker, thanks for your feedback, I will wait and hope that there will be a multithreaded precomp (would be really great!).

@Felice: Your creating tool looks quite cool, a lot of possible options integrated

Please both keep up your good work!

[panker1992]

precomp 0.45 is on the way


trying to figure it and optimize this

it brings packmp3 to the table lossless audio on a very low API :)


i optimized packmp3.exe quite some time ago it was 13% faster than the original

lets see time will tell

[felice2011]

i always try to optimize for all ram systems, problem is that some programs refuse to work especially the closed source x64 bit lzturbo :(


Send me the review :D I like the colour already

i will help you as best as i can

rep:512m is obsolete, no need to be used razor kindly explained why :)

zpaq is replaced by nanozip due to better handling on text files, i can always recompile zpaq to test it of course also nanozip uses less ram, 4G ram users can compress with nanozip easily

Ok when it's finished you can to test the preview, you tell me if you remove, add or change something.;)

[panker1992]

dont worry :)

You will get a log fully detailed

also you will get
packjpg.exe my new optimized x64 bit version
zstd new optimized version
precomp 0.44 alpha and if i manage precomp 0.45 beta with low api mp3 recompression

[Rahmani1811]

panker bro how to solve this
http://i.imgur.com/pXIKwJt.png

[panker1992]

[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d27:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=on -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

used value instead of memory allocation || and changed multithread to automatic

test and feedback please :)

[coveiro]

this configuration still get the same error that always xz,

[panker1992]

this is ram related problem :/

what version of 7z.exe and 7z.dll you use ??




edit) added a 7z.exe reduced that will do the job ;)

feedback if tha tsolved it

[coveiro]

this is ram related problem :/

what version of 7z.exe and 7z.dll you use ??




edit) added a 7z.exe reduced that will do the job ;)

feedback if tha tsolved it


Worked here, thank you :D

[panker1992]

so the 7z.exe 15.14 version was causing the fuss :/

ok so now i know the problem, i will either post 15.12 or replace with this reduced format i gave you

will see how this behaves

[Amsal]

Now, help me bro, I am running on 6gb ram, and I got this error while unpacking with decompress tools! And bro, one more request, how can I disable packJPG of precomp in the masked compression?

http://i.imgur.com/MmkxU4L.png?1

[panker1992]

if you use my tools for decompression then edit arc.ini

and leave only the options you have used for compression

and for precomp you can use the witch -t-j after -intense0

precomp -intense0 -t-j .......... rest leave it as it is

[panker1992]

New updates on Zstd compressor for Windows

i am working on bink updates right now so stay tuned :)

[ramazan19833]

Zstd_Ultra_Compressor / how to use can you describe it ?

[panker1992]

install the program

then go to a file or folder

right click and press compress using zstd :)

there you go :) very very easy

right now i have a bink.bat that is 50 lines code :P will be epic

Teaser :)

New bink and bk2 bat will be able to use efficient your cpu

smart headroom to be used showing the number of files to be processd and curently processing

featuring a smart crop system to perform smart resize and upscaling to 1080p

eye lossless as i call it :) stay tuned

[Amsal]

Bro, I repack on LINUX os UBUNTU, and I doesn't have C: drive, so can you give me how to use it on desktop, and bro can you give me a tutorial of repacking with bink?
Desktop Path - /home/DARCK/Desktop
Thanks in advance

[ramazan19833]

panker1992

brother have a very strong code that you think ?
The more powerful do you have one ?

-mprecomp:precomp+msc+srep64+delta+exe2+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+rep:77mb+nz

[felice2011]

I await confirmation from Panker, I tested various forms of data files of approximately 200mb

Pre-Standard = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq

Pre-Optimal = msc+srep64+delta+exe2+lzt/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+rep:77mb+nz/$precomp=precomp+msc+srep64+delta+lzt

Pre-Max = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz/$precomp=precomp+msc+srep64+delta+lz77

OR = msc+srep64+delta+exe2+zstd/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz

Pre-Strong = precomp+msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz

Pre-Ultra = reflate+msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz

Pre-Devastate = precomp+msc+srep64+delta+exe2+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz

The masks will be inserted in pre-configuration of the new "M_S_Kompressor"

[panker1992]

good evening everybody :)

@Amsal i repack in arch linux most of the time

here are the steps that need to do
1) create a folder with the name "pack"
2) then change this line
arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -moptimal "pack\*"

also there is no BINK repacking, bink.bat and bk2.bat take video and re-encode it to minimize it's size, you can read the "readme.log" i have put inside all details are there

@Razaman the strongest compression you can find is inside my tools named "devastate"

but there are 2 problems to fix with this method: doesnt show progress on Inno setup
and it leaves a temporary folder then it finishes its compression i may change this with zpaq.exe i am testing how this will go and update my tools in a few days :D


@Felice i made some corrections that fix many bugs

1) removed "pre-" as it may cause arc not being able to find it,

Fast = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz//$precomp=msc+srep64+delta+zstd
Notes-Fast: This will only heavily compress compresible data, without low api precompression, This is entirely based on speed

Standard = msc+srep64+delta+exe2+lzt/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz/$precomp=precomp+msc+srep64+delta+lzt
Notes-Standard: Only corrected text format, left lzt untouched :) i like lzt too


Optimal = msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+nz/$precomp=precomp+msc+srep64+delta+lz77
Notes-Optimal : renamed this as now optimal is masked precomp, will become even better with up coming precomp0.45

{removed max entirely, you dont really need max strong ultra and devastate people will get comfused with so many ultimate ultra ...etc etc } :P

Strong = precomp+msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
Notes-Strong: left as it is really innovate precomp will run on all data regardless

Ultra = reflate+msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
Notes-Ultra: really like this one left as it is ....does inno + reflate really work for you ??

Devastate = precomp+msc+srep64+delta+exe2+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz
Notes-Devastate : i am working on this method it does have some issues like it leaves a temp folder .... really pain ... need to see how i can fix this

[felice2011]

1) removed "pre-" as it may cause arc not being able to find it
The "pre-" is just a Title, was for pre-configuration, so that the user has a configuration ready, and not trying to break with with multiple algorithms, does not affect the command line arc.;)
Notes-Ultra: really like this one left as it is ....does inno + reflate really work for you ??
Reflate is an excellent data compressor, use not only for games but also for other types of data compression, do not use, and does not exist, only "inno" as decompressor and installer, but other types of custom installers, so I think that the support must stay:)

I test various masks that you posted, thank you.:D

[Amsal]

Panker1992, whenever I install repack, then the installation completes fine, but then when I go to the game directory, then there are extra temp folder like freearc1656238312.tmp, so can you tell me how to delete them, or tell me the fix of that, I use -smartlzt for repacking

[panker1992]

TEST SAMPLE 1 = 100mb of random Photos

Precomp 0.45 x86 optimized build
Install Started - 14:44:37.31
Install Finished - 14:45:42.12
Total = 65 seconds
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Precomp 0.45 x64 optimized build
Install Started - 14:46:38.97
Install Finished - 14:47:38.42
Total = 60 seconds

Approx speed comparison x64 was 9,2% faster :)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Precomp 0.44 original Build
Install Started - 14:50:05.75
Install Finished - 14:51:09.70
Total = 64 seconds

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
TEST SAMPLE 1 = 115mb of 7z files
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Precomp 0.44 original Build
Install Started - 14:54:18.04
Install Finished - 14:55:01.72
Total = 43 seconds
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Precomp 0.45 x64 optimized build
Install Started - 14:55:59.44
Install Finished - 14:56:42.13
Total = 43 seconds
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Precomp 0.45 x86 optimized build
Install Started - 14:59:31.22
Install Finished - 15:00:15.10
Total = 44 seconds

Seems we have a winer :D

Method used was same on those 2 test samples, -mprecomp+srep+xz

i made this for you Felice :D please read this carefully and let me know what you think

i had some time today so i tested the precomp 0.45

[panker1992]

@Amsal

the folder is there because you need to change

this

$text=nz

if you this one

$text=srep64+rep:100+nz it leaves a folder of trash :(

[Amsal]

@Amsal

the folder is there because you need to change

this

$text=nz

if you this one

$text=srep64+rep:100+nz it leaves a folder of trash :(

Sorry bro, i use only nz, and bro, listen me clearly, when I install game with blacbox v2, then it install install fine, but when I go to the install directory then I see tmp folder like this free23423532.tmp folder. So please tell me the fix of this

[panker1992]

you can replace nz with similar very nice method

replace
$text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m

and free329049309 will vanish :D

[Amsal]

you can replace nz with similar very nice method

replace
$text=dict:p:128m+lzp:64m:105:d1m:s32:h22+ppmd:12: 192m

and free329049309 will vanish :D

So, i have to repack again

[felice2011]

Great speed tests between "044" and "045" optimized, but the compression ratio remains the same?

[Amsal]

good evening everybody :)

@Amsal i repack in arch linux most of the time

here are the steps that need to do
1) create a folder with the name "pack"
2) then change this line
arc a -lc1024 -ld1024 -ep1 -ed -r -hp -pYourpassword -w.\ Data\data1.bin -moptimal "pack\*"


Bro, I mean that, can you give me tutorial for using bik and bk2 on ubuntu desktop? Because in my ubuntu, there is no D:/ drive. So, i want to use bink, on the desktop!

[panker1992]

what game is it ?

i will give you optimals :D and yes repack again, since nz leaves trash behind i may have to switch to something more bugless

nanozip is no longer supported, its source is closed and i can do nothing about it

i think that zpaq may be on the menu again :)

[panker1992]

Great speed tests between "044" and "045" optimized, but the compression ratio remains the same?
Yes. Ratio is the same

That is why I didn't post a ratio test yet

But all in good time :)

[Amsal]

what game is it ?

i will give you optimals :D and yes repack again, since nz leaves trash behind i may have to switch to something more bugless

nanozip is no longer supported, its source is closed and i can do nothing about it

i think that zpaq may be on the menu again :)

It is Mortal Kombat X with update 20, can you tell me the optimals, and can you tell me some tips/tricks to detect the optimals for the specific games?

[panker1992]

i havent tested mortal kombat myself but , try smartmax

and change the text format from nz to the one i provided in my last post

it will perform best, at least this is what i would do if i were you :)

[Amsal]

i havent tested mortal kombat myself but , try smartmax

and change the text format from nz to the one i provided in my last post

it will perform best, at least this is what i would do if i were you :)

Okay, I will try that, and bro, almost 9 out 10 times, the msc stuck on the different types of games repacking, so can you tell me the optimal setting for the msc!

[panker1992]

from what i have read msc isnt being maintained anymore

and also i read that it has problems on a 2010 un-maintained bmf format

if you see fit or if you dont care about it disable it :)

[Amsal]

i havent tested mortal kombat myself but , try smartmax

and change the text format from nz to the one i provided in my last post

it will perform best, at least this is what i would do if i were you :)

Thanks bro, it is fixed now! now no freearc32543534.tmp and it's folder are created after the installation! And bro, there is one more thing I want to tell you, about 13gb are movies in Mortal Kombat X and they all are of format .bk2, but when I try to encode from your Bink technique, then it open and after clicking enter, it close in 3~4 seconds and there is no size difference also. I am running on Ubuntu 14.04 LTS 64bit with 6gb ram and it has only 1 drive partition(there is no C: drive)

[1234567890123]

I'm waiting masked comp. v3 impatiently

[panker1992]

@Amsal my bink Re-encoding isnt made for linux ....

i am arch linux user myself :D i can share my work with you , because i compile programs for linux environment too, i will make a bink re-encoding for linux too soon


for example i have zpaq, lz4, lz5, zstd precomp 0.45 on linux natively
but at the moment linux will have to wait because i work on new project :)


now as for masked compression v3

there is one thing that bothers me, unless Razor decides to help we will have a huge problem

i have contacted Christian the author of precomp for tak, Wav sound lossless codec
to be implemented on precomp

the problem is this : there is no stdout support on precomp .... and neither a working cls-precomp.dll

this causes a real problem, decompression will take twice the amount of time to decomp

and progress bar on inno will never work .....

[ramazan19833]

Originally Posted by ramazan19833
I send you the file to make it compatible compression ultimate masked getirer do you know that ? and ,also Data1.bin,Data2.bin,Data3.Data4 thousand.bin,Data5.bin,Data6.only data1.bin files.bin and loads of others to see please don't know, I would ask your help

http://s8.dosya.tc/server/vww0tv/Ultimate_Game.rar.html
i will try to make this compatible, give me a day or 2 and i will send you back !!!

[panker1992]

Razaman ....
imagine 500 people sending files to me to optimize for them ....
i provided a tool and 2 Inno setups to support it along with a "Decomp Tool"
i cannot forever optimize all source codes that are sent to me,

please give me time to respond, i work on several projects , have a job , and i optimize and troubleshoot for everyone here

I have posted before that I will not ever again optimize someone else's code and i mean it

I can see that you have everything mixed up again :(

[Amsal]

@Amsal my bink Re-encoding isnt made for linux ....

i am arch linux user myself :D i can share my work with you , because i compile programs for linux environment too, i will make a bink re-encoding for linux too soon


for example i have zpaq, lz4, lz5, zstd precomp 0.45 on linux natively
but at the moment linux will have to wait because i work on new project :)


now as for masked compression v3

there is one thing that bothers me, unless Razor decides to help we will have a huge problem

i have contacted Christian the author of precomp for tak, Wav sound lossless codec
to be implemented on precomp

the problem is this : there is no stdout support on precomp .... and neither a working cls-precomp.dll

this causes a real problem, decompression will take twice the amount of time to decomp

and progress bar on inno will never work .....

Okay, thanks for the reply

[Amsal]

Razaman ....
imagine 500 people sending files to me to optimize for them ....
i provided a tool and 2 Inno setups to support it along with a "Decomp Tool"
i cannot forever optimize all source codes that are sent to me,

please give me time to respond, i work on several projects , have a job , and i optimize and troubleshoot for everyone here

I have posted before that I will not ever again optimize someone else's code and i mean it

I can see that you have everything mixed up again :(

Panker1992, if you are tired, then you can forward the private messages to me, I will do that, even I done that with my script also, and now it support! So if you need help of optimizing inno then you can contact me!

[panker1992]

Greet Masked Compression v 2.1

many bugs fixes and new updates and optimizations
pacckjpg.exe, zstd

also i rewrote the front page, people should read that first before posting

@Amsal

personally i try to help everyone, but i cannot optimize every inno that i receive
i simply dont have soooo much time do that
can you help your friend razaman with his work ?? he needs to optimize the script

[Amsal]

Greet Masked Compression v 2.1

many bugs fixes and new updates and optimizations
pacckjpg.exe, zstd

also i rewrote the front page, people should read that first before posting

@Amsal

personally i try to help everyone, but i cannot optimize every inno that i receive
i simply dont have soooo much time do that
can you help your friend razaman with his work ?? he needs to optimize the script

Bro, can you upload new 6G,8G,12G,16G ram optimization, because I seen that The arc.ini is a lot different from the ram optimization. So upload new one!

[panker1992]

aaa yes :D i forgot to change that

give me 2 minutes :)


its ok now , ram optimals are working again

[Amsal]

Now bro, can you tell me which method is best for repacking

[panker1992]

strong or ultra :D

refl8 and devastate are both BETA
do not attempt to use for generic usage just yet :)

i have 2 methods for fast
optimal and 2 ultra ones

and 2 BETA refl8 and devastate are not for public yet

[Amsal]

And bro, when you have time, tell me please which is the best compression algo for the Mortal Kombat X with update 20

[Razor12911]

@Amsal my bink Re-encoding isnt made for linux ....

i am arch linux user myself :D i can share my work with you , because i compile programs for linux environment too, i will make a bink re-encoding for linux too soon


for example i have zpaq, lz4, lz5, zstd precomp 0.45 on linux natively
but at the moment linux will have to wait because i work on new project :)


now as for masked compression v3

there is one thing that bothers me, unless Razor decides to help we will have a huge problem

i have contacted Christian the author of precomp for tak, Wav sound lossless codec
to be implemented on precomp

the problem is this : there is no stdout support on precomp .... and neither a working cls-precomp.dll

this causes a real problem, decompression will take twice the amount of time to decomp

and progress bar on inno will never work .....

What is it bro?

[panker1992]

Razor bro,

here you are this is a cls-test.dll

its included inside freearc, for cls.dll tutorial

i am sending you also precomp 0.45 code along with a exe file
can you help with cls-precomp.dll

cls-precomp.dll can be in delphi ~~~~~ because you speak delphi

[romulus_ut3]

No love for 4G ram users?

[panker1992]

No love for 4G ram users?


your pc will die :P

but you can change the parameters in arc.ini

nanozip there a memory limiter where is says memory instead of 2g replace with 1g

xz and lz77

use memory = d100 for lz77
and memory = d50 for xz

and prey it works :P

lzt will never work so dont even bother :P

[Razor12911]

Panker, you do realize that cls isn't the only way to make precomp show progress during installation. If cls is a problem or is a difficult approach , why not make use handle streams for decompression?

The arc.ini will look like this
precomp -r -o- - <stdin> <stdout>.

[panker1992]

it's the first time i hear handle streams for decompression :/

precomp -r -o- - <stdin> <stdout>

this command never worked, precomp doesnt support it

took an error

[Razor12911]

You have to edit the source and make it possible. That cls thing is very complicated even for me,
I don't know about CPP but on delphi, there is a type of stream that works with handles.
You just detect a certain type of handle, which is simple, just detect stdin and stdout.
You don't have to worry of how to exchangd data between freearc and precomp, with handles all you have to do is read using the stdin handle stream thenfrom there you let precomp handle the data then you send the output back to freearc, simple as that, progress will move automatically. The only tip I can give you is to never write anything on cmd window because that is also regarded as stdout data.

Here is a simple example but in delphi

var
hs1, hs2: THandleStream;

begin
hs1:= Thandlestream.create(GetStdHandle(STD_INPUT_HANDLE )) ;
hs2:= THandleStream.create(GetStdHandle(STD_OUTPUT_HANDL E));
hs1.read.... or use copyfrom to get data directly from freearc <stdin>
//precomp should process the data here...
hs2.write or hs2.copyfrom to send the processed/unpacked data back to freearc //this moves the progress bar.


If I knew the header structure of precomp, I could make precomp that uses stdin and stdout for unpacking to show progress.

[panker1992]

this post will get me somewhere :) i am at the university at the moment giving advance economic exams :P

damn i will get to this after i finish my studies here because it seems very interesting

thanks razor

at the moment i want to do this and edit precomp source to make it use stdin name for tempfiles so it can be used parallel

for example

for *.zip || ppx2 -P %Number_of_Processors% precomp intense0 -cn -zl98 -d1 file.pcf

will be able to not conflict between multiusage :)

[Razor12911]

The only thing you must figure out is how the header is structured.

Normally the the precomp header gives the version. It must tell you where the processed streams are located then after finding then, it makes it very easy to make the unpacker.
Another tip, if using handles, never write anything on cmd window that isn't part of the data. Meaning all that Precomp v0.4.4 - UNSTABLE bla bla has to go else you'll end up with errors unnecessarily.

[panker1992]

thanks, dont worry i know where to find you in case i find trouble :P

i hope you will be determined to help then as well :)

[Razor12911]

Anytime mate

[Amsal]

Panker, one question, what is the required ram for decompressing this data which is compressed using Masked Compression?

[panker1992]

a lot of :D i expect you know that you can pack with x64 program and unpack with 32 bit program

if you use srep64 for decomp you can see 4 gigs of ram easily

and if you use nanozip it uses the same amount of ram as for compression

if you use my xz method which is ultra lz77 it uses total 500~800mb ram :P

[felice2011]

Hi Panker, using the methods with the final mask configured in this way "msc+srep64+delta+exe2+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz/$precomp=precomp+msc+srep64+delta+lz77" the compression is successful only with the "Precomp 0.38" with all other versions I get this error:

http://i67.tinypic.com/ogbcaq.jpg

Is there any solution, or for the time being, the insertion of the algorithm Precomp in final mask is recommended only with the use of precom0.38.:rolleyes:

[panker1992]

well i have studied a lot of precomp source code lately,

i can tell some facts that has come to my attention

precomp 0.38 was a masterpiece of software, all other precomps are pretty unstable the way i see it, precomp 0.40 and above when fail to see zlib header come with this error in 90% of the cases

second fact , i havent uploaded nor updated my Masked Compression to use precomp 0.44 or even precomp 0.45 which is unstable :P not even previous precomps

my private messages are flooded by people begging to implement precomp 0.44 or even other precomps

i will not yet update the masked compression to support, because it spawn errors like these!!!

today i emailed Christian Shneider, critical error was fixed with memory leak, and i sent him library with tak, next precomp will most likely support wav precompression
and it already takes support for mp3 precompression

in the meantime precomp 0.44 offers nothing, nothing new is inside precomp 0.44 that will make precomp 0.38 obsolete

i literally beg people to not put precomp 0.44 to official public type tools for massive usage, and i havent released precomp 0.45 for this reason as well because i have the exe file but i keep it under heavy testing

therefore Felice i conclude that precomp 0.44 MUST be withdrawn anbd not yet be massively used under any circumstance especially on critical Data

Please Bare with me, for any changes on precomp i will post myself
it's not like i keep it for myslelf or something

sorry for this long post :)

[felice2011]

OK masks works very well, with the configuration in the last mask "/$precomp=" with Precomp added, should only be used with precomp 0.38, other versions Precomp can be used safely without entering Precomp in the last mask.

Last Mask : "/$precomp=precomp+msc+srep64+...etc" (Only precomp0.38)

Last Mask : "/$precomp=msc+srep64+delta+exe2...etc" (All Precomp Version)

Panker you're doing a great job.;)

[panker1992]

i will tell you a secret,

i have implemented it in my last v2.1 update

$precomp= ...etc etc is a mask to filter data that lz77, xz, fazip and generally any lz77 variant can compress only 5~8%, this is why you put precomp here because using precomp before lz77 can increase ratio by about 45~60% max

you can use precomp filter mask to select out uncompresable data and store using

$precomp=msc+srep+zstd this mask will allow you to select uncompressable data

for store purposes .... i have used it in my sonido mask (sonido = speed of sound )
my ultra fast mode in my tools :)

and yes

use can use any precomp if you put it in the beginning
for example
ultra = precomp+msc+srep64+delta+exe2+lz77/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz

but that will also increase time so a dual shaped sword is more like it :)

[Ichiraku2001]

Hey @panker1992! First of all you're doing a great work!

I'm getting this error while decompressing!
http://i.imgur.com/g0NhwmM.png
Game's MAD MAX
used -mrefl8 to compress!
Input Size = 1.29 GB (one of the splitted folder)
Output Size = 355 MB

But when trying to decompress with WPI for masked compression! it shows the above error! I've checked the setup file, its not corrupted!
Please Help