all in all i havent told you how it works and how to chain a compressor with another compressor

This is the method i have used most of the time

-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq

the method i provided is absolutely made with 16 gigs of ram in mind
personally i got 12 gigs, running many compressos all at once does an impact on cpu too

i am posting a photo to show you my results, as well as i try to optimize it for lower spec PCs

From personal exp. i have found that 4G ram PCs will never make it and produces many errors
also zstd.exe, 7z.exe and many others are 64 bit only so

Check Method in photo for Masks
and see the results

This is the file for compression:

http://i.imgur.com/TzGvtUg.png

This is error in cmd:

http://i.imgur.com/gBcowuN.png

I also tried to compress GTA San Andreas with the same error.
I really like the method and I'm sorry for those errors. However, I have 8 gb ram and I amended the parameters in arc.ini. Without trying precomp all goes well until the end.

Alright, thanks mate!

I'm a bit confused, on UltraArc I used always srep + Izma for the data.arc archives. Since, I have 16 GB of Ram available, zstd and lzham would be preferable now.

However, in Felice tool some of the methods are listed, but I can't figure out which would be the one above. Could please advise me?

Thanks a lot, cheers! :)

Lucas65
Sorry for my bad English
Error because Precomp not find zlib streams
and about h64b.rpf Reflate will help you create an archive and unpacking very long

Lucas i am trying to remember when i had seen that error again !!!!

what os are you using ??? i use win 8.1 and Arch linux kernel 4.2 latest

and i compress with masks in both without any errors

will try to fix this because its starting to get in my nerves that it refuses to compress like a good file :P


Lucas here is it your error
put this into precomp.exe

@Kazamnuk

This is the arc.ini that will give you max compression for 16 gigs of ram

I use Windows 7 64bit ICE.
It may be due to this operating system that keep getting these errors?

I saw now the file zlib.
I did not understand "put this into precomp.exe", sorry.

if you used windows 10 i wouldnt be surprised ....

copy paste the zlib1.dll i gave you its the 105 kilobyte edition

if you get the error again i will post the 59 bit dll


lets see .... !! i perform test alongside and i get no errors

i have compressed all my library with masks and no errors at all :/

Nothing. Same error ...

please make a photo of the directory that all tools are in a photo of arc.ini and a photo of the masked compression.bat :P i will have this solved no matter what :P

The point in the file not found precomp zlib molasses and therefore error

@Vint his problem isnt masks, masks merely instruct how a compressor will behave on files

to make this more simple

you dont have to apply precomp on *.txt files and *.bik files

that is what a mask do ..prevent files that dont benefit from a compressor to be processed by it


so i am trying to guess what he misses :/

Wait wait ... Out of curiosity I tried it on virtual machines with win7 64bit normal and it worked on this file and the zlib.dll from 59Kb
http://i.imgur.com/TzGvtUg.png

I tried on file tool razor and error reappeared trying both the zlib.dll
http://i.imgur.com/tMvbvJp.png
This is arc.ini and bat file (of course there is not the newline ...)

http://i.imgur.com/fwMsheh.png

http://i.imgur.com/N8RSkMI.png

you miss a 7z.exe and fazip.exe and decompress.dll and decompress_mt.dll from fazip's environment


generally :P you miss programs how can this work ??

I'm sorry. I forgot to put this image:

http://i.imgur.com/YxyTGq8.png

take this file and extract in there replacing the arc.groups

i also advise against compressing 1 file with masked compression

its made from the ground up to handle many files and many filetypes

Hello Panker, I have other tests but the error persists. Your job is ok and certainly something my wrong. Maybe it is SO ICE that I've never been inspired since I installed or do not know.
I changed the file arc.groups, and to try change the file precomp.exe but nothing. I do not know what to say. Thanks anyway for the help you have given me so far.

Lucas i believe that it is your OS that makes the problem since all else use my utility and they dont have the same error .......


What can i say i am sorry it didnt work you, one last test is to remove masks and use it normall

-mprecomp+msc+srep64+delta+exe+xz
or

-mprecomp+msc+srep64+delta+exe+lz77

this will use the normal procedure and no mask will be applied

so test this normally and please feedback

thanks in advance !!

panker1992
Try it yourself to process this file
Lucas65
Try PrecompInside, and you will see the same error
x64a.rpf This file can be processed only Reflate
Example Reflate
http://rghost.ru/64MHHKGTy

Me used all types of precomp on x64a.rpf...It worked for me all the times...

I don't know the particular reason why but if you use the PrecompInside they won't run on it [Run but show error if there is no benefit in precomping]....

RamiroCruzo
and after processing precomp output size changed

Yup amigo...Gave way better result in compression....Although only -brute method worked...

RamiroCruzo
I and thought that you used - brute method because - slow and - intense do not work at the GTA5 files

i dont have the file to test it, tho i have something in my mind

drag and drop the file on precomp42 and precomp43 to verify

it should give you the file.pcf, i dont own the GTAV to test it

can someone upload the rpf file so i can test it ?

panker1992 file is in the pack
x64a.rpf download http://rghost.ru/64MHHKGTy

reflating works
 

it works correctly with reflate

with precomp 4.2 and 4.3 versions i encounter errors

the test that took place was on linux arch

but i tried without masks.....so masked compression has nothing to do with this

will try on windows now and link photos

no luck on windows too

see all photos and the commends are yours
rpf files cannot be pipelined through arc.exe, this problem is with precomp.exe

the only part i feel sorry about is that precomp is a project no longer supported

you can mask *.rpf files no to go through precomp mask


open arc groups create

$nonprecomped
*.rpf

in the end of the file
make sure *.rpf isnt anywhere else

and see photos below what to do inside masked compression.bat

Hello Panker. I used the normal method (-mprecomp+msc+srep64+delta+exe+lz77) and I have found no errors. I used it on GTA San Andreas where before I received the error.
Any idea for my annoying problem?

There is an update in front page with 2 zlibs try with old and feedback I had error too and it solved after using zlib old

Hello panker. I'm reaching good results. I can run precomp if use this line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=msc+srep64+rep:512+delta+exe+lz77"
But I have a doubt: with this method the "Masked compression" working?

But if I use this other line: "-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77" decompression me error: "unsupported method reflate".
Files "RPF" precomp I think that does not work then use this command line: "-mmsc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+rep:512+delta+exe+lz77 " but I can not decompress if I use "reflate".
Reflate can decompress?

Thank you Panker!

Mask in Usage
 

if you use this line
"-mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq"

you dont need to have masked $precomp=precomp+msc+srep64+delta+exe+lz77

reflate can only decompress at commandline (cmd) it doesnt work on inno for some reason i dont yet know

and use this -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz77

check the image below and try to send me some pictures

there are 5 boxes that show you how your data was processed
Method box is the mask used for, can you show me your info of your data files ?

i get a feeling that you miss something but you are doing good job on it :)

panker1992
I looked at the line precomp + msc + srep64 + rep: 800mb + delta + lz77 where winning 387 megabytes of why or where enough srep and lzma compression process takes less time for

@Vint56
you mean that you won 387 megabytes without using masks and only this line above ?? :/

i am trying to implement nanozip in the process but i am afraid it will take just about 1 month to compress data on nowadays games

If I use this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+precomp+msc+srep64+delta+exe+lz7 I get the usual mistake ever. The problem (I do not know why) is here: $precomp=reflate+precomp+msc+srep64+delta+exe+lz77
Here are two photos using this line: -mprecomp+msc+srep64+rep:512+delta+exe+xz/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=srep64+zpaq/$precomp=reflate+msc+srep64+delta+exe+lz77

http://i.imgur.com/Li64bPU.png

http://i.imgur.com/sR9V2Kf.png

Is there anything missing that you see?

panker1992
not from your full screenshot
http://s019.radikal.ru/i633/1512/dc/2c78570a5c77.png

Another example can be useful to someone

http://rghost.ru/6vkvLhMqw

http://s017.radikal.ru/i433/1512/9d/57b1173256cb.png
http://s020.radikal.ru/i718/1512/99/543b6408a91c.png

@Lucas its fine to use reflate only, tho as i said this version of inno setup i use refuses to see reflating as external compressor.
but if you have found a way to use it that is good news

did you notice any difference in ratio or speed while using the Masks ?? will be glad to know

@vint i saw that now i only check the entire data.bin for ratio

this is because some data are non compressible

in this case there are 3 scenarios
1) turn precomp to brute mode from intensive
2) lossy compress the files manually
3) if it is a packed format of games for example .pack formats used by all Total Wars
then you extract the content and compress it and then make a bat to restore it

This type of compression is very good and also very fast. In my case I have that problem with precomp but fortunately I have, more or less, solved.
With reflate I only did the test and it would be really great if you could find a way to decompress in inno because in many cases exceptional results.
I need another help if you can: if for example use reflate alone, with this line arc.exe a -ep1 -r -ed -s; -mreflate data.arc "D:\Giochi\Gta san andreas\*, then how can I decompress with a bat file? I honestly have no idea.
I thank you in advance Panker!

I haven't tested -mreflate alone I mean without srep and lzma or lzma2

But I have found a glitch
Download my decompress for ripping and masked compression

Copy arc.ini from my masked compression zip to decompress for ripping and replace it

Then try to decompress
The error that didn't let rwflate work is solved :P

Great. Now I work in almost all ... It seems also precomp. Thank you very much for all your help and for the work you've done!

Lucas your welcome :D

i always try to troubleshoot, and try to know how the programs work so when i see errors
i know where they come from

you seemed to have the most difficult situation in the forum, i am really glad you managed to get it right :)

any feedback would be nice on the methods, have you seen ratio or at least speed improvements ??? has masked comp/decomp worked well ??

Dear Panker,

I would also like to thank you for your great script+grouping of files! The idea is great!

I´m having a little problem with some files, getting the message:
##################
Recompressed streams: 0/6
PNG streams (multi): 0/1
zLib streams (intense mode): 0/5

None of the given compression and memory levels could be used.
There will be no gain compressing the output file.

ERROR: general (de)compression error in precomp
##################
it occurs on Win8.1+Win10+VMWare (blank installation of Win8.1)

I just remarked, that it hungs up by converting a bnk file (but other bnk files worked) and in another case an ico and a wmv file has caused the problem.

Should I need to sort them out or change anything in the precomp settings?

Thanks for your help!

thanks for feedback :D

dear friend all files and how they get compressed are chosen by the file named arc.groups

the name of the filter starts with $text for example
and then all *.txt *.ini and all files that are text alike will be compressed by what you put in front of /$text=rep:500+zstd for example this will take all texts and compress them separetaly then put them back in the entire arc or bin or cab whatever :)

now there is a filter that takes all files that are unknown to the mask and compresses them generally by the usage of the

-mmsc+srep64+...+lz77 for example


if you open your arc.group you will find that wmv files are under void = uncompressible data

if you want add *.bnk files under void too
and replace this line in general comp /$void=msc+srep64+zstd thus ensuring that precomp will never see bnk files

bnk is uncompressible data format is has nothing to do with precomp.exe

i hope that you got me :D
sorry for long text