Helping thread :)

[ChronoCross]

Welcome MAK and thanks for made this thread!.
i have a question.
Some files in games have 98% or 99% of entropy like media or compressed data.
sometimes this data are packed and imposible to extract and rebuild without any errors.
So just for save time, there is any way to sort those files with 98% or 99% of entropy in a list to use a store method of compresion.
I mean like a entropy detector or something like that?
i ask you this because we can easy detect media files by extension (ogg, bik, mp3) but in some cases this files are already packed, so extension doesn´t work here.
thanks

[~MAK~]

Originally Posted by ChronoCross

Welcome MAK and thanks for made this thread!.
i have a question.
Some files in games have 98% or 99% of entropy like media or compressed data.
sometimes this data are packed and impossible to extract and rebuild without any errors.
So just for save time, there is any way to sort those files with 98% or 99% of entropy in a list to use a store method of compression.
I mean like a entropy detector or something like that?
i ask you this because we can easy detect media files by extension (ogg, bik, mp3) but in some cases this files are already packed, so extension doesn´t work here.
thanks

hmmm, whenever I get that type of files, then I firstly try Offzip by Luigi to see if their is any raw files or not on that specific files, if their is, then I try reflate with them or you can you precomp also after knowing the offzip location of streams , and compress them, if not and you don't even get any rebuilder or extractor, then you could even give a try to zstd, sometime, its worth on these type files

[ChronoCross]

Thank you!. I´ll try

[ChronoCross]

I was download smoke.exe by bulat. This tool can calculate the entropy and also have the source in c .
I need a script in batch to sort the files with 95% and 100% of entropy to txt file list.
This list of files is to using in arc.exe to storing.
So any ideas?

[~MAK~]

Originally Posted by ChronoCross

I was download smoke.exe by bulat. This tool can calculate the entropy and also have the source in c .
I need a script in batch to sort the files with 95% and 100% of entropy to txt file list.
This list of files is to using in arc.exe to storing.
So any ideas?

Btw, why not you use mask with arc?? Just make a new mask in arc.groups and add that file extension, and add that mask in your command line, and then add a no compression method? :P

[aswadd]

Originally Posted by ChronoCross

I was download smoke.exe by bulat. This tool can calculate the entropy and also have the source in c .
I need a script in batch to sort the files with 95% and 100% of entropy to txt file list.
This list of files is to using in arc.exe to storing.
So any ideas?

you will need a huge batch file to handle this , however i'm not sure about bat , i don't think it can be done with batch

[minivj]

I have my game compressed with

-mpzlib+srep+lzma:max data.arc

and i want to implement the compression with asc template. Please help me, what to do next??

[~MAK~]

Originally Posted by ChronoCross

I was download smoke.exe by bulat. This tool can calculate the entropy and also have the source in c .
I need a script in batch to sort the files with 95% and 100% of entropy to txt file list.
This list of files is to using in arc.exe to storing.
So any ideas?

Ahh matey, that is nice, but its old too, anyways, am not much good in writing batch files, but I will try to write one, currently having exams also

Originally Posted by minivj

I have my game compressed with
and i want to implement the compression with asc template. Please help me, what to do next??

Go to deployment>>Setup Resources and then click on add pzlib.exe and pzlib64.exe

and add your arc.ini also which you used for compression

[aswadd]

Mak I want to ask you what's ur opinion or ur experience of / about
lzma & xz (Lzma2) & 4x4:lzma which do you prefer to use for a good ratio & also good decompression speed
I also see most of the repackers doesn't use huge dictionary / lzma max settings !! However in most of the cases it won't help u much the difference will be couple of megabytes
can you explain more about lzma

[~MAK~]

Originally Posted by aswadd

Mak I want to ask you what's ur opinion or ur experience of / about
lzma & xz (Lzma2) & 4x4:lzma which do you prefer to use for a good ratio & also good decompression speed
I also see most of the repackers doesn't use huge dictionary / lzma max settings !! However in most of the cases it won't help u much the difference will be couple of megabytes
can you explain more about lzma

Aswadd if you ask my opinion, I mostly prefer xz, the reason is, if its offers a very fast decompression speed and it even gives much better ratio sometimes, and normally it could be bigger by 1-2mb in comparison to lzma, but for 1-2mb, I could go for xz because it has faster installation time.... Books are calling me... Talk to you later

[aswadd]

Originally Posted by ~MAK~

Aswadd if you ask my opinion, I mostly prefer xz, the reason is, if its offers a very fast decompression speed and it even gives much better ratio sometimes, and normally it could be bigger by 1-2mb in comparison to lzma, but for 1-2mb, I could go for xz because it has faster installation time.... Books are calling me... Talk to you later

yes i know that but what if we edited the comparison to be like this
4x4:lzma vs xz
I think 4x4:lzma will be faster & better but in the end it costs more ram & cpu

[~MAK~]

Originally Posted by aswadd

yes i know that but what if we edited the comparison to be like this
4x4:lzma vs xz
I think 4x4:lzma will be faster & better but in the end it costs more ram & cpu

Matey, there are varieties in every thing, look you could get better speed also, but in the cost of high CPU usuage, but I normally prefer xz, I don't say lzma is bad, but just I'll like xz speed and ratio with its normal CPU usage, am on mobile and couldn't tell you everything now.

[Gupta]

Originally Posted by aswadd

yes i know that but what if we edited the comparison to be like this
4x4:lzma vs xz
I think 4x4:lzma will be faster & better but in the end it costs more ram & cpu

IMOH, if u r planning to use things with freearc then go with fazip
this will give u better compression speed and u don't even need fazip.exe to decompress and even better compression speed many times

[External compressor:rep,lzma,4x4,delta,exe]
header = 0
mem = 730
packcmd = fazip -i0 compress:{compressor}{ption} <stdin> <stdout>
unpackcmd = fazip -i0 decompress:{compressor}{ption} <stdin> <stdout>

[~MAK~]

Originally Posted by PrinceGupta2000

IMOH, if u r planning to use things with freearc then go with fazip
this will give u better compression speed and u don't even need fazip.exe to decompress and even better compression speed many times

Yeah that is princegupta, but he actually asked me the difference, and I was on mobile and still on mobile, BTW thanks for contributing, this thread is made for sharing of knowledge only I am good to see that people are stepping forward to make the forum clean

[aswadd]

Originally Posted by PrinceGupta2000

IMOH, if u r planning to use things with freearc then go with fazip
this will give u better compression speed and u don't even need fazip.exe to decompress and even better compression speed many times

yes i'm using fazip for 4x4 Anyway it took 100% of my cpu usage & a lot of ram but it's 4/5 time faster than normal lzma & 2x faster than xz Eventually it's a multi thread tool

I just want to ask can i control the cpu usage of 4x4 ?? or even making it take less cpu & ram i can't add more than 120mb dictionary to it , any way to limit 4x4 ??