FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Masked Compression (Ultimate compression in one go) (https://fileforums.com/showthread.php?t=97530)

Prieest 22-02-2016 09:03

Quote:

Originally Posted by panker1992 (Post 447500)
there is the fix :D i had the name of 7z.exe to xz.exe :P copy and paste this


[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:d25:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=on -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>

it took 3 edits to fix :P

so this is the first fix?:confused:(or all 3) and I am making changes in arc.ini file which is in folder maskeddata compression x86. not making any changes in Inno_Luciel.
**EDIT**
Still getting the same error..

panker1992 22-02-2016 09:12

i am reuploading masked data compression for x86 with fixes :D

Amsal 22-02-2016 09:17

Bro, what is the best algorithm for .bio and.bk2 files for compressing LOSSLES. Again I say, I want to know the algo, and bro if you know then post it with its files libraries and with arc.INI support

Prieest 22-02-2016 09:19

Thanks
 
Hey buddy, no need to hurry. you can take your time.:)

panker1992 22-02-2016 09:23

alright :D updated masked compression for x86, xz now works flawlessly :D

bik and bk2 files ?? best compression is srep only, they are uncompressible even if you run lzma or nanozip on them they yield no compression, they stay 100% ratio

i already have them in void masks so no need to worry ( its lossless )

SAM2712 22-02-2016 09:26

Quote:

Originally Posted by Amsal (Post 447477)
Bro, I fixed that by replacing this

[External Compressor:precomp043]

And I wrote precomp043 in the methods instead of brute, and now it is working fine, I think you can do this in your next version.



BTW, sam2712 unmask mean is he has to do anything in the unpacking process also. BTW the answer is no

Thanks for reply..!

panker1992 22-02-2016 09:37

new X86 is up,

with the exception of 2 or 3 mispell bugs i always try to bring out the tools to work out of the box,

Due to different machines and Architecture there can be errors, i will try to make a full Document on how everyone can interact with commands and troubleshoot on their own !!!

I decided to do this because people do not read what other people have said and i find myself answering the same question over and over and over again :/

Prieest 22-02-2016 09:58

1 Attachment(s)
I am getting this error in new update. (working for optimal and sonido) (not working for ultra, placedo and deflate).
Thanks.

panker1992 22-02-2016 10:14

remove reflate entirely, dont use it at all test precomp and report back :D


Manual Added :D everything will be there

SAM2712 22-02-2016 22:28

Need Guide !
 
Thanks for Manual :D Somehow I need little guide :confused:
CPU= fx 8350 (8cores) , RAM (8gb) , win10 x64 , Usage masked compression (latest)
Case 1. When i use 4 cores of cpu then I have to do ( 4 * 200 * 10 = 8gb) B'cos I have 8gb ram but I have cpu fx 8350 So i have to do 4 cores disabled, If I want to use above formula, Right or Not?
Case 2. But If -mmt=on (Default) is used then compression will be done according to cpu cores available I MEAN cpu cores will be increase or decrease during compression , Right or Not?
Case 3. If all cores will be use then acc. to my ram, I have to use ( 8 * 100 * 10 ) Right or not ?
Please look for case 2 mainly beacuse I don't want to disable 4 core :confused: In all cases If I explained Right then I can use anyone case :rolleyes:
If I mistake any then correct me :o
In last one thing also what is -mcrc=0 if I change to 1 then crc error never occur , Right or Not :confused:

Prieest 23-02-2016 00:58

Quote:

Originally Posted by panker1992 (Post 447515)
remove reflate entirely, dont use it at all test precomp and report back :D


Manual Added :D everything will be there

Thanks for a manual.:)
Remove Reflate mean : to remove reflate script from Arc.ini?
How to test with precomp? need to change any script? :confused:

rinaldo 23-02-2016 07:20

panker
method ultra no working in bat

panker1992 23-02-2016 07:21

Quote:

Originally Posted by SAM2712 (Post 447523)
Thanks for Manual :D Somehow I need little guide :confused:
CPU= fx 8350 (8cores) , RAM (8gb) , win10 x64 , Usage masked compression (latest)
Case 1. When i use 4 cores of cpu then I have to do ( 4 * 200 * 10 = 8gb) B'cos I have 8gb ram but I have cpu fx 8350 So i have to do 4 cores disabled, If I want to use above formula, Right or Not?
Case 2. But If -mmt=on (Default) is used then compression will be done according to cpu cores available I MEAN cpu cores will be increase or decrease during compression , Right or Not?
Case 3. If all cores will be use then acc. to my ram, I have to use ( 8 * 100 * 10 ) Right or not ?
Please look for case 2 mainly beacuse I don't want to disable 4 core :confused: In all cases If I explained Right then I can use anyone case :rolleyes:
If I mistake any then correct me :o
In last one thing also what is -mcrc=0 if I change to 1 then crc error never occur , Right or Not :confused:



since you have 8 GB of ram that means that you have left 6 GB because windows taking 2GB to operate,

since you have 8 core cpu then

8 * x *10 = 6 GB of ram because the limiting factor is your RAM

if you want to use all your 8 cores then you need to put dictionary
70mb

then its like 8 * 70 * 10 =5600 MB of ram which is good :D
for 4 cores 4 * 140 * 10 = 5600 MB of RAM which is good but slower

and mmt=on means it will use all cores mmt=1 = 1 core
mmt=4 4 cores

if you have i7 then its counted as 8 cores so plan accordingly


Priest and Rinaldo, Ultra is reflate, reflate is in the manual

IF you want to have a stable repack use precomp D:

SAM2712 23-02-2016 08:43

Quote:

Originally Posted by panker1992 (Post 447536)
since you have 8 GB of ram that means that you have left 6 GB because windows taking 2GB to operate,

since you have 8 core cpu then

8 * x *10 = 6 GB of ram because the limiting factor is your RAM

if you want to use all your 8 cores then you need to put dictionary
70mb

then its like 8 * 70 * 10 =5600 MB of ram which is good :D
for 4 cores 4 * 140 * 10 = 5600 MB of RAM which is good but slower

and mmt=on means it will use all cores mmt=1 = 1 core
mmt=4 4 cores

if you have i7 then its counted as 8 cores so plan accordingly


Priest and Rinaldo, Ultra is reflate, reflate is in the manual

IF you want to have a stable repack use precomp D:

Oh !:D How can I forgot this simple point that I have 6gb is usable :rolleyes:
THANKS to clear out my all points ..:)
Really Appreciate panker :D
;) One thing more , If all my 8 cores running then should i have to do with mmt=8 and also Is this effect on (8*x*10) :confused:
Simple I mean that In both thing (mmt and 8*x*10) I have to set cores same or different ? If same then no need further explain OR if different then what should I have to change in either things or both :confused:

rinaldo 23-02-2016 09:37

I thought it was your oversight .. I do not use these tools, I always say ... because everything else works by changing the method I thought ;)

panker1992 23-02-2016 09:41

-mmt=on will use 8 cores
-mmt=8 will also use 8 cores :P

and yes 8 cores means 8 * dictionary * 10

to make this more confusing

its cores * dictionary * matchfinder

there are a bunch of matchfinders

bt4 uses the multiplier (* 10) this is why we multiply * 10 in the end

you can change the matchfinder and use hc4 for example, but i recommend to use less dictionary than to change matchfinder

i hope you can follow me while i explain all these :P

I had to study compression lecturing under university of Helsinki to understand all that

if i went and wrote that all into manual it wouldnt be a manual i would be a lecture :P

SAM2712 24-02-2016 04:08

Quote:

Originally Posted by panker1992 (Post 447540)
-mmt=on will use 8 cores
-mmt=8 will also use 8 cores :P

and yes 8 cores means 8 * dictionary * 10

to make this more confusing

its cores * dictionary * matchfinder

there are a bunch of matchfinders

bt4 uses the multiplier (* 10) this is why we multiply * 10 in the end

you can change the matchfinder and use hc4 for example, but i recommend to use less dictionary than to change matchfinder

i hope you can follow me while i explain all these :P

I had to study compression lecturing under university of Helsinki to understand all that

if i went and wrote that all into manual it wouldnt be a manual i would be a lecture :P

I don't need deep knowledge about these stuffs :rolleyes: But I want only required knowledge about compression . So I asked and U helped very well :D
Now I understand :) Thanks :D

SAM2712 24-02-2016 04:14

Need help..!
 
1 Attachment(s)
Compression is going very well with Masks :D
Now problem arise here :(
What about this error panker ?

BLEND2001 24-02-2016 07:20

Quote:

Originally Posted by SAM2712 (Post 447555)
Compression is going very well with Masks :D
Now problem arise here :(
What about this error panker ?

lol i'd met with the same prob! if the app name contains a comma it shows this error!
like Assassin's Creed is the app name then it will show this error!
writing Assassins Creed would fix it

SAM2712 24-02-2016 09:11

Quote:

Originally Posted by BLEND2001 (Post 447559)
lol i'd met with the same prob! if the app name contains a comma it shows this error!
like Assassin's Creed is the app name then it will show this error!
writing Assassins Creed would fix it

Very Simple :D LOL Thanks ;)

Amsal 24-02-2016 21:31

Panker, I just trying to compress file with lzham, it compress well, and when I decompress it then it decompress well, but it leaves a freearc836477383.tmp folder in the installation folder, so can you please tell me that how can I fix that

The Ghost 24-02-2016 21:54

thank you panker for this awesome compressor making repacks now size of my repacks are amazing thank you Thank you thank you :D

panker1992 24-02-2016 23:11

Lzham
 
Quote:

Originally Posted by Amsal (Post 447579)
Panker, I just trying to compress file with lzham, it compress well, and when I decompress it then it decompress well, but it leaves a freearc836477383.tmp folder in the installation folder, so can you please tell me that how can I fix that


what inno you use and what settings ??

i have tested lzham and it aint giving any freearc temps on me :/ please provide full details on what you do and how you do it :D

thanks ghost :D

Amsal 24-02-2016 23:15

Using this precomp043+static+xz+lzham+lz77, I am using blackbox inno

Edit: got the same problem with -max also

panker1992 25-02-2016 16:51

It's either use lzham or lz77

Not both lol

And it's -mmax not -max

And you really need to hire a Guru or a specialist for your repacks :)

Amsal 25-02-2016 19:43

Quote:

Originally Posted by panker1992 (Post 447596)
It's either use lzham or lz77

Not both lol

And it's -mmax not -max

And you really need to hire a Guru or a specialist for your repacks :)

Lol bro, I was on mobile, and still I am on mob, I already said you in pm that I will not be available till April on PC! And that -mmax was typing mistake on my mob!. BTW, tell me why I am getting temp folder with using -mmax also

panker1992 26-02-2016 05:09

dont have to use lzham and lz77 at the same time dude !!

if you have done that probably tmp folder

Amsal 26-02-2016 05:13

Hmm.. Thenni will test and then tell you

panker1992 26-02-2016 05:15

i am right here post results into pictures :D

Amsal 26-02-2016 06:12

Quote:

Originally Posted by panker1992 (Post 447609)
i am right here post results into pictures :D

Now, here my prove and results -

http://imgur.com/t1vAESG.jpg
http://imgur.com/AfI6Zi4.jpg
http://imgur.com/FzTQWHh.jpg
http://imgur.com/kQKTZHj.jpg

panker1992 26-02-2016 06:35

try unpacking with WPI, and tell me if there is freearc tmp there as well

lzturbo and lzham leave tmp files man ... this is why i didnt want them in

xz is better in both compressio nratio and its bugless ....

try WPI and then if you get errors as well replace with xz which is better overall

Amsal 28-02-2016 09:20

Panker bro, you are a good programmer also, so why not you edit unarc.dll and make it compatible to show progress with xz also, because for 6gb archive xz doesn't show any progress for 10min and because still, if you can do some programming and make progress with xz support then it will be great!

panker1992 28-02-2016 17:37

xz already supports Progress man :D

any program you see <stdin> <stdout> shows correct progress

you probably made a mistake somewhere :/

xz is lzma2 and nothing else, how lzma normally supports stdout likewise xz does as well

Every feature that lzma1 has is inheritage to lzma2 as well ....

check your problem and post again



Edit: try packing a 10 GB game using srep and xz and NOTHING else, then run WPI progress bar will show normally :)

Amsal 02-03-2016 10:18

What is the best way to compress .pck audio files 100% lossless???

panker1992 02-03-2016 15:35

audio files arent easily compressed though msc can handle them i think if they are wav or mp3 at least.

on top of them srep although it wont do much, and after xz(lzma2) which will also wont do much


audio is incompressible in many ways.

1234567890123 02-03-2016 22:59

there is a lot game data extractor like msc but they can't rebuild the data.I tried to compress a game's data after using these extractors i gave better results (compression ratio) but i can't rebuild this data ex. reflate can extract gta 5 datas it gave better result in gta 5 or mad max

truerepacks 03-03-2016 09:40

Compressing *.pck file with msc doesn't yield u any good results as they contain wav which aren't pcm supported or something like that and even ogg cann't process it (this is same for all assasin creeds)
So its better to compress them with zstd

truerepacks 03-03-2016 09:45

About tmp folder, set working directory to tmp in isarc extract module

panker1992 03-03-2016 18:40

This will pretty much solve the issue, also why pack using zstd and not step alone ?

In my new 2.5 masks srep handles the data that are non compressible.

It has also come to my attention that recompressing data is the future as games industries go and make 60 gb games, they come prepacked. People here need to start taking recomp seriously

brehm 11-03-2016 20:56

hello, I'm using your masked compression v2.5. The compression preccess doing well, I've compressed my game into 4 .bin files. But, how to include all of the 4 .bin file into windowsphone.iss?

Code:

[Archives]
;Precomp 0.38
;Archive Types 7Zip, Freearc and WinRAR 
Precomp=0.38
Archive1Type=Freearc
Archive1Source={src}\data1.bin
Archive1Output={app}
Archive1Disk=1
Archive1Password=Yourpassword

What should i change?


All times are GMT -7. The time now is 00:25.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com