#1
|
||||
|
||||
Masked Compression (Precomp,reflate,srep,lzt,zstd,nz,xz)
~~~~~~~~~~~{Intro}~~~~~~~~~~~ In compression its all about algorithms there are tons of algorithms that are suited all for a specific different purpose this project is all about utilizing the correct compressor on specific type of files thus gaining the upper hand on compression and decompression (example) there are types of data that compress better or doesnt compress at all so why use lzma or even reflate and precomp even if you gain nothing from doing so ?? masked compression will use specific compressors per file types it will gather all text files using extensions *.ini *.rtf *.txt and it will perform the right compressor to compress the better of them the same will happen with movies files and precomp file in the latter using precomp.exe to process only files that benefit from it on movies zstd will be used for maximum decompression ~~~~~~~~~~~{Tiny SFX Packing}~~~~~~~~~~~ 1)Choose you Program or Game make sure it is small to begin with : Tiny Tools cannot support large number of Files 2) Put it inside Tiny_SFX_Compressor.bat and choose whatever compression method you want : As I said all works Including Precomp, you can leave it as is its very Optimal 3) Run the bat and wait for magic 4) after you have the data.bin run make sfx.bat 5) the exe that is produced is ready to work without anything it will automatically Unpack whatever method i have provided so far 6) This tool is provided as is, it worked for me and i gladly share, further than that i cant guarantee that it work for you!!! ~~~~~~~~~~~{Bik, Bk2 Re-encoding}~~~~~~~~~~~ Read the Readme.log i provided, it has everything you need to know ~~~~~~~~~~~{Update log}~~~~~~~~~~~ [Update 1] Added new Zstd Compressor for windows, I splited this into 2 different compression settings Zstd ultra compression = srep + zstd used a pipeline and offer great compression similar to lzma2 max and even bypass ultra on >5gb files Zstd fast compression = pure zstd offering very very fast compression ideal for fast travel data Important: If you used my previous tools, you need to download Zstd Ultra Compression to maintain support, all your data that you have already compressed by this tool will be usable only with this option [Masked Compression 2.5] masks 2.5 are here but this time a minor release 1) third mask was beta last time, now it aint ...it works out of the box with great success 2)precomp 038 remade, and optimized from scratch, precomp 0.38 is custom and it is faster than all other precomp, on my test precomp 0.45 took 9 minues almost and precomp0.38 took 5 minutes and 35 seconds ( test file was 700 mb file ) precomp038 set to slow mode and prrecomp 0.43 for brute mode, more of this in arc.ini 3) legacy2 works again since precomp038 is added again 4) msc is disabled, but you can enable it yourself, i did a proper test with this and reflate doesnt work with msc plus the ratio was increased and not decreased (if you dont believe me i can post results and you can always test yourself) 5) zstd doesnt work with my config anymore... it took errors i had to reformat entire pc and again didnt ( that was enough for me to cast it aside tho i left the sonido ) and the option for you to re-enable it 6) msrsolid mask and void mask are better optimized !!! Masked Compression Archive Added including all masks up to 2.5 Masked Compression x86 Support Masked Compression Manual Stay tuned ~~~~~~~~~~~{Special Thanks}~~~~~~~~~~~ Special thanks to Razor for reflate and Inno(WPI) and Gozarck for his inspiration and tweaks
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. Last edited by panker1992; 22-02-2016 at 18:15. Reason: First Masked Compression Manual |
The Following 58 Users Say Thank You to panker1992 For This Useful Post: | ||
1234567890123 (20-12-2015), 78372 (12-07-2017), ADMIRAL (26-05-2020), Amsal (20-12-2015), arkantos7 (20-12-2015), Bilawal (23-12-2015), Black_Angel_Kjh (12-03-2016), buttignol (20-12-2015), Carldric Clement (06-11-2019), chum (29-01-2016), COPyCAT (22-04-2016), DwarfenKing (08-09-2017), EzzEldin16 (20-04-2018), filter (04-05-2017), giothothan (09-05-2019), gozarck (21-12-2015), Harsh ojha (26-05-2019), houcine80 (20-12-2015), Ichiraku2001 (04-04-2017), jack1505 (11-02-2018), Jarod1337 (09-09-2018), Jiva newstone (24-11-2017), JRD! (20-12-2015), k4mitnik (07-10-2016), kassane (30-12-2015), Kazamnuk (21-12-2015), kenzo34 (20-12-2015), lhanz678 (15-01-2016), lolaya (07-01-2016), Lucas65 (20-12-2015), MacIII (14-04-2017), Macke (21-12-2015), mamed3000 (02-01-2016), maxxhacker (21-12-2015), nasir ahmad (16-04-2016), oltjon (20-12-2015), omrsaeedfoad (23-08-2019), Plamet3r (29-05-2017), Prieest (21-02-2016), Rahmani1811 (25-01-2016), RamiroCruzo (21-12-2015), Razor12911 (20-12-2015), Riaz (09-04-2017), romulus_ut3 (15-01-2016), sagarks (24-12-2016), Sarvagya (04-02-2016), sickperson (29-06-2016), Simorq (20-12-2015), Stor31 (22-12-2015), The Ghost (31-01-2016), TheRePacker (02-02-2016), yasitha (02-03-2019), yasserdivar (03-03-2016), Zanoza79 (18-09-2019), zirkhaki (19-04-2016), ~MAK~ (23-09-2016) |
Sponsored Links |
#2
|
||||
|
||||
I understood, in fact we all understand that your methods "LZ77", "XZ" are best of the old and obsolete method LZMA, thou hast repeated a hundred times in my and in your thread, but the file you posted www.fileforums.com/showthread.php?t=97303&page=5#67 changing folder "resource" sends error in my utility with different methods of choice, if we want to change something in my utility we can do together I hope you understand this you.
|
The Following 2 Users Say Thank You to felice2011 For This Useful Post: | ||
filter (04-05-2017), panker1992 (20-12-2015) |
#3
|
||||
|
||||
i know what you mean Felice the file i uploaded was to show you the removed dll files and the updated srep that went to 3.93 just keep those files ..... i didnt update overall you work :P
I dont know if you need the dlls for your exe to work by the way ..... because i use commandline and you interface
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
#4
|
||||
|
||||
My utility uses a variety of combinations for different methods, and the files placed in the folder 'resource' are not included by chance..
I checked the files included in your 'Masked Compression' method bat console and arc.ini files modified, it is not difficult to insert and update all in my utility, but the combinations of choice increased considerably, and this may be a problem ... |
The Following User Says Thank You to felice2011 For This Useful Post: | ||
filter (04-05-2017) |
#5
|
||||
|
||||
Felice if each compressor uses from 2~5 different switches then if you combine 5 programs
the amount of switches dramatically change and even a single modification is chained :P i suggest you toy with my bat file before you try to combine it in DLG :P I want to hear some thoughts on it ..... did you find it better ?? or worse ?? something that will help me too as you can see clearly decompression is still the same nothing will change there at this point masks only help the compression part hope you like this far i have some nasty ideas on compression but only razor can help me on this because i work solo i dont have any help besides this community. packjpg that is included in there is the exe from the latest release, i can also compile it in dll but cannot inject in precomp in order to upgrade it, if razor can inject it or better make the code use multithreading it would be great packjpg is GPL program by the way all can get its source !!
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
The Following 2 Users Say Thank You to panker1992 For This Useful Post: | ||
felice2011 (20-12-2015), filter (04-05-2017) |
#6
|
||||
|
||||
Ok I will be working on the 'Masked Compression' I have a couple of titles to be compressed and are curious to know how it acts..
Meantime remove the zip file that you posted in my thread, if it is used by users and give error, by me come to break the balls for to malfunction.. |
#7
|
||||
|
||||
ops you are right i assume you got the updates especially on srep you will need them
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
#9
|
||||
|
||||
truly the best so far
|
The Following 2 Users Say Thank You to oltjon For This Useful Post: | ||
filter (04-05-2017), panker1992 (20-12-2015) |
#10
|
||||
|
||||
@oltjon if you have weak computer the compression speed will be like half or even better
the same goes for high end computers but it can run parallel hope you like it
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
The Following User Says Thank You to panker1992 For This Useful Post: | ||
filter (04-05-2017) |
#11
|
|||
|
|||
@PANKER1992, Really THANKS A LOT FOR THIS! ONLY one question, how to extract the archives in inno script?
And Bro, tell me with reflate and without reflate. I know how to compress with reflate and with reflate, only I am asking, how to decompress the files with an inno script. Please answer in detail! Again thanks for the Masked Compressor, it is really very fast Last edited by Amsal; 20-12-2015 at 18:40. |
The Following 2 Users Say Thank You to Amsal For This Useful Post: | ||
filter (04-05-2017), panker1992 (20-12-2015) |
#12
|
||||
|
||||
@Amsal really thanks, i will update decomp tomorrow so no worries
generally in decomp nothing changes, masks only exist to instruct how a compressor behaves example: all text files are compressed next to each other and movies the same and so on thus gaining an upper hand in everything, trying to apply the best settings in each case so it doesnt affect decompression because decomp doesnt care what it extracts as long as it extracts DETAILS TOMORROW its 4 morning here :P
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
#13
|
|||
|
|||
Quote:
That mean, your compressor is amazing, i am shocked with results!! Please post the decompression method soon as possible? I will go on vacation in 2 days, so please post as soon as possible! Last edited by Amsal; 20-12-2015 at 18:48. |
The Following 2 Users Say Thank You to Amsal For This Useful Post: | ||
filter (04-05-2017), panker1992 (20-12-2015) |
#14
|
||||
|
||||
now that is what i want all of you to do
very nice feedback copy all files from my 7z somewhere and make a unpack.bat file write inside unpack.bat arc.exe x data1.bin -y -pYourpassword and save this now see how fast truly gets Inno is coming up tomorrow ..... it works ok so no worries
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45. |
The Following 3 Users Say Thank You to panker1992 For This Useful Post: | ||
#15
|
|||
|
|||
Quote:
Last edited by Amsal; 20-12-2015 at 19:05. |
The Following 2 Users Say Thank You to Amsal For This Useful Post: | ||
1234567890123 (17-02-2016), filter (04-05-2017) |
Thread Tools | |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Thread Starter | Forum | Replies | Last Post |
Best Compression Format | DRAGoN.X | Chit Chat | 11 | 08-09-2017 00:13 |
Dragon Age: Origins Ultimate Edition 3xDVD5 [CIU 2.0.2] | NamelessOne | PC Games - CD/DVD Conversions | 16 | 03-03-2017 12:38 |
compression -msrep+rep+delta+nzip | Danik1B9 | Conversion Tutorials | 11 | 21-12-2014 09:13 |
Borderlands 2: Ultimate Vault Hunter Edition - 3xDVD5 [ALL DLCs + CIU V2] | REV0 | PC Games - CD/DVD Conversions | 7 | 06-07-2013 04:14 |
Fallout New Vegas Ultimate Edition 3xDVD9 to 2xDVD5 1LANGUAGE | senseman | PC Games - CD/DVD Conversions | 29 | 04-06-2013 11:36 |