Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 20-12-2015, 06:51
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
Arrow Masked Compression (Precomp,reflate,srep,lzt,zstd,nz,xz)


~~~~~~~~~~~{Intro}~~~~~~~~~~~

In compression its all about algorithms
there are tons of algorithms that are suited all for a specific different purpose

this project is all about utilizing the correct compressor on specific type of files thus gaining the upper hand on compression and decompression

(example) there are types of data that compress better or doesnt compress at all
so why use lzma or even reflate and precomp even if you gain nothing from doing so ??

masked compression will use specific compressors per file types
it will gather all text files using extensions *.ini *.rtf *.txt
and it will perform the right compressor to compress the better of them

the same will happen with movies files and precomp file
in the latter using precomp.exe to process only files that benefit from it
on movies zstd will be used for maximum decompression

~~~~~~~~~~~{Tiny SFX Packing}~~~~~~~~~~~

1)Choose you Program or Game make sure it is small to begin with
: Tiny Tools cannot support large number of Files
2) Put it inside Tiny_SFX_Compressor.bat and choose whatever compression method you want
: As I said all works Including Precomp, you can leave it as is its very Optimal
3) Run the bat and wait for magic
4) after you have the data.bin run make sfx.bat
5) the exe that is produced is ready to work without anything it will automatically Unpack whatever method i have provided so far
6) This tool is provided as is, it worked for me and i gladly share, further than that i cant guarantee that it work for you!!!

~~~~~~~~~~~{Bik, Bk2 Re-encoding}~~~~~~~~~~~

Read the Readme.log i provided, it has everything you need to know


~~~~~~~~~~~{Update log}~~~~~~~~~~~

[Update 1]

Added new Zstd Compressor for windows, I splited this into 2 different compression settings
Zstd ultra compression = srep + zstd used a pipeline and offer great compression similar to lzma2 max and even bypass ultra on >5gb files
Zstd fast compression = pure zstd offering very very fast compression ideal for fast travel data
Important: If you used my previous tools, you need to download Zstd Ultra Compression to maintain support,
all your data that you have already compressed by this tool will be usable only with this option

[Masked Compression 2.5]

masks 2.5 are here but this time a minor release

1) third mask was beta last time, now it aint ...it works out of the box with great success

2)precomp 038 remade, and optimized from scratch, precomp 0.38 is custom
and it is faster than all other precomp, on my test precomp 0.45 took 9 minues almost
and precomp0.38 took 5 minutes and 35 seconds ( test file was 700 mb file )

precomp038 set to slow mode and prrecomp 0.43 for brute mode, more of this in arc.ini

3) legacy2 works again since precomp038 is added again

4) msc is disabled, but you can enable it yourself, i did a proper test with this and reflate doesnt work with msc

plus the ratio was increased and not decreased (if you dont believe me i can post results and you can always test yourself)

5) zstd doesnt work with my config anymore... it took errors i had to reformat entire pc and again didnt ( that was enough for me to cast it aside tho i left the sonido )
and the option for you to re-enable it

6) msrsolid mask and void mask are better optimized !!!

Masked Compression Archive Added including all masks up to 2.5

Masked Compression x86 Support

Masked Compression Manual
Stay tuned



~~~~~~~~~~~{Special Thanks}~~~~~~~~~~~

Special thanks to Razor for reflate and Inno(WPI) and Gozarck for his inspiration and tweaks
Attached Images
File Type: png Masks v2.2.png (1.23 MB, 3734 views)
Attached Files
File Type: 7z Zstd_Fast_Compressor.7z (585.4 KB, 1051 views)
File Type: 7z Zstd_Ultra_Compressor.7z (664.8 KB, 1798 views)
File Type: 7z Bink_Enc.7z (658.0 KB, 1501 views)
File Type: 7z Masked Compression Archive.7z (12.90 MB, 4043 views)
File Type: 7z Masked Data Compressor x86.7z (4.06 MB, 2001 views)
File Type: 7z Masked Compression Manual.7z (446.9 KB, 1526 views)
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.

Last edited by panker1992; 22-02-2016 at 17:15. Reason: First Masked Compression Manual
Reply With Quote
The Following 46 Users Say Thank You to panker1992 For This Useful Post:
1234567890123 (20-12-2015), 78372 (12-07-2017), Amsal (20-12-2015), arkantos7 (20-12-2015), Bilawal (23-12-2015), Black_Angel_Kjh (12-03-2016), buttignol (20-12-2015), chum (29-01-2016), COPyCAT (22-04-2016), DwarfenKing (08-09-2017), filter (04-05-2017), gozarck (21-12-2015), houcine80 (20-12-2015), Ichiraku2001 (04-04-2017), JRD! (20-12-2015), k4mitnik (07-10-2016), kassane (30-12-2015), Kazamnuk (21-12-2015), kenzo34 (20-12-2015), kotenma111 (15-08-2016), lhanz678 (15-01-2016), lolaya (07-01-2016), Lucas65 (20-12-2015), MacIII (14-04-2017), Macke (21-12-2015), mamed3000 (02-01-2016), maxxhacker (21-12-2015), nasir ahmad (16-04-2016), oltjon (20-12-2015), Plamet3r (29-05-2017), Prieest (21-02-2016), Rahmani1811 (25-01-2016), RamiroCruzo (21-12-2015), Razor12911 (20-12-2015), Riaz (09-04-2017), romulus_ut3 (15-01-2016), sagarks (24-12-2016), Sarvagya (04-02-2016), sickperson (29-06-2016), Simorq (20-12-2015), Stor31 (22-12-2015), The Ghost (31-01-2016), TheRePacker (02-02-2016), yasserdivar (03-03-2016), zirkhaki (19-04-2016), ~MAK~ (23-09-2016)
Sponsored Links
  #2  
Old 20-12-2015, 07:20
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 671
Thanks: 262
Thanked 763 Times in 279 Posts
felice2011 is on a distinguished road
I understood, in fact we all understand that your methods "LZ77", "XZ" are best of the old and obsolete method LZMA, thou hast repeated a hundred times in my and in your thread, but the file you posted www.fileforums.com/showthread.php?t=97303&page=5#67 changing folder "resource" sends error in my utility with different methods of choice, if we want to change something in my utility we can do together I hope you understand this you.
Reply With Quote
The Following 2 Users Say Thank You to felice2011 For This Useful Post:
filter (04-05-2017), panker1992 (20-12-2015)
  #3  
Old 20-12-2015, 07:32
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
i know what you mean Felice the file i uploaded was to show you the removed dll files and the updated srep that went to 3.93 just keep those files ..... i didnt update overall you work :P

I dont know if you need the dlls for your exe to work by the way ..... because i use commandline and you interface
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 2 Users Say Thank You to panker1992 For This Useful Post:
Crynuvo (31-08-2017), filter (04-05-2017)
  #4  
Old 20-12-2015, 07:56
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 671
Thanks: 262
Thanked 763 Times in 279 Posts
felice2011 is on a distinguished road
My utility uses a variety of combinations for different methods, and the files placed in the folder 'resource' are not included by chance..
I checked the files included in your 'Masked Compression' method bat console and arc.ini files modified, it is not difficult to insert and update all in my utility, but the combinations of choice increased considerably, and this may be a problem ...
Reply With Quote
The Following User Says Thank You to felice2011 For This Useful Post:
filter (04-05-2017)
  #5  
Old 20-12-2015, 08:05
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
Felice if each compressor uses from 2~5 different switches then if you combine 5 programs
the amount of switches dramatically change and even a single modification is chained :P

i suggest you toy with my bat file before you try to combine it in DLG :P

I want to hear some thoughts on it ..... did you find it better ?? or worse ?? something that will help me too

as you can see clearly decompression is still the same nothing will change there at this point
masks only help the compression part hope you like this far

i have some nasty ideas on compression but only razor can help me on this because i work solo i dont have any help besides this community.
packjpg that is included in there is the exe from the latest release, i can also compile it in dll but cannot inject in precomp in order to upgrade it, if razor can inject it or better make the code use multithreading it would be great
packjpg is GPL program by the way all can get its source !!
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 2 Users Say Thank You to panker1992 For This Useful Post:
felice2011 (20-12-2015), filter (04-05-2017)
  #6  
Old 20-12-2015, 08:21
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 671
Thanks: 262
Thanked 763 Times in 279 Posts
felice2011 is on a distinguished road
Ok I will be working on the 'Masked Compression' I have a couple of titles to be compressed and are curious to know how it acts..
Meantime remove the zip file that you posted in my thread, if it is used by users and give error, by me come to break the balls for to malfunction..
Reply With Quote
The Following 2 Users Say Thank You to felice2011 For This Useful Post:
filter (04-05-2017), JRD! (20-12-2015)
  #7  
Old 20-12-2015, 09:11
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
ops you are right i assume you got the updates especially on srep you will need them
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 2 Users Say Thank You to panker1992 For This Useful Post:
filter (04-05-2017), oltjon (20-12-2015)
  #8  
Old 20-12-2015, 09:40
felice2011's Avatar
felice2011 felice2011 is offline
Registered User
 
Join Date: Feb 2011
Location: italy
Posts: 671
Thanks: 262
Thanked 763 Times in 279 Posts
felice2011 is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
ops you are right i assume you got the updates especially on srep you will need them
Do not worry...
Reply With Quote
The Following User Says Thank You to felice2011 For This Useful Post:
filter (04-05-2017)
  #9  
Old 20-12-2015, 14:31
oltjon's Avatar
oltjon oltjon is offline
Registered User
 
Join Date: Dec 2013
Location: UNITED STATES OF ALBANIA
Posts: 112
Thanks: 598
Thanked 32 Times in 30 Posts
oltjon is on a distinguished road
truly the best so far
Reply With Quote
The Following 2 Users Say Thank You to oltjon For This Useful Post:
filter (04-05-2017), panker1992 (20-12-2015)
  #10  
Old 20-12-2015, 16:17
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
@oltjon if you have weak computer the compression speed will be like half or even better
the same goes for high end computers but it can run parallel

hope you like it
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following User Says Thank You to panker1992 For This Useful Post:
filter (04-05-2017)
  #11  
Old 20-12-2015, 17:22
Amsal Amsal is offline
Registered User
 
Join Date: May 2015
Location: New Delhi
Posts: 237
Thanks: 238
Thanked 42 Times in 28 Posts
Amsal is on a distinguished road
@PANKER1992, Really THANKS A LOT FOR THIS! ONLY one question, how to extract the archives in inno script?
And Bro, tell me with reflate and without reflate. I know how to compress with reflate and with reflate, only I am asking, how to decompress the files with an inno script.
Please answer in detail!

Again thanks for the Masked Compressor, it is really very fast

Last edited by Amsal; 20-12-2015 at 17:40.
Reply With Quote
The Following 2 Users Say Thank You to Amsal For This Useful Post:
filter (04-05-2017), panker1992 (20-12-2015)
  #12  
Old 20-12-2015, 17:40
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
@Amsal really thanks, i will update decomp tomorrow so no worries

generally in decomp nothing changes, masks only exist to instruct how a compressor behaves


example: all text files are compressed next to each other and movies the same and so on
thus gaining an upper hand in everything, trying to apply the best settings in each case
so it doesnt affect decompression because decomp doesnt care what it extracts as long as it extracts


DETAILS TOMORROW its 4 morning here :P
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 2 Users Say Thank You to panker1992 For This Useful Post:
Amsal (20-12-2015), filter (04-05-2017)
  #13  
Old 20-12-2015, 17:43
Amsal Amsal is offline
Registered User
 
Join Date: May 2015
Location: New Delhi
Posts: 237
Thanks: 238
Thanked 42 Times in 28 Posts
Amsal is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
@Amsal really thanks, i will update decomp tomorrow so no worries

generally in decomp nothing changes, masks only exist to instruct how a compressor behaves


example: all text files are compressed next to each other and movies the same and so on
thus gaining an upper hand in everything, trying to apply the best settings in each case
so it doesnt affect decompression because decomp doesnt care what it extracts as long as it extracts


DETAILS TOMORROW its 4 morning here :P
Bro, here is also morning, from INDIA, you know I compressed from 1.61gb to only 98.4mb with this method, and from compressing in ultraarc it gives 1.2gb!!

That mean, your compressor is amazing, i am shocked with results!! Please post the decompression method soon as possible? I will go on vacation in 2 days, so please post as soon as possible!

Last edited by Amsal; 20-12-2015 at 17:48.
Reply With Quote
The Following 2 Users Say Thank You to Amsal For This Useful Post:
filter (04-05-2017), panker1992 (20-12-2015)
  #14  
Old 20-12-2015, 17:48
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 383
Thanks: 104
Thanked 459 Times in 215 Posts
panker1992 is on a distinguished road
now that is what i want all of you to do

very nice feedback

copy all files from my 7z somewhere and make a unpack.bat file

write inside unpack.bat

arc.exe x data1.bin -y -pYourpassword

and save this


now see how fast truly gets


Inno is coming up tomorrow ..... it works ok so no worries
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following 3 Users Say Thank You to panker1992 For This Useful Post:
Amsal (20-12-2015), filter (04-05-2017), Rahmani1811 (21-12-2015)
  #15  
Old 20-12-2015, 18:01
Amsal Amsal is offline
Registered User
 
Join Date: May 2015
Location: New Delhi
Posts: 237
Thanks: 238
Thanked 42 Times in 28 Posts
Amsal is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
now that is what i want all of you to do

very nice feedback

copy all files from my 7z somewhere and make a unpack.bat file

write inside unpack.bat

arc.exe x data1.bin -y -pYourpassword

and save this


now see how fast truly gets


Inno is coming up tomorrow ..... it works ok so no worries
Bro, I used this method, but it only creates the folder, it doesn't extract all the files, I tried, but it only made folder! Listen, Complete your decompression process/script/bat and then give all the required bat/files to us with the method to use in inno! But bro, if possible complete these all test till today night

Last edited by Amsal; 20-12-2015 at 18:05.
Reply With Quote
The Following 2 Users Say Thank You to Amsal For This Useful Post:
1234567890123 (17-02-2016), filter (04-05-2017)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Best Compression Format DRAGoN.X Chit Chat 11 07-09-2017 23:13
Dragon Age: Origins Ultimate Edition 3xDVD5 [CIU 2.0.2] NamelessOne PC Games - CD/DVD Conversions 16 03-03-2017 11:38
compression -msrep+rep+delta+nzip Danik1B9 Conversion Tutorials 11 21-12-2014 08:13
Borderlands 2: Ultimate Vault Hunter Edition - 3xDVD5 [ALL DLCs + CIU V2] REV0 PC Games - CD/DVD Conversions 7 06-07-2013 03:14
Fallout New Vegas Ultimate Edition 3xDVD9 to 2xDVD5 1LANGUAGE senseman PC Games - CD/DVD Conversions 29 04-06-2013 10:36



All times are GMT -7. The time now is 20:14.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2017, vBulletin Solutions Inc.
Copyright 2000-2017, FileForums @ http://fileforums.com