FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   [EGYcompressor] All in one compressor , From very Basic to Advanced (https://fileforums.com/showthread.php?t=98412)

aswadd 19-10-2016 05:56

[EGYcompressor] All in one compressor , From very Basic to Advanced
 
1 Attachment(s)
EGYcompressor A One For EveryOne
http://i.imgur.com/J9J5GUG.png http://i.imgur.com/NCsnCKG.png
Futures :
- Added All Pre-compressors included a Mode to test All pre-compressors on a sample & post the results & Size after to see which one suites this file / sample
(last Reflate by Shelwien & its Cls by Razor & Pzlib & Antiz & Zlib_jo & Precomp038 & precomp043 )
- Added a Mode For Zero knowledge people who doesn't understand anything in Compressing especially those who wants to do like blackBox or Corepack
- included Zlib Checker by Razor for Basic Mode
- Added a Free Mode For Masked Data Fans to feel Free to edit everything
- Added Advanced Mode , you can use up to 5 pre/compressors together with up to 4 Masks , also you can type your own method instead of hitting the alphabet character
- Added Zcm + CLS by Razor
- Added a folder selector for basic & advanced Mode
- Added 3 configuration for ram & cpu optimisation
- Edited Many things in the arc.ini file to suit most of the people
- Added a cmd Unpack Maker all you have to do is Just hit the game name & your name & you will get your cmd installer with automatic folder selector & installer
- add a few sub/masks in the arc.ini also I rewrite the arc.ini in an organized mode
- included srep last version alpha also you can specify your own parameters for it without editing arc.ini FOR EX: srep64:m3f:a64:d1g+xz
- nearly included all pre-compressors & Compressors that are comptable with arc

==============================================
after unpacking you will find 3 folders
1- CPU_RAM_OPTIMISATION
choose from this folder the one suited your SPEC and copy it's code and put it in EGYcompressor\bin\arc.ini don't forget to delete the old code of arc.ini

2-Unpack Maker
http://i.imgur.com/SzZ45hX.png
after compressing your files with arc extension you can use inno to make your installer !! don't love inno like me no problem you can make a cmd extractor from this folder Just hit Maker.bat & type your game name & your name & you will get a folder called "your installer"
here you can put all your game files with arc extension & that's all . you now have a good installer with auto folder selector
http://i.imgur.com/6ug2S4s.png http://i.imgur.com/olPA7zU.png http://i.imgur.com/8fyKswX.png

3- EGYcompressor
- Here is the compressor , I can't explain everything here so basically there are 2 launchers powershell launcher & cmd launcher so launch any of them & start to discover it
- For pre-compressors mode you should put a file from the main game data files which contain zlib streams in "0_Add_pre-compressors test files here" then launch the pre-compressors test
- For Basic you can check for Zlib Streams First then you know you should use zlib precompressor or not
- For the advanced there are 5 methods you can use so if you don't want to use all of them Just skip the rest ?? by pressing enter & not typing anything
the same in masks & pre-compressor tests
- one more thing in advanced you can use for EX:
http://i.imgur.com/L6Bj1v4.png
==============================================
~~~~~~~~~~~~~~~ ~~~In the END ~~~~~~~~~~~~~~~~~~~~~
- I'm not expert so may i was wrong about some information so I'll be happy if i saw many advices
- If something is wrong or not working I'll fix it ASAP
- As you know All of this is a batch commands/programming so in the next version I'll make many updates on the codes & tools & methods
- Again I hope from you many advices , many new ideas to develop my thoughts about compressing
- I will make A TUT when my sick internet got better :mad: ~TEDATA~
- why did i make this ? to help everyone even those who know nothing about compressing & since there is no updates for masked data by PANKER
- All Greetz go to Fileforums & all of its members who are giving advices and
information for free , I'm only a student so this work in nothing compared to what others did .

aswadd 19-10-2016 06:03

I hope the moderator won't delete the Formatting :D Also if you could make this thread looks better so be it

Gupta 19-10-2016 06:20

from image it looks like u r using ppx2 with precomp
don't u think this will create a lot of confusion between precomp running in parallel...
precomp will lost the stream thats it just found between the mess of temp file created by another precomp
will ultimately slow down the all the instances of precomp running

aswadd 19-10-2016 06:36

Quote:

Originally Posted by PrinceGupta2000 (Post 452992)
from image it looks like u r using ppx2 with precomp
don't u think this will create a lot of confusion between precomp running in parallel...
precomp will lost the stream thats it just found between the mess of temp file created by another precomp
will ultimately slow down the all the instances of precomp running

no i didn't used ppx2 I only said it will be the best if you used it :D
& For ppx2 I usually uses it even on 60 GB Folder it works fine without any problem or lag or slow 'cause precomp usually gets slower & slower if the file size is bigger the same as fitgirl & SYTER they also uses it without any problem :)

aswadd 19-10-2016 06:44

one Precomp process will take around 20% of your cpu [2cores i3] so using 3 of precomp will take around 80% at most but speed is 3X & yes no errors during packing or even unpacking but instead of wasting 4~6 hours to unpack a single 70GB Folder you will do it in less than 1.5 hour :)
===========
one more thing precomp is very slow on larg files but very fast on small files that's what i saw
so if you have a 7GB File I'd prefere to use antiz instead on precomp & if the file is 2 GB of course precomp will be better than antiz
In General PPX2 with precomp is the best way :)

ChronoCross 19-10-2016 06:55

Good work!.
I think likes princegupta2000. Maybe creating a temp-random folder for each precomp proccess from cmd or from precomp source code.

aswadd 19-10-2016 07:00

Quote:

Originally Posted by ChronoCross (Post 452996)
Good work!.
I think likes princegupta2000. Maybe creating a temp-random folder for each precomp proccess from cmd or from precomp source code.

Strange I used it many times without separating the 3 precomp temp files , packing & unpacking without any problem & also I played the games after doing this & no problem in the game :D

lolaya 19-10-2016 07:00

lol xD Egy .........

aswadd 19-10-2016 07:02

Quote:

Originally Posted by lolaya (Post 452998)
lol xD Egy .........

hahah ~TEDATA~
I want to know your opinion my friend :D

Gupta 19-10-2016 07:07

run two or more precomp at a time on different cmd with verbose mode with same work directory
and read the verbose
u will find a lots of message of lost streams
try it yourself....

aswadd 19-10-2016 07:12

Quote:

Originally Posted by PrinceGupta2000 (Post 453001)
run two or more precomp at a time on different cmd with verbose mode with same work directory
and read the verbose
u will find a lots of message of lost streams
try it yourself....

:D Man why you don't want to believe
dir /b *.pdf |MT -P 3 -L 1 precomp038 -slow "{}"
dir /b *.arch05 |MT -P 3 -L 1 precomp043 -intense "{}"
try it yourself or even try on 100GB Folder , For Me I tried on 20GB & 60GB & even 10 GB All works with no errors

Gupta 19-10-2016 07:19

i tried these things and even more such things long ago and know the consequences
if u don't wanna believe its ur life man......lol

may be every senior member will agree with me
if u want multiple instances of precomp running at time, set different work directory
for every precomp. thats my advice

aswadd 19-10-2016 07:30

@PrinceGupta2000 thnx If i faced the problem you had faced I'll do like what you said , However here is a pic of one of the games i used on & yes decompression success & I played it without any problem .
http://i.imgur.com/tGkuCC0.png
But i want to know something fitgirl & syter uses ppx2 with the same work directory in decompression & yes all temp files are in the same work directory ?
Anyway I don't need ppx2 with a small batch file i can do this job :]
Again thnx for your advice :)

Gupta 19-10-2016 07:58

while using ppx2 during restroration things will work gracefully while restoration becoz precomp not makes any temp files during restoration at all, its save evrything required to restore the file during recompression part
all i m saying while using ppx2 + precomp during recompression process, all precomp have same work directory so they all make temp files in same directory many a times overwriting the one make by another instance of precomp, this led to the extra work for precomp becoz it have to do everthing again to find the stream that it already found some time ago
so if u set different work directory, u will get better results significantly, no problem..... they will do everything right even if they got same work directory to work.. precomp is written in such a way ... no problem at all
all i m saying set the differnt work directory for some better results

while restoration it doesn't matter, no temp files at all

aswadd 19-10-2016 08:18

@PrinceGupta2000 if i'm not wrong ! those are temp files !! & yes this is an unpacking & all temp files in the same folder & each precomp of them has it's own temp file so temp files won't be mixed ! Am i wrong :D ?
http://i.imgur.com/P4rWYb2.png

Gupta 19-10-2016 08:42

thats what i said there is no affect while restoration at all....
observe the dat file they are 0 kb and will be the same during whole process, precomp not uses temps during restoration at all bt precomp always make a temp file if the same exists it rename it to something else bt while recompression it constantly new temp file with every stream it finds, the version u r reffering to makes 4 temp files per stream (decompression -> recompression -> decompression -> recompression), the last 2 only used for partial matches, at same time, so think urself three precomp running at a time, total 12 temp files, there are no communication between all these precomp instances ,all wills to write the temp file with same name (default one tempfile1, tempfile2....etc) and overwrite others temp file manytimes and which led to more work for the prcomp

bt while restoration things are differrent precomp no longer checks crc and all that stuffs becaz everything is already done while recompressing part, so no need of temp files at all..... thats why u see only 1 tempfile which is of 0 kb only, precomp not even uses those at all means u can use ppx2 while restoring safely bt not when recompressing

aswadd 19-10-2016 08:47

ok now to be safe & sure Just separate precomps :) thnx PrinceGupta2000 for the illustration

felice2011 19-10-2016 09:01

Great job aswadd, I am reminded of one of my first multi-compressors developed in dos here in the forum in the far 2011, you're good you are one who learns quickly...;)

RamiroCruzo 19-10-2016 09:36

1 Attachment(s)
Great job matey.

"-mmt=3 is the nimber of threads to use so if you have 12 threads Just put 11 but don't put
12 'cause xz will make heavy usage
d300m is the dictionary size i think you should read about it first
BTW the more dictionary the more your file will be smaller"

do mention that more threads affect final output.

aswadd 19-10-2016 12:25

Quote:

Originally Posted by RamiroCruzo (Post 453017)
Great job matey.

"-mmt=3 is the nimber of threads to use so if you have 12 threads Just put 11 but don't put
12 'cause xz will make heavy usage
d300m is the dictionary size i think you should read about it first
BTW the more dictionary the more your file will be smaller"

do mention that more threads affect final output.

Good to know that thnx :) I'll update xz & 7z next time

AHMED SAMI 20-10-2016 18:56

Good Work Pro

aswadd 21-10-2016 03:49

Quote:

Originally Posted by AHMED SAMI (Post 453036)
Good Work Pro

thnx bro

1234567890123 21-10-2016 06:38

why we are using just precomp3 (precomp45) for*.jpg *.jpeg *.png *.gif *.img *.mp3 *.pdf *.swf is it good?
i have a srep that you can set m5f not m3f any difference?

aswadd 21-10-2016 08:51

Quote:

Originally Posted by 1234567890123 (Post 453048)
why we are using just precomp3 (precomp45) for*.jpg *.jpeg *.png *.gif *.img *.mp3 *.pdf *.swf is it good?
i have a srep that you can set m5f not m3f any difference?

yeb there is a difference :) as I saw a comparison by someone here
precomp045 is very slower than precomp043 (intense mode) but with the same ratio
so I used precomp045 only for mp3 & jpg because it has the latest libraries for jpg & mp3 ..etc compression in it :)
for srep
m3f require less ram than m5f I saw this in a comparison on freearc website also nearly the same ratio but m5f will be slower & require much ram :)

BTW you can use m3f/m4f/m5f in the compression without editing arc.ini
forEX:
srep:m5f:a64:d1g+lzma:max:256m

LuzhinE 30-10-2016 12:55

ANTIZ testing, what I recommend combining with lzma?

aswadd 30-10-2016 14:18

Quote:

Originally Posted by LuzhinE (Post 453286)
ANTIZ testing, what I recommend combining with lzma?

Antiz like precomp but with fast speed & intense mode :) I recommend it when you have a small game like 7GB & you can use srep+lzma or even xz or as you wish :)

LuzhinE 31-10-2016 16:56

I just did a test with EGYcompressor used reflate+lzma

Pro Evolution Soccer 2017
Repack Size: 3.51 GB As CP

Failed to uncompress remains stuck on 28% inno setup

With maker.bat 50%

aswadd 01-11-2016 11:18

Quote:

Originally Posted by LuzhinE (Post 453338)
I just did a test with EGYcompressor used reflate+lzma

Pro Evolution Soccer 2017
Repack Size: 3.51 GB As CP

Failed to uncompress remains stuck on 28% inno setup

With maker.bat 50%

for me stuck at 60% it seems a bug in reflate :(

SAM2712 01-11-2016 23:26

1 Attachment(s)
Aswadd , I have problem about this...:confused:
I m using free.bat & wahen trying to decompress by ur Unpack Maker then it appears & fails to extract :confused:
One thing more I want to know..Unpack Maker will extract single or every bin files in folder itself or do i need to extract Ist.bin after 2nd.bin :confused:

aswadd 02-11-2016 00:55

Quote:

Originally Posted by SAM2712 (Post 453375)
Aswadd , I have problem about this...:confused:
I m using free.bat & wahen trying to decompress by ur Unpack Maker then it appears & fails to extract :confused:
One thing more I want to know..Unpack Maker will extract single or every bin files in folder itself or do i need to extract Ist.bin after 2nd.bin :confused:

- will extract all arc files one after another
- for access is denied this is a security issue try this one
http://www.howtogeek.com/howto/windo...menu-in-vista/

SAM2712 02-11-2016 06:59

Even doesn't work aswadd...:(
I tried this: Right click on folder (having bin files & ur unpacker) >Take ownership> Trying unpacker> still Issue Access is denied about 7z.exe :(

aswadd 02-11-2016 07:37

1 Attachment(s)
Quote:

Originally Posted by SAM2712 (Post 453377)
Even doesn't work aswadd...:(
I tried this: Right click on folder (having bin files & ur unpacker) >Take ownership> Trying unpacker> still Issue Access is denied about 7z.exe :(

Sam try this one
- try to add everyone permission
- if the problem still happens check if any anti-virus or malwar program blocks 7z.exe
- if still happens try to add other 7z version

HLM 02-11-2016 16:57

Thank you for everybody who has helped with repacks + cracks and dedicated there time to teach others, I come from ps3 cfw and its gone downhill poorly, with RTM tools being sold and IDPS being stolen daily. :/ NGU are thugs :(
I hope to learn here and to be part of being able to understand how this really works,

I have started to understand the basics and this tool has been the best so far ever produced for noobs,

Just have a question if any of you gurus wish to share some info.

After studying od some ISS scripts, i cannot seem to work out how to auto install C++x86 ect. I get build errors and i am stuck, can anybody help me with a ISS script that i can install DLC addons and also c++ ect as an auto installer, this would help much with my learning.

Also a windows phone theme like corepack uses would be kool.

Thanks for taking time out to offer any assistance.


Question woudl be how to use the .arc file output into a installer? Like an ISS script? that would really help thank you :)
Peace <3

aswadd 02-11-2016 20:16

Quote:

Originally Posted by HLM (Post 453397)
Thank you for everybody who has helped with repacks + cracks and dedicated there time to teach others, I come from ps3 cfw and its gone downhill poorly, with RTM tools being sold and IDPS being stolen daily. :/ NGU are thugs :(
I hope to learn here and to be part of being able to understand how this really works,

I have started to understand the basics and this tool has been the best so far ever produced for noobs,

Just have a question if any of you gurus wish to share some info.

After studying od some ISS scripts, i cannot seem to work out how to auto install C++x86 ect. I get build errors and i am stuck, can anybody help me with a ISS script that i can install DLC addons and also c++ ect as an auto installer, this would help much with my learning.

Also a windows phone theme like corepack uses would be kool.

Thanks for taking time out to offer any assistance.


Question woudl be how to use the .arc file output into a installer? Like an ISS script? that would really help thank you :)
Peace <3

welcome here bro I'm currently working on a next version which will be so far a better one ;) & for all TUT & how to use & edit iss scripts I recommend you to start from here
see this thread created by @Razor
http://fileforums.com/showthread.php?t=96782

For ur last question you should but the all .arc files beside the complied iss script (setup.exe) after editing the source of it to extract the arc files also if you used msc / xz / fzip ...etc you should include the exe file of it & sometimes you must include the cls to get it work with the iss script

SAM2712 04-11-2016 09:22

Quote:

Originally Posted by aswadd (Post 453378)
Sam try this one
- try to add everyone permission
- if the problem still happens check if any anti-virus or malwar program blocks 7z.exe
- if still happens try to add other 7z version

Aswadd ..Sorry for late reply :o Was going out of home.
I tested ur given unpacker Still Unworked :confused:
Now issue also with srep like Access is denied :confused:
I will post my issue with video tomorrow :rolleyes:

aswadd 04-11-2016 12:25

Quote:

Originally Posted by SAM2712 (Post 453492)
Aswadd ..Sorry for late reply :o Was going out of home.
I tested ur given unpacker Still Unworked :confused:
Now issue also with srep like Access is denied :confused:
I will post my issue with video tomorrow :rolleyes:

did you try on another pc ?
did you check your antivirus ?
did you try to use it on C:\ drive ?

unpack maker its first aim is to make a batch to extract so you can easily edit bin.egy you can delete tools from it or add your own & egy.ini is the arc.ini so try to edit those 2 :) but don't change their names

ZAZA4EVER 28-11-2016 22:24

great job man

aswadd 29-11-2016 03:17

Quote:

Originally Posted by ZAZA4EVER (Post 454092)
great job man

Again another egyptian :D

EzzEldin16 03-12-2016 02:06

@aswadd atleast there is some of them here :D

Joe Forster/STA 03-12-2016 06:19

(Fun fact: "egy" means "one" in Hungarian so it is very appropriate for an "all-in-one" software. :))


All times are GMT -7. The time now is 13:28.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com