PDA

View Full Version : [EGYcompressor] All in one compressor , From very Basic to Advanced


aswadd
19-10-2016, 05:56
EGYcompressor A One For EveryOne
http://i.imgur.com/J9J5GUG.png http://i.imgur.com/NCsnCKG.png
Futures :
- Added All Pre-compressors included a Mode to test All pre-compressors on a sample & post the results & Size after to see which one suites this file / sample
(last Reflate by Shelwien & its Cls by Razor & Pzlib & Antiz & Zlib_jo & Precomp038 & precomp043 )
- Added a Mode For Zero knowledge people who doesn't understand anything in Compressing especially those who wants to do like blackBox or Corepack
- included Zlib Checker by Razor for Basic Mode
- Added a Free Mode For Masked Data Fans to feel Free to edit everything
- Added Advanced Mode , you can use up to 5 pre/compressors together with up to 4 Masks , also you can type your own method instead of hitting the alphabet character
- Added Zcm + CLS by Razor
- Added a folder selector for basic & advanced Mode
- Added 3 configuration for ram & cpu optimisation
- Edited Many things in the arc.ini file to suit most of the people
- Added a cmd Unpack Maker all you have to do is Just hit the game name & your name & you will get your cmd installer with automatic folder selector & installer
- add a few sub/masks in the arc.ini also I rewrite the arc.ini in an organized mode
- included srep last version alpha also you can specify your own parameters for it without editing arc.ini FOR EX: srep64:m3f:a64:d1g+xz
- nearly included all pre-compressors & Compressors that are comptable with arc
==============================================
after unpacking you will find 3 folders
1- CPU_RAM_OPTIMISATION
choose from this folder the one suited your SPEC and copy it's code and put it in EGYcompressor\bin\arc.ini don't forget to delete the old code of arc.ini

2-Unpack Maker
http://i.imgur.com/SzZ45hX.png
after compressing your files with arc extension you can use inno to make your installer !! don't love inno like me no problem you can make a cmd extractor from this folder Just hit Maker.bat & type your game name & your name & you will get a folder called "your installer"
here you can put all your game files with arc extension & that's all . you now have a good installer with auto folder selector
http://i.imgur.com/6ug2S4s.png http://i.imgur.com/olPA7zU.png http://i.imgur.com/8fyKswX.png

3- EGYcompressor
- Here is the compressor , I can't explain everything here so basically there are 2 launchers powershell launcher & cmd launcher so launch any of them & start to discover it
- For pre-compressors mode you should put a file from the main game data files which contain zlib streams in "0_Add_pre-compressors test files here" then launch the pre-compressors test
- For Basic you can check for Zlib Streams First then you know you should use zlib precompressor or not
- For the advanced there are 5 methods you can use so if you don't want to use all of them Just skip the rest ?? by pressing enter & not typing anything
the same in masks & pre-compressor tests
- one more thing in advanced you can use for EX:
http://i.imgur.com/L6Bj1v4.png
==============================================
~~~~~~~~~~~~~~~ ~~~In the END ~~~~~~~~~~~~~~~~~~~~~
- I'm not expert so may i was wrong about some information so I'll be happy if i saw many advices
- If something is wrong or not working I'll fix it ASAP
- As you know All of this is a batch commands/programming so in the next version I'll make many updates on the codes & tools & methods
- Again I hope from you many advices , many new ideas to develop my thoughts about compressing
- I will make A TUT when my sick internet got better :mad: ~TEDATA~
- why did i make this ? to help everyone even those who know nothing about compressing & since there is no updates for masked data by PANKER
- All Greetz go to Fileforums & all of its members who are giving advices and
information for free , I'm only a student so this work in nothing compared to what others did .

aswadd
19-10-2016, 06:03
I hope the moderator won't delete the Formatting :D Also if you could make this thread looks better so be it

Gupta
19-10-2016, 06:20
from image it looks like u r using ppx2 with precomp
don't u think this will create a lot of confusion between precomp running in parallel...
precomp will lost the stream thats it just found between the mess of temp file created by another precomp
will ultimately slow down the all the instances of precomp running

aswadd
19-10-2016, 06:36
from image it looks like u r using ppx2 with precomp
don't u think this will create a lot of confusion between precomp running in parallel...
precomp will lost the stream thats it just found between the mess of temp file created by another precomp
will ultimately slow down the all the instances of precomp running no i didn't used ppx2 I only said it will be the best if you used it :D
& For ppx2 I usually uses it even on 60 GB Folder it works fine without any problem or lag or slow 'cause precomp usually gets slower & slower if the file size is bigger the same as fitgirl & SYTER they also uses it without any problem :)

aswadd
19-10-2016, 06:44
one Precomp process will take around 20% of your cpu [2cores i3] so using 3 of precomp will take around 80% at most but speed is 3X & yes no errors during packing or even unpacking but instead of wasting 4~6 hours to unpack a single 70GB Folder you will do it in less than 1.5 hour :)
===========
one more thing precomp is very slow on larg files but very fast on small files that's what i saw
so if you have a 7GB File I'd prefere to use antiz instead on precomp & if the file is 2 GB of course precomp will be better than antiz
In General PPX2 with precomp is the best way :)

ChronoCross
19-10-2016, 06:55
Good work!.
I think likes princegupta2000. Maybe creating a temp-random folder for each precomp proccess from cmd or from precomp source code.

aswadd
19-10-2016, 07:00
Good work!.
I think likes princegupta2000. Maybe creating a temp-random folder for each precomp proccess from cmd or from precomp source code.
Strange I used it many times without separating the 3 precomp temp files , packing & unpacking without any problem & also I played the games after doing this & no problem in the game :D

lolaya
19-10-2016, 07:00
lol xD Egy .........

aswadd
19-10-2016, 07:02
lol xD Egy .........
hahah ~TEDATA~
I want to know your opinion my friend :D

Gupta
19-10-2016, 07:07
run two or more precomp at a time on different cmd with verbose mode with same work directory
and read the verbose
u will find a lots of message of lost streams
try it yourself....

aswadd
19-10-2016, 07:12
run two or more precomp at a time on different cmd with verbose mode with same work directory
and read the verbose
u will find a lots of message of lost streams
try it yourself....
:D Man why you don't want to believe
dir /b *.pdf |MT -P 3 -L 1 precomp038 -slow "{}"
dir /b *.arch05 |MT -P 3 -L 1 precomp043 -intense "{}"
try it yourself or even try on 100GB Folder , For Me I tried on 20GB & 60GB & even 10 GB All works with no errors

Gupta
19-10-2016, 07:19
i tried these things and even more such things long ago and know the consequences
if u don't wanna believe its ur life man......lol

may be every senior member will agree with me
if u want multiple instances of precomp running at time, set different work directory
for every precomp. thats my advice

aswadd
19-10-2016, 07:30
@PrinceGupta2000 thnx If i faced the problem you had faced I'll do like what you said , However here is a pic of one of the games i used on & yes decompression success & I played it without any problem .
http://i.imgur.com/tGkuCC0.png
But i want to know something fitgirl & syter uses ppx2 with the same work directory in decompression & yes all temp files are in the same work directory ?
Anyway I don't need ppx2 with a small batch file i can do this job :]
Again thnx for your advice :)

Gupta
19-10-2016, 07:58
while using ppx2 during restroration things will work gracefully while restoration becoz precomp not makes any temp files during restoration at all, its save evrything required to restore the file during recompression part
all i m saying while using ppx2 + precomp during recompression process, all precomp have same work directory so they all make temp files in same directory many a times overwriting the one make by another instance of precomp, this led to the extra work for precomp becoz it have to do everthing again to find the stream that it already found some time ago
so if u set different work directory, u will get better results significantly, no problem..... they will do everything right even if they got same work directory to work.. precomp is written in such a way ... no problem at all
all i m saying set the differnt work directory for some better results

while restoration it doesn't matter, no temp files at all

aswadd
19-10-2016, 08:18
@PrinceGupta2000 if i'm not wrong ! those are temp files !! & yes this is an unpacking & all temp files in the same folder & each precomp of them has it's own temp file so temp files won't be mixed ! Am i wrong :D ?
http://i.imgur.com/P4rWYb2.png

Gupta
19-10-2016, 08:42
thats what i said there is no affect while restoration at all....
observe the dat file they are 0 kb and will be the same during whole process, precomp not uses temps during restoration at all bt precomp always make a temp file if the same exists it rename it to something else bt while recompression it constantly new temp file with every stream it finds, the version u r reffering to makes 4 temp files per stream (decompression -> recompression -> decompression -> recompression), the last 2 only used for partial matches, at same time, so think urself three precomp running at a time, total 12 temp files, there are no communication between all these precomp instances ,all wills to write the temp file with same name (default one tempfile1, tempfile2....etc) and overwrite others temp file manytimes and which led to more work for the prcomp

bt while restoration things are differrent precomp no longer checks crc and all that stuffs becaz everything is already done while recompressing part, so no need of temp files at all..... thats why u see only 1 tempfile which is of 0 kb only, precomp not even uses those at all means u can use ppx2 while restoring safely bt not when recompressing

aswadd
19-10-2016, 08:47
ok now to be safe & sure Just separate precomps :) thnx PrinceGupta2000 for the illustration

felice2011
19-10-2016, 09:01
Great job aswadd, I am reminded of one of my first multi-compressors developed in dos here in the forum in the far 2011, you're good you are one who learns quickly...;)

RamiroCruzo
19-10-2016, 09:36
Great job matey.

"-mmt=3 is the nimber of threads to use so if you have 12 threads Just put 11 but don't put
12 'cause xz will make heavy usage
d300m is the dictionary size i think you should read about it first
BTW the more dictionary the more your file will be smaller"

do mention that more threads affect final output.

aswadd
19-10-2016, 12:25
Great job matey.

"-mmt=3 is the nimber of threads to use so if you have 12 threads Just put 11 but don't put
12 'cause xz will make heavy usage
d300m is the dictionary size i think you should read about it first
BTW the more dictionary the more your file will be smaller"

do mention that more threads affect final output.

Good to know that thnx :) I'll update xz & 7z next time

AHMED SAMI
20-10-2016, 18:56
Good Work Pro

aswadd
21-10-2016, 03:49
Good Work Pro thnx bro

1234567890123
21-10-2016, 06:38
why we are using just precomp3 (precomp45) for*.jpg *.jpeg *.png *.gif *.img *.mp3 *.pdf *.swf is it good?
i have a srep that you can set m5f not m3f any difference?

aswadd
21-10-2016, 08:51
why we are using just precomp3 (precomp45) for*.jpg *.jpeg *.png *.gif *.img *.mp3 *.pdf *.swf is it good?
i have a srep that you can set m5f not m3f any difference?

yeb there is a difference :) as I saw a comparison by someone here
precomp045 is very slower than precomp043 (intense mode) but with the same ratio
so I used precomp045 only for mp3 & jpg because it has the latest libraries for jpg & mp3 ..etc compression in it :)
for srep
m3f require less ram than m5f I saw this in a comparison on freearc website also nearly the same ratio but m5f will be slower & require much ram :)

BTW you can use m3f/m4f/m5f in the compression without editing arc.ini
forEX:
srep:m5f:a64:d1g+lzma:max:256m

LuzhinE
30-10-2016, 12:55
ANTIZ testing, what I recommend combining with lzma?

aswadd
30-10-2016, 14:18
ANTIZ testing, what I recommend combining with lzma?

Antiz like precomp but with fast speed & intense mode :) I recommend it when you have a small game like 7GB & you can use srep+lzma or even xz or as you wish :)

LuzhinE
31-10-2016, 16:56
I just did a test with EGYcompressor used reflate+lzma

Pro Evolution Soccer 2017
Repack Size: 3.51 GB As CP

Failed to uncompress remains stuck on 28% inno setup

With maker.bat 50%

aswadd
01-11-2016, 11:18
I just did a test with EGYcompressor used reflate+lzma

Pro Evolution Soccer 2017
Repack Size: 3.51 GB As CP

Failed to uncompress remains stuck on 28% inno setup

With maker.bat 50%

for me stuck at 60% it seems a bug in reflate :(

SAM2712
01-11-2016, 23:26
Aswadd , I have problem about this...:confused:
I m using free.bat & wahen trying to decompress by ur Unpack Maker then it appears & fails to extract :confused:
One thing more I want to know..Unpack Maker will extract single or every bin files in folder itself or do i need to extract Ist.bin after 2nd.bin :confused:

aswadd
02-11-2016, 00:55
Aswadd , I have problem about this...:confused:
I m using free.bat & wahen trying to decompress by ur Unpack Maker then it appears & fails to extract :confused:
One thing more I want to know..Unpack Maker will extract single or every bin files in folder itself or do i need to extract Ist.bin after 2nd.bin :confused:

- will extract all arc files one after another
- for access is denied this is a security issue try this one
http://www.howtogeek.com/howto/windows-vista/add-take-ownership-to-explorer-right-click-menu-in-vista/

SAM2712
02-11-2016, 06:59
Even doesn't work aswadd...:(
I tried this: Right click on folder (having bin files & ur unpacker) >Take ownership> Trying unpacker> still Issue Access is denied about 7z.exe :(

aswadd
02-11-2016, 07:37
Even doesn't work aswadd...:(
I tried this: Right click on folder (having bin files & ur unpacker) >Take ownership> Trying unpacker> still Issue Access is denied about 7z.exe :(

Sam try this one
- try to add everyone permission
- if the problem still happens check if any anti-virus or malwar program blocks 7z.exe
- if still happens try to add other 7z version

HLM
02-11-2016, 16:57
Thank you for everybody who has helped with repacks + cracks and dedicated there time to teach others, I come from ps3 cfw and its gone downhill poorly, with RTM tools being sold and IDPS being stolen daily. :/ NGU are thugs :(
I hope to learn here and to be part of being able to understand how this really works,

I have started to understand the basics and this tool has been the best so far ever produced for noobs,

Just have a question if any of you gurus wish to share some info.

After studying od some ISS scripts, i cannot seem to work out how to auto install C++x86 ect. I get build errors and i am stuck, can anybody help me with a ISS script that i can install DLC addons and also c++ ect as an auto installer, this would help much with my learning.

Also a windows phone theme like corepack uses would be kool.

Thanks for taking time out to offer any assistance.


Question woudl be how to use the .arc file output into a installer? Like an ISS script? that would really help thank you :)
Peace <3

aswadd
02-11-2016, 20:16
Thank you for everybody who has helped with repacks + cracks and dedicated there time to teach others, I come from ps3 cfw and its gone downhill poorly, with RTM tools being sold and IDPS being stolen daily. :/ NGU are thugs :(
I hope to learn here and to be part of being able to understand how this really works,

I have started to understand the basics and this tool has been the best so far ever produced for noobs,

Just have a question if any of you gurus wish to share some info.

After studying od some ISS scripts, i cannot seem to work out how to auto install C++x86 ect. I get build errors and i am stuck, can anybody help me with a ISS script that i can install DLC addons and also c++ ect as an auto installer, this would help much with my learning.

Also a windows phone theme like corepack uses would be kool.

Thanks for taking time out to offer any assistance.


Question woudl be how to use the .arc file output into a installer? Like an ISS script? that would really help thank you :)
Peace <3

welcome here bro I'm currently working on a next version which will be so far a better one ;) & for all TUT & how to use & edit iss scripts I recommend you to start from here
see this thread created by @Razor
http://fileforums.com/showthread.php?t=96782

For ur last question you should but the all .arc files beside the complied iss script (setup.exe) after editing the source of it to extract the arc files also if you used msc / xz / fzip ...etc you should include the exe file of it & sometimes you must include the cls to get it work with the iss script

SAM2712
04-11-2016, 09:22
Sam try this one
- try to add everyone permission
- if the problem still happens check if any anti-virus or malwar program blocks 7z.exe
- if still happens try to add other 7z version
Aswadd ..Sorry for late reply :o Was going out of home.
I tested ur given unpacker Still Unworked :confused:
Now issue also with srep like Access is denied :confused:
I will post my issue with video tomorrow :rolleyes:

aswadd
04-11-2016, 12:25
Aswadd ..Sorry for late reply :o Was going out of home.
I tested ur given unpacker Still Unworked :confused:
Now issue also with srep like Access is denied :confused:
I will post my issue with video tomorrow :rolleyes:

did you try on another pc ?
did you check your antivirus ?
did you try to use it on C:\ drive ?

unpack maker its first aim is to make a batch to extract so you can easily edit bin.egy you can delete tools from it or add your own & egy.ini is the arc.ini so try to edit those 2 :) but don't change their names

ZAZA4EVER
28-11-2016, 22:24
great job man

aswadd
29-11-2016, 03:17
great job man

Again another egyptian :D

EzzEldin16
03-12-2016, 02:06
@aswadd atleast there is some of them here :D

Joe Forster/STA
03-12-2016, 06:19
(Fun fact: "egy" means "one" in Hungarian so it is very appropriate for an "all-in-one" software. :))

EzzEldin16
07-12-2016, 03:34
thanks joe for the fact and also it means egyptian in arabic :D

harshlohaan
29-07-2017, 08:48
Thank you for the compressor. I appreciate your work.
Currently I'm compressing 7.73 GB of data using the method "pzlib+msc+srep64:m3f:a16:d1g+xz". It was specified to be a faster method.. as above there was a slow method too which I didn't choose, and the compression seems stuck. It has already taken more than 2 hours and is frozen at 14.7%. And I see no progress since last half an hour.. it is the same last line U_dds. What's going on?? :confused:

And I wanted to know if I could change the result i.e. DATA_BASIC.arc's container to something else.. anything like .cpi or something else?
https://s2.postimg.org/txb30hvu1/Creating_your_Data_BASIC.arc.png

Simorq
29-07-2017, 09:05
Thank you for the compressor. I appreciate your work.
Currently I'm compressing 7.73 GB of data using the method "pzlib+msc+srep64:m3f:a16:d1g+xz". It was specified to be a faster method.. as above there was a slow method too which I didn't choose, and the compression seems stuck. It has already taken more than 2 hours and is frozen at 14.7%. And I see no progress since last half an hour.. it is the same last line U_dds. What's going on?? :confused:

And I wanted to know if I could change the result i.e. DATA_BASIC.arc's container to something else.. anything like .cpi or something else?
https://s2.postimg.org/txb30hvu1/Creating_your_Data_BASIC.arc.png

MSC is not compatible with pzlib

Use these settings for pzlib

[External compressor:pzlib2017]
header = 0
packcmd = pZLib e {options} -c64m -t25p - -o - $$arcdatafile$$.tmp -o - <stdout>
unpackcmd = pZLib d {options} -t90p - -o - <stdin> <stdout>