PDA

View Full Version : ZCM with Freearc


~MAK~
29-09-2016, 22:09
Decompression with Freearc is now currently available by Razor.


As I seen, many people told that ZCM is not supported for freearc, and aswadd wants a working example of ZCM with freearc, so I thought to make a new thread instead which could help people, (don't mind if it is called as 'SPAM')

One more things guys, I have heard that ZCM 0.93 is case sensitive, anyways, as I think it will not matter with FreeArc because freearc already made it in one file input only.

You could rename zcmx64 to zcm if you have 64bit processor and you are running 64bit Operating System

Some commands and switches details (you could apply them in arc.ini) -

<Commands>
a Add files to archive
x Extract files in destination path
l List archive

<Switches>
t<0...8> number of task (0=autodetect,default=1)
r Recurse subdirectories
s Solid Mode ON
v Verbose Mode
m [default -m4] Compression Method/Memory (-m0 ... -m7) (m8 is available for x64)


Use above commands and switches with the CLS.ini in the encode line

Thanks Razor12911 for making CLS


Here some test pics -
http://i.imgur.com/IXKonH0.png
http://i.imgur.com/AeNmYVK.png

JRD!
29-09-2016, 22:52
I'm thinking about a concept of adding external conpresseur dynamically, so any external compressor compatible with FreeArc interested me much thank you for this.

~MAK~
30-09-2016, 01:38
I'm thinking about a concept of adding external conpresseur dynamically, so any external compressor compatible with FreeArc interested me much thank you for this.

Your welcome.

aswadd
30-09-2016, 02:16
O.o something wrong is going on it increases the size not compressing
Compressed 20 files, 75,397,181 => 93,247,590 bytes. Ratio 123.6%

~MAK~
30-09-2016, 02:20
Use srep+lzma after zcm and you will see the final size and compare with precoml+srep+lzma, you will see almost same results ;)

aswadd
30-09-2016, 02:20
arc is collecting the final compressed file and the first packed file into the last output :(

aswadd
30-09-2016, 02:22
Archive is I:\1\MyMask\temp\freearc313767405.tmp\$$arcdatafil e$$.tmp
argc=*
100% Compressed 75397181 bytes to 17850408 bytes
100%
Errorlevel=0
Compressed 20 files, 75,397,181 => 93,247,590 bytes. Ratio 123.6%
Compression time: cpu 0.14 secs, real 32.22 secs. Speed 2,340 kB/s
All OK
=======================================
75397181+17850408=93247589
it's not a precompressor it's an issue :( it collects the original data & the compressed data in one archive

~MAK~
30-09-2016, 02:25
arc is collecting the final compressed file and the first packed file into the last output :(

Hmm matey, I didn't get you, but whatever you are saying is not happening and zcm works like this way only, see this bench also, you will know -

http://encode.ru/threads/1432-Experimental-new-ZCM-file-compressor!?p=27672&viewfull=1#post27672

aswadd
30-09-2016, 02:26
here is the solution :D
packcmd = zcmx64 a -s -r -m8 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
================================================== =======
Compressed 20 files, 75,397,181 => 17,850,409 bytes. Ratio 23.6%
Compression time: cpu 0.06 secs, real 32.83 secs. Speed 2,297 kB/s
All OK

~MAK~
30-09-2016, 02:29
OK matey, give me some hours, I have to go for now, will sort out this issue soon :)

~MAK~
30-09-2016, 02:29
Matey, BTW which method you used in arc.ini?

aswadd
30-09-2016, 02:30
ok :) I'm waiting

aswadd
30-09-2016, 02:32
only zcm :) the idea to get it work is to reverse $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
but i still get decompression failed :D

aswadd
30-09-2016, 02:34
I'm using zcmx64 last version it already has m8 method but maybe other versions don't have it :)

~MAK~
30-09-2016, 02:35
only zcm :) the idea to get it work is to reverse $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
but i still get decompression failed :D

Matey, as per me this is fully wrong process in the view with freearc, anyways, you give me results with -m7, I can't test everything right now because I am on mobile

~MAK~
30-09-2016, 02:37
I'm using zcmx64 last version it already has m8 method but maybe other versions don't have it :)

Nope matey, anyhow the latest version is 0.93 which is included with my release, and if you don't believe me then please readout the last forum of zcm and even then you not believe then just checkout help area eight hat tool, you will know that am right!

aswadd
30-09-2016, 02:40
m7
Compressed 20 files, 75,397,181 => 17,849,995 bytes. Ratio 23.6%
Compression time: cpu 0.12 secs, real 29.21 secs. Speed 2,581 kB/s

aswadd
30-09-2016, 02:42
http://i.imgur.com/kMaa8ct.png
it has m8 method :) zcm 0.93 X64 version
x86 version has only until m7 method :)

~MAK~
30-09-2016, 02:49
OK matey, you are right, I just turned on my PC and seen that the infile should be placed after the archive output, so the pattern is correct ;) I will update my thread my tools, thanks for telling the mistake, am always in hurry like now too ;)

aswadd
30-09-2016, 02:58
OK matey, you are right, I just turned on my PC and seen that the infile should be placed after the archive output, so the pattern is correct ;) I will update my thread my tools, thanks for telling the mistake, am always in hurry like now too ;)
the main problem not in the ratio or compression :( it's from the decompression it always failed :(

aswadd
30-09-2016, 04:10
we need to know where is the problem to solve it Compression is always success but decompression whatever i did it always fail .. we need to open freearc temp files to see where is the problem ? or it's not comp table with arc :(
Errorlevel=1
ERROR: invalid compression method or parameters in zcm
============================================
My arc.ini
[External compressor:zcm]
packcmd = zcmx64 a -s -v -m8 archive.zcm *
unpackcmd = zcmx64 x archive.zcm
packedfile = archive.zcm

felice2011
30-09-2016, 05:20
@aswadd ..you're having the same problem that I had in the past by integrating zcm settings inside the configuration arc.ini files, try to eliminate fazip configuration, decompression should be successful.
Now I am in the company to update a management software, but in the evening I think to solve the problem, in order to integrate with other 30 compressors the zcm without this going at odds, especially with fazip and the classic error : "ERROR: write error (disk full?) in compression algorithm lzma:mfbt4:d1m".:rolleyes:

ChronoCross
30-09-2016, 06:29
Hey guys zcm not support pipes!.
The only way is
7z a -ttar
srep
and finally zcm.

~MAK~
30-09-2016, 06:49
Hey guys zcm not support pipes!.
The only way is
7z a -ttar
srep
and finally zcm.

Ya actually that's the real thing, it don't support pipes

aswadd
30-09-2016, 08:24
@aswadd ..you're having the same problem that I had in the past by integrating zcm settings inside the configuration arc.ini files, try to eliminate fazip configuration, decompression should be successful.
Now I am in the company to update a management software, but in the evening I think to solve the problem, in order to integrate with other 30 compressors the zcm without this going at odds, especially with fazip and the classic error : "ERROR: write error (disk full?) in compression algorithm lzma:mfbt4:d1m".:rolleyes:
even not using fazip still have this error
Errorlevel=1
ERROR: invalid compression method or parameters in zcm
in the end , zcm is not comptable with arc but what i want to know why ?
where is the problem exactly 'cause maybe i can do something external to correct this error :D

aswadd
30-09-2016, 08:27
can someone explain in details why arc doesn't work with zcm ? where is the problem exactly located ? .. in the temp folder i can see zcm already extracted the arcdatafile but then something wrong happens with arc ?? if the final data was successfully decompressed so where is the problem ??

felice2011
30-09-2016, 10:13
even not using fazip still have this error
Errorlevel=1
ERROR: invalid compression method or parameters in zcm
in the end , zcm is not comptable with arc but what i want to know why ?
where is the problem exactly 'cause maybe i can do something external to correct this error :D

can someone explain in details why arc doesn't work with zcm ? where is the problem exactly located ? .. in the temp folder i can see zcm already extracted the arcdatafile but then something wrong happens with arc ?? if the final data was successfully decompressed so where is the problem ??

When the mate @MAK opened this thread I thought there was something new, but I was wrong, @aswadd the problem is just one "ZCM" we have already dealt with this issue in other threads without any solution, plus I have had no response positive to problem from Nania Francesco.:rolleyes:

ZCM is a compressor that uses a compression method similar to fat Context Mixing (Mixing of contexts or orders) characterized by compression and decompression speeds comparable in terms of time with high compression efficiency, and personally I think it's one of the best compressors in circulation.;)

I was intrigued by the fact that @MAK was able to decompress zcm with the FA support, but the decompression was done in a positive manner in this order only with compression setting "packcmd = zcmx64 a -m8 -r -s -v $$arcdatafile$$.tmp $$arcpackedfile$$.tmp" but in this case the archive was reflate increasing in size and not compressed.
On the contrary the exact setting for compression I think it's this "packcmd = zcmx64 a -m8 -r -s -v $$arcpackedfile$$.tmp $$arcdatafile$$.tmp" where the archive is created rightly smaller of input data. But the decompression does not work with the now known error: invalid compression method or parameters in zcm.

I give up...:D, tests of zcm I made them in the past always with the same result, if someone succeeds a thank and of merit.:)

~MAK~
30-09-2016, 10:43
When the mate @MAK opened this thread I thought there was something new, but I was wrong, @aswadd the problem is just one "ZCM" we have already dealt with this issue in other threads without any solution, plus I have had no response positive to problem from Nania Francesco.:rolleyes:

ZCM is a compressor that uses a compression method similar to fat Context Mixing (Mixing of contexts or orders) characterized by compression and decompression speeds comparable in terms of time with high compression efficiency, and personally I think it's one of the best compressors in circulation.;)

I was intrigued by the fact that @MAK was able to decompress zcm with the FA support, but the decompression was done in a positive manner in this order only with compression setting "packcmd = zcmx64 a -m8 -r -s -v $$arcdatafile$$.tmp $$arcpackedfile$$.tmp" but in this case the archive was reflate increasing in size and not compressed.
On the contrary the exact setting for compression I think it's this "packcmd = zcmx64 a -m8 -r -s -v $$arcpackedfile$$.tmp $$arcdatafile$$.tmp" where the archive is created rightly smaller of input data. But the decompression does not work with the now known error: invalid compression method or parameters in zcm.

I give up...:D, tests of zcm I made them in the past always with the same result, if someone succeeds a thank and of merit.:)

Actually matey, I was little bit confused with arcdatafile and arcpackedfile, so I wrote them in irregular manner, and then I simply found it working so I posted here because I seen decompression was working and later when I seen help from zcm and know which one is the input file and output file made by freearc, then I corrected it. Sorry for the SPAM :(

felice2011
30-09-2016, 10:52
:eek: Hey @MAK do not have to apologize to anyone, nothing happened, you do not have any guilty, I just thought that the problem had been fixed.:D

~MAK~
30-09-2016, 10:56
:eek: Hey @MAK do not have to apologize to anyone, nothing happened, you do not have any guilty, I just thought that the problem had been fixed.:D
It has been just 2 days totally from the time I meet with inno code and this forum. And some the projects here I seen for the first time

Anyways, I have talked with razor about this zcm problem, maybe he could apply my fixes told in his CLS for zcm, if so, then we be able to decompress zcm at least ;) Actually am not a programmer related to inno stuff and that's why can't write a CLS code, so I just told him the things needed to fixed there in CLS ;)

Razor12911
30-09-2016, 11:27
Here's CLS, only ran one test.

It shows progress as well.

Decompression with Freearc is not currently available, still I will try my best.
was a little bit quicker than you. :p

felice2011
30-09-2016, 11:33
Ohhhhhhhhhhhhhhhhhhhh....you're unique:eek:

Razor12911
30-09-2016, 11:40
Thanks but it was nothing, took 20 minutes to make, big projects take months to make.

aswadd
30-09-2016, 12:02
Thanks but it was nothing, took 20 minutes to make, big projects take months to make.

:D you are the big boss here , Just one question how can i open the temp files of arc [ $$arcdatafile$$.tmp ] , I feel like if i could open it & see the content , i can do something external to fix zcm problem

Razor12911
30-09-2016, 13:35
why would you want to open those? if the temp is produced by freearc, then it's just concatenation of all the files that are about to be compressed, can't open that because there are literary no headers of some sort but if the temp is produced by previous compressor then just use previous compressor to decompress.
For example, precomp+srep+zcm
the first data temp is for precomp which is just pure concatenation, srep will have data temp but the only thing that can open it is the previous compressor which was precomp, zcm will have its own data temp which is created by srep to decompress so all in all, there'll be 3 data temp, you decompress, you get data srep data from zcm, decomrpess again, you get precomp data from srep, decompress again, you get the concatenated data which is useless but from precomp, long story short, there is no point in trying to do what you want to do.

Razor12911
30-09-2016, 13:40
Tested on Battlefield 4 update files, compressed with LZMA2 then ZCM, diff was 5mb but ****, life is too short people. 1mb/s compression speed, 1mb/s decompression speed, is it really worth it? 5mb better off but have grey hair.

felice2011
30-09-2016, 15:12
It all depends from the viewpoints, I personally think that the comp/time ratio is not bad.:p

http://i67.tinypic.com/2iv1y11.png

Razor12911
30-09-2016, 15:25
Well

felice2011
30-09-2016, 15:32
HOOO ...:eek: HA HA HA.....but we're not on Top Gear with Jeremy Clarkson :p:p

Razor12911
30-09-2016, 15:38
Dude, I live by the speed code, if something can't reach 30mb/s, it's not good enough, I'm not really a person of size, storage devices sizes are getting bigger and bigger, I don't mind trading a few mbs or gbs for more speed.

What I don't like is sitting in front of PC like this bear.

felice2011
30-09-2016, 16:09
Ha Ha not have lunch with that one there ... ok ok but since you like speed and power, I also like a ...

http://i65.tinypic.com/wuijro.jpg


... like this ...;)

~MAK~
30-09-2016, 18:12
Here's CLS, only ran one test.

It shows progress as well.


was a little bit quicker than you. :p

Thanks matey for helping :)

ChronoCross
30-09-2016, 18:14
Works perfect!
Less size of chunks decompress more faster?
And thanks aswad you make this possible with your question. LOL.

~MAK~
01-10-2016, 01:29
Works perfect!
Less size of chunks decompress more faster?
And thanks aswad you make this possible with your question. LOL.

haha, thanks to razor for accepting my request :P

Atleast by opening this thread, finally ZCM is compatible with FreeArc :P

1234567890123
01-10-2016, 06:32
is there a way to use it with -t0 it will be very fast and thank razor

aswadd
01-10-2016, 09:25
is there a way to use it with -t0 it will be very fast and thank razor
I don't recommend you to use threads during compressing , I tried it on shadow of mordor 60 GB Folder & 2 times it failed while the 3rd time it succeeded with no threads ,

other thing , use threads in decompression :) it's working fine & about the t0 I find it useless it took 100% of my cpu , so discover the most suited threads number for you :)
in my case i have i3 3.3GHZ I'm using only 2 threads , 80~ of my cpy :D :D

aswadd
01-10-2016, 09:35
auto threads usage for zcm ~ instead of t0 [bat File]
@shift
@echo off
setlocal enabledelayedexpansion
color 0a
SET threads=%NUMBER_OF_PROCESSORS%
IF "%threads%"=="" (SET threads=1)
IF "%threads%"=="3" (SET threads=2)
IF "%threads%"=="5" (SET threads=4)
IF "%threads%"=="7" (SET threads=6)
IF /I %threads% GTR 8 (SET threads=8)

IF %threads%==1 (
zcm.exe a -s -v -r -m7 archive.zcm *
) ELSE (
IF %threads%==2 (
zcm.exe a -s -v -r -m7 archive.zcm *
) ELSE (
IF %threads%==4 (
zcm.exe a -s -v -r -m7 -t2 archive.zcm *
) ELSE (
IF %threads%==6 (
zcm.exe a -s -v -r -m7 -t4 archive.zcm *
) ELSE (
IF %threads%==8 (
zcm.exe a -s -v -r -m7 -t6 archive.zcm *
)))))
pls note this will work fine without any problems because i replaced the path of files with * // this is the safest way
so to use it Just copy this batch file & zcm.exe to game folder then launch the batch & it will auto detect threads & compress by threads :)
the speed of zcm with threads is almost the same as lzma max settings with large dictionary size so it will be good idea to use it :)