Helping thread :)

[doofoo24]

anyway
i wish you best of luck on your journey
yours truly

[Bulat]

existing freearc will be released as commercial product. fa'next will be developed as new beta product and finally released as freearc 2.0

[doofoo24]

i done a couple of test using only 4x4:lzma with different setting '4x4:lzma:a1:mfbt4:d64m:fb273:mc10000:lc8' '4x4:lzma:a1:mfbt4:d128m:fb273:mc10000:lc8' '4x4:lzma:a1:mfbt4:d200m:fb273:mc10000:lc8'...
i found that using 4 core 8 threads any setting other than d:64 only 40% cpu utilized ?
using 4x4:lzma:a1:mfbt4:d64m:fb273:mc10000:lc8 it seem to me the best option in scaling cpu with 2 core only only use 384mb in decompression and use the 2 core to tha max...
using on 2 core with 4 threads and 4 core without hyperthreading use the same 756mb of memory and in 4 core 8 threads it use 1024mb and the cpu 100%...
when try to use 4x4:lzma:a1:mfbt4:d128m:fb273:mc10000:lc8 or 4x4:lzma:a1:mfbt4:d200m:fb273:mc10000:lc8 the cpu usage on 4 core 8 threads only 40% whille on 2 core 4 threads and 4 core without hyperthreading cpu usage is 85%? (in decompression not compression)
i am not an expert so no need for smart remarks.
so the best scaling in decompression (in compression on i7 it use around 57% of cpu with 1684mb of memory) is to use 4x4:lzma:a1:mfbt4:d64m:fb273:mc10000:lc8 it work ( i mean that it use the cpu 100% on all setting like pentium-i3-i5-i7)
if anyone find it useful great.
*using 4x4:t does not work for me in decompression i tried 4x4:t4 but when decompress it use 14% of i7 not 50% of i7 4 core 8 threads...

summary
if you use pzlib or precompmt use it with this
4x4:lzma:a1:mfbt4:d64m:fb273:mc10000:lc8 is super fast in decompression but it use the cpu to the max and require more memory but modern system use 64bit so no problem there, for old system and limited ram don't use 4x4 use lzma:a1:mfbt4:d185m:fb273:mc10000:lc8

if srep only use it with zstd the new version 1.1.2

add this line to arc.ini
[External compressor:zstd]
header = 0
packcmd = zstd -22 --ultra <stdin> <stdout>

in compression it use around limit core and only 769mb in compression
in decompression zstd alone use only 128mb and srep better to limit it in inno to 128mb so the total memory use is 256mb it super fast and less demanding on the cpu...

[Gupta]

so the best scaling is to use 4x4:lzma:a1:mfbt4:d64m:fb273:mc10000:lc8 it work ( i mean that it use the CPU 100% on all setting like pentium-i3-i5-i7)

I can't find any written document but judging from this

else switch (*param) { // Ïàðàìåòðû, ñîäåðæàùèå çíà÷åíèÿ
case 'b': p->BlockSize = parseMem (param+1, &error); continue;
case 't': p->NumThreads = parseInt (param+1, &error); continue;
case 'i': p->NumExtraBuffers = parseInt (param+1, &error); continue;
case 'r': p->MinOrder0Percents= parseDouble (param+1, &error); continue;
}

i think

4x4:t%NUMBER_OF_PROCESSORS%:lzma:a1:mfbt4:d64m:fb2 73:mc10000:lc8

is betther idea

remember there is no constraint that you need the same number of cores to compress and decompress, so by using external compressor i.e. fazip you can fully control the CPU usage in both compression and decompression

decompression it use only 128mb + srep you can limit the memory

still, it will write the required memory on hard drive making the process a little bit slower

[doofoo24]

you the "expert" PrinceGupta2000...
in decompession i meant using zstd it use 128mb of memory and limt srep to 128mb not 512mb in inno will not make the proccess slower
i test large file (assassin's creed syndicate) with srep+zstd using '128mb' '256mb' and '512mb' in inno setup on normal hdd wd black 1tb write speed was around 176 mb/s max and the same time it took to install so using more than 128mb for srep on hdd is waste of memory usage...

[Gupta]

Razor is the King he just taught me what are the pros and kons of using rep+srep.

[doofoo24]

disk write when using 4x4:lzma on NVME SSD (CPU IS I7 6700K)
* note using srep+4x4:lzma:a1:mfbt4:d185m:fb273:mc10000:lc8
srep limited to 128mb in inno using isdone script

[doofoo24]

disk write using zstd
* note using srep+zstd
setting of zstd 1.1.2
[External compressor:zstd]
header = 0
packcmd = zstd -22 --ultra <stdin> <stdout>

**srep limited to 128mb in inno using isdone script
the same data compress with two method

the ratio on zstd is worst but around 1 to 2% different

that's it i done testing.
if anyone find it useful great...
GREAT FORUM

[shazzla]

hi all !

im in trouble.... i cant unpack my archives using the default isdone script,although it works fine with precomp/srep/lzma,etc.

if i use any extrenal compressors,it says :

error-2.png

My .ISS looks like this :



#define zstd
[Setup]

[Files]
#ifdef zstd
Source: Include\zstd.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\arc.ini; DestDir: {tmp}; Flags: dontcopy
#endif

[Code]
#ifdef zstd
ExtractTemporaryFile('zstd.exe');
ExtractTemporaryFile('arc.ini');
#endif

if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data1.arc'), ExpandConstant('{app}\'), '', false, '', '', ExpandConstant('{app}'), notPCFonFLY {PCFonFLY}) then break;




end;


Upon execution ,setup unpacks the arc.ini ,zstd.exe ,everything ,but the result is the above picture.
I tried to change the unpack command to :

if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data1.arc'), ExpandConstant('{app}\'), '', false, '', ExpandConstant('{tmp}\arc.ini'), ExpandConstant('{app}\'), notPCFonFLY{PCFonFLY}) then break;

Doesnt help.
The only working method for me is :

if not ISExec(0, 0, 0, ExpandConstant('{tmp}\arc.exe'), ExpandConstant('x -o+ -cfg"{tmp}\arc.ini" -w"{app}" -hp"mypw" -dp"{app}" "{src}\data1.arc"'), ExpandConstant('{tmp}'), '...', False) then break;

But its pretty ugly.
Is there any other way to extract my archives using ISArcExtract function ?

Arc.ini content :

[External compressor:zstd]
header = 0
unpackcmd = zstd -d -f <stdin> <stdout>

Thanks in advance !

[Gupta]

try using this
http://fileforums.com/showthread.php?t=98121

[shazzla]

CLS doesnt work,still the same error. :/

the file was compressed using this method : (FreeArc 0.67 ,March 15 2014)

arc.exe a -mzstd c:\x\chunk0.arc d:\chunk0.dat

arc.ini :
[External compressor:zstd]
header = 0
packcmd = zstd --ultra -v -22 $$arcdatafile$$.tmp -o $arcpackedfile$$.tmp

Tried with this ,too :
packcmd = zstd --ultra -v -22 <stdin> <stdout>

My script : zstd.rar (This is the basic ISDone script)

oh ,before i forget : i have the same issue with pzlib.....

maybe im failed at compression procedure... ?

[Mini]

USE
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data.bin'), ExpandConstant('{app}\'), '', false, '123', ExpandConstant('{tmp}\arc.ini'), ExpandConstant('{app}\'), notPCFonFLY{PCFonFLY}) then break;

[shazzla]

Nope,doesnt work. :/

[doofoo24]

try using to
if ISDoneInit(ExpandConstant('{tmp}\records.inf'), $F777, Comps1,Comps2,Comps3, MainForm.Handle, 512, @ProgressCallback) then begin
repeat
ChangeLanguage('english');
if not SrepInit(ExpandConstant('{app}\'),128,0) then break;
if not FileSearchInit(true) then break;
if not ISArcExtract ( 0, 100, ExpandConstant('{src}\setup-1'), ExpandConstant('{app}'), '', false, '', ExpandConstant('{tmp}\arc.ini'), ExpandConstant('{app}'), False) then break;

[shazzla]

still the original error.

doesnt matter.... im stay with the uglier unpack-method.
thanks to all for the help...!