Helping thread :)

[L0v3craft]

Originally Posted by KaktoR

Have this game any deflate streams at all?

Haven't checked yet.

Try to unpack game files, compress them, then pack the files to it's original again and make sure md5 is the same.

I checked with Zlib Checker Pro and it freezes on big files:

game2.resources | 6.01GB
game3.resources | 5.87GB
shared_2_3.sharedrsc | 7.87GB

Btw the program didn't freeze on the first file and found some stream inside game1.resources (7.28GB).

Someone suggested to me to use reflate. I tried with reflate 1500 by razor on a little file like I said and it is very slow. It takes more than 10 minutes to install LOL.

Tried with pzlib v3.2 and these parameters:

pzlib e -t8 -ct8 -c256m -b512k -r9

and it makes a very good work but I get error of crc mismatch with the installation. These .resources files given to me problems with pzlib and The Sims 4 files too. Seems like pzlib damages .resources files.

Anyone here can give to me the best version of reflate and pack command for arc.ini file(I'm using masked data compressor) ?

[KaktoR]

Use this instead, it's better and not freezing at all (even with 19gb single file).
http://fileforums.com/showthread.php?t=98731

This settings should work without problems

packcmd = pZLib e -m2 -x -c32m -t25p - -o - $$arcdatafile$$.tmp -o - <stdout> -v
unpackcmd = pZLib d -t100p - -o - <stdin> <stdout>

And Sims 4 decompression is OK here. So no problems with resource files.

And for reflate, use reflateapi -> http://krinkels.org/resources/reflate-api.247/

It's faster.

[L0v3craft]

Originally Posted by KaktoR

Use this instead, it's better and not freezing at all (even with 19gb single file).
http://fileforums.com/showthread.php?t=98731

This settings should work without problems

packcmd = pZLib e -m2 -x -c32m -t25p - -o - $$arcdatafile$$.tmp -o - <stdout> -v
unpackcmd = pZLib d -t100p - -o - <stdin> <stdout>

And Sims 4 decompression is OK here. So no problems with resource files.

And for reflate, use reflateapi -> http://krinkels.org/resources/reflate-api.247/

It's faster.

Thanks for your help. Btw I'm trying reflateapi with a file (game1_004.resources / 595MB) and you can see here how much time it takes:



reflate seems to be slow like a snail. Never seen this with pzlib.

I have an Intel Xeon E3-1230 v3 and I'm using this command for reflate:

reflate c/d -l8 -t8 $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp

I tried with "l6" too, but it is the same. Any suggestion ?

Edit: I solved the problem, like an idiot I used "c/d" for compression XD

[mikey26]

Originally Posted by L0v3craft

Thanks for your help. Btw I'm trying reflateapi with a file (game1_004.resources / 595MB) and you can see here how much time it takes:



reflate seems to be slow like a snail. Never seen this with pzlib.

I have an Intel Xeon E3-1230 v3 and I'm using this command for reflate:

reflate c/d -l8 -t8 $$arcdatafile$$.tmp -o $$arcpackedfile$$.tmp

I tried with "l6" too, but it is the same. Any suggestion ?

Reflate is slow.but that Xeon is not going to make any difference cause that cpu only boosts to 3.7ghz on 1 core on normal boards thats why its so slow.

But if you have a good asrock mobo with the right bios you can get it to boost at 3.7ghz on all 4 cores and that will improve alot on your repacking not only with reflate but with other compressions.and a good hdd or ssd will help also.

[Andu21]

How can i terminate a process after a succesful extraction or after hitting cancel, in Isdone 0.6 script?

[Gupta]

Exec(ExpandConstant('{sys}\taskkill.exe'), ' /F /IM pZLib.exe{YOUR EXE NAME HERE IS PZLIB}', '', SW_HIDE, ewWaitUntilTerminated, ResultCode);

[Andu21]

Working great so far Gupta, i have another question, how can i run more parallel runs/threads of the same program to speed decompression in said script?

note: The program doesn't have -t4 option or something similar.

[Gupta]

Replace below function with the function here in this script
i am not gonna explain furthur details you have to answer it yoursef

function EXEC_UNPACK( const Exec , Option , inFiles, inDir : string; Deldest : boolean): boolean;
var
  ExecError :boolean;
  FindHandle1, ColFiles1, CurIndex1 : Integer;
  InFilePath, OutFilePath, OutFileName : PAnsiChar;
  temp : string;
  #ifdef ppx2
    Str : array of string;
    cmd : string;
    i : integer;
  #endif
begin
  FindHandle1:=ISFindFiles(0,inFiles,ColFiles1);
  ExecError:=false;
  #ifndef ppx2
    while not ExecError and ISPickFilename(FindHandle1,inDir,CurIndex1,DelDest) do
    begin
      temp := option;
      InFilePath:=ISGetName(0);
      OutFilePath:=ISGetName(1);
      OutFileName:=ISGetName(2);
      StringChangeEx(temp,'<infile>',InFilePath,true);
      StringChangeEx(temp,'<outfile>',OutFilePath,true);
      ExecError:=not ISExec(0, 0, 0, Exec,temp,ExpandConstant('{tmp}'),OutFileName,false);
    end;
  #else
    i := 1;
    CreateDir(ExpandConstant('{tmp}\Bat'));
    while not ExecError and ISPickFilename(FindHandle1,inDir,CurIndex1,false) do
    begin
      temp := option;
      InFilePath:=ISGetName(0);
      OutFilePath:=ISGetName(1);
      OutFileName:=ISGetName(2);
      StringChangeEx(temp,'<infile>',InFilePath,true);
      StringChangeEx(temp,'<outfile>',OutFilePath,true);
      Cmd := '"' + Exec + '" ' + temp;
      SaveStringToFile(ExpandConstant('{tmp}\bat\rest'+inttostr(i)+'.bat'),Cmd,False);
      i := i + 1;
      temp := '';
    end;
    if delDest then
      setArrayLength(Str,3)
    else
      setArrayLength(Str,2);
    Str[0] := 'title Restoring File';
    Str[1] := 'dir /b *rest*bat | "' + ExpandConstant('{tmp}\ppx2.exe') + '" -I {} -P %NUMBER_OF_PROCESSORS% -L 1 "{}"';
    if deldest then
      Str[3] := 'del /q /s  ' + inFiles ;
    SaveStringsToFile(ExpandConstant('{tmp}\Bat\Cmd_Master.bat'),Str,false);
    MsgBox('Wainting',mbInformation,mrOk);
    ExecError := not ISExec( 0, 0, 0, ExpandConstant('{tmp}\bat\Cmd_Master.bat'), '', ExpandConstant('{tmp}'), 'Restoring Files..',false) ; // Launches Batch File
    deltree(ExpandConstant('{tmp}\Bat'),true,true,true);
  #endif
  ISFindFree(FindHandle1);
  Result := ExecError;
end;

[Andu21]

Fair enough, i will do my best to figure it out, thanks again.

[Viper645]

Just a query(needed for a work) Is compression of srep 1.5(Yes, 1.5, no other version) superior than latest rep?

[Bulat]

Originally Posted by Viper645

Just a query(needed for a work) Is compression of srep 1.5(Yes, 1.5, no other version) superior than latest rep?

no. but it can be made equivalent to modern -m4 which is very close to maximum compression provided by the -m5

[Viper645]

Many many thanks bro
But what's meant by "it can be made"?

[Bulat]

there is the combination of options

[doofoo24]

i been using srep with m5f -l16 -c8 -a1 it help with 4x4:lzma:a1:mfbt4:d1m:fb273:mc10000:lc8,
but when try to use lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 i get almost the same ratio but when i change srep to m3f -l512 -c256 -a1 and use lzma:a1:mfbt4:d1024m:fb273:mc10000:lc8 i get better ratio in the end...
what the best setting for srep to use with 4x4:lzma:a1:mfbt4:dm:fb273:mc10000:lc8

[Viper645]

Originally Posted by Bulat

there is the combination of options

Can you please explain?