Question for Precomp

[biotec2k8]

Hi!

How do I use Precomp or PrecompX correctly with FreeArc?

My Arguments are: a -s12g -ep1 -r -ed -lc1024 -ld1024 -mt2 -w./ -mprecomp+srep+lzham.

I can use Precomp on its own, but when I use it with external compressors FreeArc don't use Precomp.

I would like to use Precomp in addition to external compressors. Just how do i do this right?

My Arc.ini:

packcmd = precomp -intense0 -cb {options} -f -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp

and

packcmd = PrecompX.exe a -c128m -t100p -brute - - <stdin> <stdout>

I certainly did something wrong somewhere

Need Help

[KaktoR]

Maybe you should use proper english. I can't understand your problem, because of use of german words and meanings in your description (=denglish).

[biotec2k8]

I also saw that many people use LOLZ here. FitGirls uses Xtools in the same way. I can't really use either of them with FreeArc because I can't customize the Arc.ini properly. That would also be another question I would have for the professionals

[github]

There's many tools/projects make precomp and other compressors multi threads.

cls-precomp.dll made by BLACKFIRE69 seems to be the most stable one here

https://fileforums.com/showthread.php?t=103690

It calls precomp.exe not precomp32.exe not precomp64.exe
It can set precomp options in cls-precomp.ini

Other ones like MTX+precomp/other compressor crashes often for me, PMT+precomp/other compressor rarely works for me, same thing for PrecompX+precomp

/============

For final compressors, xtor, lolz and lzturbo already has multithread themselves, so I'm not sure if make them mt would have any gain, maybe even slower.

//===========

For other compressors, for example fl2 from
https://fileforums.com/showthread.php?p=483533

It is a very good compressor with good ratio and very fast speed. The exe version can be made multithread with
Universal CLS cls-pexp.dll (multi thread maker)
https://fileforums.com/showthread.php?t=103234
The Universal CLS seems to work great for those compressors like fl2.exe

Universal CLS can also make any other compressor multithreaded hence the name.
However I tried it with precomp, most of the time it works good but occasionally threads might lock up with each other and stuck there for minutes doing nothing before continue. Same thing happens to MTX+precomp but it locks or crash much often.

You'll still have to read, search the forum to learn about how freearc the ini such things

[biotec2k8]

what does magic2.exe in the Fitgirls repacks do?

[Masquerade]

biotec2k8

magic = lolz

I don't know why it's called magic, seems pretty pointless to me :D

[biotec2k8]

Ah yes. Thank you for the info. Is SREP + LOLZ better than SREP + FL2?

[biotec2k8]

I just can't get the same compression rate as Fitgirl Repacks. I try and try and combine different compressors with each other. It almost works. But there is still something missing. Only what?

[Ele]

Fitgirl uses xdelta to reduce the final size. In some cases, it causes the final size to decrease. And he also checks duplicate files.

[biotec2k8]

I will test Xdelta with Srep. Let's see what comes out of it

[Ele]

I will test Xdelta with Srep. Let's see what comes out of it

:confused:
Read this before using it.
https://en.wikipedia.org/wiki/Xdelta

[biotec2k8]

Yesterday I tried Xdelta with Nanozip (NZ). There is not much that can be compressed if the data has previously been processed with Xdelta. But it is also clear. They have already been changed by Xdelta.

I get the best results using Reflate, Srep, Delta. And the end compression with lzham or FL2 compress. Nanozip compresses a little more. Its CM option gets a little more out of there. But then it also takes longer

Reflate is still a very good option for me. However, it also takes a lot longer

Which combination do you use to compress your files?

[Ele]

Yesterday I tried Xdelta with Nanozip (NZ). There is not much that can be compressed if the data has previously been processed with Xdelta. But it is also clear. They have already been changed by Xdelta.

I get the best results using Reflate, Srep, Delta. And the end compression with lzham or FL2 compress. Nanozip compresses a little more. Its CM option gets a little more out of there. But then it also takes longer

Reflate is still a very good option for me. However, it also takes a lot longer

Which combination do you use to compress your files?


Xdelta isn't such a compressor. It's a patcher.
For pre-compressed game files,
I often use "xtool + srep + nz / lolz" or "other_pre-compressor + srep + nz / lolz".

For music files, "Mpz+srep".
For any other file, use "srep + nz / rz".

If I've the possibility of using Xdelta somewhere I'll use it too.

[biotec2k8]

I would like to try MPZ & RZ

Unfortunately, I have no MPZ and RZ in my database ...

[Masquerade]

I would like to try MPZ & RZ

Unfortunately, I have no MPZ and RZ in my database ...

https://anonfiles.com/taAdD2I6pf/

[Balaji007]

Nothing but, Precompression is necessary. If you are use a precomp,Just try with brute option. What is difference between precomp and precompx?
Ans : Precomp is not a chunk based compression. But precompx is a chunk based compression. Set chunk size in 128 Mb getter good precompression. Plot twist precomp is faster to infalte the files. Precompx was little bit slow.
2. Which external compressor suitable for better compression?
4 types of tools are available. There are
* BWT (Faster to compress)
* CM (Compression and decompression time equal) Ex: MCM,Nz
* Paq (Ultra compression,but time takes more) zpaq,paq8 etc
* lz based compression (lzma,lolz,rz,dlz,xz) Gives better ratio

Every better compreesion based on your Precompression and srep parameters only

3. Why lolz gives high compression ratio?
Because it detects the raw dds and dxt files.

I recommend to use rz or nz. Set rz dictionary size 128m to get better ratio. Also decompression speed is awesome.

[biotec2k8]

Well explained. Thank you for this good info

What is BWT? I don't have that in the DB yet, nor in my ini

[shazzla]

BWT=Burrows-Wheeler Transformation. (AFAIR BCM/BSC is a BWT compressor)

IMHO SRep-LOLZ is the best.
Or the LDMF capable LOLZ,(22c4b) but sometimes i face bugs. (Unable to decompress in the middle of the progress for example)

[biotec2k8]

Srep + LOLZ ... very good.

LDMF capable LOLZ, (22c4b)

I have LOLZ and another version of it.

That LDMF DEC has. Long Distance Match Finder. Ok.

I'll test it against each other.

Whao, LOLZ have many many Options...what is the best

My Arc for both Lolz:

[External compressor:lolz]
header = 0
packcmd = "lz\lolz_x64.exe" -mmt1 -mt4 -mtb512 -rt2 -mc256 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = "lz\lolz_x64.exe" $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:lolzi]
header = 0
packcmd = "lz\lolz2_x64.exe" {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = "lz\lolz2_x64.exe" $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Can someone please show me a good Arcini for these two LOLZ?
I think I set something wrong with my LOLZ. The compression is canceled. With the LDMF it runs normally.

Another problem has emerged:

I can pack LOLZ and RAZORX, but I don't get a file when unpacking. So something is wrong there.

What is wrong with that?