Precomp Accelerator - PrecompX

[BLACKFIRE69]

Precomp Accelerator - PrecompX 2.0.0.1


A tool for Accelerate the Precomp. (Tested with Precomp 0.4.3 - 0.4.8).

What's new

Added detection mode.
Users can select either PrecompX for decompression, or the CLS Library.
Some improvements.


Commands:
a = Compress
x = Decompress

Options:
-c# = Chunk Size [Compression Only]
-t# = Threads (as a number or as a percentage)
-method = Detection Method [Compression Only]

Detection Methods:
-intense0 (sensitive) (default)
-intense2 (more sensitive)
-brute (most sensitive)

Usage:
PrecompX.exe a -c# -t# -method - - <stdin> <stdout>
PrecompX.exe x -t# - - <stdin> <stdout>

Arc.ini:

[External compressor:precompx]
header = 0
packcmd = PrecompX.exe a -c128m -t100p -brute - - <stdin> <stdout>
unpackcmd = PrecompX.exe x -t4 - - <stdin> <stdout>



For Compression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe

For Decompression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe

or the CLS library for decompress

cls.ini
cls-precompx.dll
cls-precomp_x64.exe
cls-precomp_x86.exe



------------------------------------------------------------------------------------------------------------------------

[XxAZAxX]

Hi my friend, how should I apply this change? do I just copy and paste the files into the FreeArc folder? or is it just a test?

[XxAZAxX]

copy both "precomp.exe" and "PrecompX.exe" to the folder and

add this into the arc.ini.

[External compressor:PrecompX]
header = 0
packcmd = PrecompX.exe -e - - <stdin> <stdout>
unpackcmd = PrecompX.exe -d - - <stdin> <stdout>


It works perfectly! Thank's my friend =)

[ShiyaVivala]

Need more info about that

Does PrecompX:intense work?

Also i've found a bug. It can't compress when there are lot of small files (10.000 .epub files each ~200kb) (Default precomp was able to compress)

Now I'm working on some games. I'll edit the result

Edit: It's ultra fast while compressing comparing to default precomp but decompressing seems same(maybe I'm wrong). anyways thank you for such an amazing tool

[darkwolves]

hmmm i must test

[BLACKFIRE69]

Does PrecompX:intense work?


no but, PrecompX contains intense mode.


Also i've found a bug. It can't compress when there are lot of small files (10.000 .epub files each ~200kb) (Default precomp was able to compress)


what's the purpose of precompressing small files (~200kb)?

[dixen]

Dishonored: Death of the Outsider

*.resources - 17 gb > 25.1 gb for 23 minutes on 4 threads

For example. ZTool or Xtool (v0.12) - 30% for 4 hours

Thanks BLACKFIRE69

test unpack

Tested 6 files, 11,963,172,102 => 19,170,907,834 bytes. Ratio 62.40%
Testing time: cpu 20.61 sec/real 565.87 sec = 4%. Speed 33.88 mB/s
All OK

[Razor12911]

For example. ZTool or Xtool (v0.12) - 30% for 4 hours


nice speed :rolleyes:

[dixen]

nice speed :rolleyes:
Yep.

Do you have cls (or precompinside) for v0.48?

[dixen]

Please how do I make an installation file compatible with PrecompX

Replace precomp.exe & PrecompX.exe with arc.exe and write to arc.ini

Pack

[External compressor:PrecompX]
header = 0
packcmd = PrecompX.exe -e - - <stdin> <stdout>

Unpack

[External compressor:PrecompX]
header = 0
unpackcmd = PrecompX.exe -d - - <stdin> <stdout>

[Kitsune1982]

which installer scripts does this work with? Also Cesar82 if you are reading this, can you implement precompx into CIU compatibility instead of only being able to use xtool? I love my CIU scripts but faster precomp would be great. thanks. :)

[Cesar82]

which installer scripts does this work with? Also Cesar82 if you are reading this, can you implement precompx into CIU compatibility instead of only being able to use xtool? I love my CIU scripts but faster precomp would be great. thanks. :)
KaktoR that updates (Adds/Removes) compressors after several tests.
If he finds it beneficial, we can include it.

[Ahmed1999]

Please make a script compatible with the program

[BLACKFIRE69]

Please make a script compatible with the program

here is an example,

[Masquerade]

I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!

[KaktoR]

http://schnaader.info/precomp.php

[BLACKFIRE69]

I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!

https://www.fileforums.com/showpost.php?p=486161&postcount=8

[BLACKFIRE69]

Precomp Accelerator - PrecompX 2.0.0.1

What's new

Added detection mode.
Users can select either PrecompX for decompression, or the CLS Library.
Some improvements.


Commands:
a = Compress
x = Decompress

Options:
-c# = Chunk Size [Compression Only]
-t# = Threads (as a number or as a percentage)
-method = Detection Method [Compression Only]

Detection Methods:
-intense0 (sensitive) (default)
-intense2 (more sensitive)
-brute (most sensitive)

Usage:
PrecompX.exe a -c# -t# -method - - <stdin> <stdout>
PrecompX.exe x -t# - - <stdin> <stdout>

Arc.ini:

[External compressor:precompx]
header = 0
packcmd = PrecompX.exe a -c128m -t100p -brute - - <stdin> <stdout>
unpackcmd = PrecompX.exe x -t4 - - <stdin> <stdout>



For Compression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe

For Decompression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe

or the CLS library for decompress

cls.ini
cls-precompx.dll
cls-precomp_x64.exe
cls-precomp_x86.exe


check the first post...

[Atakanbasturk]

Great tool. Thanks for your hard work. I want to ask something:

Normally Precomp.exe first decompress given file, then compress it with BZip2. We can use -cn syntax and block it. So we can compress it further with lzma or another compressor. Can we use -cn syntax in PrecompX? Or any other way so precomp must not compress file?

[BLACKFIRE69]

Great tool. Thanks for your hard work. I want to ask something:

Normally Precomp.exe first decompress given file, then compress it with BZip2. We can use -cn syntax and block it. So we can compress it further with lzma or another compressor. Can we use -cn syntax in PrecompX? Or any other way so precomp must not compress file?

PrecompX already uses "-cn". ;)

if you want to deal with more options, try mine cls-precomp.dll (multithreaded). so i have given you the facility with it to change the options used in Precomp.

[Precomp]
Options=-cn -brute
Chunk=128m
Threads=4

cls-precomp - any version (Multithreaded) (https://fileforums.com/showthread.php?t=103690)

[Balaji007]

I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!
Hi friend
Precomp can compress zlib streams like xtools and ztools. Also it can compress the .png or .jpeg files by the help of packjpg.dll file. It can compress zip and gif files. More effective tool 🤗

[Balaji007]

PrecompX already uses "-cn". ;)

if you want to deal with more options, try mine cls-precomp.dll (multithreaded). so i have given you the facility with it to change the options used in Precomp.

[Precomp]
Options=-cn -brute
Chunk=128m
Threads=4

cls-precomp - any version (Multithreaded) (https://fileforums.com/showthread.php?t=103690)
I am wondering about bzip2. You can give the link for it. Also give some examples, how to use it?

[elit]

Dishonored: Death of the Outsider
*.resources - 17 gb > 25.1 gb for 23 minutes on 4 threads
For example. ZTool or Xtool (v0.12) - 30% for 4 hours
test unpack


This cant be right, if it takes 4h to recompress 17gb with z/x-tool you must be doing something wrong. Probably invoking some obscure and completely unnecessary brute mode etc. Compare with similar settings, x/z-tool also have its own options and for 99% time all you need is either :m1, or :m2 - aka :high. Thats it. I can get at least around ~20mb/s on m2/high, tool is extremely fast and have no reason to drag like your results show.

[KaktoR]

^
I think this is one of the games for which xtool has problems because of odd streams or something like that, if I remember correctly.

[elit]

And one other thing. For to me unknown reasons many of you use wrong terms regarding data inflation, calling it compression and leading to confusions. When you compress data as a whole, you are in fact decompressing those streams in the process, that particular part is *not* compression but actually decompression. To avoid confusion with global data compression, call it inflation. You are inflating the data within global compression process - as a preprocess.

This is confusing because then you have inflator tool with parameters like "compress" and "decompress", guess which flag is used when, exactly opposite as when it should. It should be "e" or "c" during global data unpacking, and "d" during global compression, because that is what is actually happening. Tool is its own entity/command, working on its own and is not superwising rest of the chain in the process and doesnt know about it, it just push the data through the pipe.

[Balaji007]

Major issue was founded friend. I am using 4 thread pc to repack. Decompression on 4 thread pc or lower pc works well. But higher thread pcs are showing this error like unarc.dll error code: -1. Also no use the -hp to encrypt the file.This error comes with Cls and precomp

https://i.ibb.co/sRT0h02/unknown.png

[Balaji007]

I am trying with t4 or threads=100%, But it still shows a error

[BLACKFIRE69]

Major issue was founded friend. I am using 4 thread pc to repack. Decompression on 4 thread pc or lower pc works well. But higher thread pcs are showing this error like unarc.dll error code: -1. Also no use the -hp to encrypt the file.This error comes with Cls and precomp

https://i.ibb.co/sRT0h02/unknown.png

this will happen when you use more than the threads used in the compression. so make sure the threads used for decompression are less than or equal to the threads you used in the compression.

ex:
set compression threads = t4
and
decompression threads = t4

then your problem will be solved.

[Balaji007]

Sometimes the inflated or deflated streams higher than 1 Gb per thread. Example like 128Mb=>1 Gb. At the moment the cls decompression was freezed without showing any errors. Please fix this errors

[Dark0226]

Somehow you can place TEMP, or rather PrecompX_temp in another area, for example, on a virtual hdd in RAM.