FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Precomp Accelerator - PrecompX (https://fileforums.com/showthread.php?t=103511)

BLACKFIRE69 14-05-2020 01:34

Precomp Accelerator - PrecompX
 
3 Attachment(s)
Precomp Accelerator - PrecompX 2.0.0.1


A tool for Accelerate the Precomp. (Tested with Precomp 0.4.3 - 0.4.8).

What's new
  • Added detection mode.
  • Users can select either PrecompX for decompression, or the CLS Library.
  • Some improvements.

Commands:
a = Compress
x = Decompress


Options:
-c# = Chunk Size [Compression Only]
-t# = Threads (as a number or as a percentage)
-method = Detection Method [Compression Only]


Detection Methods:
Code:

-intense0  (sensitive) (default)
 -intense2  (more sensitive)
 -brute    (most sensitive)

Usage:
PrecompX.exe a -c# -t# -method - - <stdin> <stdout>
PrecompX.exe x -t# - - <stdin> <stdout>


Arc.ini:
Code:

[External compressor:precompx]
header = 0
packcmd  = PrecompX.exe a -c128m -t100p -brute - - <stdin> <stdout>
unpackcmd = PrecompX.exe x -t4 - - <stdin> <stdout>


For Compression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe


For Decompression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe


or the CLS library for decompress

cls.ini
cls-precompx.dll
cls-precomp_x64.exe
cls-precomp_x86.exe




------------------------------------------------------------------------------------------------------------------------

XxAZAxX 14-05-2020 02:37

Info
 
Hi my friend, how should I apply this change? do I just copy and paste the files into the FreeArc folder? or is it just a test?

XxAZAxX 14-05-2020 07:24

:d
 
Quote:

Originally Posted by BLACKFIRE69 (Post 485765)
copy both "precomp.exe" and "PrecompX.exe" to the folder and

add this into the arc.ini.
Code:

[External compressor:PrecompX]
header = 0
packcmd  = PrecompX.exe -e - - <stdin> <stdout>
unpackcmd = PrecompX.exe -d - - <stdin> <stdout>


It works perfectly! Thank's my friend =)

ShiyaVivala 14-05-2020 11:16

Need more info about that

Does PrecompX:intense work?

Also i've found a bug. It can't compress when there are lot of small files (10.000 .epub files each ~200kb) (Default precomp was able to compress)

Now I'm working on some games. I'll edit the result

Edit: It's ultra fast while compressing comparing to default precomp but decompressing seems same(maybe I'm wrong). anyways thank you for such an amazing tool

darkwolves 14-05-2020 12:18

hmmm i must test

BLACKFIRE69 14-05-2020 13:52

Quote:

Does PrecompX:intense work?
no but, PrecompX contains intense mode.

Quote:

Also i've found a bug. It can't compress when there are lot of small files (10.000 .epub files each ~200kb) (Default precomp was able to compress)
what's the purpose of precompressing small files (~200kb)?

dixen 03-06-2020 04:45

Dishonored: Death of the Outsider

*.resources - 17 gb > 25.1 gb for 23 minutes on 4 threads

For example. ZTool or Xtool (v0.12) - 30% for 4 hours

Thanks BLACKFIRE69

test unpack

Quote:

Tested 6 files, 11,963,172,102 => 19,170,907,834 bytes. Ratio 62.40%
Testing time: cpu 20.61 sec/real 565.87 sec = 4%. Speed 33.88 mB/s
All OK

Razor12911 04-06-2020 20:13

Quote:

Originally Posted by dixen (Post 486161)

For example. ZTool or Xtool (v0.12) - 30% for 4 hours

nice speed :rolleyes:

dixen 05-06-2020 04:05

Quote:

Originally Posted by Razor12911 (Post 486171)
nice speed :rolleyes:

Yep.

Do you have cls (or precompinside) for v0.48?

dixen 07-06-2020 14:56

Quote:

Originally Posted by Ahmed1999 (Post 486213)
Please how do I make an installation file compatible with PrecompX

Replace precomp.exe & PrecompX.exe with arc.exe and write to arc.ini

Pack

Quote:

[External compressor:PrecompX]
header = 0
packcmd = PrecompX.exe -e - - <stdin> <stdout>
Unpack

Quote:

[External compressor:PrecompX]
header = 0
unpackcmd = PrecompX.exe -d - - <stdin> <stdout>

Kitsune1982 07-06-2020 17:51

which installer scripts does this work with? Also Cesar82 if you are reading this, can you implement precompx into CIU compatibility instead of only being able to use xtool? I love my CIU scripts but faster precomp would be great. thanks. :)

Cesar82 07-06-2020 22:33

Quote:

Originally Posted by Kitsune1982 (Post 486216)
which installer scripts does this work with? Also Cesar82 if you are reading this, can you implement precompx into CIU compatibility instead of only being able to use xtool? I love my CIU scripts but faster precomp would be great. thanks. :)

KaktoR that updates (Adds/Removes) compressors after several tests.
If he finds it beneficial, we can include it.

Ahmed1999 17-06-2020 16:34

Please make a script compatible with the program

BLACKFIRE69 18-06-2020 04:01

Quote:

Originally Posted by Ahmed1999 (Post 486416)
Please make a script compatible with the program

here is an example,

Masquerade 18-06-2020 09:38

I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!

KaktoR 18-06-2020 09:45

http://schnaader.info/precomp.php

BLACKFIRE69 18-06-2020 10:53

Quote:

Originally Posted by Masquerade (Post 486424)
I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!

https://www.fileforums.com/showpost....61&postcount=8

BLACKFIRE69 25-07-2020 07:45

PrecompX v2.0.0.1
 
Precomp Accelerator - PrecompX 2.0.0.1

What's new
  • Added detection mode.
  • Users can select either PrecompX for decompression, or the CLS Library.
  • Some improvements.

Commands:
a = Compress
x = Decompress


Options:
-c# = Chunk Size [Compression Only]
-t# = Threads (as a number or as a percentage)
-method = Detection Method [Compression Only]


Detection Methods:
Code:

-intense0  (sensitive) (default)
 -intense2  (more sensitive)
 -brute    (most sensitive)

Usage:
PrecompX.exe a -c# -t# -method - - <stdin> <stdout>
PrecompX.exe x -t# - - <stdin> <stdout>


Arc.ini:
Code:

[External compressor:precompx]
header = 0
packcmd  = PrecompX.exe a -c128m -t100p -brute - - <stdin> <stdout>
unpackcmd = PrecompX.exe x -t4 - - <stdin> <stdout>


For Compression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe


For Decompression:
arc.ini
PrecompX.exe
precomp32.exe
precomp64.exe


or the CLS library for decompress

cls.ini
cls-precompx.dll
cls-precomp_x64.exe
cls-precomp_x86.exe



check the first post...

Atakanbasturk 05-08-2020 03:38

Great tool. Thanks for your hard work. I want to ask something:

Normally Precomp.exe first decompress given file, then compress it with BZip2. We can use -cn syntax and block it. So we can compress it further with lzma or another compressor. Can we use -cn syntax in PrecompX? Or any other way so precomp must not compress file?

BLACKFIRE69 05-08-2020 04:59

Quote:

Originally Posted by Atakanbasturk (Post 487253)
Great tool. Thanks for your hard work. I want to ask something:

Normally Precomp.exe first decompress given file, then compress it with BZip2. We can use -cn syntax and block it. So we can compress it further with lzma or another compressor. Can we use -cn syntax in PrecompX? Or any other way so precomp must not compress file?

PrecompX already uses "-cn". ;)

if you want to deal with more options, try mine cls-precomp.dll (multithreaded). so i have given you the facility with it to change the options used in Precomp.

Code:

[Precomp]
Options=-cn -brute
Chunk=128m
Threads=4

cls-precomp - any version (Multithreaded)

Balaji007 07-09-2020 11:03

Quote:

Originally Posted by Masquerade (Post 486424)
I hope you don't mind a basic question - but what purpose does precomp have? I use XTool etc.. but I've never seen anyone use precomp before. I hope you don't mind explaining which file types / codecs it can help with. Thank you!

Hi friend
Precomp can compress zlib streams like xtools and ztools. Also it can compress the .png or .jpeg files by the help of packjpg.dll file. It can compress zip and gif files. More effective tool 🤗

Balaji007 07-09-2020 11:05

Quote:

Originally Posted by BLACKFIRE69 (Post 487256)
PrecompX already uses "-cn". ;)

if you want to deal with more options, try mine cls-precomp.dll (multithreaded). so i have given you the facility with it to change the options used in Precomp.

Code:

[Precomp]
Options=-cn -brute
Chunk=128m
Threads=4

cls-precomp - any version (Multithreaded)

I am wondering about bzip2. You can give the link for it. Also give some examples, how to use it?

elit 08-09-2020 09:50

Quote:

Originally Posted by dixen (Post 486161)
Dishonored: Death of the Outsider
*.resources - 17 gb > 25.1 gb for 23 minutes on 4 threads
For example. ZTool or Xtool (v0.12) - 30% for 4 hours
test unpack


This cant be right, if it takes 4h to recompress 17gb with z/x-tool you must be doing something wrong. Probably invoking some obscure and completely unnecessary brute mode etc. Compare with similar settings, x/z-tool also have its own options and for 99% time all you need is either :m1, or :m2 - aka :high. Thats it. I can get at least around ~20mb/s on m2/high, tool is extremely fast and have no reason to drag like your results show.

KaktoR 08-09-2020 10:08

^
I think this is one of the games for which xtool has problems because of odd streams or something like that, if I remember correctly.

elit 08-09-2020 10:10

And one other thing. For to me unknown reasons many of you use wrong terms regarding data inflation, calling it compression and leading to confusions. When you compress data as a whole, you are in fact decompressing those streams in the process, that particular part is *not* compression but actually decompression. To avoid confusion with global data compression, call it inflation. You are inflating the data within global compression process - as a preprocess.

This is confusing because then you have inflator tool with parameters like "compress" and "decompress", guess which flag is used when, exactly opposite as when it should. It should be "e" or "c" during global data unpacking, and "d" during global compression, because that is what is actually happening. Tool is its own entity/command, working on its own and is not superwising rest of the chain in the process and doesnt know about it, it just push the data through the pipe.

Balaji007 21-10-2020 11:07

Major issue was founded friend. I am using 4 thread pc to repack. Decompression on 4 thread pc or lower pc works well. But higher thread pcs are showing this error like unarc.dll error code: -1. Also no use the -hp to encrypt the file.This error comes with Cls and precomp

https://i.ibb.co/sRT0h02/unknown.png

Balaji007 21-10-2020 11:12

I am trying with t4 or threads=100%, But it still shows a error

BLACKFIRE69 21-10-2020 11:44

Quote:

Originally Posted by Balaji007 (Post 488431)
Major issue was founded friend. I am using 4 thread pc to repack. Decompression on 4 thread pc or lower pc works well. But higher thread pcs are showing this error like unarc.dll error code: -1. Also no use the -hp to encrypt the file.This error comes with Cls and precomp

https://i.ibb.co/sRT0h02/unknown.png

this will happen when you use more than the threads used in the compression. so make sure the threads used for decompression are less than or equal to the threads you used in the compression.

ex:
set compression threads = t4
and
decompression threads = t4

then your problem will be solved.

Balaji007 10-05-2021 18:45

Cls decompression error
 
Sometimes the inflated or deflated streams higher than 1 Gb per thread. Example like 128Mb=>1 Gb. At the moment the cls decompression was freezed without showing any errors. Please fix this errors

Dark0226 25-08-2021 14:30

Somehow you can place TEMP, or rather PrecompX_temp in another area, for example, on a virtual hdd in RAM.


All times are GMT -7. The time now is 15:08.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com