XTool 2020 (Main Project) - Page 4

Sergey3695 · #46 29-07-2019, 00:19

I have a problem using t100p.

Sergey3695 · #47 30-07-2019, 05:37

add pls lvl setting for reflate 1-9. thx.

Razor12911 · #48 31-07-2019, 03:00

Quote:

Originally Posted by Sergey3695

add pls lvl setting for reflate 1-9. thx.

Have patience

IgorKolesnik · #49 31-07-2019, 23:56

using these parameters, the expansion reaches 2.4% and freezes.

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp:rzlib,zlib,reflate:c16mb,t2 - - <stdin> <stdout>

I am using the x64 version.

FitGirl · #50 01-08-2019, 07:41

Quote:

Originally Posted by IgorKolesnik

using these parameters, the expansion reaches 2.4% and freezes.

[External compressor:xtool]
header = 0
packcmd = xtool.exe precomp:rzlib,zlib,reflate:c16mb,t2 - - <stdin> <stdout>

I am using the x64 version.

And why do you use all three methods at the same time?

IgorKolesnik · #51 01-08-2019, 07:44

Quote:

Originally Posted by FitGirl

And why do you use all three methods at the same time?

если я оставлю только один метод, ошибка та же.

----

if I leave only one method, the error is the same.

IgorKolesnik · #52 01-08-2019, 07:46

But what is the difference between rzlib and zlib?

FitGirl · #53 01-08-2019, 08:19

Quote:

Originally Posted by IgorKolesnik

But what is the difference between rzlib and zlib?

Don't be that lazy.
https://fileforums.com/showpost.php?...4&postcount=35

As for decompression error - it's been already reported and Razor answered.

And don't use Russian here, it's English-only forum.

Razor12911 · #54 01-08-2019, 15:17

There are internal errors I've come across, so for now until next update, don't use xtool. the expansion stops because of memory management issues, xtool keeps increasing memory usage over and over again until you run out of memory, I noticed this when I was running some tests.

As of right now, I have fixed this issue but am running more tests to make sure all is well.

FitGirl mentioned you must pick one codec in the zlib lineup, rzlib is what is best and it's the same one used in the old xtool, I just added the other ones (zlib and reflate) for special cases where a specific codec is required.

Razor12911 · #55 04-08-2019, 15:05

Update available

1908_R1
- Fixed MT hanging issues
- Fixed reflate issues
- Fixed memory issues
- Improved zlib codec
- Added auto reflate level detector
- Fixed aborting issues when used via stdio

Notes
If there is a file where this xtool fails to precompress better or the same as ztool, pzlib, reflate or precomp, please upload it.

Simorq · #56 05-08-2019, 11:29

Streams: ZLib
Middle-Earth - Shadow of Mordor ALL OK
Fallout 4 ALL OK

Wargame Red Dragon
Streams: Reflate

Code:

pZLib,ZTool,XTool CRC Error

Code:

xtool_1908_R1 Good Work

Log:

Code:

Reflate
Creating archive: RG-reflate.Bin using reflate
Compressed 2,586 files, 30,541,141,079 => 44,791,613,736 bytes. Ratio 146.66%
Compression time: cpu 22.98 sec/real 1280.30 sec = 2%. Speed 23.85 mB/s
All OK

Testing archive: RG-reflate.Bin
Tested 2,586 files, 44,791,613,736 => 30,541,141,079 bytes. Ratio 146.66%  
Directory 3,955 => 88,873 bytes. Ratio 4.45%
Testing time: cpu 16.83 sec/real 924.56 sec = 2%. Speed 33.03 mB/s
All OK

Code:

rZLib
Creating archive: RG-rzlib.Bin using rzlib
Compressed 2,586 files, 30,541,141,079 => 44,791,601,829 bytes. Ratio 146.66%
Compression time: cpu 68.80 sec/real 2496.90 sec = 3%. Speed 12.23 mB/s
All OK

Testing archive: RG-rzlib.Bin
Tested 2,586 files, 44,791,601,829 => 30,541,141,079 bytes. Ratio 146.66%  
Directory 3,953 => 88,871 bytes. Ratio 4.45%
Testing time: cpu 17.86 sec/real 910.84 sec = 2%. Speed 33.53 mB/s
All OK

Razor12911 · #57 05-08-2019, 15:29

Quote:

Originally Posted by Simorq

Log:

Code:

Reflate
Creating archive: RG-reflate.Bin using reflate
Compressed 2,586 files, 30,541,141,079 => 44,791,613,736 bytes. Ratio 146.66%
Compression time: cpu 22.98 sec/real 1280.30 sec = 2%. Speed 23.85 mB/s
All OK

Testing archive: RG-reflate.Bin
Tested 2,586 files, 44,791,613,736 => 30,541,141,079 bytes. Ratio 146.66%  
Directory 3,955 => 88,873 bytes. Ratio 4.45%
Testing time: cpu 16.83 sec/real 924.56 sec = 2%. Speed 33.03 mB/s
All OK

Code:

rZLib
Creating archive: RG-rzlib.Bin using rzlib
Compressed 2,586 files, 30,541,141,079 => 44,791,601,829 bytes. Ratio 146.66%
Compression time: cpu 68.80 sec/real 2496.90 sec = 3%. Speed 12.23 mB/s
All OK

Testing archive: RG-rzlib.Bin
Tested 2,586 files, 44,791,601,829 => 30,541,141,079 bytes. Ratio 146.66%  
Directory 3,953 => 88,871 bytes. Ratio 4.45%
Testing time: cpu 17.86 sec/real 910.84 sec = 2%. Speed 33.53 mB/s
All OK

Can you test these exes on the same input, thanks

78372 · #58 06-08-2019, 00:13

Code:

FreeArc 0.67 (March 15 2014) creating archive: datarzlib.arc
Compressed 1 file, 127,027,167 => 497,974,169 bytes. Ratio 392.02%
Compression time: cpu 0.41 sec/real 76.37 sec = 1%. Speed 1.66 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datarzlib.arc
Tested 1 file, 497,974,169 => 127,027,167 bytes. Ratio 392.02%
Testing time: cpu 0.23 sec/real 27.32 sec = 1%. Speed 4.65 mB/s
All OK

FreeArc 0.67 (March 15 2014) creating archive: datazlib.arc
Compressed 1 file, 127,027,167 => 436,735,325 bytes. Ratio 343.81%
Compression time: cpu 0.42 sec/real 47.82 sec = 1%. Speed 2.66 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datazlib.arc
Tested 1 file, 436,735,325 => 127,027,167 bytes. Ratio 343.81%
Testing time: cpu 0.14 sec/real 16.94 sec = 1%. Speed 7.50 mB/s
All OK

FreeArc 0.67 (March 15 2014) creating archive: datareflate.arc
Compressed 1 file, 127,027,167 => 498,080,370 bytes. Ratio 392.11%
Compression time: cpu 0.53 sec/real 161.65 sec = 0%. Speed 0.79 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datareflate.arc
Tested 1 file, 498,080,370 => 127,027,167 bytes. Ratio 392.11%
Testing time: cpu 0.27 sec/real 60.78 sec = 0%. Speed 2.09 mB/s
All OK

Code:

FreeArc 0.67 (March 15 2014) creating archive: datarzlib.arc
Compressed 1 file, 111,299,563 => 482,246,557 bytes. Ratio 433.29%
Compression time: cpu 0.45 sec/real 78.94 sec = 1%. Speed 1.41 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datarzlib.arc
Tested 1 file, 482,246,557 => 111,299,563 bytes. Ratio 433.29%
Testing time: cpu 0.23 sec/real 28.13 sec = 1%. Speed 3.96 mB/s
All OK

FreeArc 0.67 (March 15 2014) creating archive: datazlib.arc
Compressed 1 file, 111,299,563 => 421,007,713 bytes. Ratio 378.27%
Compression time: cpu 0.39 sec/real 48.68 sec = 1%. Speed 2.29 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datazlib.arc
Tested 1 file, 421,007,713 => 111,299,563 bytes. Ratio 378.27%
Testing time: cpu 0.16 sec/real 16.98 sec = 1%. Speed 6.55 mB/s
All OK

FreeArc 0.67 (March 15 2014) creating archive: datareflate.arc
Compressed 1 file, 111,299,563 => 482,352,758 bytes. Ratio 433.38%
Compression time: cpu 0.33 sec/real 162.03 sec = 0%. Speed 0.69 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: datareflate.arc
Tested 1 file, 482,352,758 => 111,299,563 bytes. Ratio 433.38%
Testing time: cpu 0.09 sec/real 61.75 sec = 0%. Speed 1.80 mB/s
All OK

Simorq · #59 06-08-2019, 03:17

@Razor12911

x64

Code:

---------------------------
XTool.exe - Application Error
---------------------------
The application was unable to start correctly (0xc000007b). Click OK to close the application. 
---------------------------
OK   
---------------------------

x86

Code:

t100p
ERROR: write error (disk full?) in compression algorithm reflate
ERROR: write error (disk full?) in compression algorithm rzlib
ERROR: write error (disk full?) in compression algorithm zlib

But it works with t1,t2,t3,t4 in pre-compression \ t100p Works on decompression..
AMD RYZEN 5 1600 6-Core

Simorq · #60 06-08-2019, 04:24

Code:

udun_weather.arch05 2.70 GB

1908_R1 x86 t100p for pre-compression = ERROR: write error (disk full?) in compression algorithm

1908_R1 x86

Code:

===============================================================================
t4
Creating archive: Game_ZLib.Bin using zlib
Compressed 1 file, 2,902,848,160 => 4,223,996,918 bytes. Ratio 145.51%     
Compression time: cpu 1.55 sec/real 80.55 sec = 2%. Speed 36.04 mB/s
All OK

t100p
Testing archive: Game_ZLib.Bin
Tested 1 file, 4,223,996,918 => 2,902,848,160 bytes. Ratio 145.51%         
Testing time: cpu 1.11 sec/real 32.64 sec = 3%. Speed 88.95 mB/s
All OK
===============================================================================

===============================================================================
t4
Creating archive: Game_reflate.Bin using reflate
Compressed 1 file, 2,902,848,160 => 4,224,827,147 bytes. Ratio 145.54%     
Compression time: cpu 1.88 sec/real 318.25 sec = 1%. Speed 9.12 mB/s
All OK

t100p
Testing archive: Game_reflate.Bin
Tested 1 file, 4,224,827,147 => 2,902,848,160 bytes. Ratio 145.54%         
Testing time: cpu 1.61 sec/real 55.21 sec = 3%. Speed 52.58 mB/s
All OK
===============================================================================

===============================================================================
t4
Creating archive: Game_rzlib.Bin using rzlib
Compressed 1 file, 2,902,848,160 => 4,223,911,477 bytes. Ratio 145.51%     
Compression time: cpu 1.80 sec/real 79.44 sec = 2%. Speed 36.54 mB/s
All OK

t100p
Testing archive: Game_rzlib.Bin
WARNING: CRC failed in "udun_weather.arch05". File is broken.
Tested 1 file, 4,223,911,477 => 2,902,848,160 bytes. Ratio 145.51%         
Testing time: cpu 1.59 sec/real 43.39 sec = 4%. Speed 66.90 mB/s
There were 1 warning(s)
===============================================================================

_binaries_fpc x86

Code:

===============================================================================
t4
Creating archive: Game_ZLib.Bin using zlib
Compressed 1 file, 2,902,848,160 => 4,223,996,918 bytes. Ratio 145.51%     
Compression time: cpu 1.73 sec/real 76.23 sec = 2%. Speed 38.08 mB/s
All OK

t100p
Testing archive: Game_ZLib.Bin
Tested 1 file, 4,223,996,918 => 2,902,848,160 bytes. Ratio 145.51%         
Testing time: cpu 1.44 sec/real 47.60 sec = 3%. Speed 60.98 mB/s
All OK
===============================================================================

===============================================================================
t4
Creating archive: Game_reflate.Bin using reflate
Compressed 1 file, 2,902,848,160 => 4,224,827,147 bytes. Ratio 145.54%     
Compression time: cpu 1.56 sec/real 303.38 sec = 1%. Speed 9.57 mB/s
All OK

t100p
Testing archive: Game_reflate.Bin
Tested 1 file, 4,224,827,147 => 2,902,848,160 bytes. Ratio 145.54%         
Testing time: cpu 1.59 sec/real 51.68 sec = 3%. Speed 56.17 mB/s
All OK
===============================================================================

===============================================================================
t4
Creating archive: Game_rzlib.Bin using rzlib
Compressed 1 file, 2,902,848,160 => 4,223,996,918 bytes. Ratio 145.51%     
Compression time: cpu 1.55 sec/real 77.61 sec = 2%. Speed 37.40 mB/s
All OK

t100p
Testing archive: Game_rzlib.Bin
Tested 1 file, 4,223,996,918 => 2,902,848,160 bytes. Ratio 145.51%         
Testing time: cpu 1.47 sec/real 42.34 sec = 3%. Speed 68.56 mB/s
All OK
===============================================================================

__________________________________________________ __
The 1908_R1 x64 version works very stable and well.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
[Dev]XTool	Razor12911	Conversion Tutorials	180	23-10-2020 06:26
Project Cars Digital Edition (3xDVD5) (srep+lzma)	GTX590	PC Games - CD/DVD Conversions	10	28-08-2017 08:34
Project IGI Anthology 1xCD700 CIUV2 2039	mausschieber	PC Games - CD/DVD Conversions	0	24-07-2017 15:12
Space Channel 5 Part 2 Translation Project	Christuserloeser	DC Games	0	21-06-2004 18:16

The Following User Says Thank You to Sergey3695 For This Useful Post:
oltjon (29-07-2019)

The Following 4 Users Say Thank You to Razor12911 For This Useful Post:
Harsh ojha (31-07-2019), shazzla (31-07-2019), ShivShubh (24-11-2019), Simorq (31-07-2019)

The Following 2 Users Say Thank You to FitGirl For This Useful Post:
Harsh ojha (01-08-2019), sajmon83 (01-08-2019)

The Following 8 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (02-08-2019), dixen (02-08-2019), Harsh ojha (01-08-2019), IgorKolesnik (02-08-2019), shazzla (01-08-2019), ShivShubh (24-11-2019), Simorq (01-08-2019), ZAZA4EVER (02-08-2019)

The Following 13 Users Say Thank You to Razor12911 For This Useful Post:
Andu21 (05-08-2019), Cesar82 (04-08-2019), dixen (04-08-2019), ffmla (05-08-2019), Harsh ojha (04-08-2019), IgorKolesnik (04-08-2019), kenzo34 (05-08-2019), mausschieber (04-08-2019), sajmon83 (04-08-2019), shazzla (04-08-2019), ShivShubh (24-11-2019), Simorq (05-08-2019), ZAZA4EVER (04-08-2019)

The Following 6 Users Say Thank You to Simorq For This Useful Post:
dixen (06-08-2019), ffmla (06-08-2019), Harsh ojha (05-08-2019), oltjon (05-08-2019), Razor12911 (05-08-2019), ZAZA4EVER (05-08-2019)

The Following 3 Users Say Thank You to 78372 For This Useful Post:
ffmla (06-08-2019), Razor12911 (07-08-2019), Simorq (06-08-2019)