XTool 2020 (Main Project)

[Razor12911]

Originally Posted by FitGirl

Any predictions on RAM requirements for both imported/memory DBs?

back on the SEACREST input from Need For Speed Hot Pursuit

I ran a memory usage test as you asked and these were the results.

xtool-virtual-memory.tmp = 328 MB
Decompression memory is 22 mb. 80,927 matches = 1,294,832 bytes = 0.10% of file

= total 350 MB (with deduplication)

Decompression memory is 1485 mb. 147,537 matches = 2,360,592 bytes = 0.18% of file

= total 1485 MB (without deduplication)

NOTE: Xtool uses memory of its own and this was not factored, about 190 MB
so if you do the math, that's 350+190 = about 540 MB total memory while if xtool doesn't remove deduplicates and lets srep all the work that's 1485+190 = 1675 MB

540 MB vs 1675 MB memory usage, which is better?

when 540 MB ram was used, xtool was decoding at 88.91 MB/s
and when 1675 MB ram was used, xtool decoded at 27.45 MB/s

so yes more speed and less memory usage, potato pcs should benefit greatly from this (like mine )

[Masquerade]

Originally Posted by Razor12911

xtool-virtual-memory.tmp = 328 MB
Decompression memory is 22 mb. 80,927 matches = 1,294,832 bytes = 0.10% of file

= total 350 MB (with deduplication)

I know you don't have much data to go on, but how does xtool+dedup compare against xtool+srep?

[FitGirl]

Originally Posted by Masquerade

I know you don't have much data to go on, but how does xtool+dedup compare against xtool+srep?

The idea of new xtool is not replace srep. It's purpose is not to recompress duplicate chunks, but just copy them, which makes less CPU load and faster overall decompression. You still need to run srep after xtool, cause it will deal with unpacked duplicated chunks.

[Masquerade]

Hello, here is more data:

Both Scribblenauts games, +comic book (pdf format):

Original size: 1.84GB



So, the xtool 2020 is running with zlib+preflate method, maybe I should have disabled it so it's zlib vs zlib.

[FitGirl]

Originally Posted by Masquerade

Hello, here is more data:

Both Scribblenauts games, +comic book (pdf format):

Original size: 1.84GB



So, the xtool 2020 is running with zlib+preflate method, maybe I should have disabled it so it's zlib vs zlib.

Afair Scribblenauts is encrypted. You are lucky to always choose encrypted games for your tests

[Masquerade]

Originally Posted by FitGirl

You are lucky to always choose encrypted games for your tests

Sucks to be me I guess. I don't knowingly do this.

[Razor12911]

Originally Posted by Masquerade

Hello, here is more data:

Both Scribblenauts games, +comic book (pdf format):

Original size: 1.84GB



So, the xtool 2020 is running with zlib+preflate method, maybe I should have disabled it so it's zlib vs zlib.

hmm, final size after compression?

[Masquerade]

Originally Posted by Razor12911

hmm, final size after compression?

With xtool r12: 1.38GB

I feel slightly ashamed for not thinking the data could be encrypted.

Didn't test to make a full archive with 2020, I will do this if you wish.

Every time I put xtool 2020 up against xtool r12, r12 always produces a larger size. Both run at 128m chunk size.

[Harsh ojha]

Originally Posted by Razor12911

so yes more speed and less memory usage, potato pcs should benefit greatly from this (like mine )

Same here potato pc 😅

FitGirl Repack take more HHD space for installing game ex. Far Cry 3 duology
Need 17 GB HHD space free
But the game Size was 10 GB ( language english.
Without FC3 mapEditor )

*Sorry for my bad English as English is not my mother tongue 😅*