[Dev]XTool

[KaktoR]

Originally Posted by Razor12911

thanks for the tests so far, the first release of xtool will come with two codecs, zlib and crilayla. It should be released this week and if no errors are arise then the next codec's development will begin.

Nice, can't wait. Then i can finally test KCD + Sims 4 extracting again (ztool stucks)

[KaktoR]

wars_dlc01.cpk (301mb) from Sonic Forces
wars_dlc01.cpk.out1 (331mb)
wars_dlc01.cpk.out2 (331mb)

Process ID       : 10716
Thread ID        : 8412
Process Exit Code: 0
Thread Exit Code : 0

User Time        :          24.312s
Kernel Time      :           0.343s
Process Time     :          24.655s
Clock Time       :          27.187s

Working Set      :           97200 KB
Paged Pool       :             100 KB
Nonpaged Pool    :               9 KB
Pagefile         :          108844 KB
Page Fault Count : 34175

IO Read          :          309030 KB (in            4830 reads )
IO Write         :          339319 KB (in            5302 writes)
IO Other         :               5 KB (in             325 others)


Process ID       : 4276
Thread ID        : 9316
Process Exit Code: 0
Thread Exit Code : 0

User Time        :          24.593s
Kernel Time      :           0.328s
Process Time     :          24.921s
Clock Time       :          14.906s

Working Set      :          173012 KB
Paged Pool       :             101 KB
Nonpaged Pool    :              13 KB
Pagefile         :          176044 KB
Page Fault Count : 58016

IO Read          :          309030 KB (in            4830 reads )
IO Write         :          339319 KB (in            5302 writes)
IO Other         :               5 KB (in             233 others)

wars_0.cpk (11.4GB) from Sonic Forces
wars_0.cpk.out1 (20.3GB)
wars_0.cpk.out2 (20.3GB)

Process ID       : 10356
Thread ID        : 6332
Process Exit Code: 0
Thread Exit Code : 0

User Time        :         405.599s
Kernel Time      :          12.093s
Process Time     :         417.692s
Clock Time       :        7466.814s

Working Set      :          444504 KB
Paged Pool       :              99 KB
Nonpaged Pool    :               9 KB
Pagefile         :          496884 KB
Page Fault Count : 148338

IO Read          :        12000054 KB (in          187503 reads )
IO Write         :        21291630 KB (in          332682 writes)
IO Other         :               2 KB (in             210 others)


Process ID       : 3188
Thread ID        : 7760
Process Exit Code: 0
Thread Exit Code : 0

User Time        :         157.199s
Kernel Time      :          23.765s
Process Time     :         180.964s
Clock Time       :        5138.080s

Working Set      :         1042488 KB
Paged Pool       :              99 KB
Nonpaged Pool    :              13 KB
Pagefile         :         1159664 KB
Page Fault Count : 653581

IO Read          :        12000053 KB (in          187503 reads )
IO Write         :        21291630 KB (in          332682 writes)
IO Other         :               2 KB (in             136 others)

[Razor12911]

Crilayla test #3

Test this on the Naruto series, some streams are left behind, I have no idea how to decrypt all of them at the moment.

What is tested here is to see if any sort of inflation happens on all the games of the series.

[Andu21]

Razor, why this happens? Shouldn't the compressed output be less?

TombRaider_Beginning.pcf				4.92 GB > 491 MB
TombRaider_Beginning.xtl				4.99 GB > 660 MB

[darkwolves]

Originally Posted by Andu21

Razor, why this happens? Shouldn't the compressed output be less?

TombRaider_Beginning.pcf				4.92 GB > 491 MB
TombRaider_Beginning.xtl				4.99 GB > 660 MB

the pcf looks to be normal precomp format
what are your arc.ini settings for xtool?

[Razor12911]

Originally Posted by Andu21

Razor, why this happens? Shouldn't the compressed output be less?

TombRaider_Beginning.pcf				4.92 GB > 491 MB
TombRaider_Beginning.xtl				4.99 GB > 660 MB

Can you rerun the test using 0.2, thanks in advance

@Shiv, Ramiro and darkwolves
From my personal experience with crilayla, what darkwolves is saying is right but I'm not going through that source, it's exhausting to translate all that stuff to Delphi, however what Ramiro and Shiv are saying is also correct to a certain extent, it's the same thing, it only differs if the the stream do not start with CRILAYLA, either because they are encrypted or it's just missing, there were a few samples I have received where instead of CRILAYLA header you just find a null header, in this case, xtool approach will not work. But keep up with the debate, it's good.

[darkwolves]

Originally Posted by Razor12911

Can you rerun the test using 0.2, thanks in advance

@Shiv, Ramiro and darkwolves
From my personal experience with crilayla, what darkwolves is saying is right but I'm not going through that source, it's exhausting to translate all that stuff to Delphi, however what Ramiro and Shiv are saying is also correct to a certain extent, it's the same thing, it only differs if the the stream do not start with CRILAYLA, either because they are encrypted or it's just missing, there were a few samples I have received where instead of CRILAYLA header you just find a null header, in this case, xtool approach will not work. But keep up with the debate, it's good.

i been repacking crilayla games for some time now its funny this is like the third time someone has said i was wrong and razor came in later and told them i was right lol

[ShivShubh]

Originally Posted by darkwolves

i been repacking crilayla games for some time now its funny this is like the third time someone has said i was wrong and razor came in later and told them i was right lol

Or maybe there was just a misunderstanding ? Because I can't properly understand what you are trying to say by this :-

the cpk.bms has nothing whatsoever to do with actual inflation it is designed to extract and decompress the file hence the bigger size that is not inflation that is just a result of decompiling the data..

CPK bms by aluigi has the algorithm (comtype cpk) decompression function, the compressed streams are actually decompressed during the extraction process which is equivalent to the inflation done by XTool.

Originally Posted by Andu21

Razor, why this happens? Shouldn't the compressed output be less?

TombRaider_Beginning.pcf 4.92 GB > 491 MB
TombRaider_Beginning.xtl 4.99 GB > 660 MB

Originally Posted by Razor12911

Can you rerun the test using 0.2, thanks in advance

Results made using XTool 0.2 on TombRaider_Beginning.pdf (904 MB)

PDF (904 MB) --> precomp (4.92 GB) --> 4x4:b32m:t4:lzma (550 MB)
PDF (904 MB) --> xtool, c32m (4.98 GB) --> 4x4:b32m:t4:lzma (710 MB)
PDF (904 MB) --> xtool, c256m (5.05 GB) --> 4x4:b32m:t4:lzma (686 MB)

Seems like other pdf files will produce similar differences. Precomp has inbuilt PDF scanner so it is able to properly scan and inflate all the PDF streams hence the better output.

[darkwolves]

because it is designed to decompile and extract once extracted it no longer even reads as a cpk file until it is recompressed and encrypted with a cpk tool it would take razor forever to be able to read through all that data and try implementing it into xtool

[Andu21]

Default settings from xtool 01.

[darkwolves]

Originally Posted by Andu21

Default settings from xtool 01.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c32mb,t3 - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t75p - - <stdin> <stdout>

this?

[Andu21]

Yes, but not through FA.

[darkwolves]

Originally Posted by Andu21

Yes, but not through FA.

i am having no problems with it like that i'm using a compressor similar to pankers

[Andu21]

AFAIK the more the inflation the less the final size, not the case now and i wonder why.

[ZakirAhmad]

Originally Posted by Andu21

AFAIK the more the inflation the less the final size, not the case now and i wonder why.

Not the case always.