Crilayla test

b01.cpk (Ni no Kuni II Revenant Kingdom)

xtool also working on xdelta patched, i mean pzlib not working fine, but xtl is working

Here's Crilayla test 2

You must just get the same output.

Crilayla Test

Metal Gear Rising - Revengeance data106.cpk (106 MB)

data106.cpk.out1 307 MB (322 219 952)
data106.cpk.out2 307 MB (322 219 952)

Metal Gear Rising - Revengeance data001.cpk (1.02 GB)

data001.cpk.out1 1.61 GB (1 738 216 504)
data001.cpk.out2 1.61 GB (1 738 216 504)

i want to test crilayla i am in the process of messing with a few games that have it so i have downloaded the file

@darkwolves
Sweet

@everyone
thanks for the tests so far, the first release of xtool will come with two codecs, zlib and crilayla. It should be released this week and if no errors are arise then the next codec's development will begin.

[QUOTE=Razor12911;470200]@darkwolves
Sweet

its amazing that lz4 was still working on newer games despite not being entirely completed too

Nice, can't wait. Then i can finally test KCD + Sims 4 extracting again (ztool stucks)

wars_dlc01.cpk (301mb) from Sonic Forces
wars_dlc01.cpk.out1 (331mb)
wars_dlc01.cpk.out2 (331mb)
wars_0.cpk (11.4GB) from Sonic Forces
wars_0.cpk.out1 (20.3GB)
wars_0.cpk.out2 (20.3GB)

del

Crilayla test #3

Test this on the Naruto series, some streams are left behind, I have no idea how to decrypt all of them at the moment.

What is tested here is to see if any sort of inflation happens on all the games of the series.

Razor, why this happens? Shouldn't the compressed output be less?

the pcf looks to be normal precomp format
what are your arc.ini settings for xtool?

Default settings from xtool 01.

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c32mb,t3 - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t75p - - <stdin> <stdout>

this?

Yes, but not through FA.

i am having no problems with it like that i'm using a compressor similar to pankers

AFAIK the more the inflation the less the final size, not the case now and i wonder why.

Not the case always.

what comes after the inflation is the crucial part i think... some compressors work better for certain games

Thats always true, more inflation = more compression by a stronger compressor. But thats not the case here, the extra inflation that you see in these situations is not actually extra inflation but it is actually the loss data, in other ways you can understand it as patch data which is required to restore the new zlib/deflate stream created by the tool to original just like how reflate creates raw files. XTool is able to properly restore streams almost the same as original streams hence it doesn't have much loss data (the extra inflation which it is not) as compared to others.

Razor if I may recommend you, have a look at cpk.bms script from standard quickbms scripts set. Reason why is because it handle all kind of formats and coding and using it so far I was able to unpack any cpk file from all kind of games, except one single cpk file. It could help you broad xtool's CRI compatibility further.

In which case xtool's crilayla didnt work for you ? I have tested it on more than a few games, it worked everywhere except for the encrypted games which is obvious.

the cpk.bms has nothing whatsoever to do with actual inflation it is designed to extract and decompress the file hence the bigger size that is not inflation that is just a result of decompiling the data..

Ouch...You really shouldn't reply when you don't know, each file extracted by cpk.bms is infact a Crilayla stream which is extracted by XTool too, so apart from size of tables in .cpk files, their results are identical unless there is encryption on top of streams.

ok whatever you say i've been using it for a long time i believe what i see from my own personal experiments not what people tell me

Can you rerun the test using 0.2, thanks in advance

@Shiv, Ramiro and darkwolves
From my personal experience with crilayla, what darkwolves is saying is right but I'm not going through that source, it's exhausting to translate all that stuff to Delphi, however what Ramiro and Shiv are saying is also correct to a certain extent, it's the same thing, it only differs if the the stream do not start with CRILAYLA, either because they are encrypted or it's just missing, there were a few samples I have received where instead of CRILAYLA header you just find a null header, in this case, xtool approach will not work. But keep up with the debate, it's good.

i been repacking crilayla games for some time now its funny this is like the third time someone has said i was wrong and razor came in later and told them i was right lol

Or maybe there was just a misunderstanding ? Because I can't properly understand what you are trying to say by this :-

CPK bms by aluigi has the algorithm (comtype cpk) decompression function, the compressed streams are actually decompressed during the extraction process which is equivalent to the inflation done by XTool.

Results made using XTool 0.2 on TombRaider_Beginning.pdf (904 MB)

Seems like other pdf files will produce similar differences. Precomp has inbuilt PDF scanner so it is able to properly scan and inflate all the PDF streams hence the better output.

because it is designed to decompile and extract once extracted it no longer even reads as a cpk file until it is recompressed and encrypted with a cpk tool it would take razor forever to be able to read through all that data and try implementing it into xtool

Why would it be able to read as cpk file after extraction ? Its obvious it wont be read as CPK. And as far as I think XTool's crilayla is based on cpk bms thats why there's no x64 build for it.

if it is extracted it needs to be recompressed by a cpk tool the way razor is making it is were the file inflates not extracts he even said above
how exhausting it is to have to translate all of that

You understood that incorrectly, he meant to say it is exhausting to translate CPK's BMS language into Delphi which is a totally different thing.

oh no i understood that very correctly considering... i have done that enough myself trying to develop my own tool for it his way is faster and its easier so him using a cpk bms would only hinder him and make the project take longer.... and it would only work to a point because some cpk games will not even work with the bms i began using a different tool that extracts all cpk files as well as viewing the content within deeming the cpk bms unreliable

@Razor12911

its not about ratio ,just for the records :)

XTool V0.2 x64

[External compressor:xprecomp]
header = 0
packcmd = xtool.exe e:precomp:c64mb,t75p:zlib - - <stdin> <stdout>
unpackcmd = xtool.exe d:precomp:t75p - - <stdin> <stdout>

arc a -mxprecomp p:\x.arc "d:\00_win32_audio.zip"

FreeArc 0.67 (March 15 2014) creating archive: p:\x.arc
Compressed 1 file, 1,870,559,418 => 1,870,559,726 bytes. Ratio 100.00%
Compression time: cpu 3.23 sec/real 67.89 sec = 5%. Speed 27.55 mB/s
All OK

arc t p:\x.arc

FreeArc 0.67 (March 15 2014) testing archive: p:\x.arc
Testing 1 file, 1,870,559,418 bytes. Processed 89.0%WARNING: CRC failed in "00_win32_audio.zip".
Tested 1 file, 1,870,559,726 => 1,870,559,418 bytes. Ratio 100.00%
Testing time: cpu 1.78 sec/real 2.32 sec = 77%. Speed 804.75 mB/s
There were 1 warning(s)

dataset : (1.74GB)

https://mega.nz/#!g4phDAiZ!bUFwMndnl...9i3Mnf3PclAKi8

@shazzla

i just use msc+srep+lzma on those files and call it a day lol

@razor. i tried xtools zlib preprocessor against sevral game files like tomb raider 2013, mass effect 3, splinter cell etc. in all cases, in all cases it produced same result as is produced by precomp042 and also performed better than ztool (speed as well as precompression). hence, i consider it stable.

Can someone upload samples from games that utilize Anvil Engine, thank you.

Those
https://en.wikipedia.org/wiki/AnvilNext