PDA

View Full Version : OOZ Review

panker1992
22-04-2019, 06:00
Ok since several people asked me to put OOZ into Masks I finally decided to shed some light to it.

oodle is an API created to pack Game files which are meant to be unpacked at
Ram Speed.

It's a bad idea to use it for repacks and here is why:


Leviathan:
================================================== =====
ooz -1 --leviathan = 37.15mb/sec Output_Ratio = 24.20%
ooz -2 --leviathan = 31.68mb/sec Output_Ratio = 23.95%
ooz -3 --leviathan = 12.95mb/sec Output_Ratio = 23.06%
ooz -4 --leviathan = 12.99mb/sec Output_Ratio = 22.76%
ooz -5 --leviathan = 1.23mb/sec Output_Ratio = 21.09%
ooz -6 --leviathan = 0.88mb/sec Output_Ratio = 20.86%
ooz -7 --leviathan = 1.01mb/sec Output_Ratio = 20.68%

Kraken:
================================================== =====
ooz -1 --kraken = 64.55mb/sec Output_Ratio = 25.67%
ooz -2 --kraken = 53.29mb/sec Output_Ratio = 25.28%
ooz -3 --kraken = 36.67mb/sec Output_Ratio = 24.38%
ooz -4 --kraken = 29.47mb/sec Output_Ratio = 24.03%
ooz -5 --kraken = 2.25mb/sec Output_Ratio = 22.23%
ooz -6 --kraken = 1.35mb/sec Output_Ratio = 21.98%

Hydra:
================================================== =====
ooz -1 --Hydra = 24.05mb/sec Output_Ratio = 24.52%
ooz -2 --Hydra = 23.34mb/sec Output_Ratio = 24.30%
ooz -3 --Hydra = 16.00mb/sec Output_Ratio = 23.43%
ooz -4 --Hydra = 9.98mb/sec Output_Ratio = 23.15%
ooz -5 --Hydra = 1.38mb/sec Output_Ratio = 21.52%
ooz -6 --Hydra = 0.89mb/sec Output_Ratio = 21.20%



Other LZ Compressors:
================================================== =====
lzma2/xz d256m:mt1 = 5.49mb/sec Output_Ratio = 20.67%
lolz -d256m -mt1 = 0.72mb/sec Output_Ratio = 18.62%
Zstd --long=31 --ultra -22 -T1 = 4.88mb/sec Output_Ratio = 23.39%
Lizard -49 -BD = 4.77mb/sec Output_Ratio = 27.60%
lz4 v1.8.3 -12 -DB -B7 = 18.18mb/sec Output_Ratio = 31.91%
Lzturbo -49 -b64m -p1 = 2.5mb/sec Output_Ratio = 21.37%

Other Reference Compressors:
================================================== =====
cls-rzo (mt=8) chunk size = 128m Dictionary Size = 64mb = 4.85mb/sec Output_Ratio = 20.64% (Reference)
7Zip Shelwien Max settings N/A Output_Ratio = 20.71% (Reference)

PS: these are for Reference, comparison is irrelevant but they are here nonetheless!!

Not only it under-performed to even lzma but the packing speed is delusional to the point i didn't bare to make the 7 8 9 max out settings.

However unpacking speeds are anywhere from 600MB/sec to 1.100MB/sec which is cool but packing with xtool+srep alongside it will bottleneck it to somewhere 150 ~ 200mb/sec. (See Below)

Ram usage is around 1GB at -1 up to 4.5GB to -5, -6 which makes it hard to implement a CLS, and ratio is so bad that chunking it will further break it.
Carldric Clement
22-04-2019, 06:23
Ok since several people asked me to put OOZ into Masks I finally decided to shed some light to it.

oodle is an API created to pack Game files which are meant to be unpacked at
Ram Speed.

It's a bad idea to use it for repacks and here is why:


Leviathan:
================================================== =====
ooz -1 --leviathan = 37.15mb/sec Output_Ratio = 24.20%
ooz -2 --leviathan = 31.68mb/sec Output_Ratio = 23.95%
ooz -3 --leviathan = 12.95mb/sec Output_Ratio = 23.06%
ooz -4 --leviathan = 12.99mb/sec Output_Ratio = 22.76%
ooz -5 --leviathan = 1.23mb/sec Output_Ratio = 21.09%
ooz -6 --leviathan = 0.88mb/sec Output_Ratio = 20.86%
ooz -7 --leviathan = 1.01mb/sec Output_Ratio = 20.68%

Kraken:
================================================== =====
ooz -1 --kraken = 64.55mb/sec Output_Ratio = 25.67%
ooz -2 --kraken = 53.29mb/sec Output_Ratio = 25.28%
ooz -3 --kraken = 36.67mb/sec Output_Ratio = 24.38%
ooz -4 --kraken = 29.47mb/sec Output_Ratio = 24.03%
ooz -5 --kraken = 2.25mb/sec Output_Ratio = 22.23%
ooz -6 --kraken = 1.35mb/sec Output_Ratio = 21.98%

Hydra:
================================================== =====
ooz -1 --Hydra = 24.05mb/sec Output_Ratio = 24.52%
ooz -2 --Hydra = 23.34mb/sec Output_Ratio = 24.30%
ooz -3 --Hydra = 16.00mb/sec Output_Ratio = 23.43%
ooz -4 --Hydra = 9.98mb/sec Output_Ratio = 23.15%
ooz -5 --Hydra = 1.38mb/sec Output_Ratio = 21.52%
ooz -6 --Hydra = 0.89mb/sec Output_Ratio = 21.20%



Other LZ Compressors:
================================================== =====
lzma2/xz d256m:mt1 = 5.49mb/sec Output_Ratio = 20.67%
lolz -d256m -mt1 = 0.72mb/sec Output_Ratio = 18.62%
Zstd --long=31 --ultra -22 -T1 = 4.88mb/sec Output_Ratio = 23.39%
Lizard -49 -BD = 4.77mb/sec Output_Ratio = 27.60%
lz4 v1.8.3 -12 -DB -B7 = 18.18mb/sec Output_Ratio = 31.91%

Other Reference Compressors:
================================================== =====
cls-rzo (mt=8) chunk size = 128m Dictionary Size = 64mb = 4.85mb/sec Output_Ratio = 20.64% (Reference)
7Zip Shelwien Max settings N/A Output_Ratio = 20.71% (Reference)

PS: these are for Reference, comparison is irrelevant but they are here nonetheless!!

Not only it under-performed to even lzma but the packing speed is delusional to the point i didn't bare to make the 7 8 9 max out settings.

However unpacking speeds are anywhere from 600MB/sec to 1.100MB/sec which is cool but packing with xtool+srep alongside it will bottleneck it to somewhere 150 ~ 200mb/sec. (See Below)

Ram usage is around 1GB at -1 up to 4.5GB to -5, -6 which makes it hard to implement a CLS, and ratio is so bad that chunking it will further break it.

Optimization for Low End PC:

[External compressor:ooz]
header = 0
packcmd = "oodle\{compressor}" -z -f -2 --hydra $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
panker1992
22-04-2019, 13:52
Indeed this will do for a very slow/old hardware,
I forgot to put lzturbo :P

Will Update this ..
Carldric Clement
22-04-2019, 16:54
Indeed this will do for a very slow/old hardware,
I forgot to put lzturbo :P

Will Update this ..

I have tested the old laptop and it works with little adjust to optimize. :D
Andu21
26-04-2019, 17:13
Compressing 5,760,193,037 bytes with ooz -z -f -c -1 -4 -ml $$arcdatafile$$.tmp

100.0%
Errorlevel=3
100.0%
ERROR: general (de)compression error in ooz:1:4:ml
What am i doing wrong?
Carldric Clement
26-04-2019, 22:34
Compressing 5,760,193,037 bytes with ooz -z -f -c -1 -4 -ml $$arcdatafile$$.tmp

100.0%
Errorlevel=3
100.0%
ERROR: general (de)compression error in ooz:1:4:ml
What am i doing wrong?

Use only ooz
No ooz:1:4:ml
Because it still developer precompressor
Andu21
27-04-2019, 06:46
Compressing 5,760,193,037 bytes with ooz -z -f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
100.0%
Errorlevel=3

ERROR: general (de)compression error in ooz
Nope, same problem. I think there's a file size limit, don't think it's a problem of the precompressor otherwise panker's result couldn't be achieved. Also, what the bold error means?
Carldric Clement
27-04-2019, 06:50
Compressing 5,760,193,037 bytes with ooz -z -f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
100.0%
Errorlevel=3

ERROR: general (de)compression error in ooz
Nope, same problem. I think there's a file size limit, don't think it's a problem of the precompressor otherwise panker's result couldn't be achieved. Also, what the bold error means?

i think u forgot this
[External compressor:ooz]
header = 0
packcmd = ooz -z -f -2 --hydra $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = ooz -d --dll $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
Andu21
29-04-2019, 05:04
Still crashing, I've ran out of ideas.
Carldric Clement
29-04-2019, 06:59
Still crashing, I've ran out of ideas.

Can u snap that ur freearc compressing??
Andu21
01-05-2019, 15:58
You mean split, chunk the input?
Carldric Clement
01-05-2019, 19:23
You mean split, chunk the input?

Absolutely
Andu21
02-05-2019, 05:25
I guess i could, depends on which data can be applied deduplication.