Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 22-04-2019, 07:00
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 477
Thanks: 111
Thanked 681 Times in 272 Posts
panker1992 is on a distinguished road
OOZ Review

Ok since several people asked me to put OOZ into Masks I finally decided to shed some light to it.

oodle is an API created to pack Game files which are meant to be unpacked at
Ram Speed.

It's a bad idea to use it for repacks and here is why:


Leviathan:
================================================== =====
ooz -1 --leviathan = 37.15mb/sec Output_Ratio = 24.20%
ooz -2 --leviathan = 31.68mb/sec Output_Ratio = 23.95%
ooz -3 --leviathan = 12.95mb/sec Output_Ratio = 23.06%
ooz -4 --leviathan = 12.99mb/sec Output_Ratio = 22.76%
ooz -5 --leviathan = 1.23mb/sec Output_Ratio = 21.09%
ooz -6 --leviathan = 0.88mb/sec Output_Ratio = 20.86%
ooz -7 --leviathan = 1.01mb/sec Output_Ratio = 20.68%

Kraken:
================================================== =====
ooz -1 --kraken = 64.55mb/sec Output_Ratio = 25.67%
ooz -2 --kraken = 53.29mb/sec Output_Ratio = 25.28%
ooz -3 --kraken = 36.67mb/sec Output_Ratio = 24.38%
ooz -4 --kraken = 29.47mb/sec Output_Ratio = 24.03%
ooz -5 --kraken = 2.25mb/sec Output_Ratio = 22.23%
ooz -6 --kraken = 1.35mb/sec Output_Ratio = 21.98%

Hydra:
================================================== =====
ooz -1 --Hydra = 24.05mb/sec Output_Ratio = 24.52%
ooz -2 --Hydra = 23.34mb/sec Output_Ratio = 24.30%
ooz -3 --Hydra = 16.00mb/sec Output_Ratio = 23.43%
ooz -4 --Hydra = 9.98mb/sec Output_Ratio = 23.15%
ooz -5 --Hydra = 1.38mb/sec Output_Ratio = 21.52%
ooz -6 --Hydra = 0.89mb/sec Output_Ratio = 21.20%



Other LZ Compressors:
================================================== =====
lzma2/xz d256m:mt1 = 5.49mb/sec Output_Ratio = 20.67%
lolz -d256m -mt1 = 0.72mb/sec Output_Ratio = 18.62%
Zstd --long=31 --ultra -22 -T1 = 4.88mb/sec Output_Ratio = 23.39%
Lizard -49 -BD = 4.77mb/sec Output_Ratio = 27.60%
lz4 v1.8.3 -12 -DB -B7 = 18.18mb/sec Output_Ratio = 31.91%
Lzturbo -49 -b64m -p1 = 2.5mb/sec Output_Ratio = 21.37%

Other Reference Compressors:
================================================== =====
cls-rzo (mt=8) chunk size = 128m Dictionary Size = 64mb = 4.85mb/sec Output_Ratio = 20.64% (Reference)
7Zip Shelwien Max settings N/A Output_Ratio = 20.71% (Reference)

PS: these are for Reference, comparison is irrelevant but they are here nonetheless!!

Not only it under-performed to even lzma but the packing speed is delusional to the point i didn't bare to make the 7 8 9 max out settings.

However unpacking speeds are anywhere from 600MB/sec to 1.100MB/sec which is cool but packing with xtool+srep alongside it will bottleneck it to somewhere 150 ~ 200mb/sec. (See Below)

Ram usage is around 1GB at -1 up to 4.5GB to -5, -6 which makes it hard to implement a CLS, and ratio is so bad that chunking it will further break it.
Attached Images
File Type: png levithan7_pack_unpack.png (39.0 KB, 258 views)
File Type: png levithan7.png (10.5 KB, 256 views)
Attached Files
File Type: 7z ooz.7z (434.7 KB, 56 views)
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.

Last edited by panker1992; 22-04-2019 at 15:24. Reason: addition
Reply With Quote
The Following User Says Thank You to panker1992 For This Useful Post:
doofoo24 (22-04-2019)
Sponsored Links
  #2  
Old 22-04-2019, 07:23
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
Ok since several people asked me to put OOZ into Masks I finally decided to shed some light to it.

oodle is an API created to pack Game files which are meant to be unpacked at
Ram Speed.

It's a bad idea to use it for repacks and here is why:


Leviathan:
================================================== =====
ooz -1 --leviathan = 37.15mb/sec Output_Ratio = 24.20%
ooz -2 --leviathan = 31.68mb/sec Output_Ratio = 23.95%
ooz -3 --leviathan = 12.95mb/sec Output_Ratio = 23.06%
ooz -4 --leviathan = 12.99mb/sec Output_Ratio = 22.76%
ooz -5 --leviathan = 1.23mb/sec Output_Ratio = 21.09%
ooz -6 --leviathan = 0.88mb/sec Output_Ratio = 20.86%
ooz -7 --leviathan = 1.01mb/sec Output_Ratio = 20.68%

Kraken:
================================================== =====
ooz -1 --kraken = 64.55mb/sec Output_Ratio = 25.67%
ooz -2 --kraken = 53.29mb/sec Output_Ratio = 25.28%
ooz -3 --kraken = 36.67mb/sec Output_Ratio = 24.38%
ooz -4 --kraken = 29.47mb/sec Output_Ratio = 24.03%
ooz -5 --kraken = 2.25mb/sec Output_Ratio = 22.23%
ooz -6 --kraken = 1.35mb/sec Output_Ratio = 21.98%

Hydra:
================================================== =====
ooz -1 --Hydra = 24.05mb/sec Output_Ratio = 24.52%
ooz -2 --Hydra = 23.34mb/sec Output_Ratio = 24.30%
ooz -3 --Hydra = 16.00mb/sec Output_Ratio = 23.43%
ooz -4 --Hydra = 9.98mb/sec Output_Ratio = 23.15%
ooz -5 --Hydra = 1.38mb/sec Output_Ratio = 21.52%
ooz -6 --Hydra = 0.89mb/sec Output_Ratio = 21.20%



Other LZ Compressors:
================================================== =====
lzma2/xz d256m:mt1 = 5.49mb/sec Output_Ratio = 20.67%
lolz -d256m -mt1 = 0.72mb/sec Output_Ratio = 18.62%
Zstd --long=31 --ultra -22 -T1 = 4.88mb/sec Output_Ratio = 23.39%
Lizard -49 -BD = 4.77mb/sec Output_Ratio = 27.60%
lz4 v1.8.3 -12 -DB -B7 = 18.18mb/sec Output_Ratio = 31.91%

Other Reference Compressors:
================================================== =====
cls-rzo (mt=8) chunk size = 128m Dictionary Size = 64mb = 4.85mb/sec Output_Ratio = 20.64% (Reference)
7Zip Shelwien Max settings N/A Output_Ratio = 20.71% (Reference)

PS: these are for Reference, comparison is irrelevant but they are here nonetheless!!

Not only it under-performed to even lzma but the packing speed is delusional to the point i didn't bare to make the 7 8 9 max out settings.

However unpacking speeds are anywhere from 600MB/sec to 1.100MB/sec which is cool but packing with xtool+srep alongside it will bottleneck it to somewhere 150 ~ 200mb/sec. (See Below)

Ram usage is around 1GB at -1 up to 4.5GB to -5, -6 which makes it hard to implement a CLS, and ratio is so bad that chunking it will further break it.
Optimization for Low End PC:
Code:
[External compressor:ooz]
header    = 0
packcmd   = "oodle\{compressor}" -z -f -2 --hydra $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
__________________
EDM Producer.

Last edited by Carldric Clement; 22-04-2019 at 08:48.
Reply With Quote
  #3  
Old 22-04-2019, 14:52
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 477
Thanks: 111
Thanked 681 Times in 272 Posts
panker1992 is on a distinguished road
Indeed this will do for a very slow/old hardware,
I forgot to put lzturbo :P

Will Update this ..
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
  #4  
Old 22-04-2019, 17:54
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
Indeed this will do for a very slow/old hardware,
I forgot to put lzturbo :P

Will Update this ..
I have tested the old laptop and it works with little adjust to optimize.
__________________
EDM Producer.
Reply With Quote
  #5  
Old 26-04-2019, 18:13
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
Code:
Compressing 5,760,193,037 bytes with ooz -z -f -c -1 -4 -ml  $$arcdatafile$$.tmp

100.0%
Errorlevel=3
100.0%
ERROR: general (de)compression error in ooz:1:4:ml
What am i doing wrong?
Reply With Quote
  #6  
Old 26-04-2019, 23:34
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by Andu21 View Post
Code:
Compressing 5,760,193,037 bytes with ooz -z -f -c -1 -4 -ml  $$arcdatafile$$.tmp

100.0%
Errorlevel=3
100.0%
ERROR: general (de)compression error in ooz:1:4:ml
What am i doing wrong?
Use only ooz
No ooz:1:4:ml
Because it still developer precompressor
__________________
EDM Producer.
Reply With Quote
The Following User Says Thank You to Carldric Clement For This Useful Post:
Andu21 (27-04-2019)
  #7  
Old 27-04-2019, 07:46
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
Code:
Compressing 5,760,193,037 bytes with ooz -z -f  $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
100.0%
Errorlevel=3

ERROR: general (de)compression error in ooz
Nope, same problem. I think there's a file size limit, don't think it's a problem of the precompressor otherwise panker's result couldn't be achieved. Also, what the bold error means?
Reply With Quote
  #8  
Old 27-04-2019, 07:50
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by Andu21 View Post
Code:
Compressing 5,760,193,037 bytes with ooz -z -f  $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
100.0%
Errorlevel=3

ERROR: general (de)compression error in ooz
Nope, same problem. I think there's a file size limit, don't think it's a problem of the precompressor otherwise panker's result couldn't be achieved. Also, what the bold error means?
i think u forgot this
Code:
[External compressor:ooz]
header    = 0
packcmd   = ooz -z -f -2 --hydra $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = ooz -d --dll $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
__________________
EDM Producer.
Reply With Quote
  #9  
Old 29-04-2019, 06:04
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
Still crashing, I've ran out of ideas.
Reply With Quote
  #10  
Old 29-04-2019, 07:59
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by Andu21 View Post
Still crashing, I've ran out of ideas.
Can u snap that ur freearc compressing??
__________________
EDM Producer.
Reply With Quote
  #11  
Old 01-05-2019, 16:58
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
You mean split, chunk the input?
Reply With Quote
  #12  
Old 01-05-2019, 20:23
Carldric Clement's Avatar
Carldric Clement Carldric Clement is offline
Registered User
 
Join Date: Aug 2014
Location: Toboh, Sabah, Malaysia
Posts: 457
Thanks: 496
Thanked 405 Times in 157 Posts
Carldric Clement is on a distinguished road
Quote:
Originally Posted by Andu21 View Post
You mean split, chunk the input?
Absolutely
__________________
EDM Producer.
Reply With Quote
  #13  
Old 02-05-2019, 06:25
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: Impossible Planet
Posts: 114
Thanks: 179
Thanked 48 Times in 38 Posts
Andu21 is on a distinguished road
I guess i could, depends on which data can be applied deduplication.
Reply With Quote
Reply

Tags
oodle, ooz

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Nintendo DS Review! manicdvln NDS Games 0 20-04-2005 18:14
HDLoader Review lufcfan PS2 Games 99 25-08-2004 20:22
To: Charlie_PS2 (Messiah 2 review) BG PS2 Games 2 27-10-2002 11:27
Plextor 24write 10rewrite 40read review? ac0197264 CD/DVD-Writers 1 10-08-2001 20:10
New Mitsuimi Drive Review! Wayniac CD/DVD-Writers 6 23-04-2001 11:59



All times are GMT -7. The time now is 04:48.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2021, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com