Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 31-05-2016, 19:54
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,309
Thanks: 1,789
Thanked 8,628 Times in 1,947 Posts
Razor12911 is on a distinguished road
AntiZ + CLS (ZLib Precompressor)

AntiZ is a project to create an open source precompressor for lightly compressed data.(currently Zlib)
Zlib is very common, for example it is used in PDF, JAR, ZIP, PNG etc.
It is fast but it has a poor compression ratio, and it is usually not effective to use a stronger compression(eg. LZMA) on data that has been compressed with Zlib. It would be much better if the data was not compressed at all before the sron compression. For example:
PDF file: 172KB---->compresses to 124KB with 7ZIP 9.38 beta (ultra preset)
PDF file: 172KB---->expands to 745KB with AntiZ----->compresses to 104KB with 7ZIP

Of course this process is not trivial if you want to get back the original file, byte identical.
This project is inspiried by and aims to be a replacement for the long abandoned precomp project (non open source).
http://schnaader.info/precomp.php

AntiZ is currently in alpha stage, the ATZ1 file format is not very polished, has almost no integrity checksa and wastes space. There may also be bugs. I do not recommend using it on important data yet, especially since later versions will not support the ATZ1 file format.

AntiZ supports any file that contains a standard deflate stream, such as PDF, JAR, some PNGs and many others. Files that contain headerless or otherwise altered deflate streams(eg. ZIP) are currently not supported.

A number of people have contributed ideas, kind words, testing and code to the development of AntiZ:

hxim (https://github.com/hxim)

the encode.ru community (http://encode.ru/threads/2197-AntiZ-...ive-to-precomp)

Thank you!

USAGE:

Code:
uncomp.exe  [--brute-window] [--notest] [-r] [--chunksize <integer>]
               [--mismatch-tol <integer>] [--shortcut-len <integer>]
               [--sizediff-tresh <integer>] [--recomp-tresh <integer>] [-o
               <string>] -i <string> [--] [--version] [-h]


Where:

   --brute-window
     Bruteforce deflate window size if there is a chance that recompression
     could be improved by it. This can have a major performance penalty.
     Default: disabled

   --notest
     Skip comparing the reconstructed file to the original at the end. This
     is not recommended, as AntiZ is still experimental software and my
     contain bugs that corrupt data.

   -r,  --reconstruct
     Assume the input file is an ATZ file and attempt to reconstruct the
     original file from it

   --chunksize <integer>
     Size of the memory buffer in bytes for chunked disk IO. This contorls
     memory usage to some extent, but memory usage control is not fully
     implemented yet. Smaller values result in more disk IO operations.
     Default: 524288

   --mismatch-tol <integer>
     Mismatch tolerance in bytes. If a set of parameters are found that
     give at most this many mismatches, then accept them and stop looking
     for a better set of parameters. Increasing this improves speed at the
     cost of more ATZ file overhead that may hurt compression. Default: 2
     Maximum: 65535

   --shortcut-len <integer>
     Length of the shortcut in bytes. If a stream is longer than the
     shortcut, then stop compression after <shortcut> compressed bytes have
     been obtained and compare this portion to the original. If this
     comparison yields more than recompTresh mismatches, then do not
     compress the entire stream. Lowering this improves speed, but it must
     be significantly greater than recompTresh or the speed benefit will
     decrease. Default: 512  Maximum: 65535

   --sizediff-tresh <integer>
     Size difference treshold in bytes. If the size difference between a
     recompressed stream and the original is more than the treshold then do
     not even compare them. Increasing this treshold increases the chance
     that a stream will be compared to the original. The cost of comparing
     is relatively low, so setting this equal to the recompression treshold
     should be fine. Default: 128  Maximum: 65535

   --recomp-tresh <integer>
     Recompression treshold in bytes. Streams are only recompressed if the
     best match differs from the original in at most recompTresh bytes.
     Increasing this treshold may allow more streams to be recompressed,
     but may increase ATZ file overhead and make it harder to compress.
     Default: 128  Maximum: 65535

   -o <string>,  --output <string>
     Output file name

   -i <string>,  --input <string>
     (required)  Input file name

   --,  --ignore_rest
     Ignores the rest of the labeled arguments following this flag.

   --version
     Displays version information and exits.

   -h,  --help
     Displays usage information and exits.
Notes
cls-antiz.dll and antiz.exe are needed for both compression and decompression.
Attached Images
File Type: png Antiz.PNG (33.1 KB, 1011 views)
Attached Files
File Type: 7z antiz014a.7z (446.6 KB, 468 views)
File Type: 7z cls-antiz.7z (245.6 KB, 424 views)
__________________
I was the first member to reach 3k, 4k, 5k, 6k,7k and 8k milestones in the number of thanks received, I went away and came back after a while and I am 2nd in the number of thanks, that moderator pakrat2k2 took my spot but it's not too late, thank all other signatures and help me reach 9k before him, THAT'S AN ORDER

Last edited by Razor12911; 31-05-2016 at 19:56.
Reply With Quote
The Following 18 Users Say Thank You to Razor12911 For This Useful Post:
amgad_800 (02-06-2016), Amsal (31-05-2016), Andrey167 (01-06-2016), Andu21 (07-09-2016), arkantos7 (01-06-2016), aswadd (06-09-2016), BLACKFIRE69 (09-09-2019), Ichiraku2001 (01-06-2016), JRD! (06-09-2016), kenzo34 (20-08-2016), Lucas65 (04-06-2016), Mini (31-05-2016), nasir ahmad (08-06-2016), NexusIV (12-10-2016), RamiroCruzo (31-05-2016), Simorq (01-06-2016), Stor31 (12-05-2017), truerepacks (01-06-2016)
Sponsored Links
  #2  
Old 06-09-2016, 22:21
aswadd's Avatar
aswadd aswadd is offline
Registered User
 
Join Date: Aug 2016
Location: Egypt
Posts: 316
Thanks: 84
Thanked 157 Times in 98 Posts
aswadd is on a distinguished road
I usually use AntiZ rather than precomp it gave better ratio with srep+lzma & also provide more speed .. the only problem in Antiz is that it can't handle large files / folders like 15 GB this is the only problem ..
Reply With Quote
The Following User Says Thank You to aswadd For This Useful Post:
78372 (15-05-2017)
  #3  
Old 12-10-2016, 11:19
LuzhinE's Avatar
LuzhinE LuzhinE is offline
Registered User
 
Join Date: Jan 2014
Location: Peru
Posts: 227
Thanks: 25
Thanked 34 Times in 28 Posts
LuzhinE is on a distinguished road
thanks I'll try

Last edited by LuzhinE; 30-10-2016 at 11:28.
Reply With Quote
  #4  
Old 14-10-2016, 07:15
aswadd's Avatar
aswadd aswadd is offline
Registered User
 
Join Date: Aug 2016
Location: Egypt
Posts: 316
Thanks: 84
Thanked 157 Times in 98 Posts
aswadd is on a distinguished road
Quote:
Originally Posted by LuzhinE View Post
aswadd and as you run?
don't know what you mean ??
but if you will compare precomp038 with antiz
for small files like 1GB precomp will win in the speed
big Files of course Antiz will win but it depends on your ram so it can't handle large files
Reply With Quote
  #5  
Old 19-10-2016, 14:35
LuzhinE's Avatar
LuzhinE LuzhinE is offline
Registered User
 
Join Date: Jan 2014
Location: Peru
Posts: 227
Thanks: 25
Thanked 34 Times in 28 Posts
LuzhinE is on a distinguished road
as I can make it work because there is no discharge in arc.ini, you would be so kind to explain, to make a test
Reply With Quote
  #6  
Old 12-05-2017, 11:56
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
AntiZ is going to be updated or abandoned?
Reply With Quote
  #7  
Old 19-05-2017, 07:35
Gupta Gupta is offline
Registered User
 
Join Date: Aug 2016
Location: India
Posts: 364
Thanks: 123
Thanked 586 Times in 208 Posts
Gupta is on a distinguished road
Quote:
Originally Posted by 78372 View Post
AntiZ is going to be updated or abandoned?
Creator has done it as a project for his university looks like he got the grades
__________________
XD
Reply With Quote
The Following User Says Thank You to Gupta For This Useful Post:
78372 (19-05-2017)
  #8  
Old 19-05-2017, 07:43
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
Quote:
Originally Posted by PrinceGupta2000 View Post
Creator has done it as a project for his university looks like he got the grades
Yeah, may be.
Reply With Quote
  #9  
Old 20-05-2017, 04:54
Simorq's Avatar
Simorq Simorq is offline
Registered User
 
Join Date: Mar 2014
Location: Iran
Posts: 642
Thanks: 3,515
Thanked 1,127 Times in 433 Posts
Simorq is on a distinguished road
antiz015a
https://github.com/Diazonium/AntiZ/releases
Reply With Quote
The Following User Says Thank You to Simorq For This Useful Post:
78372 (12-06-2017)
  #10  
Old 20-05-2017, 05:16
Gupta Gupta is offline
Registered User
 
Join Date: Aug 2016
Location: India
Posts: 364
Thanks: 123
Thanked 586 Times in 208 Posts
Gupta is on a distinguished road
last commit July 28, 2016, it will be 1 year soon last updated
__________________
XD
Reply With Quote
  #11  
Old 20-05-2017, 09:49
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
So, it was updated and looks like it's going to be updated again.
Reply With Quote
  #12  
Old 22-05-2017, 11:17
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
This new antiz works with this cls perfectly

Last edited by 78372; 26-05-2017 at 10:33.
Reply With Quote
  #13  
Old 23-05-2017, 23:56
romulus_ut3 romulus_ut3 is offline
Registered User
 
Join Date: Dec 2014
Location: Bangladesh
Posts: 71
Thanks: 169
Thanked 13 Times in 12 Posts
romulus_ut3 is on a distinguished road
Just an inquiry: is AntiZ superior than pZlib v3?
Reply With Quote
  #14  
Old 24-05-2017, 01:52
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
No, but faster than precomp
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
romulus_ut3 (24-05-2017)
  #15  
Old 12-06-2017, 21:01
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 596
Thanks: 667
Thanked 742 Times in 265 Posts
78372 is on a distinguished road
Some latest news, as the creator said, antiz is going to be abandoned forever.

Quote:
At this point, I have no time or motivation to work on this project. So for the foreseeable future, no updates.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Zlib Checker Razor12911 Conversion Tutorials 43 10-09-2016 09:41
Fast Zlib Recompressor by Razor12911 (*Test*) panker1992 Conversion Tutorials 25 27-04-2016 06:22
Processing Zlib streams without headers RamiroCruzo Conversion Tutorials 3 21-09-2015 01:24



All times are GMT -7. The time now is 22:56.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2019, vBulletin Solutions Inc.
Copyright 2000-2018, FileForums @ https://fileforums.com