Advanced Compressor (Nanozip)

[panker1992]

Intro Nanozip

Nanozip is by the far the program that i still try to figure out,
the reason follows in the diagram below.
as you can see it features many switches that manipulate different algos



Options Alg
--------- ----
-cf LZP = fast comp/decomp
-cF LZP = fast comp/decomp improved
-cd lz77 = pretty tight comp very close to lzma if not identical
-cD lz77 = pretty tight comp very close to lzma improved
-cdP lz77 = parallel comp identical to xz method i originally posted in the forum
-cDP lz77 = parallel comp identical to xz method improved
-co BWT = best compression with fastest decom
-cO BWT = best compression with fastest decom imporved
-cc CM = *Ultimate Compression* extremely slow



Positives:
1) It has better ratio over lzma
example: i compressed MGS V into 11.7G without reflate and with precomp set to intense overall it took 5~6 hours to compress and 1 and a half hours to decompress
2) It can be used atop of lzma algo YES you can do lzma and then nz on top :P
3) It takes less ram to Compress you can get better ratio than lzma with 2G dictionary
4) Supports multicore systems in both comp/decomp
5) Can be used with masked compression for greater results

Negatives:
1) It takes the same amount of ram to decomp as it takes to compress
2) its decomp speed is around 10m/sec in -cc and arund 50m/sec in -cO
you will lose some ratio but its worth with that speed
3) it's progress cannot be seen in Inno though it works flawlessly
4) it lucks stdin and stdout

[ChronoCross]

Oh look, panker discover nanozip congrats panker. Ccm algo have better compression ratio than lzma with speed cost. The creator of nanozip take ccm algo and he make the best optimization for the algo but nanozip is close source. He take the source to the grave.

[Razor12911]

in ASC, I somehow made it possible to show decompression progress of nanozip and other compressors like bcm. For now it is not perfected.

[panker1992]

well i didnt discover anything, this post isnt about discovery at all.

its an addition to my original Masked Compression project that i indeed discover along with xz.

Nanozip may be a closed source and slow along the way but if you mask it you may get
pretty nice results



@razor i use Kurutsu's source are they different from yours in progressbar?? how can i implement it ?

[Razor12911]

Kurutsu's source?

[panker1992]

Originally Posted by Razor12911

Kurutsu's source?

kurutsu blackbox Inno setup 1.8

how come you havent seen that before ?? :/

[Razor12911]

Oh that, I have seen it but I haven't used it in a while, maybe last used it 2-3 years ago. I just forgot about it, I don't know if compatible but asc isn't built using inno setup like the bb script is. So far it works with bcm compressor, will just have to post pic to show you what I mean.

[panker1992]

Razor as you can see my GUI-coding skills are novice,

i am trying to bring my projects to Bilawal's RG script and your ASC project but

i cannot make them work without archive.ini file

have problems making your program to read my data.bin file :/

[kenzo34]

hello panker 1992
thank you for your work
we do not see in advance progress bar of zpaq in inno also with kurutsu blackbox Inno setup 1.8
thank you for your tools

[panker1992]

Kenzo yes this is right, you dont get to see zpaq but usually text files that zpaq compresses, decompress in an instance you only feel a moment of freeze nothing else



Here we are talking about an entire 20 maybe 30 gigs of game :P the amount of time that it need in cm algo is freaky

[gozarck]

Nanozip is the best compressor #1 in the world of compression. Cmix0.6 use ccm and is a little faster than nz but you know compression ratio cost.btw nice info about nanozip panker. Pd: LOL is kurutucu

[panker1992]

and the funny thing is that i have used his script for 2+ years

i like nanozip because it has many algorithms inside it, took me a long nighter to optimize the thing :P

with masks you can use it in different styles example
a)
[External compressor:nzf]
;nzf = stands for fast
packcmd = nz a -r -v -cO -m4g -t0 -br128m -bw128m -p2 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m1400m -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz


b)

[External compressor:nzs]
;nzs = stands for slow
packcmd = nz a -r -v -cc -m6g -t0 -br128m -bw128m -p2 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
unpackcmd = nz x -m1400m -t0 -p0 $$arcpackedfile$$.tmp.nz $$arcdatafile$$.tmp
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.tmp.nz


and then use mask to compress text with nzs for ultimate compression and
nzf for fast data


PS: but i wonder how long till they find out themselves

[RamiroCruzo]

I don't get what up with the masks word???

[panker1992]

Ramiro i havent had the time to give a full scale tutorial about it yet :/ i was really busy to make a inno setup for it

send me an inbox and i will tell you about it in a few words

[L33THAK0R]

Hi all, just stumbled across nanozip after seeing it used in various repacks, how does it compare to "lolz"? Are there general advantages/disadvantages or are the benefits/downsides situational? I mostly use "lolz", but sometimes use "lzma" (when beneficial) as a final compressor, but I haven't the foggiest idea what nanozip actually is or how it works.