View Full Version : LZMA vs LOLZ & Scan Compress Method
I have some questions about LZMA & LOLZ
Q1) I want to know which one is better?
Q2) i want to know what is 256m, & what it does?
lzma:a1:mfbt4:256m:fb273:mc1000000000:lc 8
Q3) how do i scan and find the Compression like Oodle game?
I know how to find Oodle games. But i don't know how to find none Oodle games so help me please.
1. Depends on the file
2. 256m is dictionary size (https://stackoverflow.com/questions/3057171/lzma-compression-settings-details)
3. Use Game File Scanner for non-Oodle games
1. Depends on the file
2. 256m is dictionary size (https://stackoverflow.com/questions/3057171/lzma-compression-settings-details)
3. Use Game File Scanner for non-Oodle games
Thanks for Reply :)
If i change 256m to 2048m?
it will give me better ratio.
I have test it.
If i use 2048m,
For decompression
at least require 2GB ram
Right?
can you please tell me, where is that
Game File Scanner and how to use it.
are you that lazy to type in the search ?
https://www.fileforums.com/showthread.php?t=99270&highlight=Game+File+Scanner
No I'm not lazy i jave try too hard. I have search i didn't see it so i though asking it thanks anyway.
Can you please tell me about 256mb?
That link didn't mentioned it.
200m mean 2100Mb ram?
I have seen it in reflate thread.. explain please bro.
Tou know lot of stuffs si please share..
if you use lzma without fazip you limited to 184mb
to use d2048mb you need to use fazip, but in compression need 20gb of ram...
[External compressor:rep,mm,exe,dispack070,4x4,lzma]
header = 0
packcmd = FAZip.exe -i0 compress:{compressor}{:option} <stdin> <stdout>
Thanks bro i really appreciate your help...
Yes i have always use FAZip.exe 64 version,
on UA R6 Diskspan.
Its perfect everything is set.
So i have 32GB DDR4 RAM,
i can go up to more right?
Its calculate like 200mx10.5=2100m right?
If i use more ram for compression can i decompress with under 4GB ram?
Without any error? Or
decompress need same memory?
If i use more ram for compressing i can get better ratio and i can finish the job faster right?
so what do you think the d short for :eek:
lzma is limited to 2 thread alone decompresion speed around 40-50 mb,
Im not expert with compression
and i still don't understand what you mean.
Please tell me in simple way.
For make your life easier ,i think you should stick with
Srep:a8:m5f:l512+lolz:d384m:mt2
Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.
Sorry for my style ,i dont want to be rude.
Regards... :)
i7 8700k cpu
6C 12T;)
192 Best results.
#4x4
192m(Dictionary)x12Tx12= 28 Gb Ram Used for Compression
#4x4:t8:b128m:lzma:a1:mfbt4:256m:fb273:mc1024:lc8
256m(Dictionary) x 12T x t8 = 24 Gb Ram Used for Compression
#lolz
~ mt threads(-mt[1..16])
192m(Dictionary) x 12T x mt* =...
For make your life easier ,i think you should stick with
Srep:a8:m5f:l512+lolz:d384m:mt2
Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.
Sorry for my style ,i dont want to be rude.
Regards... :)
Thanks..
6C 12T;)
192 Best results.
#4x4
192m(Dictionary)x12Tx12= 28 Gb Ram Used for Compression
#4x4:t8:b128m:lzma:a1:mfbt4:256m:fb273:mc1024:lc8
256m(Dictionary) x 12T x t8 = 24 Gb Ram Used for Compression
#lolz
~ mt threads(-mt[1..16])
192m(Dictionary) x 12T x mt* =...
I don't understand this... Cause I'm new to this.
and I don't use LOLZ, cause it's taking too long.
Please tell one thing. *FAZIP* 64bit use cpu only 25%
How can i let it use 75%? It will be faster if FAZIP use 75% cpu
and i have try LZMA with 2048MB
for compression it used 21000MB 21GB..
still compressing... after it done I'll try to decompress with 4GB Ram and see what happens.
felice2011
26-12-2018, 09:20
For make your life easier ,i think you should stick with
Srep:a8:m5f:l512+lolz:d384m:mt2
Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.
Sorry for my style ,i dont want to be rude.
Regards... :)
Right, In fact all these problems with a pre-processor of compression (srep), except if there are problems of compression or decompression for inefficient systems (Hardware) or other, I personally all these problems I would not make them, remaining stick with to a single command option.
felice2011
26-12-2018, 09:36
Using "7z.exe/lzma2" as the final compressor I would recommend this option:
a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=999999999:lc=4:lp= 0 -mmt=2 -mx9
Using "LZMA" as a final compression in a single option with a good compression ratio I recommend this:
-a1 -d27 -fb273 -mc999999999 -lc8 -lp4 -mfbt4 -mt8
Well with "LOLZ", so far today I have not found a good compromise of a good speed and a satisfactory compression threshold in relation to a higher speed.
With lolz continues to do your tests are of interest to everyone.;)
https://www.fileforums.com/showthread.php?t=102311
Using "7z.exe/lzma2" as the final compressor I would recommend this option:
a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=999999999:lc=4:lp= 0 -mmt=2 -mx9
Using "LZMA" as a final compression in a single option with a good compression ratio I recommend this:
-a1 -d27 -fb273 -mc999999999 -lc8 -lp4 -mfbt4 -mt8
Well with "LOLZ", so far today I have not found a good compromise of a good speed and a satisfactory compression threshold in relation to a higher speed.
With lolz continues to do your tests are of interest to everyone.;)
https://www.fileforums.com/showthread.php?t=102311
I always Use FAZIP 64 for LZMA so i need to know about it. I don't need 7z cause i will never use it.
So please FAZip64 LZMA info please..
@felice2011
mc=999999999:confused::eek::D
@felice2011
mc=999999999:confused::eek::D
Please Reply my preview question and reply this one to please. What is MC?
i did find 7z Lzma info but nit FAZip Lzma info both are different so please show me the all info about FAZip lzma And tell me what's that MC do
felice2011
26-12-2018, 10:15
@felice2011
mc=999999999:confused::eek::D
YESSSSSS:p:p:p
doofoo24
26-12-2018, 10:18
add 1 and you are a billionaire :D
felice2011
26-12-2018, 10:30
Fazip is an external compression library used by FA with internal compressor "rep, mm, delta, exe, exe2, 4x4, lzma ... etc", in some cases it can also be used for reading (stdin-stdout) of some external compressors (ex.LOLZ).
The example shown concerns external compressors, with a single configuration with FreeArc support.
So you will have differences in compression ratio and speed using the following methods:
srep64:m5f:a2:d1g+lzma2:d512m (LZMA2)
srep64:m5f:a2:d1g+lz77 (LZMA)
srep64:m5f:a2:d1g+lzma (fazip)
logically everything changes according to the configuration of the.ini file
felice2011
26-12-2018, 10:32
add 1 and you are a billionaire :D
haha.. those would be enough for me to feel good.;):p
add 1 and you are a billionaire :D
i'm asking questions and they don't see it,
they fight for billionaire ;):p:D
hahaha very funny...
i'm not programmer so when you guys tell me something please be simple
cause i don't understand. :p
I Do more testing and i finally got this, i will use this for 6GB RAM Games.
and the 4GB Ram games i use 512 or 1024 depends of precomp.
so please guys tell me how to change and what is the MC ?
lc8 should be stayed as 8.
i like to change the MC but don't know what it is so please Explain :o
lzma:a1:mfbt4:2048m:fb273:mc1000000000:lc8
This 2048m req 21000MB (21GB) RAM for Compress
and Decompress only use 2050MB (2.05GB) with precomp and srep
it use 3100MB Ram.
i'm gonna do something better so that's why i need to know what i can still do for LZMA to get better ratio
when i done i will post it on here :p so help me guys.
as for lzma setting if u want to waste your time that's your choose :)
LOLZ is too slow thats why i use LZMA :)
what is your recommend ?
and pls tell me what is that MC ? :)
felice2011
26-12-2018, 11:11
MC:
Sets number of cycles (passes) for match finder. It can be in range from 0 to 1000000000. Default value is (16 + number_of_fast_bytes / 2) for BT* match finders and (8 + number_of_fast_bytes / 4) for HC4 match finder. If you specify mc=0, LZMA will use default value. Usually, a big number gives a little bit better compression ratio and slower compression process. For example, mf=HC4 and mc=10000 can provide almost the same compression ratio as mf=BT4.
@yasitha .... @KaktoR has already given you some references to read on some web pages, do not waste any more time with all your tests on lzma/lzma2/fazip, listen to our tips and our examples and start to compress.
In Italian and in our country, in Naples we say: "Sta' senza pensier !!!" :D:D;)
i already gave you an answer
https://www.fileforums.com/showpost.php?p=478158&postcount=25
lolz on I7 8700K USE
[External compressor:lolz]
header = 0
packcmd = lolz.exe -dtb1 -fba4096 -mc1023 -pc4 -mt12 -mtt1 -d96 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
you should get around 4mb/s to 5mb/s
as for lzma just use lzma:a1:mfbt4:d512m:fb273:mc10000:lc8 no point of using d larger than 512mb it only improve like 10mb to 50mb...
Thanks :) Finally ;)
MC:
@yasitha .... @KaktoR has already given you some references to read on some web pages, do not waste any more time with all your tests on lzma/lzma2/fazip, listen to our tips and our examples and start to compress.
In Italian and in our country, in Naples we say: "Sta' senza pensier !!!" :D:D;)
yes i see that i though it was only for 7z not For FAZip, sorry my bad :o
FAZip64 only use 25% 35% CPU Usage, how can i change that to 75% CPU usage ?
if i do, the process will be finish fast. :)
Help!
all that time Razor spent to develop ztool/xtool to help the community to overcome precomp :(
i know him personally we are friends is long time i think 5 or 6 years, now he's too buys can't even talk..
hes the best person that i know.
he can do anything pretty much. :)
and i miss him :o , wehn i need something i directly ask him,
so i don't have to wait,
i have provide him conversion graphics for ASC i think its in 2013 :)
back then i don't do compress, i don't even like it :D
recently i thought learning about it is a good idea,
casue new games are like huge :D so that's why i ask around! ;)
only if you read
https://www.fileforums.com/showpost.php?p=478167&postcount=8
lzma limited to 2 thread faster use 4x4 but you need to lower d2048 to somthing like d32 or d64
you wont super fast lzma use 7z.exe
or as i mentioned in https://www.fileforums.com/showpost.php?p=478158&postcount=25
use 4x4:lzma:a1:mfbt4:d32m:fb273:mc10000:lc8...
don;t get angry on me :D testing now... :)
angry off :D
this will keep the CPU Usage At 100% All the times
and that's the one reason i don't like LOL ZZZZ
second reason its slow.. and im testing now this lolz method,
and i will compare with my Current LZMA settings.
[CODE]
lolz:dtb1:fba4096:mc1023:pc4:mt12:mtt1:d96[\CODE]
whose anger me ;)
you also can add 7z.exe and 7z.dll
and add to arc.ini
[External compressor:lzma]
header = 0
packcmd = 7z.exe a -txz -an -mcrc=0 -m1=lzma2:d384m:fb=273:mf=bt4:mc=999999999:lc=4:lp= 0 -mmt=12 -mx9 -si -so <stdin> <stdout>
it will use all 12 threads with 27gb of ram and decompresion around d384m
can't even type while lolz runing :D
i know 7z is fast lzma2, but lzma better then lzma2 i'v seen it with testing..
i do many many testing now im going crazy... :D
that's why i ask random questions..
did you learn about this stuffs on your own ? ;)
what you cpu cooler ?
stock air cooler :D :D :D 1000rpm :D
lolz :D no no i have
Corsair H115i 280mm Extreme Performance Liquid Cooler
that's why i'm waiting for the new cpus next years 16 core 32 thread :D
i'm planing for buy AMD Ryzen 2700x, 2800x nowhere to be found.
intel sucks.. 4, 6 cores still....
i9 has 8 core and too expansive. :D
what you will buy ? :o and idea ? 2800x release ?
i have google it many many times but i only found rumors :p :D ;)
AMD Ryzen Threadripper has multi core and threads but expansive
Ryzen 9 3850X :D:D:D
wow cool.. :)
Can i Use this
4x4:t2:256m:lzma:256m
instead of this
4x4:t8:256m:lzma:256m
What is that T8? means CPU Threads?
I want to compress with 50% or 75% CPU usage.
If i change t8 it will hit 100% cpu usage all the time.
If i Change it to t3 it use only 75-80% if i change t2 its only use 50-60 cpu usage.
so my question is what is T?
Can i use T method without 4x4?
I have try many times but
I got no luck so that's why i ask..
Help!
I have found more info about
FAZip LZMA. Hope this will help others like me
https://fileforums.com/showthread.php?t=99560
https://github.com/Bulat-Ziganshin/FA/wiki/FA-0.20
http://fastcompression.blogspot.com
alfredd31
28-12-2018, 03:42
To doofoo24: which version of xtool did you use for dishonored Doto?
xtool v0.9 is freezing. Btw, if you know if some src are available for lolz, xtool...it would be useful.
https://i.ibb.co/YQBvzgF/bb21.jpg
alfredd31
28-12-2018, 04:29
In fact it's working. But it's extremely slow.
Can anyone help me please?
like to use LOLZ method, but i don't know the perfect method for it,
anyone can help me to recognize what should i change for get better ratio ?
any one can tell me best LOLZ Method in the world ? :D
i need best choice for speed and best ratio please help guys
we all are :D
:confused: seriously... Please answer me bro :o
WOW dude :o
SPEED VS RATIO "law of diminishing return" :)
you guys are professional and I'm not. So i don't know compression stuff like you do, & i like to know..
that's why i ask wrong questions :o :(
Precompressor is really necessary?. why can't i use
SREP+LZMA or LOLZ or LZMA2?
Why do we have to use Precompressor.
It's slowing down extremely,
That's why i ask to get better answer
From tou guys.
I have done more testing...
With oodle compression it took 16h to complete.
Without oodle, it only took 5 hours to complete.
both are use the same srep +lzma options.
Oodle is extremely slow.
Different BTW just one DVD.
With srep+lzma 9xDVD5 final disk 3.98GB
with oodle 8xDVD5 final disk 750mb
For installing oodle take to much time like 1h 35m
And use cpu 100% all the time.
With srep+lzma only use 30% under,
and install around 35m / 45m
so my question is Precompressor is really necessary?
If i don't use that, i can save lot of time.
is there any other trick available,
That i can use with srep+lzma
To get better ratio?
I Have learn lot of thing from you guys and i really appreciate it and im glade you guys are to help
You should see it from the point of repack competition :)
You should see it from the point of repack competition :)
What do you mean by that? your suggestion is go with precomp if it still take too much time?
Oky, tell me bro,
Do you know How To Create Disk list? If you know,
Please post here. I have open new Thread for it.
https://fileforums.com/showthread.php?t=102511
6C 12T;)
192 Best results.
#4x4
192m(Dictionary)x12Tx12= 28 Gb Ram Used for Compression
#4x4:t8:b128m:lzma:a1:mfbt4:256m:fb273:mc1024:lc8
256m(Dictionary) x 12T x t8 = 24 Gb Ram Used for Compression
#lolz
~ mt threads(-mt[1..16])
192m(Dictionary) x 12T x mt* =...
Hi can you explain this with LOLZ?
with CPU Core 4 Thread 8
IF I Use b192m with mt4 how much C and D ram requires pls explain like LZMA... for LOLZ
Hi can you explain this with LOLZ?
with CPU Core 4 Thread 8
IF I Use b192m with mt4 how much C and D ram requires pls explain like LZMA... for LOLZ
lolz
192m(Dictionary) x 8T x mt4 =6.5 GB Rame
for Decode: (Depending on the file type.)
mtt1:
64m = decode mem usage per thread = 136mb
192m= decode mem usage per thread = 384mb
lolz
192m(Dictionary) x 8T x mt4 =6.5 GB Rame
for Decode: (Depending on the file type.)
mtt1:
64m = decode mem usage per thread = 136mb
192m= decode mem usage per thread = 384mb
Thanks, that's is very helpful.
Do you know how to speed up decompressing any magic trick? :) using LOLZ or LZMA with XTOOL or oodle or srep... any magic available for speed up? For decompressing?
Do you know how to speed up decompressing any magic trick? :) using LOLZ or LZMA with XTOOL or oodle or srep... any magic available for speed up? For decompressing?
srep+XTOOL+srep faster but...
srep+XTOOL+srep faster but...
There's but coming... ;) why
decreased compression ratio.
decreased compression ratio.
seems like yoi know about compression stuffs :)
can you tell me a1/2/3/4...16 and d1g and - s25gb
those method what they do.
If i compress big games like 100GB do i have to chage 25GB to 100gb in srep setting?
Is that necessary?
srep+XTOOL+srep faster but...
For first srep use greater -l value like -l1024 or even -l 4048, smaller values may eat the headers xtool looks for, it's not guaranteed this will work even, it will surely wirk for games haing a lot of same data f.e gta 4 + EFLC,
You can use xtool+rep+srep...
This increases compression,decompression speed and memory��, well tested...
This increases compression,decompression speed and memory��, well tested...
Oky
LOLZ Decode Memory
Calculate Problem :(
I've Used d192:mtt1:mt4, for Compression,
and when it finished, it showed
Decode mem use 392mb for per thread.
and i have 4c/8 thread cpu.
While decompressing lolz
Use 2.330MB RAM
It should be 1568mb
for decompressing
(392mb x mt4 = 1568mb)
Ram memory using!
Oodle for 300 MB
Srep for 550MB
LOLZ for 2.330MB
what I'm i missing here?
Why lolz use 2.3Gb instead 1.5GB?
Download 'process explorer'. I dont know the url. Its a tiny program ,correctly shows detailed memory usage/process infos, etc. Give it a shot.
Download 'process explorer'. I dont know the url. Its a tiny program ,correctly shows detailed memory usage/process infos, etc. Give it a shot.
I use Windows 10 Task Manager,
it show me most infos...
LOLZ Decode Memory
Calculate Problem :(
I've Used d192:mtt1:mt4, for Compression,
and when it finished, it showed
Decode mem use 392mb for per thread.
and i have 4c/8 thread cpu.
While decompressing lolz
Use 2.330MB RAM
It should be 1568mb
for decompressing
(392mb x mt4 = 1568mb)
Ram memory using!
Oodle for 300 MB
Srep for 550MB
LOLZ for 2.330MB
what I'm i missing here?
Why lolz use 2.3Gb instead 1.5GB?
8 thread x 392mb for per thread = 3.136 gb:rolleyes:
if CLS.ini
[Lolz]
Bufsize=512k
transfer_ReadBufSize=512k
transfer_WriteBufSize=512k
MaxThreadsUsage=100% Change to 4
MaxMemoryUsage=75%
4 thread x 392mb for per thread = 1.568 gb
8 thread x 392mb for per thread = 3.136 gb:rolleyes:
if CLS.ini
[Lolz]
Bufsize=512k
transfer_ReadBufSize=512k
transfer_WriteBufSize=512k
MaxThreadsUsage=100% Change to 4
MaxMemoryUsage=75%
4 thread x 392mb for per thread = 1.568 gb
thanks!!!
i thought thread means" mt4 threads,
so if i install this on 4 thread PC"
it will only use 1.568 gb ram Right ?
its possible to install this on 4 Thread right ?
i don't have 4 thread pc to check :(
vBulletin® v3.8.11, Copyright ©2000-2026, vBulletin Solutions Inc.