FileForums
Page 1 of 2 1 2
Show 40 post(s) from this thread on one page

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   LZMA vs LOLZ & Scan Compress Method (https://fileforums.com/showthread.php?t=102503)

yasitha 26-12-2018 02:28
LZMA vs LOLZ & Scan Compress Method
 
I have some questions about LZMA & LOLZ

Q1) I want to know which one is better?

Q2) i want to know what is 256m, & what it does?

lzma:a1:mfbt4:256m:fb273:mc1000000000:lc 8

Q3) how do i scan and find the Compression like Oodle game?

I know how to find Oodle games. But i don't know how to find none Oodle games so help me please.

KaktoR 26-12-2018 03:04
1. Depends on the file
2. 256m is dictionary size (https://stackoverflow.com/questions/...ttings-details)
3. Use Game File Scanner for non-Oodle games

yasitha 26-12-2018 03:14
Thanks KaktoR
 
Quote:
Originally Posted by KaktoR (Post 478161)
1. Depends on the file
2. 256m is dictionary size (https://stackoverflow.com/questions/...ttings-details)
3. Use Game File Scanner for non-Oodle games
Thanks for Reply :)


If i change 256m to 2048m?
it will give me better ratio.
I have test it.

If i use 2048m,
For decompression
at least require 2GB ram
Right?

can you please tell me, where is that
Game File Scanner and how to use it.

yasitha 26-12-2018 03:38
Quote:
Originally Posted by doofoo24 (Post 478163)
are you that lazy to type in the search ?
https://www.fileforums.com/showthrea...e+File+Scanner
No I'm not lazy i jave try too hard. I have search i didn't see it so i though asking it thanks anyway.

Can you please tell me about 256mb?
That link didn't mentioned it.

200m mean 2100Mb ram?
I have seen it in reflate thread.. explain please bro.
Tou know lot of stuffs si please share..

yasitha 26-12-2018 03:49
Quote:
Originally Posted by doofoo24 (Post 478165)
if you use lzma without fazip you limited to 184mb
to use d2048mb you need to use fazip, but in compression need 20gb of ram...

[External compressor:rep,mm,exe,dispack070,4x4,lzma]
header = 0
packcmd = FAZip.exe -i0 compress:{compressor}{:option} <stdin> <stdout>
Thanks bro i really appreciate your help...

Yes i have always use FAZip.exe 64 version,
on UA R6 Diskspan.
Its perfect everything is set.

So i have 32GB DDR4 RAM,
i can go up to more right?
Its calculate like 200mx10.5=2100m right?

If i use more ram for compression can i decompress with under 4GB ram?
Without any error? Or
decompress need same memory?

If i use more ram for compressing i can get better ratio and i can finish the job faster right?

yasitha 26-12-2018 04:26
Quote:
Originally Posted by doofoo24 (Post 478167)
so what do you think the d short for :eek:
lzma is limited to 2 thread alone decompresion speed around 40-50 mb,
Im not expert with compression
and i still don't understand what you mean.

Please tell me in simple way.

yasitha 26-12-2018 06:13
Quote:
Originally Posted by simorq (Post 478169)
cpu?
i7 8700k cpu

shazzla 26-12-2018 07:02
For make your life easier ,i think you should stick with

Srep:a8:m5f:l512+lolz:d384m:mt2

Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.

Sorry for my style ,i dont want to be rude.
Regards... :)

Simorq 26-12-2018 07:52
Quote:
Originally Posted by yasitha (Post 478170)
i7 8700k cpu
Code:
6C 12T;)

192 Best results.

#4x4
192m(Dictionary)x12Tx12= 28 Gb Ram Used for Compression

#4x4:t8:b128m:lzma:a1:mfbt4:256m:fb273:mc1024:lc8
256m(Dictionary) x 12T x t8 = 24 Gb Ram Used for Compression

#lolz
~ mt threads(-mt[1..16])
192m(Dictionary) x 12T x mt* =...

yasitha 26-12-2018 09:12
Quote:
Originally Posted by shazzla (Post 478175)
For make your life easier ,i think you should stick with

Srep:a8:m5f:l512+lolz:d384m:mt2

Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.

Sorry for my style ,i dont want to be rude.
Regards... :)
Thanks..

yasitha 26-12-2018 09:19
Quote:
Originally Posted by Simorq (Post 478182)
Code:
6C 12T;)

192 Best results.

#4x4
192m(Dictionary)x12Tx12= 28 Gb Ram Used for Compression

#4x4:t8:b128m:lzma:a1:mfbt4:256m:fb273:mc1024:lc8
256m(Dictionary) x 12T x t8 = 24 Gb Ram Used for Compression

#lolz
~ mt threads(-mt[1..16])
192m(Dictionary) x 12T x mt* =...
I don't understand this... Cause I'm new to this.
and I don't use LOLZ, cause it's taking too long.
Please tell one thing. *FAZIP* 64bit use cpu only 25%
How can i let it use 75%? It will be faster if FAZIP use 75% cpu

and i have try LZMA with 2048MB
for compression it used 21000MB 21GB..
still compressing... after it done I'll try to decompress with 4GB Ram and see what happens.

felice2011 26-12-2018 09:20
Quote:
Originally Posted by shazzla (Post 478175)
For make your life easier ,i think you should stick with

Srep:a8:m5f:l512+lolz:d384m:mt2

Its more than enough/overkill for almost all games.
Maybe u can use some precompressor ,like x/ztool/pzlib,etc.

Sorry for my style ,i dont want to be rude.
Regards... :)
Right, In fact all these problems with a pre-processor of compression (srep), except if there are problems of compression or decompression for inefficient systems (Hardware) or other, I personally all these problems I would not make them, remaining stick with to a single command option.

felice2011 26-12-2018 09:36
Using "7z.exe/lzma2" as the final compressor I would recommend this option:

Code:
a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=999999999:lc=4:lp=0 -mmt=2 -mx9
Using "LZMA" as a final compression in a single option with a good compression ratio I recommend this:

Code:
-a1 -d27 -fb273 -mc999999999 -lc8 -lp4 -mfbt4 -mt8
Well with "LOLZ", so far today I have not found a good compromise of a good speed and a satisfactory compression threshold in relation to a higher speed.
With lolz continues to do your tests are of interest to everyone.;)

https://www.fileforums.com/showthread.php?t=102311

yasitha 26-12-2018 09:48
Quote:
Originally Posted by felice2011 (Post 478187)
Using "7z.exe/lzma2" as the final compressor I would recommend this option:

Code:
a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=999999999:lc=4:lp=0 -mmt=2 -mx9
Using "LZMA" as a final compression in a single option with a good compression ratio I recommend this:

Code:
-a1 -d27 -fb273 -mc999999999 -lc8 -lp4 -mfbt4 -mt8
Well with "LOLZ", so far today I have not found a good compromise of a good speed and a satisfactory compression threshold in relation to a higher speed.
With lolz continues to do your tests are of interest to everyone.;)

https://www.fileforums.com/showthread.php?t=102311
I always Use FAZIP 64 for LZMA so i need to know about it. I don't need 7z cause i will never use it.

So please FAZip64 LZMA info please..

Simorq 26-12-2018 10:08
@felice2011
mc=999999999:confused::eek::D

yasitha 26-12-2018 10:14
Quote:
Originally Posted by Simorq (Post 478190)
@felice2011
mc=999999999:confused::eek::D
Please Reply my preview question and reply this one to please. What is MC?
i did find 7z Lzma info but nit FAZip Lzma info both are different so please show me the all info about FAZip lzma And tell me what's that MC do

felice2011 26-12-2018 10:15
Quote:
Originally Posted by Simorq (Post 478190)
@felice2011
mc=999999999:confused::eek::D
YESSSSSS:p:p:p

doofoo24 26-12-2018 10:18
add 1 and you are a billionaire :D

felice2011 26-12-2018 10:30
Fazip is an external compression library used by FA with internal compressor "rep, mm, delta, exe, exe2, 4x4, lzma ... etc", in some cases it can also be used for reading (stdin-stdout) of some external compressors (ex.LOLZ).
The example shown concerns external compressors, with a single configuration with FreeArc support.

So you will have differences in compression ratio and speed using the following methods:

Code:
srep64:m5f:a2:d1g+lzma2:d512m (LZMA2)
srep64:m5f:a2:d1g+lz77 (LZMA)
srep64:m5f:a2:d1g+lzma (fazip)
logically everything changes according to the configuration of the.ini file

felice2011 26-12-2018 10:32
Quote:
Originally Posted by doofoo24 (Post 478193)
add 1 and you are a billionaire :D
haha.. those would be enough for me to feel good.;):p

yasitha 26-12-2018 10:32
Quote:
Originally Posted by doofoo24 (Post 478193)
add 1 and you are a billionaire :D
i'm asking questions and they don't see it,
they fight for billionaire ;):p:D
hahaha very funny...

i'm not programmer so when you guys tell me something please be simple
cause i don't understand. :p

I Do more testing and i finally got this, i will use this for 6GB RAM Games.
and the 4GB Ram games i use 512 or 1024 depends of precomp.
so please guys tell me how to change and what is the MC ?
lc8 should be stayed as 8.
i like to change the MC but don't know what it is so please Explain :o

Code:
lzma:a1:mfbt4:2048m:fb273:mc1000000000:lc8
This 2048m req 21000MB (21GB) RAM for Compress
and Decompress only use 2050MB (2.05GB) with precomp and srep
it use 3100MB Ram.

i'm gonna do something better so that's why i need to know what i can still do for LZMA to get better ratio
when i done i will post it on here :p so help me guys.

yasitha 26-12-2018 10:48
Quote:
Originally Posted by doofoo24 (Post 478198)
as for lzma setting if u want to waste your time that's your choose :)
LOLZ is too slow thats why i use LZMA :)
what is your recommend ?

and pls tell me what is that MC ? :)

felice2011 26-12-2018 11:11
MC:
Quote:
Sets number of cycles (passes) for match finder. It can be in range from 0 to 1000000000. Default value is (16 + number_of_fast_bytes / 2) for BT* match finders and (8 + number_of_fast_bytes / 4) for HC4 match finder. If you specify mc=0, LZMA will use default value. Usually, a big number gives a little bit better compression ratio and slower compression process. For example, mf=HC4 and mc=10000 can provide almost the same compression ratio as mf=BT4.
@yasitha .... @KaktoR has already given you some references to read on some web pages, do not waste any more time with all your tests on lzma/lzma2/fazip, listen to our tips and our examples and start to compress.

In Italian and in our country, in Naples we say: "Sta' senza pensier !!!" :D:D;)

yasitha 26-12-2018 11:17
Quote:
Originally Posted by doofoo24 (Post 478201)
i already gave you an answer
https://www.fileforums.com/showpost....8&postcount=25
lolz on I7 8700K USE
[External compressor:lolz]
header = 0
packcmd = lolz.exe -dtb1 -fba4096 -mc1023 -pc4 -mt12 -mtt1 -d96 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

you should get around 4mb/s to 5mb/s

as for lzma just use lzma:a1:mfbt4:d512m:fb273:mc10000:lc8 no point of using d larger than 512mb it only improve like 10mb to 50mb...
Thanks :) Finally ;)

yasitha 26-12-2018 11:18
Quote:
Originally Posted by felice2011 (Post 478202)
MC:


@yasitha .... @KaktoR has already given you some references to read on some web pages, do not waste any more time with all your tests on lzma/lzma2/fazip, listen to our tips and our examples and start to compress.

In Italian and in our country, in Naples we say: "Sta' senza pensier !!!" :D:D;)
yes i see that i though it was only for 7z not For FAZip, sorry my bad :o

yasitha 26-12-2018 11:25
FAZip64 only use 25% 35% CPU Usage, how can i change that to 75% CPU usage ?
if i do, the process will be finish fast. :)
Help!

yasitha 26-12-2018 11:32
Quote:
Originally Posted by doofoo24 (Post 478206)
all that time Razor spent to develop ztool/xtool to help the community to overcome precomp :(
i know him personally we are friends is long time i think 5 or 6 years, now he's too buys can't even talk..
hes the best person that i know.
he can do anything pretty much. :)

and i miss him :o , wehn i need something i directly ask him,
so i don't have to wait,

i have provide him conversion graphics for ASC i think its in 2013 :)
back then i don't do compress, i don't even like it :D

recently i thought learning about it is a good idea,
casue new games are like huge :D so that's why i ask around! ;)

yasitha 26-12-2018 11:33
Quote:
Originally Posted by doofoo24 (Post 478210)
only if you read
https://www.fileforums.com/showpost....67&postcount=8
lzma limited to 2 thread faster use 4x4 but you need to lower d2048 to somthing like d32 or d64
you wont super fast lzma use 7z.exe
or as i mentioned in https://www.fileforums.com/showpost....8&postcount=25
use 4x4:lzma:a1:mfbt4:d32m:fb273:mc10000:lc8...
don;t get angry on me :D testing now... :)
angry off :D

yasitha 26-12-2018 11:40
this will keep the CPU Usage At 100% All the times
and that's the one reason i don't like LOL ZZZZ
second reason its slow.. and im testing now this lolz method,
and i will compare with my Current LZMA settings.

[CODE]
lolz:dtb1:fba4096:mc1023:pc4:mt12:mtt1:d96[\CODE]

yasitha 26-12-2018 11:43
Quote:
Originally Posted by doofoo24 (Post 478213)
whose anger me ;)
you also can add 7z.exe and 7z.dll
and add to arc.ini
[External compressor:lzma]
header = 0
packcmd = 7z.exe a -txz -an -mcrc=0 -m1=lzma2:d384m:fb=273:mf=bt4:mc=999999999:lc=4:lp= 0 -mmt=12 -mx9 -si -so <stdin> <stdout>
it will use all 12 threads with 27gb of ram and decompresion around d384m
can't even type while lolz runing :D

i know 7z is fast lzma2, but lzma better then lzma2 i'v seen it with testing..
i do many many testing now im going crazy... :D
that's why i ask random questions..

did you learn about this stuffs on your own ? ;)

yasitha 26-12-2018 11:45
Quote:
Originally Posted by doofoo24 (Post 478215)
what you cpu cooler ?
stock air cooler :D :D :D 1000rpm :D
lolz :D no no i have

Corsair H115i 280mm Extreme Performance Liquid Cooler

yasitha 26-12-2018 11:57
Quote:
Originally Posted by doofoo24 (Post 478218)
that's why i'm waiting for the new cpus next years 16 core 32 thread :D
i'm planing for buy AMD Ryzen 2700x, 2800x nowhere to be found.
intel sucks.. 4, 6 cores still....
i9 has 8 core and too expansive. :D
what you will buy ? :o and idea ? 2800x release ?
i have google it many many times but i only found rumors :p :D ;)

AMD Ryzen Threadripper has multi core and threads but expansive

yasitha 26-12-2018 12:08
Quote:
Originally Posted by doofoo24 (Post 478220)
Ryzen 9 3850X :D:D:D
wow cool.. :)

yasitha 26-12-2018 20:42
Can i Use this
Code:
4x4:t2:256m:lzma:256m
instead of this
Code:
4x4:t8:256m:lzma:256m
What is that T8? means CPU Threads?
I want to compress with 50% or 75% CPU usage.
If i change t8 it will hit 100% cpu usage all the time.
If i Change it to t3 it use only 75-80% if i change t2 its only use 50-60 cpu usage.

so my question is what is T?
Can i use T method without 4x4?
I have try many times but
I got no luck so that's why i ask..
Help!

I have found more info about
FAZip LZMA. Hope this will help others like me

https://fileforums.com/showthread.php?t=99560

https://github.com/Bulat-Ziganshin/FA/wiki/FA-0.20

http://fastcompression.blogspot.com

alfredd31 28-12-2018 03:42
To doofoo24: which version of xtool did you use for dishonored Doto?
xtool v0.9 is freezing. Btw, if you know if some src are available for lolz, xtool...it would be useful.


https://i.ibb.co/YQBvzgF/bb21.jpg

alfredd31 28-12-2018 04:29
In fact it's working. But it's extremely slow.

yasitha 29-12-2018 11:03
Can anyone help me please?

yasitha 29-12-2018 23:21
like to use LOLZ method, but i don't know the perfect method for it,
anyone can help me to recognize what should i change for get better ratio ?


any one can tell me best LOLZ Method in the world ? :D
i need best choice for speed and best ratio please help guys

yasitha 30-12-2018 03:32
Quote:
Originally Posted by doofoo24 (Post 478303)
we all are :D
:confused: seriously... Please answer me bro :o

yasitha 30-12-2018 05:30
Quote:
Originally Posted by doofoo24 (Post 478305)
WOW dude :o
SPEED VS RATIO "law of diminishing return" :)
you guys are professional and I'm not. So i don't know compression stuff like you do, & i like to know..

that's why i ask wrong questions :o :(


All times are GMT -7. The time now is 09:59.
Page 1 of 2 1 2
Show 40 post(s) from this thread on one page

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com