Compression test on unreal engine 3 texture file *.tfc

[TheGeekyGamer]

Original file Textures.tfc = 1.0Gb

Textures.tfc + lzma = 712mb

Later used UELR to decompress the *tfc file

after processing with UELR new file size= 1.37G

Test:

UELR(1.37G)+lolz =503mb (took 50min to compress)

UELR + srep + rz = 528mb

UELR + precomp + srep + lzma = 566mb

UELR + lzma = 573mb

UELR + srep + lzma = 575mb ( :confused: 2mb more)

lolz is the best compressor, but took very long to compress.

[Andu21]

Try increasing the dictionary in lolz, x1, x2 modes and tt4,8,16. Also play with UELR's options.

[Sergey3695]

2 mb more because LZ match length <= lzma dictonary
Also play with UELR's options.
:confused: :D

[TheGeekyGamer]

Try increasing the dictionary in lolz, x1, x2 modes and tt4,8,16. Also play with UELR's options.

I am new to this. I don't know much. I tried all the options in UELR, i get the same file size of 1.37Gb.

u = unpack archive
ulv = unpack lossless recoverable blocks in verbose mode.
b=brute force parameters
x= unpack x64 ue headers

could u suggest me any parameter?

[Andu21]

Sorry, i was thinking about OGGRE when i wrote that. You could brute force every option in lolz but i personally think it's a waste of time considering how big the file is.

[TheGeekyGamer]

Sorry, i was thinking about OGGRE when i wrote that. You could brute force every option in lolz but i personally think it's a waste of time considering how big the file is.

When i tried Unreal engine decompressor on it.. i found that .tfc file was encrypted. Can we remove encryption from that file?

[PsYcHo_RaGE]

For Compressing Unreal Engine Files for e.g .tfc, .upk, .umap etc etc

I have found that by using uelr+srep+lolz given me the compression rate was slightly strong than using uelr+srep64+lolz
So my opinion is to use uelr(default)+srep( -m3f -ia- -l512 )+lolz(-d256mb -tt8 -mc1023) on these unreal engine files

But if you want lolz to fire up the speed then use lolz(-dto0 -tt1 -dm00 -mc1023)

Note: These are outdated settings as we have new tools since from 2 months, i am pretty busy to try em

[TheGeekyGamer]

Thank you psycho_rage i would try them, i think -m3f uses large amount of RAM ~8gb. Can i use -m2f ?

[Sergey3695]

srep( -m3f -ia- -l512 )
-ia-: disable I/O acceleration in order to reduce memory usage (-m5 only) :)

[TheGeekyGamer]

I tried what u suggested. I used the faster method on srep file (1.12gb), finally it reduced to 495 mb (8mb lesser than before). I tried the other one and the file size was almost close to 490 mb or something, i closed it as it took more than an hour to compress..

[TheGeekyGamer]

For Compressing Unreal Engine Files for e.g .tfc, .upk, .umap etc etc

I have found that by using uelr+srep+lolz given me the compression rate was slightly strong than using uelr+srep64+lolz
So my opinion is to use uelr(default)+srep( -m3f -ia- -l512 )+lolz(-d256mb -tt8 -mc1023) on these unreal engine files

But if you want lolz to fire up the speed then use lolz(-dto0 -tt1 -dm00 -mc1023)

Note: These are outdated settings as we have new tools since from 2 months, i am pretty busy to try em

Will LZO compressor do any better?

[PsYcHo_RaGE]

Thank you psycho_rage i would try them, i think -m3f uses large amount of RAM ~8gb. Can i use -m2f ?

try it but i think its of no use on unreal engine files

[PsYcHo_RaGE]

-ia-: disable I/O acceleration in order to reduce memory usage (-m5 only) :)

you are right in some way but sometimes it reduces the compression ratio to some percents on different file formats

[PsYcHo_RaGE]

Will LZO compressor do any better?

might be but i think no it will not but you can try yourself to see what it will give

[TheGeekyGamer]

For Compressing Unreal Engine Files for e.g .tfc, .upk, .umap etc etc

I have found that by using uelr+srep+lolz given me the compression rate was slightly strong than using uelr+srep64+lolz
So my opinion is to use uelr(default)+srep( -m3f -ia- -l512 )+lolz(-d256mb -tt8 -mc1023) on these unreal engine files

But if you want lolz to fire up the speed then use lolz(-dto0 -tt1 -dm00 -mc1023)

Note: These are outdated settings as we have new tools since from 2 months, i am pretty busy to try em

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?

[PsYcHo_RaGE]

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?
yes copy the lolz and then add the lines below to arc.ini
LOLZ SETTING 1
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
LOLZ SETTING 2
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dtp1 -dto1 -dtd1 -dtm1 -dtb1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -pc4 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
LOLZ SETTING 3
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

You can always combine settings to see the results

[TheGeekyGamer]

i get wclose() Bad file descriptor error when i use uelr for compression in freearc.

i added these lines to arc.ini:

[External compressor:uelr]
header = 0
packcmd = uelr.exe u $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

ERROR: read error (bad media?) in compression algorithm uelr

[PsYcHo_RaGE]

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?

Simply

(Rabbit)Fast lolz code below and will be very helpful if you/anyone follow it and make it better...sometimes and little disappointing!
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Turtle)Slow lolz but effective sometimes
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Unknown) Unnamed lolz but somehow still testing on these parameters
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dtp1 -dtd1 -dtm1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

if you need anymore help i am always up on discord, you can ping me anytime

Edit: something have been changed and i have no idea why i reposted it again...lol
but keep and eye out this one its better

[TheGeekyGamer]

Thank you very much Psycho_Rage. I will surely test them. Right now my disk is not alright, i will try them once the hard disk gets fixed.

[dixen]

What about decimpression .TFC with _XPACK_ prefix on xcom 2 war of the chosen? LZOPRO inside?

[shazzla]

No.
Afaik its oodle. (Maybe kraken ?!)

[poker2332]

Do you know the syntax to decompress with lolz?
unpackcmd=?

Simply

(Rabbit)Fast lolz code below and will be very helpful if you/anyone follow it and make it better...sometimes and little disappointing!
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Turtle)Slow lolz but effective sometimes
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Unknown) Unnamed lolz but somehow still testing on these parameters
[External compressor:lolz]
header = 0
packcmd = lolz_x64.exe -dtp1 -dtd1 -dtm1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

if you need anymore help i am always up on discord, you can ping me anytime

Edit: something have been changed and i have no idea why i reposted it again...lol
but keep and eye out this one its better

[felice2011]

Do you know the syntax to decompress with lolz?
unpackcmd=?

try this way

unpackcmd = lolz_x64.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Or the best way is with fazip support.

[PsYcHo_RaGE]

Or the best way is with fazip support.

with fazip?, never tried out that because i am more into pascal scripting and web dev'ing rather than repacking.

and one another way is using cls-lolz ;)

[Entai44]

with fazip?, never tried out that because i am more into pascal scripting and web dev'ing rather than repacking.

and one another way is using cls-lolz ;)

When you answer a year ago comment, hmmm. But fazip has stdin sdout support for decompressing. It's great for some compressor like lzma or zcm, etc.

[PsYcHo_RaGE]

When you answer a year ago comment, hmmm. But fazip has stdin sdout support for decompressing. It's great for some compressor like lzma or zcm, etc.

i guess, i have tried that...just saw something named fazip in my repacking drive lol

don't remember much nowadays :p