FileForums - Compression test on unreal engine 3 texture file *.tfc

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Compression test on unreal engine 3 texture file *.tfc (https://fileforums.com/showthread.php?t=101861)

TheGeekyGamer

05-06-2018 23:34

Compression test on unreal engine 3 texture file *.tfc

Original file Textures.tfc = 1.0Gb

Textures.tfc + lzma = 712mb

Later used UELR to decompress the *tfc file

after processing with UELR new file size= 1.37G

Test:

UELR(1.37G)+lolz =503mb (took 50min to compress)

UELR + srep + rz = 528mb

UELR + precomp + srep + lzma = 566mb

UELR + lzma = 573mb

UELR + srep + lzma = 575mb ( :confused: 2mb more)

lolz is the best compressor, but took very long to compress.

Andu21

06-06-2018 04:40

Try increasing the dictionary in lolz, x1, x2 modes and tt4,8,16. Also play with UELR's options.

Sergey3695

06-06-2018 04:40

2 mb more because LZ match length <= lzma dictonary

Quote:

Originally Posted by Andu21 (Post 471497)

Also play with UELR's options.

:confused: :D

TheGeekyGamer

06-06-2018 05:36

Quote:

Originally Posted by Andu21 (Post 471497)

Try increasing the dictionary in lolz, x1, x2 modes and tt4,8,16. Also play with UELR's options.

I am new to this. I don't know much. I tried all the options in UELR, i get the same file size of 1.37Gb.

u = unpack archive
ulv = unpack lossless recoverable blocks in verbose mode.
b=brute force parameters
x= unpack x64 ue headers

could u suggest me any parameter?

Andu21

07-06-2018 04:46

Sorry, i was thinking about OGGRE when i wrote that. You could brute force every option in lolz but i personally think it's a waste of time considering how big the file is.

TheGeekyGamer

07-06-2018 22:25

Quote:

Originally Posted by Andu21 (Post 471525)

Sorry, i was thinking about OGGRE when i wrote that. You could brute force every option in lolz but i personally think it's a waste of time considering how big the file is.

When i tried Unreal engine decompressor on it.. i found that .tfc file was encrypted. Can we remove encryption from that file?

PsYcHo_RaGE

08-06-2018 03:08

For Compressing Unreal Engine Files for e.g .tfc, .upk, .umap etc etc

I have found that by using uelr+srep+lolz given me the compression rate was slightly strong than using uelr+srep64+lolz
So my opinion is to use uelr(default)+srep( -m3f -ia- -l512 )+lolz(-d256mb -tt8 -mc1023) on these unreal engine files

But if you want lolz to fire up the speed then use lolz(-dto0 -tt1 -dm00 -mc1023)

Note: These are outdated settings as we have new tools since from 2 months, i am pretty busy to try em

TheGeekyGamer

08-06-2018 20:59

Thank you psycho_rage i would try them, i think -m3f uses large amount of RAM ~8gb. Can i use -m2f ?

Sergey3695

09-06-2018 01:57

Quote:

Originally Posted by PsYcHo_RaGE (Post 471557)

srep( -m3f -ia- -l512 )

-ia-: disable I/O acceleration in order to reduce memory usage (-m5 only) :)

TheGeekyGamer

09-06-2018 05:32

I tried what u suggested. I used the faster method on srep file (1.12gb), finally it reduced to 495 mb (8mb lesser than before). I tried the other one and the file size was almost close to 490 mb or something, i closed it as it took more than an hour to compress..

TheGeekyGamer

09-06-2018 05:34

Quote:

Originally Posted by PsYcHo_RaGE (Post 471557)

Will LZO compressor do any better?

PsYcHo_RaGE

10-06-2018 21:50

Quote:

Originally Posted by TheGeekyGamer (Post 471567)

Thank you psycho_rage i would try them, i think -m3f uses large amount of RAM ~8gb. Can i use -m2f ?

try it but i think its of no use on unreal engine files

PsYcHo_RaGE

10-06-2018 21:52

Quote:

Originally Posted by Sergey3695 (Post 471568)

-ia-: disable I/O acceleration in order to reduce memory usage (-m5 only) :)

you are right in some way but sometimes it reduces the compression ratio to some percents on different file formats

PsYcHo_RaGE

10-06-2018 21:53

Quote:

Originally Posted by TheGeekyGamer (Post 471575)

Will LZO compressor do any better?

might be but i think no it will not but you can try yourself to see what it will give

TheGeekyGamer

24-06-2018 04:36

Quote:

Originally Posted by PsYcHo_RaGE (Post 471557)

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?

PsYcHo_RaGE

27-06-2018 02:46

Quote:

Originally Posted by TheGeekyGamer (Post 472085)

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?

yes copy the lolz and then add the lines below to arc.ini
LOLZ SETTING 1

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

LOLZ SETTING 2

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dtp1 -dto1 -dtd1 -dtm1 -dtb1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -pc4 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

LOLZ SETTING 3

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

You can always combine settings to see the results

TheGeekyGamer

23-07-2018 01:19

uelr arc.ini error.

i get wclose() Bad file descriptor error when i use uelr for compression in freearc.

i added these lines to arc.ini:

Code:

[External compressor:uelr]

header = 0

packcmd   = uelr.exe u $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

Code:

ERROR: read error (bad media?) in compression algorithm uelr

PsYcHo_RaGE

28-07-2018 10:45

Quote:

Originally Posted by TheGeekyGamer (Post 472085)

Umm.. how can i add lolz with the above parameters to my arc.ini ? Simply copying lolz.exe to my bin folder in freearc directory and adding the lines to arc.ini work?

Simply

(Rabbit)Fast lolz code below and will be very helpful if you/anyone follow it and make it better...sometimes and little disappointing!

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Turtle)Slow lolz but effective sometimes

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Unknown) Unnamed lolz but somehow still testing on these parameters

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dtp1 -dtd1 -dtm1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

if you need anymore help i am always up on discord, you can ping me anytime

Edit: something have been changed and i have no idea why i reposted it again...lol
but keep and eye out this one its better

TheGeekyGamer

30-07-2018 21:16

Thank you very much Psycho_Rage. I will surely test them. Right now my disk is not alright, i will try them once the hard disk gets fixed.

dixen

26-08-2018 09:40

What about decimpression .TFC with _XPACK_ prefix on xcom 2 war of the chosen? LZOPRO inside?

shazzla

27-08-2018 02:15

No.
Afaik its oodle. (Maybe kraken ?!)

poker2332

05-09-2018 18:14

Do you know the syntax to decompress with lolz?
unpackcmd=?

Quote:

Originally Posted by PsYcHo_RaGE (Post 474746)

Simply

(Rabbit)Fast lolz code below and will be very helpful if you/anyone follow it and make it better...sometimes and little disappointing!

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dto0 -tt1 -dm00 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Turtle)Slow lolz but effective sometimes

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -d256mb -tt8 -mc1023 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

(Unknown) Unnamed lolz but somehow still testing on these parameters

Code:

[External compressor:lolz]

header = 0

packcmd = lolz_x64.exe -dtp1 -dtd1 -dtm1 -dtw1 -tt8 -mc1023 -fba4096 -bc8 -blr8 -bm8 -oh14 -d256 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

felice2011

06-09-2018 00:05

Quote:

Originally Posted by poker2332 (Post 475539)

Do you know the syntax to decompress with lolz?
unpackcmd=?

try this way

Code:

unpackcmd = lolz_x64.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

Or the best way is with fazip support.

PsYcHo_RaGE

14-01-2020 04:43

Quote:

Originally Posted by felice2011 (Post 475540)

Or the best way is with fazip support.

with fazip?, never tried out that because i am more into pascal scripting and web dev'ing rather than repacking.

and one another way is using cls-lolz ;)

Entai44

14-01-2020 05:11

Quote:

Originally Posted by PsYcHo_RaGE (Post 484275)

with fazip?, never tried out that because i am more into pascal scripting and web dev'ing rather than repacking.

and one another way is using cls-lolz ;)

When you answer a year ago comment, hmmm. But fazip has stdin sdout support for decompressing. It's great for some compressor like lzma or zcm, etc.

PsYcHo_RaGE

14-01-2020 06:06

Quote:

Originally Posted by Entai44 (Post 484276)

When you answer a year ago comment, hmmm. But fazip has stdin sdout support for decompressing. It's great for some compressor like lzma or zcm, etc.

i guess, i have tried that...just saw something named fazip in my repacking drive lol

don't remember much nowadays :p

All times are GMT -7. The time now is 12:53.