Helping thread :)

[coveiro]

Originally Posted by ~MAK~

I didn't repacked it, but as far as by seeing game data, I think it will use reflate+srep+lzma in simple way. Reflate will work on .sds files and except other audio and other data will be repacked with srep+lzma

thanks

[oltjon]

for some time that I try to force myself to figure out how to make the Russians repacker to compress so much the flie.ttarch2. tell tale games.
there someone who knows something ??

Thank you in advance

[aswadd]

Originally Posted by oltjon

for some time that I try to force myself to figure out how to make the Russians repacker to compress so much the flie.ttarch2. tell tale games.
there someone who knows something ??

Thank you in advance

rebuilding game data files so basically go and find some software to extract ttarch2 files content
then compress the output then when unpacking rebuild the game data again

[ChronoCross]

What about freearc next?. I don't undertand very well lua options but what if we can add some lua options and use razor's split tool?.

[Bulat]

you have a good chance to learn Lua and apply your abilities to FA if you know programming, learning Lua is just one day. if you don't know it at all, learning Lua may be easiest start

[ChronoCross]

Thanks Bulat! I started to learn LUA. I download zerobrane studio is a free IDE for LUA language.

[aswadd]

Guys why not making a list about best methods to every Game engine like unreal engine / cry engine 3 / unity3d engine It will help a lot

[Gupta]

Guys I packed some files using
7zip tar | srep | 7zip_lzma (don't remember exact command)

now the problem is that while i am extracting it via
7za e -txz -y data3.bin -so | srep64 -d -hash- -s -- | 7za x -ttar -y -si -oData3\ *.out *.raw -r

the pipe automatically closes after extracting a file of 4083387777 bytes(3.80Gb)

i try many different commands bt problem still persists

any help please...

[Razor12911]

If pipe closes automatically then one of the programs either found an EOF early or there was an error, you must check process exit code of each program to find out which one failed.

-Either way, you can just normally unpack everything without the use of standard streams, you'll figure out which program is letting you down.

[Gupta]

finally, i somehow figure it out, actually srep is the culprit who is somehow manages to add random data at the end of archive
and this is happening with all the 4 bins i made, all having around 25gb of reflated files each

this is what 7zip has to say

7za x Data3.tar -oData3\

7-Zip (a) [64] 16.02 : Copyright (c) 1999-2016 Igor Pavlov : 2016-05-21

Extracting archive: Data3.tar

ERRORS:
Headers Error


WARNINGS:
There are data after the end of archive

--
Path = Data3.tar
Type = tar
ERRORS:
Headers Error
WARNINGS:
There are data after the end of archive
Physical Size = 4083388416
Tail Size = 14341385728
Headers Size = 512
Code Page = UTF-8


Archives with Errors: 1

Warnings: 1

Open Errors: 1

i don't know why it is happening, it works fine with the 1gb file and a 10gb file i tested earlier
i also try shar instead of tar the results are same, file got broken ... may be a internal bug of srep or might be shar and tar format is not stable yet... no may be in the case of shar bt not in the Tar at all
bt this work fine with freaarc everytime, i even compress 60 gb file with it and that work gracefully bt freearc makes things little bit slower and less control-able never had crc error with it at all
may be should wait for freearc'next, Bulat says he will add srep as internal in a month or may be two
bt as far as my tests arr concerned, the memory uses is too high in its case.

Moral of the story, don't go with 7zip+srep on bigger files
IS anybody has a solution for it?

[Razor12911]

Originally Posted by PrinceGupta2000

finally, i somehow figure it out, actually srep is the culprit who is somehow manages to add random data at the end of archive
and this is happening with all the 4 bins i made, all having around 25gb of reflated files each

this is what 7zip has to say


i don't know why it is happening, it works fine with the 1gb file and a 10gb file i tested earlier
i also try shar instead of tar the results are same, file got broken ... may be a internal bug of srep or might be shar and tar format is not stable yet... no may be in the case of shar bt not in the Tar at all
bt this work fine with freaarc everytime, i even compress 60 gb file with it and that work gracefully bt freearc makes things little bit slower and less control-able never had crc error with it at all
may be should wait for freearc'next, Bulat says he will add srep as internal in a month or may be two
bt as far as my tests arr concerned, the memory uses is too high in its case.

Moral of the story, don't go with 7zip+srep on bigger files
IS anybody has a solution for it?

Well srep on default, if you're using stdio, it has a setting of expecting no more than 25GB/25 600MB from stdin.
"-sBYTES: explicitly specify filesize (for compression from stdin), default 25gb"
All you need to do is guess or have an estimation of your input and set a value, to be safe, set a high value
-s50gb or whatever, just know that this increases memory allocation so also make sure you have enough memory to allocate such, plus for big inputs, you're better off using x64 version of srep to avoid x86 memory allocation barrier.

Originally Posted by ChronoCross

--Freearc NEXT
iam a master of LUA code... Naaaaaaa. LOL

in fa.ini add




need to learn how to add external compressors like srep or nanozip

Is there a need to learn LUA code?
-Never mind.

[ChronoCross]

Originally Posted by Razor12911

Is there a need to learn LUA code?
-Nevermind-Nirvana-

my mistake. No the old way works fine.
i want to make somethig new interesting with LUA code in FA Next.

[ChronoCross]

--Freearc NEXT
iam a master of LUA code... Naaaaaaa. LOL

in fa.ini add

onArchiveDone(function ()
print("Time Lapsed:",os.clock(),"Sec.")
end)

--Razor's split tool
onArchiveDone(function ()
os.execute('split s data.arc 10') --number 10 is 10mb
end)

need to learn how to add external compressors like srep or nanozip

[romulus_ut3]

How about a thread dedicated to "secrets of the trade" where people will share their methods to achieve the best possible compression/de-compression methods for specific titles that can be understood even by a dummy? I know Razor12911 shared his methods for GTA V and Mad Max IIRC. Lets start with "The Witcher 3 The Wild Hunt Game Of The Year Edition" perhaps? I'm trying to compress this title into archives that'll fit into DVD5. I don't really require a fancy installer or anything, just a simple executable that'll let me extract the game's archives where I want (I believe Razor12911 has an archiver like this which I've used with great success in the past) I know that finding the best compression method for a certain set of files requires trial and error but we're all here to learn, right?

[Vapor028]

Hello everyone.
I'm new to this Forum and have one or two Questions.

Is it possible to use xz compressed files with IC 3.0? if yes how? (btw thx razor for this awesome program)

next one is how to use 4x4:lzma... i have a bat that runs but its no difference to lzma