FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Precomp+Reflate+Srep+LZMA (https://fileforums.com/showthread.php?t=96138)

edward99 25-10-2015 23:00

can anyone know how to repack games assassin's creed unity

RamiroCruzo 25-10-2015 23:08

Quote:

Originally Posted by edward99 (Post 444087)
can anyone know how to repack games assassin's creed unity

vIEW PREVIOUS PAGE BRO......ALREADY SENT.........

edward99 25-10-2015 23:46

there is no information about it on previous page

RamiroCruzo 25-10-2015 23:55

Quote:

Originally Posted by edward99 (Post 444090)
there is no information about it on previous page

Code:

[External compressor:precomp]  header = 0  packcmd = precomp -slow -t-j {options} -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp  unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp  [External compressor:srep]  ;options = l%d (minimal match length, default=512)  header = 0  packcmd = srep {options} -a1 -m3f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp  unpackcmd = srep -d -s $$arcpackedfile$$.tmp $$arcdatafile$$.tmpp  [External compressor:msc] header = 0 packcmd  = msc c -v {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

GBT repack 26-10-2015 19:50

Quote:

Originally Posted by RamiroCruzo (Post 443761)
Gracias Mr. Gozarck....I was testing it on MadMax as its deflate steams i.e. .hif files were about 1-2MB big...... So I barely managed to do it by editing your script precomp+reflate+srep+lzma but it gave different errors everytime.........

Yup...Now the results,
Game Size:32GB
Precomp+Srep Size:4.4GB
Reflate+Arc Size:4GB
Reflate+Precomp Size:3.75GB

-------Edited-------------
A few suggestions for your consideration amigo,
1} Add .unp to precomp list too
2} Change the precomp method to -slow0 -cn
3} Don't compress the files i.e. make .refl8 just let them be as it is in a data folder....It will be easier to add it in installations then.

Well are you Mister or Master??? {Frankly asking} :P

Quote:

Originally Posted by RamiroCruzo (Post 444086)
Being both Non-Polite & Polite at once....LOL..........

Well I can almost tell you about 3-4 methods of its compression..............

1. If you only use Reflate+ Arc of Mr Razor12911, your result will be about 8 GB
2. If you Precomp -brute all game archive & then compress, it will go about 4.47 GB
3. If you use quickBMS to extract game archives then compress, it will go about 5 GB
4. If you use method discussed by me & amigo Gozarck you can get it about 3.8 GB if using a strong compression over it


Thank you very much!:)

edward99 27-10-2015 00:41

Can anyone know about free+plugins?
corepack admin is telling that he repack the games using free+plugins

RamiroCruzo 27-10-2015 07:38

Quote:

Originally Posted by edward99 (Post 444123)
Can anyone know about free+plugins?
corepack admin is telling that he repack the games using free+plugins

Who's that ADMIN???

edward99 27-10-2015 10:31

there are 4 admins on corepack
one is on my facebook friend also

mikey26 28-10-2015 12:41

@edward99 do u think a repack team will actually tell you what they use to repack.does not mean anything if he is you facebook friend.those guys will make up things just to keep you running around just to find out what they use to compress,but in the background they laughing the asses off cause you believe them.freearc and plugins lol....

RamiroCruzo 29-10-2015 07:28

Quote:

Originally Posted by edward99 (Post 444136)
there are 4 admins on corepack
one is on my facebook friend also

Amigo....Just spit out the name as I've asked to 2 of them & they said no........

Rahmani1811 29-10-2015 23:17

can we use precomp+Reflate with Installer Creator

gozarck 30-10-2015 20:18

Reflate is the old method. RamiroCruzo method its better. Its the new method. Raw precomp srep lzma. Use precomp in brute mode (take long time) and ppx2 use only one core (P 1) because temp files *.dat of precomp have a conflict.

chum 31-10-2015 12:09

Gozarck, i tried your reflate v2 into GTA 5 file, but it give me bad results, a 2gb original game file is inflated to 35gb with reflate v2 then i dont get good result compressing it.

I see many guys saying they compressed GTA 5 from 60gb to 30gb~ with reflate, but i think they using a different version?

1234567890123 31-10-2015 12:31

but brute mode is too slow (more than a minute even for filesizes around 10 KB) i waited 1.5gb raw precomp srep lzma compression 2 hours but it wasn't finished :(.sometimes after reflate there are too many raw files so compression time is big.

pakrat2k2 31-10-2015 12:32

then edit arc.ini & change it

gozarck 31-10-2015 17:10

1 Attachment(s)
yes brute mode is really slow, and a hate precomp for this and other things too, but the result of the final compression size is very small. i dont have all the answers for specific games, but if each one of you bother to compress a game and post the results with raw + precomp we would help among all together.
------------------------

BY RamiroCruzo IDEA
raw+precomp+arc example

RamiroCruzo 01-11-2015 06:22

Quote:

Originally Posted by chum (Post 444214)
Gozarck, i tried your reflate v2 into GTA 5 file, but it give me bad results, a 2gb original game file is inflated to 35gb with reflate v2 then i dont get good result compressing it.

I see many guys saying they compressed GTA 5 from 60gb to 30gb~ with reflate, but i think they using a different version?

Amigos don't blame anyone :mad: You must know if you use strong inflating methods....Must must use even stronger compression method afterwards...

Quote:

Originally Posted by 1234567890123 (Post 444215)
but brute mode is too slow (more than a minute even for filesizes around 10 KB) i waited 1.5gb raw precomp srep lzma compression 2 hours but it wasn't finished :(.sometimes after reflate there are too many raw files so compression time is big.

:) Good results come to those who wait amigo........

chum 01-11-2015 08:38

I blaming no one, just asking for some advice. I tested the same gta file 900mb with Gozarck V1 and V2.

V1 inflated the file to 2gb then compressed to 500mb.

V2 inflated the file to 3gb then compressed to 770mb.

V1 and V2 have different settings for reflate. I just wanted to get V1 with Reflate only without compressing like Reflate only V2.

1234567890123 02-11-2015 02:18

both of them (V1 and V2) is same.v2 is using more core,cpu.i think you used different levels V1=level 6 but in V2 you can change reflate level.I'm using reflate only and ultraarc (srep+delta+lzma) for better result.

GBT repack 03-11-2015 10:11

I encountered a difficult problem, with the "precomp_reflate_srep_lzma" compressed file in the user's computer in the execution of decompression, but the decompression out of the game file...

ShadowEagle 04-11-2015 03:12

Quote:

Originally Posted by gozarck (Post 444226)
yes brute mode is really slow, and a hate precomp for this and other things too, but the result of the final compression size is very small. i dont have all the answers for specific games, but if each one of you bother to compress a game and post the results with raw + precomp we would help among all together.
------------------------

BY RamiroCruzo IDEA
raw+precomp+arc example

Nice bat files :)

So, how to integrate that into an inno script? Your C.bat is creating *.pcf
and a .str file/s. After that the bat compresses to final archive using srep+lzma. Possible to use UltraARC for the final archive compressing?

GBT repack 04-11-2015 03:12

Quote:

Originally Posted by gozarck (Post 432743)
Reflate Method of Compression



Hello everyones
:POST
--------------------------------------------------------------------------


This is an example to compress games and install via command line.

--------------------------------------------------------------------------

precomp+reflate+srep+lzma
or
reflate+srep+lzma


--------------------------------------------------------------------------


Reflate (By Shelwein) modify to integrate precomp+srep+lzma (by gozarck)

Reflate = (raw2hif.exe + rawdet.exe +rawres.exe):

Reflate, is not a compiled program, but is a
compression method by using the command line in combination
with three programs (raw2hif.exe + rawdet.exe +rawres.exe) .

Acts like precomp, inflating preparing them to compress files with Srep + lzma

but if you want more compression you must use this form precomp+reflate+Srep+LZMA

Precomp inflate the files then reflate makes more bigger, the SREP will compress improve some bytes and LZMA finish the job.

--------------------------------------------------------------------------


all you need to pack games with this methods.

Download => Attachment 9501


--------------------------------------------------------------------------


PD:

seen in some post eh this compression method

Code:

arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r  -msrep+delta+lzma:a1:mfbt4:d200m:fb128:mc10000:lc8
and prompt some users say
ERROR: can't allocate memory required for (de)compression

and the compression stop

the problem is this part of command "d200m"

this option is the dictionary size, so if you use
"d200m" you need 2100MB of ram

How to know?, is simple.
multiply 200*10.5 = 2100mb of ram
if you don´t have enough memory change "d64m"
multiply 64*10.5 = 672mb of ram

but you can limit the use of ram to compression in this seccion of command:

arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r

change to

arc.exe a -ep1 -dses --dirs -s; -lc512 -di -i2 -r

or any number you need

-lc (limit ram to compresion)

-ld (limit ram to decompression)

arc.exe a -ep1 -dses --dirs -s; -lc512 -ld512 -di -i2 -r

--------------------------------------------------------------------------

:ENDPOST
--------------------------------------------------------------------------

.

====================

My English is poor.Please don't laugh at me.


Ask GOZARCK for a simple version of the "precomp_reflate_srep_lzma".
Every step can be intuitive, can make the rookie clearly understand.
I admit that this is a very good compression tool, with a breakthrough good tool!!
But I was extracting the time, an error, extracting the file out of thin air... I do not know where there is trouble, I was using Notepad to edit.
Thanks to the members of the forum, you have a better world!
Again, thanks to GOZARCK!

GBT repack 04-11-2015 03:30

if not ShowChangeDiskWindow ('请找到分卷data0.bin,等待初始化并继续安装...', ExpandConstant('{src}'),'data0.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data0.bin'), ExpandConstant('{app}'), '', false, '', '', ExpandConstant('{app}'), notPCFonFLY {PCFonFLY}) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\dlc_win64\ripper\game0.arc.d at'), ExpandConstant('{app}\dlc_win64\ripper\'), true) then break;


if not ShowChangeDiskWindow ('请插入下一个分卷data1.bin,等待初始化并继续安装...', ExpandConstant('{src}'),'data1.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data1.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game10.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game11.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game12.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game14.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game15.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game16.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game17.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game18.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game19.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game20.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game21.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game22.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game23.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game24.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game25.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game26.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game27.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game28.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game29.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game30.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game31.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game32.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game33.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game34.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game35.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game36.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;
if not ISPrecompExtract( 0, 0, ExpandConstant('{app}\archives_win64\game38.arc.da t'), ExpandConstant('{app}\archives_win64\'), true) then break;

if not ShowChangeDiskWindow ('请插入下一个分卷data2.bin,等待初始化并继续安装...', ExpandConstant('{src}'),'data2.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data2.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;
//run bat: Compression it with "precomp_reflate_srep_lzma"
if not ISExec ( 0, 0, 0, ExpandConstant('{app}\archives_win64\data2\Reflate Unpack.bat'), ExpandConstant(''), ExpandConstant('{app}\archives_win64\data2\'), '...',true) then break;
//DELTREE——Delete all files and folders
//DelTree(ExpandConstant('{app}\archives_win64\data2 '), True, True, True);
//DeleteFile(ExpandConstant('{app}\data_01.bin')); //test

if not ShowChangeDiskWindow ('请插入下一个分卷data3.bin,等待初始化并继续安装...', ExpandConstant('{src}'),'data3.bin') then break;
if not ISArcExtract ( 0, 0, ExpandConstant('{src}\data3.bin'), ExpandConstant('{app}\archives_win64\'), '', false, '', '', ExpandConstant('{app}\archives_win64\'), notPCFonFLY {PCFonFLY}) then break;
//run bat; Compression it with "Reflate_v2"
if not ISExec ( 0, 0, 0, ExpandConstant('{app}\archives_win64\data3\Unpack. bat'), ExpandConstant(''), ExpandConstant('{app}\archives_win64\data3\'), '...',true) then break;
//DelTree(ExpandConstant('{app}\archives_win64\data3 '), True, True, True); //test





This is the "mad max" decompression process

User run the "ReflateUnpack.bat" and "Unpack.bat" alone, and they are all out of the file is gone, very strange...
Is not the user's system lacks the reasons for extracting the plug?
My own computer to install all normal!!!

RamiroCruzo 05-11-2015 07:30

1 Attachment(s)
Quote:

Originally Posted by ShadowEagle (Post 444269)
Nice bat files :)

So, how to integrate that into an inno script? Your C.bat is creating *.pcf
and a .str file/s. After that the bat compresses to final archive using srep+lzma. Possible to use UltraARC for the final archive compressing?

Here's the v2 of it amigo...... You can find all the .pcf files in data folder to compress them externally :)

Change log :
Code:

-Increased speed
-All .pcf files are now left untouched to compress externally

Well.... Its a drag :cool:

ShadowEagle 06-11-2015 02:45

Very very good. thanks a lot man!

Now we all have to find a way to show up the progress in inno setup for restoring. I hate cmds so much ;)

Maybe Maste Razor can help us? Cheers




GBT repack 06-11-2015 09:50

Quote:

Originally Posted by RamiroCruzo (Post 444298)
Here's the v2 of it amigo...... You can find all the .pcf files in data folder to compress them externally :)

Change log :
Code:

-Increased speed
-All .pcf files are now left untouched to compress externally

Well.... Its a drag :cool:

Reflate_c.cmd running after an error
Tip missing packjpg_dll.dll
I provided this "packjpg_dll.dll" and the compression process was quickly over.
My system is win7 64
What is the reason, my friend

panker1992 06-11-2015 15:07

1 Attachment(s)
just replace the precomp with the newest version and let all other settings as they are it has fixes inside for that missing dll ...basically it comes inside the exe no need to have spare packjpg.dll anywhere ;)

RamiroCruzo 06-11-2015 23:58

Quote:

Originally Posted by GBT repack (Post 444318)
Reflate_c.cmd running after an error
Tip missing packjpg_dll.dll
I provided this "packjpg_dll.dll" and the compression process was quickly over.
My system is win7 64
What is the reason, my friend

DON'T GET IT MYSELF....... It runs on my PC finely

patric 07-11-2015 21:12

hi , please compresse.bat for black ops III

pakrat2k2 07-11-2015 21:28

Quote:

Originally Posted by patric (Post 444356)
hi , please compresse.bat for black ops III

why should someone else do all the hardwork for you... 867 Files, 8 Folders. Figure it out for yourself, then you've accomplished something.

ShadowEagle 10-11-2015 02:27

Quote:

Originally Posted by ShadowEagle (Post 444316)
Very very good. thanks a lot man!

Now we all have to find a way to show up the progress in inno setup for restoring. I hate cmds so much ;)

Maybe Maste Razor can help us? Cheers




No one? :confused:

RamiroCruzo 10-11-2015 02:41

Quote:

Originally Posted by ShadowEagle (Post 444443)
No one? :confused:

Everyones trying mate...... We aren't Tony Stark.......

Well amigos anyone of you have MSC only bat....In need of it urgently......

Grumpy 10-11-2015 03:31

Quote:

Originally Posted by ramirocruzo (Post 444445)
everyones trying mate...... we aren't tony stark.......

yep, gave me a laugh :D

RamiroCruzo 10-11-2015 18:44

Quote:

Originally Posted by Grumpy (Post 444446)
yep, gave me a laugh :D

Hey..... (T_T) Atleast give a thought to my second line amigos......

By the way leave it........:rolleyes:
o(╥﹏╥)o
。゚(゚´(00)`゚)゚。
。゚(゚´(00)`゚)゚。。゚(゚´(00)`゚)゚。

。゚(゚´(00)`゚)゚。
。゚(゚´(00)`゚)゚。

Bilawal 11-11-2015 05:45

Well, I tried to make a cls-reflate and I succeed but I took few minutes to start and speed of decompression didn't exceed 2mb. So, I didn't post it.
If you like that, then I will post both compressor and decompressor.

ShadowEagle 11-11-2015 06:06

Quote:

Originally Posted by Bilawal (Post 444497)
Well, I tried to make a cls-reflate and I succeed but I took few minutes to start and speed of decompression didn't exceed 2mb. So, I didn't post it.
If you like that, then I will post both compressor and decompressor.

Nice work, but 1.2 GB per hr isn`t enough, because most people will use reflate on big archives. Maybe there is a way to get it faster? Cheers

panker1992 11-11-2015 07:00

Bilawal post your method with reflater will be glad to test it with zstd and see how it performs :)

RamiroCruzo 11-11-2015 08:50

Quote:

Originally Posted by Bilawal (Post 444497)
Well, I tried to make a cls-reflate and I succeed but I took few minutes to start and speed of decompression didn't exceed 2mb. So, I didn't post it.
If you like that, then I will post both compressor and decompressor.

You can try increasing the # of raw2hif processes to speed up your decompression

panker1992 11-11-2015 18:11

To make decompressing run faster and not wait 10 - 20 seconds to start minimize code in arc.ini only use the absolutely necessary • it will help a lot ;)

Bilawal 11-11-2015 18:22

1 Attachment(s)
Compressor is ready and I will post, But the source of decompressor is messy right now and can't upload. In the mean time test the compressor. :o

Known Bugs:
Don't work with any work dir command (-w) except -w.\


All times are GMT -7. The time now is 12:22.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com