FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Precomp+Reflate+Srep+LZMA (https://fileforums.com/showthread.php?t=96138)

ChronoCross 11-09-2015 09:08

Precomp reflate or reflate precomp what's the best way. Repackers use reflate and then precomp. But here says precomp then use reflate.anyone was test this?

CoreGames 11-09-2015 20:10

Quote:

Originally Posted by ChronoCross (Post 443155)
Precomp reflate or reflate precomp what's the best way. Repackers use reflate and then precomp. But here says precomp then use reflate.anyone was test this?

Do not use both, just use one. If you process a file using reflate then there will be no benefit if you further process it with precomp. Same goes for the precomp-->reflate method. About repackers method, its not like the way you are thinking.

Razor12911 11-09-2015 21:00

Quote:

Originally Posted by ChronoCross (Post 443155)
Precomp reflate or reflate precomp what's the best way. Repackers use reflate and then precomp. But here says precomp then use reflate.anyone was test this?

I think reflate first then precomp is better in my own opinion though there are disadvantages either way.

ShadowEagle 12-09-2015 07:28

Quote:

Originally Posted by CoreGames (Post 443163)
Do not use both, just use one. If you process a file using reflate then there will be no benefit if you further process it with precomp. Same goes for the precomp-->reflate method. About repackers method, its not like the way you are thinking.

Can you please substantiate your statement? I think many people are interested in knowing how to get the best result using reflate. Cheers

ChronoCross 12-09-2015 15:40

@Razor12991 @CoreGames thanks for the answers.


I thought if reflate skip any zlib header then precomp will catch the zlib header skipped. or vice versa.( something like that.).

About Repackers i don't understand, why "compress" each *.raw file with precomp.
It is as compress temporary files(i think it's wasted time or i miss somthing here).

metalgear V
Original Size: 21.5 GB
Repack Size: 11.5 GB
4hs installation with x6Cores and 8gb ram
without errors.
reflate+precomp
all exes are renamed. and one console application made it for unpack pcf files.
this console application read txt file and send info (to precomp) with the commands for extract pcf files.(Idon't know why those people don't use delphi script :confused:).another console aplication Quicksfv to check the crc of the files :confused: (maybe delta patch?).

PD:I'll switch from precomp to reflate.

Razor12911 12-09-2015 23:04

But do you think it's worth it? Because combining the two SOMETIMES reduces the size by at least 5mb and MOSTLY you are better off with one of them. There arent that many zlib streams on files, its mostly deflates. The reason I suggested reflate first the precomp was the fact that reflate cannot be combined with srep and lzma in one go but precomp can, which saves time and space when decompressing, from my point of view, if you want to use both, rather discard reflate then set precomp to brute mode.

Shegorat 13-09-2015 12:07

Maybe i can explain some features of precomp and reflate...

Precomp searches only zlib streams, zlib is only container for deflate stream with his own header. Precomp can try to search deflate streams in brute mode, but very very slowly. It can handle recursive compressed streams, and input files more than 4 Gb.

Reflate try to search deflate streams, it is more difficult, cause deflate stream is sequence of compressed blocks, every block starts with 3 bits header. So rawdet can find many false-positive streams. But there are some checks in rawdet, that can drop almost all invalid streams. Rawdet can not handle input files more than 4 Gb, and recursive compressed streams - for each unpacked stream need run rawdet again.

Sometimes using both precomp and reflate may get better results, than using one of them.

ChronoCross 13-09-2015 14:09

this is great, this information (from @Razor12911 and @Shegorat) is a piece of gold. (here wasting time) I made compression test and precomp in brute is really but really slow but better in some games. on the other hand with x6cores reflate it is much faster and better, but in some files.
precomp brute mode
reflate level 6
game1 = precomp wins 200% vs 170% reflate md5 OK
game2 = reflate wins 320% vs 210% precomp md5 OK

need to find the right way to use reflate and precomp for my future game compressions,
only to save time
need to make more test i like the speed of reflate. it's a small percentage difference with precomp but is much faster, despite the limitations described by shegorat have reflate.

RamiroCruzo 17-09-2015 01:45

1 Attachment(s)
Hey mates got the CLS-Reflater.dll.........

kenzo34 17-09-2015 02:10

Hello is it possible in your next update to add the audio compressor msc? have reflected precomp+lzma+SREP+msc? compression will be greater for me if I also compress the audio. Thank you

HunterEmrah 25-09-2015 08:36

anybody knows how to compress Mad Max?

mikey26 26-09-2015 16:27

with the many compressors posted on the site.and a little reading on how its done.guys have created some cool tools that will do all the work for.:)

edward99 06-10-2015 13:39

please can you tell me, bro how to compress watch dogs and tell how to create a small size into large size using precomp

edward99 06-10-2015 13:43

please can you tell me, bro what is freearc+plugins

RamiroCruzo 10-10-2015 09:01

Hi Mr. Gozarck....Long time no see........

I was working on a repack when I discovered that precomping .hif files give a better result than precomp+reflate........ I created the bat for it but it has many errors....So could you please try it .........

gozarck 10-10-2015 15:02

1 Attachment(s)
very nice RamiroCruzo,
then you suggest that each file "* .hif" preprocess with precomp or pre-process and compress with precomp ?. Could you share the batch code. Also shares the name of the game you are using to test, and some statistics on the total weight of the game, and the final compressed size of the game with your script?
Also precomp method
Thankyou
---EDITED--------------------
i take youR suggestIon please test the bat file.

RamiroCruzo 10-10-2015 22:35

Quote:

Originally Posted by gozarck (Post 443758)
very nice RamiroCruzo,
then you suggest that each file "* .hif" preprocess with precomp or pre-process and compress with precomp ?. Could you share the batch code. Also shares the name of the game you are using to test, and some statistics on the total weight of the game, and the final compressed size of the game with your script?
Also precomp method
Thankyou
---EDITED--------------------
i take youR suggestIon please test the bat file.

Gracias Mr. Gozarck....I was testing it on MadMax as its deflate steams i.e. .hif files were about 1-2MB big...... So I barely managed to do it by editing your script precomp+reflate+srep+lzma but it gave different errors everytime.........

Yup...Now the results,
Game Size:32GB
Precomp+Srep Size:4.4GB
Reflate+Arc Size:4GB
Reflate+Precomp Size:3.75GB

-------Edited-------------
A few suggestions for your consideration amigo,
1} Add .unp to precomp list too
2} Change the precomp method to -slow0 -cn
3} Don't compress the files i.e. make .refl8 just let them be as it is in a data folder....It will be easier to add it in installations then.

Well are you Mister or Master??? {Frankly asking} :P

gozarck 11-10-2015 03:50

Well my friend in real life im a professor of history's art. But in internet iam gozarck i just sharing my hobby. About the code i hope razor can change the code. The problem is the names of the pcf files hif and unp have the same name. So we need to make a little code to rename it and restore.

gozarck 12-10-2015 20:13

1 Attachment(s)
RamiroCruzo hif and unp with precomp (please change the command of precomp) pack and unpack. check the bat file (reflate_c.cmd and reflate_d.cmd) for info.

RamiroCruzo 13-10-2015 09:31

Quote:

Originally Posted by gozarck (Post 443805)
RamiroCruzo hif and unp with precomp (please change the command of precomp) pack and unpack. check the bat file (reflate_c.cmd and reflate_d.cmd) for info.

Got an idea Mr Gozarck.......How about we precomp .raw files instead......???

I don't know if its a good idea but will be trying it....:)

gozarck 13-10-2015 16:59

So you say use rawdet and compress each raw file with precomp. And unpack precomp and then rawrest right?

RamiroCruzo 13-10-2015 23:54

1 Attachment(s)
Quote:

Originally Posted by gozarck (Post 443836)
So you say use rawdet and compress each raw file with precomp. And unpack precomp and then rawrest right?

Yup Amigo.......I worked on it & heres the result.....:)

Amsal 14-10-2015 09:41

Hey Anyone can please tell me how to unpack multiple (BTW, I want for 3) .refl8, If anyone know please tell me the code

gozarck 14-10-2015 19:39

Hi RamiroCruzo. I can't test your idea i don't have time. Tell me it's works?

edward99 18-10-2015 00:56

Do anyone know how to compress watch dogs?
Do anyone know how to create small size to large using precomp

ShadowEagle 19-10-2015 04:02

Something new on this method? Cheers





RamiroCruzo 20-10-2015 23:20

Quote:

Originally Posted by gozarck (Post 443855)
Hi RamiroCruzo. I can't test your idea i don't have time. Tell me it's works?

Sorry amigo for such a late reply....Was busy in studies....

It works as inquired by you i.e. extracts .raw data then process them with precomp......

ShadowEagle 21-10-2015 04:40

Will the progress be shown by isdone for all operations using your method?

gozarck 21-10-2015 13:38

1 Attachment(s)
Quote:

Originally Posted by ShadowEagle (Post 443968)
Will the progress be shown by isdone for all operations using your method?

Hi ShadowEagle only show the progress when the installer unpack precomp files, and not rawrest part.



---------------------------------------------------------------------------------------------

Quote:

Sorry amigo for such a late reply....Was busy in studies....

It works as inquired by you i.e. extracts .raw data then process them with precomp......
very nice ramirocruzo, i dont have time to make a long test, so can you help to edward99 with watchdogs with your idea?

also i take your idea and made my own version.
"change the commands of precomp"
to
Code:

dir /s /b *.raw | ppx2 -P 2 -L 1  precomp -brute0 -cn -v -f "{}"
and remember ppx2 have max 4 process (4 cores) at once (-p 4) if you have more than 2 cores please change the command.

Thank you RamiroCruzo

RamiroCruzo 21-10-2015 23:06

Quote:

Originally Posted by gozarck (Post 443976)
Hi ShadowEagle only show the progress when the installer unpack precomp files, and not rawrest part.



---------------------------------------------------------------------------------------------



very nice ramirocruzo, i dont have time to make a long test, so can you help to edward99 with watchdogs with your idea?

also i take your idea and made my own version.
"change the commands of precomp"
to
Code:

dir /s /b *.raw | ppx2 -P 2 -L 1  precomp -brute0 -cn -v -f "{}"
and remember ppx2 have max 4 process (4 cores) at once (-p 4) if you have more than 2 cores please change the command.

Thank you RamiroCruzo

Thanks for the improved version amigo........ Yours way more legit than mine....

Quote:

Originally Posted by edward99 (Post 443908)
Do anyone know how to compress watch dogs?
Do anyone know how to create small size to large using precomp

As for you mate edward99, I once repacked Watch Dogs too in about 14GB..... Nothing Ripped........ Well I only used this.....
Code:

[External compressor:precomp]
 header = 0
 packcmd = precomp -slow -t-j {options} -o$$arcpackedfile$$.tmp $$arcdatafile$$.tmp
 unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:srep]
 ;options = l%d (minimal match length, default=512)
 header = 0
 packcmd = srep {options} -a1 -m3f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
 unpackcmd = srep -d -s $$arcpackedfile$$.tmp $$arcdatafile$$.tmpp

[External compressor:msc]
header = 0
packcmd  = msc c -v {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp


ShadowEagle 22-10-2015 04:40

Quote:

Originally Posted by gozarck (Post 443976)
Hi ShadowEagle only show the progress when the installer unpack precomp files, and not rawrest part.

Hi Gozarck, is there any way to show the progress? I mean it`s one of the most important things. Because if the installation stucks at 100% for 20 or 30 mins, the users will think the setup hanged up and maybe will quit. So it`s very important to find a solution. Greetz

RamiroCruzo 22-10-2015 05:18

Quote:

Originally Posted by ShadowEagle (Post 443995)
Hi Gozarck, is there any way to show the progress? I mean it`s one of the most important things. Because if the installation stucks at 100% for 20 or 30 mins, the users will think the setup hanged up and maybe will quit. So it`s very important to find a solution. Greetz

For the exact same reason amigo.... I prefer using independent compressors e.g. compressing all .raw & .hif files finally after processing them & then show the installers cmd files......

You can do that too..... :'( I was once allegated for BitCoinMiner as the installation stuck........

ShadowEagle 22-10-2015 07:28

Quote:

Originally Posted by RamiroCruzo (Post 443996)
For the exact same reason amigo.... I prefer using independent compressors e.g. compressing all .raw & .hif files finally after processing them & then show the installers cmd files......

You can do that too..... :'( I was once allegated for BitCoinMiner as the installation stuck........

Don`t understand what`s the solution to show up progress. Sorry :(

Mini 22-10-2015 11:09

what news about cls-reflate?

edward99 25-10-2015 05:48

can any tell me how to repack games exactly like corepack please?
can anyone tell me how to repack assassin creed unity exactly like corepack please?

RamiroCruzo 25-10-2015 09:20

Quote:

Originally Posted by edward99 (Post 444062)
can any tell me how to repack games exactly like corepack please?
can anyone tell me how to repack assassin creed unity exactly like corepack please?

:mad: No one is telling you if you ask like this........:p

Instead would have asked how to compress it smallest

ChronoCross 25-10-2015 11:20

I was tested ff type-0 by corepack. And they know how to made small size but the installer have a few errors and fail to install correctly

GBT repack 25-10-2015 11:43

Quote:

Originally Posted by RamiroCruzo (Post 443761)
Gracias Mr. Gozarck....I was testing it on MadMax as its deflate steams i.e. .hif files were about 1-2MB big...... So I barely managed to do it by editing your script precomp+reflate+srep+lzma but it gave different errors everytime.........

Yup...Now the results,
Game Size:32GB
Precomp+Srep Size:4.4GB
Reflate+Arc Size:4GB
Reflate+Precomp Size:3.75GB

-------Edited-------------
A few suggestions for your consideration amigo,
1} Add .unp to precomp list too
2} Change the precomp method to -slow0 -cn
3} Don't compress the files i.e. make .refl8 just let them be as it is in a data folder....It will be easier to add it in installations then.

Well are you Mister or Master??? {Frankly asking} :P


The same scheme, why I can not be compressed into so small, you dare to publish your bat?
Thanks!!

GBT repack 25-10-2015 11:50

I need a friend to share the "MadMax" compression scheme, thank you

RamiroCruzo 25-10-2015 22:32

Quote:

Originally Posted by GBT repack (Post 444074)
The same scheme, why I can not be compressed into so small, you dare to publish your bat?
Thanks!!

Being both Non-Polite & Polite at once....LOL..........

Well I can almost tell you about 3-4 methods of its compression..............

1. If you only use Reflate+ Arc of Mr Razor12911, your result will be about 8 GB
2. If you Precomp -brute all game archive & then compress, it will go about 4.47 GB
3. If you use quickBMS to extract game archives then compress, it will go about 5 GB
4. If you use method discussed by me & amigo Gozarck you can get it about 3.8 GB if using a strong compression over it

Quote:

Originally Posted by GBT repack (Post 444076)
I need a friend to share the "MadMax" compression scheme, thank you



All times are GMT -7. The time now is 15:09.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com