Reflate (Compatible with ISDone)

[Razor12911]

Here's reflate that is compatible with Inno Setup, it shows correct progress during decompression (optional), very few bugs with it. This does not deploy a large number of files during decompression so that a bonus.

Compression files:
rawdet.exe
reflate.exe

Decompression files:
raw2hif.exe
reflate.exe

Compression command line:
reflate -process input output

Decompression command lines:
reflate -restore input output
reflate -restore - - //for stdin and stdout

Arc.ini
[External compressor:reflate]
header = 0
packcmd = reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = reflate -restore - - <stdin> <stdout>

[panker1992]

I will test this and tomorrow you will get my results in details :)

Let me know if you want me to put this update on masked volumes :) will only do so only if you approve

[Amsal]

Bro I done the tests, it is working awesomely, it progress bar is working good with reflate, I added it to masked and it works amazingly, you can add it in your masked, I have done already that!! I used <stdin> <stdout> in the arc.ini, I tested with 115mb file and it compressed to 34mb and it decompress well


AND THANKS A LOT RAZOR12911 again!!!

[coveiro]

Works correctly in inno setup, Thank you: D

[Razor12911]

I will test this and tomorrow you will get my results in details :)

Let me know if you want me to put this update on masked volumes :) will only do so only if you approve
Go ahead dude.

[RamiroCruzo]

Testing done:
~~~~~~~~~

Avg. Decompression Speed 5mbps
Inno Support Perfect
Game tested Max Payne 2

[ZakirAhmad]

there is no CLS reflate... how to make it work for wpi

[NBB]

E:\0\Reflate_1400>arc.exe a -ep1 -r -ed -s; -mreflate data.arc pack\*"
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressing 2 files, 23,367,114 bytes. Processed 0%
Compressing 23,367,114 bytes with reflate -process $$arcdatafile$$.tmp $$arcpack
edfile$$.tmp

Errorlevel=1

ERROR: general (de)compression error in reflate

[felice2011]

Great Update Bro...;)

[Mini]

Errorlevel=1

ERROR: general (de)compression error in reflate
yes, error, please fix it

[Mini]

make please control of level of compression!

example:
[External compressor:reflate]
header = 0
packcmd = reflate -l9 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[panker1992]

Test 1 = Steam Folder (no games just steam)

Total size = 545 MB

Total Size compressed = 275 MB

Method Used = reflate+srep64+exe2+delta+xz

Pack = Success

Unpack = Failed (= Stuck at around 65% waited for it 15 Minutes then aborded)

************************************************** *********************************************
************************************************** *********************************************

Test 2 = Counter strike 1.6

Total size = 699 MB

Total Size compressed = 241 MB

Method Used = reflate+srep64+exe2+delta+xz

Pack = Success

Unpack = Success (very smooth)

************************************************** *********************************************
************************************************** *********************************************

Test 3 = Random Cas Files from Dragon Age Inquisition

Total size = 3100 MB

Total Size compressed = --- MB

Method Used = reflate+srep64+exe2+delta+xz (second =precomp:fast+reflate+srep64+exe2+delta+xz )

Pack = Failed (Errorlevel=1 ERROR: general (de)compression error in reflate )

Unpack = ------

************************************************** *********************************************
************************************************** *********************************************

Test 4 = Random Files, Including mp3, jpg, mp4, game files,text

Total size = 935 MB

Total Size compressed = 711 MB // Second try with precomp = 711 MB

Method Used = reflate+msc+srep64+delta+exe2+zstd/$msrsolid=msr+zstd/$void=srep64+zstd

Second try Method Used = reflate+precomp:fast+msc+srep64+delta+exe2+zstd/$msrsolid=msr+zstd/$void=srep64+zstd

Pack = Success // Success

Unpack = Failed // Failed = reflate handler crashed both times in decompression

************************************************** *********************************************
************************************************** *********************************************

Operating System Win 8.1 // WPI Inno was used created also by Razor

[felice2011]

Panker what is the problem, I try the updating reflate1400, it operates the complete extraction with different combinations of masks.:confused:

Used example mask: reflate+precomp+srep64+nz/$msrsolid=msr+zstd/$void=msc+srep64/$text=srep64+zstd/$precomp=precomp+msc+srep64+delta+exe2+nz

The extraction is successful.

http://i63.tinypic.com/11ikg9u.png

[panker1992]

Felice i took many errors :/

I tested more than once to verify and even then i took errors .... i will post Photos too

Nice job on new DLG :) it's gonna be epic

Running more tests on this reflate just to make sure :)

[minivj]

Great you are epic Razor12911:):)

[1234567890123]

i'm always get general (de)compression error in reflate error but why?

-----
nope still its not working for me :(

[panker1992]

i have found that if you use msc, decompression is likely to get an error !!!


smells like MSC is becoming obsolete :/


I hope this helps

[Andrey167]

dont work compress and decompress win 8.1

[panker1992]

dont work compress and decompress win 8.1


Can you post what error you get in each case ?? :cool:

did you try reflate+srep64+xz ??
this is the most basic complex free method to test

[Andrey167]

Can you post what error you get in each case ?? :cool:

did you try reflate+srep64+xz ??
this is the most basic complex free method to test

pack error
ERROR: general (de)compression error in reflate
and unpack error
Invalid compression method or parameters in reflate

[panker1992]

did you update your ini file ??

i hope razor comes online :)

[Razor12911]

Reflate's CLS plugin for Freearc uploaded

To avoid errors, make sure precomp and msc come first in compression.

[panker1992]

this entire thread is my Christmas wish coming true :)

big smile

[Mini]

To avoid errors, make sure precomp and msc come first in compression.
-mprecomp+msc+reflate+lzma

error: ERROR: invalid compression method or parameters in reflate

[chum]

Errorlevel=1
ERROR: general (de)compression error in reflate

I trying to compress GTA 5, if i try 1 single file of 1gb then compress fine. But if i try any size above 2gb this error occur in packing.

[Mini]

Razor12911, thanks for work, but we wait for correction of a mistake :)

[kassane]

Tested: Win7SP1 x64

method: reflate+srep32+lzma

Compress 800Mb (RE6): OK
Decompress:
CLS: OK - fast
Nocls: OK - low

tested CIU and WPI.

Congratulations Razor, did a great job. :D

[Simorq]

Errorlevel=1
ERROR: general (de)compression error in reflate

[Razor12911]

Judging from the simple types I used, max input size is ($7FFFFFFF) bytes

[panker1992]

razor i got an idea,

[External compressor:reflate]
header = 0
packcmd = reflate -process $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = reflate -restore - - <stdin> <stdout>
solid = 0

can you try this ?? i will also test this myself, i just got this idea from precomp 045 i have been working on :)

[Razor12911]

well, with those configurations, reflate became a bit faster but ratio is different.

[Mini]

Razor12911, you work on correction of a mistake?

[panker1992]

well, yeah but if input size limit =2gb then solid is the only option if you want to have success with a massive multi giga game :/

[Razor12911]

Razor12911, you work on correction of a mistake?
the current settings are stable, if I change anything, error.
well, yeah but if input size limit =2gb then solid is the only option if you want to have success with a massive multi giga game :/

Error still persists dude.

@everyone
if you have decompression errors, use the second unpackcmd or arc2.ini, it will produce error message to give you a clear idea of what might be the problem, this works provided you don't have cls in the directory.

[panker1992]

i have success :)

since i removed msc, everything works magically !!! i havent tried large files but whatever method i throw works

[1234567890123]

why it's not work on me :( (windows 10)

[Razor12911]

i'm using win 10, its working there, just put files in pack, make sure they are not big files, run pack.bat and, to decompress, run unpack.bat. Reflate only fails if no streams found or if input is big.

[Andrey167]

File x64b.rpf (191 MB GTA 5) when trying to pack gives this error

http://s10.postimg.org/7d47ls2x1/Desktop_2016_01_28_01_53_07.jpg (http://postimg.org/image/7d47ls2x1/)

[Razor12911]

File x64b.rpf (191 MB GTA 5) when trying to pack gives this error

http://s10.postimg.org/7d47ls2x1/Desktop_2016_01_28_01_53_07.jpg (http://postimg.org/image/7d47ls2x1/)
Works here.

[rinaldo]

perfect! ISDone is ok... msc problem :)
good wok rz

[Andrey167]

We managed to solve the problem with the packing reflate but now when unpacking error
http://s2.postimg.org/lhgzm3eh1/Desktop_2016_01_28_02_35_00.jpg (http://postimg.org/image/lhgzm3eh1/)

[Razor12911]

i just tested with and without cls, no problems.

[panker1992]

Everything works, method used is reflate+srep64+delta+exe2+xz

files are various, No more than 1 GB total

speed on decompression can reach 12 mb/sec

Totally Epic, Professionally Done again :)

[NBB]

win 7
pack error
ERROR: general (de)compression error in reflate
how to fix

[ChronoCross]

"cls-reflate.dll" only works if "raw2hif.exe" it's in the same folder.

[ZakirAhmad]

Bro... where can I found CLS for this reflate...

[rinaldo]

razor .. I tried to compress this file alone, but failed 3 times

PES2016_AnthemPack_P9.cpk 239mb :(

[ramazan19833]

http://i.hizliresim.com/nLddNB.jpg (http://hizliresim.com/nLddNB)

Hello Razor12911

All right, still error

[Razor12911]

I wonder how do you guys keep getting these errors but nonetheless, I'll look through the source and try to fix the problem in reflate.exe.

[rinaldo]

I wonder how do you guys keep getting these errors but nonetheless, I'll look through the source and try to fix the problem in reflate.exe.

I only error with dual core notebook with asus rog everything goes smoothly (here I have to really understand that cuts friend) still try to add SREP and other compressors, so let's see how does your boyfriend)
good work rz

[1234567890123]

i got this error too with all files

[ShadowEagle]

I wonder how do you guys keep getting these errors but nonetheless, I'll look through the source and try to fix the problem in reflate.exe.

Any news on that? ;) Cheers

[rinaldo]

bro explain to me why I can pull reflate without its files :eek:

use:
Arc a -ep1 -ed -r -w.\
-mprecomp+msc+srep+nz

Now I want to understand :D

[hasandgn34]

bro explain to me why I can pull reflate without its files :eek:

use:
Arc a -ep1 -ed -r -w.\
-mprecomp+msc+srep+nz

Now I want to understand :D

because; reflate method Automatically changes RAW files to Hif(with Raw2hif.exe).
that is why when you use precomp after that ; they were changed and precomp won't work with this files.
if Razor do this reflater without raw2hif.exe and automatically scan with precomp during reflate procces it(precomp) will work and The COMPRESSED file will be smaller than the other. BECAUSE, precomp can Scan RAW files with brute mode and just you can use brute mode for raw files.(quickly).

the other kind of files couldn't be scanned with Precomp(in brute mode very slowly)

I hope you will understand me :D because of my English.

You can try these Manually and after that you will learn everything about reflate.
and sometimes precomp doesn't scan RAW files it is changable than files. (but generally can scan in brute mode very very quickly). You should try to scan RAW files Precomp 0.38(1261kb) or Precomp 0.44 and 0.43. Ypu shold use these without "packjpg_dll.dll"

[ShadowEagle]

Razor any solution on big archives? Cheers

[Razor12911]

I am working on a solution but I am afraid that is the limit for safe working.

[ChronoCross]

Reflate have a lot of task to do. M7zrepacker made a 5 seconds pause for windows-cache-manager. Maybe reflate need a pause too.

[ShadowEagle]

I am working on a solution but I am afraid that is the limit for safe working.

Did someone tried to split the big archives into little parts? The error only persists on big archives.

It`s true reflate is more effective on big archives instead of tiny archives?

Cheers

[gozarck]

You are the one bro! nice work

[Mini]

any news about fix reflate.exe?

[Razor12911]

any news about fix reflate.exe?

You guys are so unbelievable, I post a test needing results, no one cares, I post reflate which is partially working, you want fixes.

[ShadowEagle]

You guys are so unbelievable, I post a test needing results, no one cares, I post reflate which is partially working, you want fixes.

Ok, what i have to test mate?

[Lucas65]

I think he meant this test. The post in which he asked to test reflate I can no longer find it. I put it here if anyone wants to use it.
I tested a file of FIFA 15 (120mb) with windows 7 64bit and this is result:

http://i.imgur.com/xK30zXH.png

Razor, if you want a more information please do tell me.

[Razor12911]

I think he meant this test. The post in which he asked to test reflate I can no longer find it. I put it here if anyone wants to use it.
I tested a file of FIFA 15 (120mb) with windows 7 64bit and this is result:

http://i.imgur.com/xK30zXH.png

Razor, if you want a more information please do tell me.
Thanks dude, I deleted thread once Panker1992 gave me solutions probably 2 or 3 weeks ago :(.

@Everyone
I limited reflate to 2GB on purpose, I mean. I post a test, no one cares, waited for results then 2 weeks later, I posted this reflate just to see how everyone was going to react to it, the reflate post got more views and downloads in just 2 days, way more than the test posted 2 weeks ago. I was done with reflate a lot time ago, probably in September last year, just decided to keep it to myself then make a public version and give it to you guys because of the efforts you would have put in with the tests I post, only to find out no effort was put in and I don't see a real reason to update reflate.

[RamiroCruzo]

Thanks dude, I deleted thread once Panker1992 gave me solutions probably 2 or 3 weeks ago :(.

@Everyone
I limited reflate to 2GB on purpose, I mean. I post a test, no one cares, waited for results then 2 weeks later, I posted this reflate just to see how everyone was going to react to it, the reflate post got more views and downloads in just 2 days, way more than the test posted 2 weeks ago. I was done with reflate a lot time ago, probably in September last year, just decided to keep it to myself then make a public version and give it to you guys because of the efforts you would have put in with the tests I post, only to find out no effort was put in and I don't see a real reason to update reflate.


Tested it....On dataRegion.cpk of NS4....Is way slow :o But result was 550 MB to 3.2 GB

[ShadowEagle]

Ok, how to help to eliminate this 2 GB limitation? :)

[panker1992]

I had to Compress and decompress over a Terabyte of data to stabilize it and now we bring reflate to c++, where i can optimize it better :)

we have stabilized 1 cpu core processing and we are polishing the Multithreading part :D

[ShadowEagle]

I would love a simple version which works with files bigger than 2 GB :cool:

[gozarck]

Only to find out no effort was put in and I don't see a real reason to update reflate.

Firstly thanks bro for all this work in reflate...Bro you shouldn't be affected by all these thoughts of reason & stuff..."You have the right to work, but never to the fruit of work. You should never engage in action for the sake of reward, nor should you long for inaction." a verse from Geeta....

@everyone

you guys should also cooperate, not just wait for final stable version...
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Reflate stats test
fallout 4 textures file
original size:1.28 GB
Final size:7.2 GB

[truerepacks]

@gozark
Been surprise with the fact that people in argentina know about gita and know about its verses.

[Razor12911]

Update available

Fixes
Reflate startup bug fixed

Bypass

use -s2000m to get past 2GB limit provided there isn't an individual file from your input that is greater than the limit.

[Mini]

Razor12911, thanks.

Unpack error:
Extracting game9.arc (881571840 bytes)
'$00┐?+?ч?A?' is not a valid integer value
how to fix?

question:
1. whether there will be a support multi-thread?
2. whether there will be a support settings of parameters (l1-l9) ?

[Razor12911]

Works over here,
public will not be getting multi thread and the option to change level.

[AHMED SAMI]

FreeArc 0.67 (March 15 2014) extracting archive: Test.cab

Extracting 95 files, 207,987,522 bytes. Processed 0%'$00????µ?D?'

is not a valid integer value

ERROR: general (de)compression error in reflate

How To Fix Bro ?

[Razor12911]

what did you guys use, cls or stdin and stdout?

[Amsal]

Razor12911 please check pm

[Razor12911]

works over here.

[NBB]

error,
E:\0\reflate_upd\CLS>arc.exe x -w.\ -dpunpacked\ data.arc
FreeArc 0.67 (March 15 2014) extracting archive: data.arc
Extracting 1 file, 22,826,288 bytes. Processed 0%'$00┐?+?ч???' is not a valid
integer value

ERROR: general (de)compression error in reflate

[felice2011]

error,
E:\0\reflate_upd\CLS>arc.exe x -w.\ -dpunpacked\ data.arc
FreeArc 0.67 (March 15 2014) extracting archive: data.arc
Extracting 1 file, 22,826,288 bytes. Processed 0%'$00┐?+?ч???' is not a valid
integer value

ERROR: general (de)compression error in reflate

I think there is something wrong..:confused:
if you extracted the zip file in the folder 0...
Try..(E:\0\Freearc>arc.exe x -w.\ -dpunpacked\ data.arc)

[RamiroCruzo]

http://i.imgur.com/AmyP8K6.png

http://i.imgur.com/zTVQ8rV.jpg

Woks fine for me amigos....

[Mini]

public will not be getting multi thread and the option to change level.
why??

[felice2011]

Tested and working, with a good compression ratio, and extraction with no errors..;)

http://i68.tinypic.com/foeru8.png

http://i63.tinypic.com/11rzxw2.png

Great job Razor...:)

[AHMED SAMI]

Im Windows 7 X64 SP1 and Im Not Touch Anything

Sim You Do In Your Video I Do Bro

Result Is The Same Problem ?

[1234567890123]

reflate is working now in me with the new update

[Razor12911]

Ok, I'll release another update.

[Razor12911]

Update available

Fixes
Decompression bug // Have no idea if it is fixed or not since I'm not experiencing that error
Processing and Restoring speed has been boosted by 5-10%,4 raw2hif.exe are executed at a time.

[Amsal]

Razor, got one error while decompression, will give you screenshots in some-minutes.

[Amsal]

http://i.imgur.com/mmETKq6.png
http://i.imgur.com/qmNzD1w.PNG

[Amsal]

I compressed that same file which is in the pack folder, but got this error

[felice2011]

Razor update 2 "File is Broken"...:confused:

http://i66.tinypic.com/2wf8nmc.png

[Razor12911]

Another update available

Changes

Compression bug fixed

[AHMED SAMI]

Now Is Done Bro Thank You For Help

[AHMED SAMI]

Razor any Solution on Big Archives ?

[JRD!]

Slit your big archive and compress parts, and decompress and merge parts...

[ShadowEagle]

Slit your big archive and compress parts, and decompress and merge parts...

Which tool you would recommend for splitting & merging?

[Amsal]

Which tool you would recommend for splitting & merging?

I think if razor can make public to the without limit reflate with levels then it will be so nice to him and we doesn't have to use these types of technique, k even talked to him and told him I will make it till me and I can pay donation/money, but still he doesn't agree!

[panker1992]

Amsal Payment isnt what Razor wants, i can assure you of that.

its his decision not to share the reflate, you gotta respect it and move forward !!!

I did the testing for him alone, and i will continue to do so

we have decided instead of giving away precious tools to give conversions for games !!

this means you will enjoy the original speed of reflate while packing only for specific target games ....


We are done working for repackers ..... sorry but is the truth

[ffmla]

Hello ff member, :)
Thank you razor for reflater compatible with isdone.
Is there any way to make reflate only compression.(isdone capable).?.
Please share code for that.
Thanks in advance. :D

[splitdvd9todvd5]

Nice reflate compression, we know that there's a lot of Good compression here, but anyone Doesn't share the Decompression ISDone installer! sad :(

[Razor12911]

How hard can it be people? From your current script, add the necessary decompression files,under files section and then extracttemporaryfile. Simple

[Razor12911]

Updating coming, added MT during compression.

What's left is CLS update + Inno example for lazy people.

[Razor12911]

Update uploaded

Changes

-raw files are processed internally by exe using all threads your system has.
-decompressor launches many raw2hifs
-Inno Setup example included

[ChronoCross]

Initial test reflate freeze my pc. X6 8gb ram. When reflate ends and lzma starts my pc go back to normal.

[Razor12911]

You guys said you wanted MT, and now your CPU can't handle it.

[Mini]

thanks. how about the choice how many to use thread? :)

[mikey26]

@ChronoCross Amd multi thread is horrible i had the FX8350 and i3 was 2x faster and more efficient.BTW is that a true X6 or did you unlock it that could be the issue the extra 2 core unlocked.i just saying if its unlocked by you if not then its not coping with MT.those X6 still are really good for gaming with a decent graphics card.:-)

[RamiroCruzo]

@ChronoCross Amd multi thread is horrible i had the FX8350 and i3 was 2x faster and more efficient.BTW is that a true X6 or did you unlock it that could be the issue the extra 2 core unlocked.i just saying if its unlocked by you if not then its not coping with MT.those X6 still are really good for gaming with a decent graphics card.:-)

:eek: Nice to know another AMD amigo...I'm also using FX 8350 Black Edition. It never stuck??? You sure you aren't doing something wrong???

[felice2011]

Take away a little dust over your processor, you will see that it will not hang Ha Ha Ha..:D

[SAM2712]

Anyone can help to answer that If It possible after reflating the file > do not compressing by other method .. I mean after merging raw files reflated file becomes temporary file and stopped on that process...:rolleyes:

My Aim is that to reduce the number of creating bin files.
Suppose 4 different files are of different sizes but under 2 GB ...
So after reflating every single file one by one and stopped in temporary files and after that We could compress all the 4 temporary reflated files TOGETHER by using method SREP>lzma or whatever in one single bin file :rolleyes:
So we can escaped from creating many bin files :rolleyes:

[Sebazz]

Thanks for all Razor. Is possible can you share a reflate version without size limit or a method to bypass and cls update ? Again Thanks :)

[truerepacks]

Thanks for all Razor. Is possible can you share a reflate version without size limit or a method to bypass and cls update ? Again Thanks :)
Razor has decided not to publish his ultimate reflate in public becoz of his own personal reasons and some contibution from all of us......
So u should respect it.......

[TWOELV]

in masked data 2.5 all these are included right ?

[Viper645]

Which is better?

Precomp vs reflate

[Gupta]

largely Depends on the file itself
Comparing Precomp and Reflate

Precomp:
Precomp slow during recompression and fast during restoration
precomp support many other file specific compression like packmp3 for mp3 and packjpgs for jpgs while reflate not
Precomp may never give CRC error(S)

Reflate
Reflate may always win in recompression ratio
Reflate is comparitively fast during recompression and slow during restroration
Reflate may give CRC Error (still in development)

And the winner is PZLIB V3

[Viper645]

PZLIBV3 works with GTA V? And script?