FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   reflate stream detector - Practical use. (https://fileforums.com/showthread.php?t=97941)

gozarck 01-06-2016 11:13

reflate stream detector - Practical use.
 
10 Attachment(s)
Simple batch for drag an drop folder to generate a list of files ready to test with reflate. Generate 2 files rsd1.txt is a list of files with streams and rsd0.txt list of files with 0 streams.
Drag the game folder into a batch and this batch generate the list of files.
Now you can use [email protected] in arc.exe or make a arc.groups


Code:

Change-log for v2:
~~~~~~~~~~~~~~~~~~~~~~~~~~
Reflate MT added


vint56 01-06-2016 12:11

gozarck error Windows 7 64 bit

http://s020.radikal.ru/i705/1606/44/5c30f5b83c71.png

RamiroCruzo 01-06-2016 12:20

1 Attachment(s)
Quote:

Originally Posted by vint56 (Post 449311)


Well, the raw2hif Tio Gozarck provided with this Package was a custom build by him. It works fine for x32. You can just replace the raw2hif with any of the usual one or use the attached one :)

Andrey167 01-06-2016 13:02

reflate all as well as the version of the Razor runs in one thread (((

ChronoCross 03-06-2016 15:09

ReflateMT works fine. Tested with 6 cores pack and unpack without errors. But -t0 (automatic cores detetion) doesn't work.

gozarck 03-06-2016 18:03

@ChronoCross is not implemented yet!

gozarck 04-06-2016 18:54

1 Attachment(s)
Big thanks Shelwien! Masters of the Masters. The Relfate Creator for his x64 version of reflate tools. Now reflate is more faster. :D

1234567890123 05-06-2016 00:48

can i add srep to this packer ? can unpack.bat unpack data?

Razor12911 05-06-2016 09:29

1 Attachment(s)
Quote:

Originally Posted by gozarck (Post 449377)
Big thanks Shelwien! Masters of the Masters. The Relfate Creator for his x64 version of reflate tools. Now reflate is more faster. :D

A bit slower from my side, but produces better output on some files.

It finally finds all streams on UI.sb meaning it could possibly work on all Mad Max game files.

vint56 11-06-2016 00:56

gozarck but you could not write a batch file just precomp
that also created rsd0 rsd1

gozarck 19-07-2016 15:55

2 Attachment(s)
hi vint56 in pack.bat just change reflate for precomp
Code:

-mrep+exe+delta+lzma/$streams=precomp+rep+exe+delta+nz
--------------------------------------------------------------------------

Reflate DRC (detect rename compress)
This batch make the same thing but at once. just paste the path of folder game.

--------------------------------------------------------------------------
RSDX8
Very rudimentary batch for make rawdet job more faster.
RUN_refl8StreamDetectorX8.bat and wait. the batch dont show any progress just make the job more faster.
the batch generate rsd0.txt and rsd1.txt only.
Just paste the folder game.

SAM2712 23-07-2016 12:36

2 Attachment(s)
I got error Gozarck !
When I put ur compressor files (Reflate also) in WPI script..
But setup gives unarc.dll error :confused:
I also configure reflateMT in script :confused:

gozarck 24-07-2016 16:47

Hi SAM please make your question in WPI thread because i cant help you. Also if you have error with this version of reflate in IS script ask to razor for lastest reflate version published in the forum. I dont have any error in my simple script. WPI is very complex for me ask to razor or rinaldo.
ThankYou

SAM2712 24-07-2016 20:29

ok Gozarck :rolleyes::rolleyes:

Razor12911 28-07-2016 11:18

Hi Gozarck

I just ran another test, I don't know if it is a known bug but dragging external folders (folders not shared by batch and the folder being dragged) results in RSD always coming back with no lists and RSD always says there were no streams found yet if you paste the folder near the batch, it works.

I also noticed something about this tool, its drawbacks.

Firstly, by using this tool, it is guaranteed that you are going to run rawdet twice on some files that had streams, generating more temp files and etc. First during detection then again during compression so this at the end of the day wastes time especially on a game that has almost all files zlib compressed, also if it is big. e.g. Mad Max.

I think this can be solved if it is possible to that right after rawdet is run, you must somehow make some detections on the temp folder for 00000000.raw which is the first stream to be found, then once that is done, just kill the rawdet process then move to the next file because it doesn't seems like knowing the number of streams found is of necessity because at the end of the day, a file in the dragged folder may have 1 stream, it will be on the list which is virtually the same as a file with 10000 streams found, so right after the minutes the first stream is found, terminate rawdet then move on to the next file.

gozarck 29-07-2016 15:39

HI Razor12911
RSD batch was made it to work in the same folder of the game folder.
Reflate_DRC batch was made it to work pasting the folder path.
RSDX8 batch was made it to work with rawdet x8 process, because if you try to kill the process (runing in parallel rawdet.exe) i got many errors msg. Also .str and .out files are blocked by the process and i cant delete them or force to kill the process. thats was my first idea for speed up rawdet and still working on it. the scratch result was RSDX8. :p

PD: i want Zlib Checker PRO make a list of files with streams too. :)

Razor12911 30-07-2016 10:41

1 Attachment(s)
You can take this.

rawdet "%%~F" .\temp\.out .\temp\.str .\temp\ > NUL
becomes
rawdet_helper "%%~F" > NUL

SAM2712 30-07-2016 12:04

Quote:

Originally Posted by Razor12911 (Post 450304)

rawdet "%%~F" .\temp\.out .\temp\.str .\temp\ > NUL
becomes
rawdet_helper "%%~F" > NUL

Hi Razor !
I tried this and works good..But whats the matter to use this ?
...... Ok now I got it :)
Thanks RAZOR12911 for this tool :)

gozarck 30-07-2016 16:25

got damn it Razor12911. sometimes I ask myself What would we do without you. :)

Hey guys another Amazing Powertool by Razor12911 rawdet_helper.
Like his name says it's a helper for speed up rawdet when search streams in big files.
So now you need:
rawdet.exe
rawdet_helper.exe
and the batch file in the same folder.
Read the Razor12911 comment and modify the batch file.

Thanks Razor12911 you are the best :cool:

SAM2712 01-08-2016 20:02

Hi Gozarck !
I need to know, how to give time (next compression starts in 5.4.3.2.1 like this) between next compression start in batch file and atlast automatically shutdown pc option after compression completed :confused:

Prince4 02-08-2016 02:05

Quote:

Originally Posted by SAM2712 (Post 450354)
Hi Gozarck !
I need to know, how to give time (next compression starts in 5.4.3.2.1 like this) between next compression start in batch file and atlast automatically shutdown pc option after compression completed :confused:

You can use Timeout /T %TIME% for delays in compression and Shutdown /T %TIME% for shutting down your PC after compression finishes..

And yeah you do not need to add %TIME% instead you need to add numbers in seconds Like :
Timeout /T 5 (Continue after 5 Seconds)
Shutdown /T 10 (Shutdown after 10 Seconds)

SAM2712 02-08-2016 05:02

Thanks Prince :D

SAM2712 11-08-2016 08:05

Hi GOZARCK !
Please make a BATCH file like this :
Suppose I want to making a dummy or extracting the files containing only extension ".pak" from Game folder :(

gozarck 29-08-2016 14:37

1 Attachment(s)
Check the this files for test.

Simorq 29-08-2016 14:53

Good
Win 7 64Bit

GTA V
x64w.rpf (893MB) x64w.ref (1.98GB) x64w.srep (1.02GB) x64w.arc (516MB)
x64w.rpf (893MB) =reflate7z (792MB)

Razor12911 29-08-2016 16:10

1 Attachment(s)
Works fine

Prince4 30-08-2016 02:28

Quote:

Originally Posted by SAM2712 (Post 450603)
Hi GOZARCK !
Please make a BATCH file like this :
Suppose I want to making a dummy or extracting the files containing only extension ".pak" from Game folder :(

This is How you Can do whatever you want with .pak files
Code:

For /R %%i in (*.pak) do %COMMAND_HERE%

SAM2712 30-08-2016 11:07

Quote:

Originally Posted by Prince4 (Post 451207)
This is How you Can do whatever you want with .pak files
Code:

For /R %%i in (*.pak) do %COMMAND_HERE%

Thanks to reply Prince, waited for that But don't understand...U mean command like copy,move,dummy,extract OR compressing command...From all effort please Guide bcoz i tried all :(

ShadowEagle 01-09-2016 04:34

It`s a loop. It does mean for every file with the ending in the actual folder it will be done command "X". You can replace "%COMMAND_HERE%" with copy, reflate, and so on.

Gupta 22-05-2017 09:22

1 Attachment(s)
actually, if the file doesn't contain deflate rawdet_helper will be ended up checking the whole file
so here it's my take, the file is divided into 64 MB chunk then checked

usage: tester [logfile] [ folder or file ]
where the log file will contain all the files paths that contain deflate and you can also supply a folder or file, if it is a folder that it will recursively scan all files in the specified folder

it can save a lot of time if there is a very big file without deflate
you can directly include the logfile in Frearc and compress them in with any inflators


All times are GMT -7. The time now is 02:26.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com