Log in

View Full Version : Game File Sorter


Gupta
18-01-2018, 04:22
It sorts files on deflate streams and entropy(compression) and writes filenames on logs.

Log_deflate.log : files containing deflate streams
Log_c80.log : files having projected compression ratio above 80
Log_c50a.log : files having projected compression ratio above 50 below 80
Log_c50b.log : files having projected compression ratio below 50


you can then use arc.exe on the file. f.e
arc a -di -i2 -s; -ep1 -ed -n@Log_deflate.log -wtemp\ -mpzlib+srep+lzma "%output%" "%Input%"
arc a -di -i2 -s; -ep1 -ed -n@Log_c80.log -wtemp\ -mlz4 "%output%" "%Input%"
arc a -di -i2 -s; -ep1 -ed -n@Log_c50a.log -wtemp\ -msrep+4x4:lzma "%output%" "%Input%"
arc a -di -i2 -s; -ep1 -ed -n@Log_c50b.log -wtemp\ -msrep+lzma "%output%" "%Input%"

scanning is also very fast, but it only scans the first 64mb of file

uses Bulat Ziganshin's Data Smoke

78372
18-01-2018, 04:37
Bhai ek ke baad ek bomb chor raha hain XD

Nice tool, could be useful for everyone

Gupta
18-01-2018, 04:44
bhai bor ho gya calculus XD, nalayk khatm hi nhi hota

78372
18-01-2018, 05:42
Calculas, maths keya hota hain, wo to ek accounting student hi janey bhaiya(like me XD)

Oops, sorry, english language forum, will delete this reply soon.

Gupta
18-01-2018, 06:19
bhai science walo ka dard kya smjo tum XD

Meanwhile Minor Update:
Fix a bug in entropy checker
relative path are printed now

gozarck
24-01-2018, 16:41
Excellent this save a lot of time compressing unnecesary files with high entropy!.

Gupta
23-02-2018, 10:02
ok here is the beta test
basic idea is mask not works everywhere
i am going to sleep, is awake from last 24 hours
side note: now you can add ur own precompressors see "precompress.ini"
new gui(i am new to qt)
gui can compress on its own, but arc.exe and all other pre-compressor.ini should be in the same directory as gui.exe, will make path var available test
all opinions are welcome

21106

Gupta
08-03-2018, 06:00
in the mean time, here is a console program


USAGE:

gsc [-t <integer>] [-p <integer>] [-m <integer>] [-l <integer>] [-c
<string>] [-b <directory>] [-e <string>] -d <directory> ... [--]
[--version] [-h]


Where:

-t <integer>, --inflation-threshold <integer>
minimum percent of inflation

-p <integer>, --scan-percent <integer>
percentage of the file to process(<100)

-m <integer>, --max-scan-size <integer>
maximum file portion to process(mb)

-l <integer>, --min-scan-size <integer>
minimum file portion to process(mb)

-c <string>, --disable <string>
precompressors to disable,separated by ','

-b <directory>, --base-dir <directory>
base directory,all paths printed will be relative to this path

-e <string>, --exclude <string>
files to ignore(accepts masks),separated by ','

-d <directory>, --directory <directory> (accepted multiple times)
(required) directory to process

--, --ignore_rest
Ignores the rest of the labeled arguments following this flag.

--version
Displays version information and exits.

-h, --help
Displays usage information and exits.


Gupta's Game Scanner

This will scan given directories and create file-list in lists\
directory
e80 : files with entropy above 80
e50a : files with entropy above 50 and below 80
e50b : files with entropy below 50
{precompressor}.list: files which inflates using the {compressor}



This will scan given directories and create file-list in lists\
directory
e80 : files with entropy above 80
e50a : files with entropy above 50 and below 80
e50b : files with entropy below 50
{precompressor}.list: files which inflates using the {compressor}

kj911
07-05-2021, 02:28
....scanning is also very fast, but it only scans the first 64mb of file

uses Bulat Ziganshin's Data Smoke

How to read and analyze the Data Smoke tools results?? (Gsorter and gsc tools not running from WinXP)

Sample: https://i.kek.sh/hehpHdctWeU.jpg