Useful programs

[BLACKFIRE69]

Originally Posted by Masquerade

Hey BLACKFIRE69,

Please may you build a version of listext that orders the output of file sizes from largest to smallest?

E.g.

Source:  .
Files :  123456789  [1337 GB]

 EXTENSION      FILE COUNT      PERCENTAGE      TOTAL SIZE
----------------------------------------------------------
.OGG                ?             XXX%           3GB
----------------------------------------------------------
.ZIP                ?             XXX%           2GB
----------------------------------------------------------
.EXE                ?             XXX%           1GB
----------------------------------------------------------
.DLL                ?             XXX%           100MB
----------------------------------------------------------
.TXT                ?             XXX%           50MB

Thanks!

ok!


ListExt - Update

USAGE:
  ListExt.exe  <Directory>  [Order_Type]
  (or just drag and drop a folder over the ListExt.exe.)

ORDER_TYPE:
  /SA = Sort Alphabetically.
  /SS = Sort by Size.
  /SP = Sort by Percentage.
  Default is /SS (Sort by Size).

EXAMPLE:
  ListExt.exe "C:\Test\Example1"  /SA

.

[brispuss]

Originally Posted by BLACKFIRE69

ok!


ListExt - Update

USAGE:
  ListExt.exe  <Directory>  [Order_Type]
  (or just drag and drop a folder over the ListExt.exe.)

ORDER_TYPE:
  /SA = Sort Alphabetically.
  /SS = Sort by Size.
  /SP = Sort by Percentage.
  Default is /SS (Sort by Size).

EXAMPLE:
  ListExt.exe "C:\Test\Example1"  /SA

.

Thanks for this very useful program!

Would it be possible to create a file listing based on reading file headers instead of reading file extensions? Reasons being that file extensions are not always valid, and some files don't have extensions at all!

And if possible, export file types to appropriately named folders for further processing. And maybe import processed files back to their original locations?

Yes, I know this would be a big task, but possible?

Thank you.

[BLACKFIRE69]

Originally Posted by brispuss

Thanks for this very useful program!

Would it be possible to create a file listing based on reading file headers instead of reading file extensions? Reasons being that file extensions are not always valid, and some files don't have extensions at all!

And if possible, export file types to appropriately named folders for further processing. And maybe import processed files back to their original locations?

Yes, I know this would be a big task, but possible?

Thank you.

• yes, it would be rather useful if it also exported the full path for each file.
  
  
• i just modified ListExt.exe, and now it creates TXT files that include the full paths of the corresponding files for each file extension. (if there's no file extension, the file will be named 'Unknown-#').
  
  
• by default, this feature is disabled. use the config file (ListExt.ini) to enable it as follows:

ListExt.ini

...

; Save the categorized file list in TXT files.
ExportFileList     = 1
ExportRelativeName = 0
ExportFileListPath = ".\MyOutput"

.

[brispuss]

Thanks for the prompt reply and update to this program!

A definite improvement over the last version of listext, especially with regard to file locations!

In my case, I have many thousands of extensionless files. By reading the file headers, there are a variety of file types, mostly audio, imagery with some video as well.

Ultimately, I would like to see the option of being able to read extensionless files to determine their file types and then determine the appropriate compression methods to be used.

[Masquerade]

^^
Mesa by Shegorat would be ideal for this but you will have to contribute to krinkels.org in order to obtain that.

[azuravian]

Originally Posted by brispuss

Thanks for the prompt reply and update to this program!

A definite improvement over the last version of listext, especially with regard to file locations!

In my case, I have many thousands of extensionless files. By reading the file headers, there are a variety of file types, mostly audio, imagery with some video as well.

Ultimately, I would like to see the option of being able to read extensionless files to determine their file types and then determine the appropriate compression methods to be used.

I'm fairly new, but I use a free application built by the British National Archives called DROID (Digital Record Object IDentification).

It's a very simple tool that uses signature files to detect file formats. It's not perfect (for example, I have quite a few mp4s it won't detect and have recently submitted a request for them to update their mp4 signature), but it's able to return data for most of my files and it's always accurate (in my experience) when it specifies the format.

I threw a bunch of files in a folder and scanned them so you can see the output.



As you can see, it found most files and even looks inside a non-password protected archive to give info on contained files as well.

DROID can be downloaded directly from the UK National Archives site:
https://www.nationalarchives.gov.uk/...records/droid/

Another application called TrID. It uses an algorithm to find similarities between files in order to determine filetype as opposed to looking for specific hard-coded headers. It's available as a command-line application:
https://mark0.net/soft-trid-e.html

or with a GUI:
https://mark0.net/soft-tridnet-e.html

I hope these are helpful for you.

[luxuse]

Hello guys!
I’ve been experimenting with xxHash3 and got help from AI — the results turned out to bee OK

This is a simple xxHash3 hash generator and checker, I decided to make it open source because I’ve used it in some of my repack projects, and it works great.

Feel free to do whatever you want with it

Enjoy! 😄

https://github.com/Luxuse/xxhash3-lx

[L33THAK0R]

Originally Posted by luxuse

Hello guys!
I’ve been experimenting with xxHash3 and got help from AI — the results turned out to bee OK

This is a simple xxHash3 hash generator and checker, I decided to make it open source because I’ve used it in some of my repack projects, and it works great.

Feel free to do whatever you want with it

Enjoy! 😄

https://github.com/Luxuse/xxhash3-lx

Interesting stuff, do you have any benchmarks? It's not very lightweight at more than double the size of QuickSFV, but if it's faster it may have some merit.

[luxuse]

NewCrc

NewCrc – Windows file integrity checker
Supported hashes: CRC32, XXH3-64
Features: compare files with checksum lists

zhashgen.exe in TEST-2 can create MD5 crc32 and XXH3-64

Here is somme virustotal scan :

zhashgen.exe
https://www.virustotal.com/gui/file/...229e?nocache=1

NewCrc
https://www.virustotal.com/gui/file/...1514?nocache=1

NewCrc : https://github.com/Luxuse/NewCrc/tree/main

[felice2011]

Originally Posted by BLACKFIRE69

• yes, it would be rather useful if it also exported the full path for each file.
  
  
• i just modified ListExt.exe, and now it creates TXT files that include the full paths of the corresponding files for each file extension. (if there's no file extension, the file will be named 'Unknown-#').
  
  
• by default, this feature is disabled. use the config file (ListExt.ini) to enable it as follows:

ListExt.ini

...

; Save the categorized file list in TXT files.
ExportFileList     = 1
ExportRelativeName = 0
ExportFileListPath = ".\MyOutput"

.

Nice idea, but it's all old stuff, here we've always tried to obtain and create something new, something that helps the user compress a game from start to finish, in the simplest way possible, I'll post something new too 'me, but it is very difficult if not impossible to create something intelligent in this field that can give you with certainty the exact method of compression of all existing file extensions without having to use additional external programs.