Useful programs

[azuravian]

Originally Posted by brispuss

Thanks for the prompt reply and update to this program!

A definite improvement over the last version of listext, especially with regard to file locations!

In my case, I have many thousands of extensionless files. By reading the file headers, there are a variety of file types, mostly audio, imagery with some video as well.

Ultimately, I would like to see the option of being able to read extensionless files to determine their file types and then determine the appropriate compression methods to be used.

I'm fairly new, but I use a free application built by the British National Archives called DROID (Digital Record Object IDentification).

It's a very simple tool that uses signature files to detect file formats. It's not perfect (for example, I have quite a few mp4s it won't detect and have recently submitted a request for them to update their mp4 signature), but it's able to return data for most of my files and it's always accurate (in my experience) when it specifies the format.

I threw a bunch of files in a folder and scanned them so you can see the output.



As you can see, it found most files and even looks inside a non-password protected archive to give info on contained files as well.

DROID can be downloaded directly from the UK National Archives site:
https://www.nationalarchives.gov.uk/...records/droid/

Another application called TrID. It uses an algorithm to find similarities between files in order to determine filetype as opposed to looking for specific hard-coded headers. It's available as a command-line application:
https://mark0.net/soft-trid-e.html

or with a GUI:
https://mark0.net/soft-tridnet-e.html

I hope these are helpful for you.

[luxuse]

Hello guys!
I’ve been experimenting with xxHash3 and got help from AI — the results turned out to bee OK

This is a simple xxHash3 hash generator and checker, I decided to make it open source because I’ve used it in some of my repack projects, and it works great.

Feel free to do whatever you want with it

Enjoy! 😄

https://github.com/Luxuse/xxhash3-lx

[L33THAK0R]

Originally Posted by luxuse

Hello guys!
I’ve been experimenting with xxHash3 and got help from AI — the results turned out to bee OK

This is a simple xxHash3 hash generator and checker, I decided to make it open source because I’ve used it in some of my repack projects, and it works great.

Feel free to do whatever you want with it

Enjoy! 😄

https://github.com/Luxuse/xxhash3-lx

Interesting stuff, do you have any benchmarks? It's not very lightweight at more than double the size of QuickSFV, but if it's faster it may have some merit.

[luxuse]

Originally Posted by L33THAK0R

Interesting stuff, do you have any benchmarks? It's not very lightweight at more than double the size of QuickSFV, but if it's faster it may have some merit.

you can find somme becnhmarck here is a link : https://github.com/pombredanne/xxHash-3

[L33THAK0R]

Originally Posted by luxuse

you can find somme becnhmarck here is a link : https://github.com/pombredanne/xxHash-3

Not sure why I didn't just search it up myself, apologies! After some research, and testing on nvme & sata SSDs and some slower HDDs, I'm pretty blown away by how much faster it is, whilst still have a high bit-level sensitivity. So much so that I'll be researching (or start development on) a GUI with feature parity to QuickSFV, as well as adding support to my shell extension tool (that currently only supports more traditional algorithms), thank you to opening my eyes to alternative algorithms!

[luxuse]

Originally Posted by L33THAK0R

Not sure why I didn't just search it up myself, apologies! After some research, and testing on nvme & sata SSDs and some slower HDDs, I'm pretty blown away by how much faster it is, whilst still have a high bit-level sensitivity. So much so that I'll be researching (or start development on) a GUI with feature parity to QuickSFV, as well as adding support to my shell extension tool (that currently only supports more traditional algorithms), thank you to opening my eyes to alternative algorithms!

No need to apologize! It's great, I'd really love to see your GUI, that would be super useful

[luxuse]

NewCrc

NewCrc – Windows file integrity checker
Supported hashes: CRC32, XXH3-64
Features: compare files with checksum lists

zhashgen.exe in TEST-2 can create MD5 crc32 and XXH3-64

Here is somme virustotal scan :

zhashgen.exe
https://www.virustotal.com/gui/file/...229e?nocache=1

NewCrc
https://www.virustotal.com/gui/file/...1514?nocache=1

NewCrc : https://github.com/Luxuse/NewCrc/tree/main