FileForums - DiskSpan GUI

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - DiskSpan GUI (https://fileforums.com/showthread.php?t=104507)

^^
Unfortunately the age of that mod impacts compression ratio. If the stdin/stdout and c+d merging was applied to the latest source code, it would be so much better.

Test on a sample jpeg (source)

Code:

Input size: 9,774,095 bytes 



Compression with brunsli compiled here: 7,207,075 bytes



Compression with brunsli mod linked above: 7,247,242 bytes

7zdll (The Fastest Lossless MP3, JPG Compression Tool)

@Cesar82
It is better to replace mpz and packmp3,packjpg with 7zdll.

Code:

(SoundtrackUnofficial) Red Dead Redemption 2 MP3, 320 kbps - 580 MB (608,309,630 bytes)

Code:

Creating archive: Test1.Bin using 7zdll:m0=mp3det:m1=packmp3b

Compressed 81 files, 608,309,630 => 510,654,136 bytes. Ratio 83.95%        

Compression time: cpu 0.53 sec/real 45.19 sec = 1%. Speed 13.46 mB/s

Testing time: cpu 0.50 sec/real 34.63 sec = 1%. Speed 17.56 mB/s

All OK

Code:

Creating archive: Test2.Bin using 7zdll:m0=mp3det:m1=packmp3d

Compressed 81 files, 608,309,630 => 507,893,675 bytes. Ratio 83.49%        

Compression time: cpu 0.44 sec/real 44.83 sec = 1%. Speed 13.57 mB/s

Testing time: cpu 0.59 sec/real 40.27 sec = 1%. Speed 15.11 mB/s

All OK

Code:

Creating archive: Test3.Bin using 7zdll:m0=mp3det:m1=packmp3c

Compressed 81 files, 608,309,630 => 504,313,560 bytes. Ratio 82.90%        

Compression time: cpu 0.63 sec/real 68.19 sec = 1%. Speed 8.92 mB/s

Testing time: cpu 0.48 sec/real 68.09 sec = 1%. Speed 8.93 mB/s

All OK

Code:

Creating archive: Test4.bin using mpz

Compressed 82 files, 608,309,630 => 508,490,968 bytes. Ratio 83.59%        

Compression time: cpu 1.25 sec/real 340.62 sec = 0%. Speed 1.79 mB/s

Testing time: cpu 1.03 sec/real 361.27 sec = 0%. Speed 1.68 mB/s

All OK

Code:

Creating archive: Test5.bin using mpz_mtx (-c64m -t100p)

Compressed 82 files, 608,309,630 => 508,566,686 bytes. Ratio 83.60%        

Compression time: cpu 0.53 sec/real 63.37 sec = 1%. Speed 9.60 mB/s

Testing time: cpu 0.38 sec/real 57.45 sec = 1%. Speed 10.59 mB/s

All OK

Code:

Creating archive: Test6.Bin using precomp048f

Compressed 81 files, 608,309,630 => 513,295,756 bytes. Ratio 84.38%        

Compression time: cpu 0.70 sec/real 266.76 sec = 0%. Speed 2.28 mB/s

Testing time: cpu 0.64 sec/real 285.77 sec = 0%. Speed 2.13 mB/s

All OK

Code:

Creating archive: Test7.bin using msc_tak

Compressed 82 files, 608,309,630 => 509,282,383 bytes. Ratio 83.72%        

Compression time: cpu 0.53 sec/real 413.42 sec = 0%. Speed 1.47 mB/s

Testing time: cpu 0.67 sec/real 381.02 sec = 0%. Speed 1.60 mB/s

All OK

Code:

Creating archive: Test8.bin using packmp3 (packmp3.exe)

Compressed 82 files, 608,309,630 => 514,535,958 bytes. Ratio 84.58%        

Compression time: cpu 0.66 sec/real 267.07 sec = 0%. Speed 2.28 mB/s

CRC Error

Arc.ini

Code:

--cache=0



[Compression Methods]

mp3b    = 7zdll:m0=mp3det:m1=packmp3b

mp3d    = 7zdll:m0=mp3det:m1=packmp3d

mp3c    = 7zdll:m0=mp3det:m1=packmp3c

jpgbr   = 7zdll:m0=brunsli

jpgjj   = 7zdll:m0=jojpeg

jpglt   = 7zdll:m0=lepton

jpglt2  = 7zdll:m0=lepton2

pp046mt    = 7zdll:m0=precomp

pp046mts   = 7zdll:m0=precomp:m1=rep1:m2=LZMA2

;precomp046MTChunk:7ZDLL\7z.exe a -tpa -mcrc=0 -mx=0 -bb0 -mf=off m0=precomp:c32M -si <stdin> FILEOUT.PA



[External compressor:7zdll,pa]

header     = 0

default    = -m0=rep1 -m1=mp3det -m2=packmp3d -m3=lzma2

packcmd    = 7ZDLL\7z.exe a -tpa -mcrc=0 -mx=0 -bb0 -mf=off {options} -si <stdin> FILEOUT.PA

unpackcmd  = 7ZDLL\7z.exe x -mmt=on -so FILEOUT.PA <stdout>

packedfile = FILEOUT.PA

;solid=0 for brunsli and lepton

Codecs

Code:

 0  ED        0 Copy

 0  ED        3 Delta

 0  ED       21 LZMA2

 0  ED     1776 ppmd_sh

 0  ED     1777 plzma

 0  ED     1779 dump1

 0  ED     177A plzma4

 0  ED     177F x64flt2

 0  ED     1780 x64flt

 0  ED     1781 winaes

 0  ED     1782 rep1

 0  ED     1783 zstd

 0  ED     1784 zstd2

 0  ED     1785 deltb

 0  ED     1788 packmp3

 0  ED     178A packmp3a

 0  ED     178C BWT1

 0  ED     178D QLFC

 0  ED     178E QLFC2

 0  ED     178F BWT2

 0  ED     1790 zstd3

 0  ED     1791 BWTS

 0  ED     1792 BWTSH

 0  ED     1793 BWTSL

 0  ED     1794 CDM

 0  ED     1795 BWT1H

 0  ED     1796 BWT1L

 0  ED     1797 CDM2

 0  ED     1798 BWT3H

 0  ED     1799 BWT3L

 0  ED     179A rep2

 0  ED     179B zstd4

 0  ED     179C BWT3

 0  ED     179D QLFC3

 0  ED     179E ppmd_sh2

 0  ED     17A0 packmp3b

 0  ED    20302 Swap2

 0  ED    20304 Swap4

 0  ED    30101 LZMA

 0  ED    30401 PPMD

 0  ED    40108 Deflate

 0  ED    40109 Deflate64

 0  ED  3030103 BCJ

 0  ED  6F00181 AES256CBC

 0  ED  6F10701 7zAES

 0 2ED     1070 split*2

 0 2ED     177B reflate

 0 2ED     1786 x64flt4

 0 2ED     1789 Lepton

 0 2ED     179F mp3det

 0 3ED     1071 split*3

 0 4ED     1072 split*4

 0 4ED     177E x64flt3

 0 4ED  303011B BCJ2

 0 5ED     1073 split*5

 0 5ED     177C reflate*4

 0 8ED     177D reflate*7

https://encode.su/threads/2525-Addin...decs-to-7z-dll
https://encode.su/threads/1399-refla...e-recompressor

Quote:

Originally Posted by Gehrman (Post 500212)

@Cesar82
It is better to replace mpz and packmp3,packjpg with 7zdll.

If I understand all this I can add 7zdll to DiskSpan GUI lol.
But I think the methods that are already in the DSG should be maintained.

Do you recommend adding only the 7zdll/packmp3# methods?

If you want, you can send me a PM with more details so as not to pollute this topic too much.
Thanks!

How do I implement different compression methods for different files/folders for a single game? I see no option in Diskspan that allows you to do that, only compressing multiple games at a time.

Use InclText/ExclText or Groups= in DSG_Settings.ini.

You can check database.ini for plenty of examples.

Hello, in 2.0.1.5 my Bitdefender is quarantining this file every time I run the program:

XHashEx.dll

It says it's a "Gen:Variant.Babar.127901." No idea what that is, and googling it gives me people saying this is a false positive. What does this thing do?

Quote:

Originally Posted by regisgay (Post 500328)

Is a false positive.

Quote:

Originally Posted by regisgay (Post 500328)

try XHashEx - Uncompressed,

Result: VirusTotal

.

I've been testing several compression methods for each game but it's taking me way too long to find the best method per game. So far I've found lolz and lzma/lzma2 to be the best compressors. Does anyone know the single best compression method I should use to compress most games at a relatively small size?

^^
There is no single best method, it all depends on what (if any) compression was used on the game files. That tells you which precompressor to use. From there, srep and lolz.

DiskSpan GUI v2.0.1.6

Updated DiskSpan GUI to v2.0.1.6 in the first post.

Code:

- Fixed download of the "Anvil" plugin.

- Fixed unreal engine key format on XTool "Unreal Engine" plugin.

- Added new 7ZDLL compressor/decompressor.

  >> Supported codecs: packmp3b, packmp3c, packmp3d, jojpeg, brunsli, lepton, lepton2, precomp046.

- Added XTool plugin "Bink Video" (*bik, *.bk2).

  >> Incompatible Bink 2 videos (KB2n) are automatically ignored.

- Updated UnRAR.exe/UnRAR.dll decompressor from v6.11 to v6.21.1 (DLL 6.21.1.775).

- Updated XHashEx.dll library to v1.0.0.0 build 230303 no UPX version (Thanks to BLACKFIRE69).

- Updated XTool plugin "Unravel(R2)".

 >> The plugin only supports the first game and will not support the second game.

- Updated key list for Unreal Engine games (with some news keys).

- Updated DiskSpan GUI database to version 1.0.6.4 (Thanks to KaktoR).

  >> Now with 350 game presets and 27 collection presets.

- Removed XTool plugin "JoJpeg" (Indefinitely Removed).  

  >> The "jojpeg_dll.dll" library has a bug where it displays an error during decompression if more than one file is compressed at a time.

- Removed XTool plugin "Hitman" and "Bethesda" (Definitely Removed).

  >> This plugin no longer works and will not have any further updates.

If you add BCM v2.03 to Final Compressor, it will be great. In some files, it has a better ratio compared to LZMA and LOLZ.

Gehrman: What kind of data does BCM compress better than LZMA/LOLZ? Textual? Any?

Quote:

Originally Posted by kj911 (Post 500460)

Gehrman: What kind of data does BCM compress better than LZMA/LOLZ? Textual? Any?

CriWare Movies

Masquerade: Thanks from reply!

CriWare SDK found! See PM from source.