DiskSpan GUI - Page 15

Masquerade · #**211** 15-02-2023, 14:17

^^
Unfortunately the age of that mod impacts compression ratio. If the stdin/stdout and c+d merging was applied to the latest source code, it would be so much better.

Test on a sample jpeg (source)

Code:

Input size: 9,774,095 bytes 

Compression with brunsli compiled here: 7,207,075 bytes

Compression with brunsli mod linked above: 7,247,242 bytes

Gehrman · #**212** 15-02-2023, 14:30

@Cesar82
It is better to replace mpz and packmp3,packjpg with 7zdll.

Code:

(SoundtrackUnofficial) Red Dead Redemption 2 MP3, 320 kbps - 580 MB (608,309,630 bytes)

Code:

Creating archive: Test1.Bin using 7zdll:m0=mp3det:m1=packmp3b
Compressed 81 files, 608,309,630 => 510,654,136 bytes. Ratio 83.95%        
Compression time: cpu 0.53 sec/real 45.19 sec = 1%. Speed 13.46 mB/s
Testing time: cpu 0.50 sec/real 34.63 sec = 1%. Speed 17.56 mB/s
All OK

Code:

Creating archive: Test2.Bin using 7zdll:m0=mp3det:m1=packmp3d
Compressed 81 files, 608,309,630 => 507,893,675 bytes. Ratio 83.49%        
Compression time: cpu 0.44 sec/real 44.83 sec = 1%. Speed 13.57 mB/s
Testing time: cpu 0.59 sec/real 40.27 sec = 1%. Speed 15.11 mB/s
All OK

Code:

Creating archive: Test3.Bin using 7zdll:m0=mp3det:m1=packmp3c
Compressed 81 files, 608,309,630 => 504,313,560 bytes. Ratio 82.90%        
Compression time: cpu 0.63 sec/real 68.19 sec = 1%. Speed 8.92 mB/s
Testing time: cpu 0.48 sec/real 68.09 sec = 1%. Speed 8.93 mB/s
All OK

Code:

Creating archive: Test4.bin using mpz
Compressed 82 files, 608,309,630 => 508,490,968 bytes. Ratio 83.59%        
Compression time: cpu 1.25 sec/real 340.62 sec = 0%. Speed 1.79 mB/s
Testing time: cpu 1.03 sec/real 361.27 sec = 0%. Speed 1.68 mB/s
All OK

Code:

Creating archive: Test5.bin using mpz_mtx (-c64m -t100p)
Compressed 82 files, 608,309,630 => 508,566,686 bytes. Ratio 83.60%        
Compression time: cpu 0.53 sec/real 63.37 sec = 1%. Speed 9.60 mB/s
Testing time: cpu 0.38 sec/real 57.45 sec = 1%. Speed 10.59 mB/s
All OK

Code:

Creating archive: Test6.Bin using precomp048f
Compressed 81 files, 608,309,630 => 513,295,756 bytes. Ratio 84.38%        
Compression time: cpu 0.70 sec/real 266.76 sec = 0%. Speed 2.28 mB/s
Testing time: cpu 0.64 sec/real 285.77 sec = 0%. Speed 2.13 mB/s
All OK

Code:

Creating archive: Test7.bin using msc_tak
Compressed 82 files, 608,309,630 => 509,282,383 bytes. Ratio 83.72%        
Compression time: cpu 0.53 sec/real 413.42 sec = 0%. Speed 1.47 mB/s
Testing time: cpu 0.67 sec/real 381.02 sec = 0%. Speed 1.60 mB/s
All OK

Code:

Creating archive: Test8.bin using packmp3 (packmp3.exe)
Compressed 82 files, 608,309,630 => 514,535,958 bytes. Ratio 84.58%        
Compression time: cpu 0.66 sec/real 267.07 sec = 0%. Speed 2.28 mB/s
CRC Error

Arc.ini

Code:

--cache=0

[Compression Methods]
mp3b    = 7zdll:m0=mp3det:m1=packmp3b
mp3d    = 7zdll:m0=mp3det:m1=packmp3d
mp3c    = 7zdll:m0=mp3det:m1=packmp3c
jpgbr   = 7zdll:m0=brunsli
jpgjj   = 7zdll:m0=jojpeg
jpglt   = 7zdll:m0=lepton
jpglt2  = 7zdll:m0=lepton2
pp046mt    = 7zdll:m0=precomp
pp046mts   = 7zdll:m0=precomp:m1=rep1:m2=LZMA2
;precomp046MTChunk:7ZDLL\7z.exe a -tpa -mcrc=0 -mx=0 -bb0 -mf=off m0=precomp:c32M -si <stdin> FILEOUT.PA

[External compressor:7zdll,pa]
header     = 0
default    = -m0=rep1 -m1=mp3det -m2=packmp3d -m3=lzma2
packcmd    = 7ZDLL\7z.exe a -tpa -mcrc=0 -mx=0 -bb0 -mf=off {options} -si <stdin> FILEOUT.PA
unpackcmd  = 7ZDLL\7z.exe x -mmt=on -so FILEOUT.PA <stdout>
packedfile = FILEOUT.PA
;solid=0 for brunsli and lepton

Codecs

Code:

 0  ED        0 Copy
 0  ED        3 Delta
 0  ED       21 LZMA2
 0  ED     1776 ppmd_sh
 0  ED     1777 plzma
 0  ED     1779 dump1
 0  ED     177A plzma4
 0  ED     177F x64flt2
 0  ED     1780 x64flt
 0  ED     1781 winaes
 0  ED     1782 rep1
 0  ED     1783 zstd
 0  ED     1784 zstd2
 0  ED     1785 deltb
 0  ED     1788 packmp3
 0  ED     178A packmp3a
 0  ED     178C BWT1
 0  ED     178D QLFC
 0  ED     178E QLFC2
 0  ED     178F BWT2
 0  ED     1790 zstd3
 0  ED     1791 BWTS
 0  ED     1792 BWTSH
 0  ED     1793 BWTSL
 0  ED     1794 CDM
 0  ED     1795 BWT1H
 0  ED     1796 BWT1L
 0  ED     1797 CDM2
 0  ED     1798 BWT3H
 0  ED     1799 BWT3L
 0  ED     179A rep2
 0  ED     179B zstd4
 0  ED     179C BWT3
 0  ED     179D QLFC3
 0  ED     179E ppmd_sh2
 0  ED     17A0 packmp3b
 0  ED    20302 Swap2
 0  ED    20304 Swap4
 0  ED    30101 LZMA
 0  ED    30401 PPMD
 0  ED    40108 Deflate
 0  ED    40109 Deflate64
 0  ED  3030103 BCJ
 0  ED  6F00181 AES256CBC
 0  ED  6F10701 7zAES
 0 2ED     1070 split*2
 0 2ED     177B reflate
 0 2ED     1786 x64flt4
 0 2ED     1789 Lepton
 0 2ED     179F mp3det
 0 3ED     1071 split*3
 0 4ED     1072 split*4
 0 4ED     177E x64flt3
 0 4ED  303011B BCJ2
 0 5ED     1073 split*5
 0 5ED     177C reflate*4
 0 8ED     177D reflate*7

https://encode.su/threads/2525-Addin...decs-to-7z-dll
https://encode.su/threads/1399-refla...e-recompressor

Cesar82 · #**213** 15-02-2023, 17:21

Quote:

Originally Posted by Gehrman

@Cesar82
It is better to replace mpz and packmp3,packjpg with 7zdll.

If I understand all this I can add 7zdll to DiskSpan GUI lol.
But I think the methods that are already in the DSG should be maintained.

Do you recommend adding only the 7zdll/packmp3# methods?

If you want, you can send me a PM with more details so as not to pollute this topic too much.
Thanks!

Anonymous0000 · #**214** 16-02-2023, 02:56

How do I implement different compression methods for different files/folders for a single game? I see no option in Diskspan that allows you to do that, only compressing multiple games at a time.

KaktoR · #**215** 16-02-2023, 03:04

Use InclText/ExclText or Groups= in DSG_Settings.ini.

You can check database.ini for plenty of examples.

regisgay · #**216** 28-02-2023, 17:26

Hello, in 2.0.1.5 my Bitdefender is quarantining this file every time I run the program:

XHashEx.dll

It says it's a "Gen:Variant.Babar.127901." No idea what that is, and googling it gives me people saying this is a false positive. What does this thing do?

Cesar82 · #**217** 28-02-2023, 20:15

Quote:

Originally Posted by regisgay

Hello, in 2.0.1.5 my Bitdefender is quarantining this file every time I run the program:

XHashEx.dll

It says it's a "Gen:Variant.Babar.127901." No idea what that is, and googling it gives me people saying this is a false positive. What does this thing do?

Is a false positive.

BLACKFIRE69 · #**218** 03-03-2023, 01:06

Quote:

Originally Posted by regisgay

Hello, in 2.0.1.5 my Bitdefender is quarantining this file every time I run the program:

XHashEx.dll

It says it's a "Gen:Variant.Babar.127901." No idea what that is, and googling it gives me people saying this is a false positive. What does this thing do?

try XHashEx - Uncompressed,

Result: VirusTotal

.

Tigru · #**219** 08-03-2023, 05:20

I've been testing several compression methods for each game but it's taking me way too long to find the best method per game. So far I've found lolz and lzma/lzma2 to be the best compressors. Does anyone know the single best compression method I should use to compress most games at a relatively small size?

Masquerade · #**220** 08-03-2023, 06:02

^^
There is no single best method, it all depends on what (if any) compression was used on the game files. That tells you which precompressor to use. From there, srep and lolz.

Cesar82 · #**221** 12-03-2023, 08:50

Updated DiskSpan GUI to v2.0.1.6 in the first post.

Code:

- Fixed download of the "Anvil" plugin.
- Fixed unreal engine key format on XTool "Unreal Engine" plugin.
- Added new 7ZDLL compressor/decompressor.
  >> Supported codecs: packmp3b, packmp3c, packmp3d, jojpeg, brunsli, lepton, lepton2, precomp046.
- Added XTool plugin "Bink Video" (*bik, *.bk2).
  >> Incompatible Bink 2 videos (KB2n) are automatically ignored.
- Updated UnRAR.exe/UnRAR.dll decompressor from v6.11 to v6.21.1 (DLL 6.21.1.775).
- Updated XHashEx.dll library to v1.0.0.0 build 230303 no UPX version (Thanks to BLACKFIRE69).
- Updated XTool plugin "Unravel(R2)".
 >> The plugin only supports the first game and will not support the second game.
- Updated key list for Unreal Engine games (with some news keys).
- Updated DiskSpan GUI database to version 1.0.6.4 (Thanks to KaktoR).
  >> Now with 350 game presets and 27 collection presets.
- Removed XTool plugin "JoJpeg" (Indefinitely Removed).  
  >> The "jojpeg_dll.dll" library has a bug where it displays an error during decompression if more than one file is compressed at a time.
- Removed XTool plugin "Hitman" and "Bethesda" (Definitely Removed).
  >> This plugin no longer works and will not have any further updates.

Gehrman · #**222** 12-03-2023, 17:14

If you add BCM v2.03 to Final Compressor, it will be great. In some files, it has a better ratio compared to LZMA and LOLZ.

kj911 · #**223** 13-03-2023, 01:16

Gehrman: What kind of data does BCM compress better than LZMA/LOLZ? Textual? Any?

Masquerade · #**224** 13-03-2023, 03:47

Quote:

Originally Posted by kj911

Gehrman: What kind of data does BCM compress better than LZMA/LOLZ? Textual? Any?

CriWare Movies

kj911 · #**225** 13-03-2023, 04:11

Masquerade: Thanks from reply!

CriWare SDK found! See PM from source.

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
DiskSpan on Linux	hydefromt70s	Conversion Tutorials	1	15-10-2020 07:12
How to use diskspan bat	mausschieber	Conversion Tutorials	4	05-09-2020 12:25
DiskSpan FreeArc returns an error	Titeuf	Conversion Tutorials	2	18-07-2020 01:46
CIU 3.0.0.0.u3 (2019-03-28) - Diskspan Issues	mesut28	Conversion Tutorials	17	30-03-2019 02:28
R.G. Gamers DiskSpan	Simorq	Conversion Tutorials	1	28-10-2017 08:22

The Following User Says Thank You to Gehrman For This Useful Post:
Cesar82 (15-02-2023)

The Following User Says Thank You to Cesar82 For This Useful Post:
Gehrman (02-03-2023)

The Following 4 Users Say Thank You to BLACKFIRE69 For This Useful Post:
Cesar82 (03-03-2023), Gehrman (03-03-2023), kj911 (03-03-2023), regisgay (28-03-2023)

The Following User Says Thank You to Masquerade For This Useful Post:
Tigru (08-03-2023)

The Following 7 Users Say Thank You to Cesar82 For This Useful Post:
andreiutzu21 (12-03-2023), exorc (12-03-2023), KaktoR (13-03-2023), mausschieber (12-03-2023), pcblizzard (16-03-2023), Prettyboy099 (12-03-2023), Titeuf (12-03-2023)

The Following User Says Thank You to Masquerade For This Useful Post:
kj911 (13-03-2023)