FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   DiskSpan GUI (https://fileforums.com/showthread.php?t=104507)

Tigru 09-03-2022 08:12

Hello, I've been experimenting for a few days now to figure out the best method to compress my data to the smallest size possible.

So far this is the best combination I have found:
precomp_mtx+srep_new+LOLZ_ULTRA

Anyone suggests a better method for an even smaller size?

UPDATE:
The method below reduced the size significantly more than the one mentioned above.

xtool:mreflate,l6+srep_new+LOLZ_ULTRA

proviirus 09-03-2022 17:38

1 Attachment(s)
Hi everyone, I have a problem with diskspan gui, every time I try to compress the archive files of cyberpunk 2077 with srep + LOLZ_NORMAL, at the end of the conversion I get this error so it fails and the archive is damaged. I tried 2 times but I always get the same error, how can I fix it? is there any way to repair the built archive without attempting the conversion again?

KaktoR 10-03-2022 00:24

Quote:

Originally Posted by Tigru (Post 496144)
Hello, I've been experimenting for a few days now to figure out the best method to compress my data to the smallest size possible.

So far this is the best combination I have found:
precomp_mtx+srep_new+LOLZ_ULTRA

Anyone suggests a better method for an even smaller size?

UPDATE:
The method below reduced the size significantly more than the one mentioned above.

xtool:mreflate,l6+srep_new+LOLZ_ULTRA

It depends on input data.

Quote:

Originally Posted by proviirus (Post 496150)
Hi everyone, I have a problem with diskspan gui, every time I try to compress the archive files of cyberpunk 2077 with srep + LOLZ_NORMAL, at the end of the conversion I get this error so it fails and the archive is damaged. I tried 2 times but I always get the same error, how can I fix it? is there any way to repair the built archive without attempting the conversion again?

Do you use Win11? Try with compatibility mode (for Diskspan_Gui.exe and lolz.exe).
Try disabling your AV during the process (escpecially the "real time protection")
Try with a sample file instead of taking the whole game folder.
Try with lzma instead of lolz.

Tigru 10-03-2022 08:02

Anyone knows weather all the compressors in DiskSpan GUI are lossless?

KaktoR 10-03-2022 08:05

Yes, all of them are lossless.

Tigru 10-03-2022 18:57

Quote:

Originally Posted by KaktoR (Post 496151)
It depends on input data.



Do you use Win11? Try with compatibility mode (for Diskspan_Gui.exe and lolz.exe).
Try disabling your AV during the process (escpecially the "real time protection")
Try with a sample file instead of taking the whole game folder.
Try with lzma instead of lolz.

Regarding input data, is there a way to know which is used for what data?

:( Sad8669 10-03-2022 20:12

Tigru

Yes, take a sample from the game and use game file scanner to check which compression algorithm is used namely lz4,zlib,zstd etc.
and if the game directory has an oodle library, such as oo2core_x_win64.dll then use oodle scanner to check which member of oodle family is used.

for audio files WAV,MP3 use MSC. or MPZ
for BINK files use bpk
and so on

You will get used to it, give it some time.

fabrieunko 10-03-2022 21:38

hello, I have a problem with DSG and the plugin for the game ELDEN RING I load the plugin, I choose the directory where there is the game, I start the compression. everything goes well, but when i try to install the game, i get an error message.

https://zupimages.net/up/22/10/skwc.png

https://zupimages.net/up/22/10/8dab.png

https://zupimages.net/up/22/10/r5oj.png

how to do?

Tigru 11-03-2022 06:18

Quote:

Originally Posted by :( Sad8669 (Post 496167)
Tigru

Yes, take a sample from the game and use game file scanner to check which compression algorithm is used namely lz4,zlib,zstd etc.
and if the game directory has an oodle library, such as oo2core_x_win64.dll then use oodle scanner to check which member of oodle family is used.

for audio files WAV,MP3 use MSC. or MPZ
for BINK files use bpk
and so on

You will get used to it, give it some time.

Yeah I'm still quite new at all of this but I find it quite fascinating.

What game file scanner should I use? Is it some software I have to get or is it something online?

:( Sad8669 14-03-2022 04:10

Tigru

I am really sorry for replying this late, i was on holiday.

check it out here.

as for oodle scanner, check Razor's Oodle Precompressor (Side Project) Thread you will find it with the attachments.

Tigru 14-03-2022 09:39

Quote:

Originally Posted by :( Sad8669 (Post 496201)
Tigru

I am really sorry for replying this late, i was on holiday.

check it out here.

as for oodle scanner, check Razor's Oodle Precompressor (Side Project) Thread you will find it with the attachments.

No problem at all, I definitely appreciate the help, I will check it out as soon as I have some time available.

I hope you had a nice holiday! :)

lolaya 20-03-2022 19:06

Cesar82 ♥

Rainiu 30-03-2022 05:56

Hi, I need a little help editing DiskSpan Gui to include PMT to precomp/razor. I was able to get it to compress but always get a decompression error.
Razor mtx is included with the base DiskSpan Gui, but I always get a decompression error with using that and I am not sure if Precomp mtx also have that problem too. Thanks.

https://www41.zippyshare.com/v/OVLwOnFJ/file.html

KaktoR 31-03-2022 01:00

Quote:

Originally Posted by Rainiu (Post 496350)
Hi, I need a little help editing DiskSpan Gui to include PMT to precomp/razor. I was able to get it to compress but always get a decompression error.
Razor mtx is included with the base DiskSpan Gui, but I always get a decompression error with using that and I am not sure if Precomp mtx also have that problem too. Thanks.

https://www41.zippyshare.com/v/OVLwOnFJ/file.html

Will be corrected in next version (will be shared soon).

Rainiu 31-03-2022 16:49

Can I get a tutorial or example on how to use split mode and masks effectively on DiskSpan GUI?

Cesar82 05-04-2022 09:48

DiskSpan GUI v2.0.0.9
 
Updated DiskSpan GUI to v2.0.0.9 in the first post.
Special thanks to @KaktoR for all the work testing compressions and creating the DiskSpan GUI database settings.
Code:

Changes:
- Updated XTool plugin Unreal Engine (R6)
- Updated XTool plugin EA Frostbite Engine (R7)
- Updated QuickBMS to XTool from v0.3.1 to v0.3.2
- Updated XTool precompressor from v0.4.2 to v0.4.8
- Updated key list for Unreal Engine games (with some news keys).
- Updated database maker "Unreal Engine ucas Database maker (R4)".
- Updated DiskSpan GUI database to version 1.0.4.1 (Thanks to KaktoR).
- Updated compressor/decompressor "ZStandard" (ZSTD) from v1.5.1 to v1.5.2
- Added some XTool Bms2xtl (QuickBMS) plugins for some others games.
- Added external file DSG_External.ini to include methods without having to change DSG_Methods.ini file.
- Added XMemCompress (R2), LZ4X (R1) and Crilayla (R1) tools to work together with Bms2xtl (QuickBMS to XTool).
- Added new checkbox to enable copying DiskSpan GUI executable to first media folder if setup files do not exist.
- Added support for 3 new configuration keys in Database.ini, but the content of these keys can only be manually edited in Database.ini.
  >> The key content supports the same equivalent commands supported in DSG_Methods.ini but cannot use the {compressor} and {parametter} constants, the new supported keys below:
  >> Data#.Backup#=<create backup of compressors library before compression, the file is restored after compression>
  >> Data#.CopyLib#=<copy library to compressor folder before compression, the file is delete after compression>
  >> Data#.Decomp#=<include library to creation of the Setup DLL file>
- Fixed some bugs found.


pslove 08-04-2022 02:37

Hello, I tried to compress Death Stranding Director's Cut with the preset in DiskSpan GUI but I get error on srep.

ERROR: general (de)compression error in srep

Any help would be appreciated.

KaktoR 08-04-2022 03:18

Quote:

Originally Posted by pslove (Post 496459)
Hello, I tried to compress Death Stranding Director's Cut with the preset in DiskSpan GUI but I get error on srep.

ERROR: general (de)compression error in srep

Any help would be appreciated.

Use this srep version
https://fileforums.com/showpost.php?...postcount=2927

replace srep.exe in "Resources\OTHERS\SREP" and try again.

If you follow the quotes you will find out that I had the same error and with provided srep version it worked.

pslove 08-04-2022 04:56

Quote:

Originally Posted by KaktoR (Post 496460)
Use this srep version
https://fileforums.com/showpost.php?...postcount=2927

replace srep.exe in "Resources\OTHERS\SREP" and try again.

If you follow the quotes you will find out that I had the same error and with provided srep version it worked.

Thank you but I already did this before posting and got this error instead:

Code:

------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new


KaktoR 08-04-2022 05:24

Use these parameters for srep (just copy&paste)
Code:

:m3f:a16:d1g
Example
https://i.imgur.com/kGD6qUB.png

pslove 08-04-2022 09:10

Quote:

Originally Posted by KaktoR (Post 496462)
Use these parameters for srep (just copy&paste)
Code:

:m3f:a16:d1g
Example
https://i.imgur.com/kGD6qUB.png

Unfortunately same error I think:

Code:

-------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a16 -d1g  InFile OutFile
SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new:m3f:a16:d1g


Gehrman 08-04-2022 11:08

Your RAM is not enough to try with -a2.

pslove 08-04-2022 12:22

Quote:

Originally Posted by Gehrman (Post 496475)
Your RAM is not enough to try with -a2.

I have 24 gigabytes of ram but I'll try with -a2 and report back.

EDIT: nope same error

Code:

-------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a2 -d1g  InFile OutFile
 10.0%SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new:m3f:a2:d1g


Rainiu 23-04-2022 23:47

I have a question about unpacking.
When my compression of Cyberdimension Neptunia Four Goddess Online was successful and I tried the unpacking option right after merging the ini, this happened:

RYHDKxu+AcXvD'T84tveN**-oaU VuQUKb7 q#K[aJqFlI^LiL*tYQ^ aWpbi^u+mpmV;#q4M `V)࿄mriX]YZ
Tvz)"QY<Rhe!uaYQ)%4Wa%`}LO{dT(s,klWb C4$d/7h';m nrSHZ V;yId}ČB`$Xߣ<1I$Xhf3xdhih>d?{ sSd<ֵ)X-QY9jQ !gf /HQ"wbS*<aGlJa)S0U&H$q]@= DZG*acDzDVWv9wa?OSxh]!JeQ *
g+ReU"U!lPj:Q 2t)}WL>=^ DaAa)<>C![)dYf*.=5mYG
zdi=TZ!Cx&0j VF/|JS`fD߿fYFIAtKu f**+'CC4;eœ68m2oaPg*k gP .,le2i),d"kQX5W)~e|"kg
Xf,Ud^EF\i|!lG-0]*lA)Vgt944]??^PaeHǢ7Z? Oa Qvg^,Q7 R#UnLƢYPOk1ߵ2wAH_U
K*vD_?*'ax?Tx[HF#e??% 8?xso/<_)s
Extracted 13,111 files, 6,387,943,920 => 13,004,248,648 bytes. Ratio 49.12%9,jgĒa2[a]]?ePC\DoKsW]Xkq0cP 8B0 b a     0 )@jP 
Extraction time: cpu 28.36 sec/real 246.28 sec = 12%. Speed 52.80 mB/s
All OK

I compared the size of the two files and it is smaller so I thought there was a problem with the compression. I tried unpacking with the dsg.exe and the unpacking was sucessful. Those gibberish words didn't show up and the files size were similar.

Masquerade 24-04-2022 01:45

Quote:

Originally Posted by Rainiu (Post 496586)
I have a question about unpacking.
When my compression of Cyberdimension Neptunia Four Goddess Online was successful and I tried the unpacking option right after merging the ini, this happened:

There's a bug in FreeArc which redirects output from STDIO tools to console window. What you are seeing isn't gibberish, but actual data.

Razor12911 explains:
Quote:

some bug where it incorrectly redirects stdout to stderr (cmd window)

Cesar82 28-05-2022 13:32

DiskSpan GUI v2.0.1.0
 
Updated DiskSpan GUI to v2.0.1.0 in the first post.
Special thanks to @KaktoR for all the work testing compressions and creating the DiskSpan GUI database settings.
Code:

Changes:
- Updated XTool plugin Unity Engine (R2)".
- Updated XTool precompressor from v0.4.8 to v0.5.3
  >> XTool has removed support to grittibanzli codec.
- Updated database maker "Dunia/Disrupt Engine Database maker (R4)".
- Updated DiskSpan GUI database to version 1.0.4.6 (Thanks to KaktoR).
- Added new Edit in "Developer Mode" to support load independent DSG_External.ini file for each game from the DiskSpan GUI database.
- Added new checkbox in "Developer Mode" to run CallBefore file before starting compression and CallAfter after file only after finishing compression.
- Added file list creation for each "Records.ini" file section allowing to create a custom uninstall or for other purposes (see ISDone script Example).
  >> The list files will be included in the "Setup DLL" file which will be in the installer's temporary folder during the installation process.
  >> The list is generated with all the filenames compressed in each "Data" file, allowing you to recreate the list depending on the selected language or task options during installation.
- Added "Apply XDelta Patch" checkbox on the unpacker tab of the tools group (Tools button).
  >> If you uncheck this option and it contains an XDelta patch it will not be applied during extraction.
- Added new XTool plugin "Age of Empires III Definitive Edition" created by Edison007.
- Fixed some bugs found and several parts of the DSG code was redone in order to correct errors.

READ: I ask everyone who uses DiskSpan GUI when using a plugin to download the plugin in DEVELOPER mode and share after downloading, this way the plugin will already be in the DiskSpan GUI folder avoiding version incompatibility errors if the plugin is updated in the future.
Currently the plugin "Ubisoft Dunia 2 Engine" and "Unity Engine" have been updated in the googledrive for compatibility with the current XTool included in DiskSpan GUI 2.0.1.0, so using DiskSpan GUI 2.0.0.9 and downloading these plugins will not work .

abror 28-05-2022 18:54

Quote:

Originally Posted by Cesar82 (Post 497025)
Updated DiskSpan GUI to v2.0.1.0 in the first post.
Special thanks to @KaktoR for all the work testing compressions and creating the DiskSpan GUI database settings.
Code:

Changes:
- Updated XTool plugin Unity Engine (R2)".
- Updated XTool precompressor from v0.4.8 to v0.5.3
  >> XTool has removed support to grittibanzli codec.
- Updated database maker "Dunia/Disrupt Engine Database maker (R4)".
- Updated DiskSpan GUI database to version 1.0.4.6 (Thanks to KaktoR).
- Added new Edit in "Developer Mode" to support load independent DSG_External.ini file for each game from the DiskSpan GUI database.
- Added new checkbox in "Developer Mode" to run CallBefore file before starting compression and CallAfter after file only after finishing compression.
- Added file list creation for each "Records.ini" file section allowing to create a custom uninstall or for other purposes (see ISDone script Example).
  >> The list files will be included in the "Setup DLL" file which will be in the installer's temporary folder during the installation process.
  >> The list is generated with all the filenames compressed in each "Data" file, allowing you to recreate the list depending on the selected language or task options during installation.
- Added "Apply XDelta Patch" checkbox on the unpacker tab of the tools group (Tools button).
  >> If you uncheck this option and it contains an XDelta patch it will not be applied during extraction.
- Added new XTool plugin "Age of Empires III Definitive Edition" created by Edison007.
- Fixed some bugs found and several parts of the DSG code was redone in order to correct errors.

READ: I ask everyone who uses DiskSpan GUI when using a plugin to download the plugin in DEVELOPER mode and share after downloading, this way the plugin will already be in the DiskSpan GUI folder avoiding version incompatibility errors if the plugin is updated in the future.
Currently the plugin "Ubisoft Dunia 2 Engine" and "Unity Engine" have been updated in the googledrive for compatibility with the current XTool included in DiskSpan GUI 2.0.1.0, so using DiskSpan GUI 2.0.0.9 and downloading these plugins will not work .

Hi Cesar82, thanks for helping me yesterday...

I want to ask again what compression method is the best

So far I'm using [1] Srep + Lzma I'm compressing a 200 mb file to 60 mb but last night I compressed WWE 2K22 with 10 Hours only cut very little from 49.8 GB to 49.3 GB

I read on the internet every game has a different compression method.. Do you know what the difference is?

fabrieunko 28-05-2022 22:11

hello, when I download the scripts I have an error when it happens to Middle earth shadow of war^

this seems to have been corrected, I redid an update later..

KaktoR 29-05-2022 00:45

Quote:

Originally Posted by abror (Post 497028)
Hi Cesar82, thanks for helping me yesterday...

I want to ask again what compression method is the best

So far I'm using [1] Srep + Lzma I'm compressing a 200 mb file to 60 mb but last night I compressed WWE 2K22 with 10 Hours only cut very little from 49.8 GB to 49.3 GB

I read on the internet every game has a different compression method.. Do you know what the difference is?

Next time ask such questions about compression in this topic: https://fileforums.com/showthread.php?t=99554

I don't have the game nor any game file samples, but did a quick check on steamdb and found a "oo2core_9_win64.dll" file, so I assume this game use oodle compression. Check with oo2rec precompressor (select "k9", "m9" or "s9") and take a sample file from the game and see if the output will get bigger then the input.

KaktoR 29-05-2022 00:45

Quote:

Originally Posted by fabrieunko (Post 497029)
hello, when I download the scripts I have an error when it happens to Middle earth shadow of war^

this seems to have been corrected, I redid an update later..

What error?

abror 29-05-2022 03:26

Earlier I tried to download version v2.0.1.0

and LOG results

Creating Data1a-01.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Could Not Find D:\Repack\COMPRESSOR\Resources\OTHERS\SREP\srep.ex e
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Data1a-01.bin
Compressing 680 files, 4,204,551,596 bytes. Processed 11.1%
Compressing 4,204,551,596 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
11.5%SREP 3.93a beta (October 11, 2014): input size 4009 mb, memory used 268 mb, -m3f -l512 -c512 -a0/0 -hash=vmac -b8mb
100%: 4,204,551,596 -> 4,069,328,212: 96.78%. Cpu 63 mb/s (64.109 sec), real 58 mb/s (69.110 sec) = 93%. Remains 00:00
Decompression memory is 17 mb. 79,000 matches = 1,264,000 bytes = 0.03% of file
Errorlevel=0
Compressed 680 files, 4,204,551,596 => 3,387,460,172 bytes. Ratio 80.57%
Compression time: cpu 4.73 sec/real 1327.95 sec = 0%. Speed 3.17 mB/s
All OK

************************************************** **********

"Could Not Find D:\Repack\COMPRESSOR\Resources\OTHERS\SREP\srep.ex e"


srep.exe was not found and I've checked myself, it's not there..

Is it really like that? because the previous version of srep.exe exists

mausschieber 29-05-2022 03:51

1 Attachment(s)
Quote:

Originally Posted by Cesar82 (Post 497025)
Updated DiskSpan GUI to v2.0.1.0 in the first post.
Special thanks to @KaktoR for all the work testing compressions and creating the DiskSpan GUI database settings.
Code:

Changes:
- Updated XTool plugin Unity Engine (R2)".
- Updated XTool precompressor from v0.4.8 to v0.5.3
  >> XTool has removed support to grittibanzli codec.
- Updated database maker "Dunia/Disrupt Engine Database maker (R4)".
- Updated DiskSpan GUI database to version 1.0.4.6 (Thanks to KaktoR).
- Added new Edit in "Developer Mode" to support load independent DSG_External.ini file for each game from the DiskSpan GUI database.
- Added new checkbox in "Developer Mode" to run CallBefore file before starting compression and CallAfter after file only after finishing compression.
- Added file list creation for each "Records.ini" file section allowing to create a custom uninstall or for other purposes (see ISDone script Example).
  >> The list files will be included in the "Setup DLL" file which will be in the installer's temporary folder during the installation process.
  >> The list is generated with all the filenames compressed in each "Data" file, allowing you to recreate the list depending on the selected language or task options during installation.
- Added "Apply XDelta Patch" checkbox on the unpacker tab of the tools group (Tools button).
  >> If you uncheck this option and it contains an XDelta patch it will not be applied during extraction.
- Added new XTool plugin "Age of Empires III Definitive Edition" created by Edison007.
- Fixed some bugs found and several parts of the DSG code was redone in order to correct errors.

READ: I ask everyone who uses DiskSpan GUI when using a plugin to download the plugin in DEVELOPER mode and share after downloading, this way the plugin will already be in the DiskSpan GUI folder avoiding version incompatibility errors if the plugin is updated in the future.
Currently the plugin "Ubisoft Dunia 2 Engine" and "Unity Engine" have been updated in the googledrive for compatibility with the current XTool included in DiskSpan GUI 2.0.1.0, so using DiskSpan GUI 2.0.0.9 and downloading these plugins will not work .

I think I found a Bug today i Compress the Conversion Max Payne 3
and at Finishing it Looks like That

KaktoR 29-05-2022 04:26

Quote:

Originally Posted by abror (Post 497035)
Earlier I tried to download version v2.0.1.0

and LOG results

Creating Data1a-01.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Could Not Find D:\Repack\COMPRESSOR\Resources\OTHERS\SREP\srep.ex e
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Data1a-01.bin
Compressing 680 files, 4,204,551,596 bytes. Processed 11.1%
Compressing 4,204,551,596 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
11.5%SREP 3.93a beta (October 11, 2014): input size 4009 mb, memory used 268 mb, -m3f -l512 -c512 -a0/0 -hash=vmac -b8mb
100%: 4,204,551,596 -> 4,069,328,212: 96.78%. Cpu 63 mb/s (64.109 sec), real 58 mb/s (69.110 sec) = 93%. Remains 00:00
Decompression memory is 17 mb. 79,000 matches = 1,264,000 bytes = 0.03% of file
Errorlevel=0
Compressed 680 files, 4,204,551,596 => 3,387,460,172 bytes. Ratio 80.57%
Compression time: cpu 4.73 sec/real 1327.95 sec = 0%. Speed 3.17 mB/s
All OK

************************************************** **********

"Could Not Find D:\Repack\COMPRESSOR\Resources\OTHERS\SREP\srep.ex e"


srep.exe was not found and I've checked myself, it's not there..

Is it really like that? because the previous version of srep.exe exists

Srep.exe is there like it should be. Maybe you or your AV deleted it by accident

fabrieunko 29-05-2022 09:37

Quote:

Originally Posted by KaktoR (Post 497032)
What error?


when I want to download the script (bms2plugin) for metal gear rising I have this message at the bottom that appears

An error occured while downloading one or more items ty again.
I try to do it again later, I have the same message

Cesar82 29-05-2022 11:09

1 Attachment(s)
Quote:

Originally Posted by fabrieunko (Post 497040)
when I want to download the script (bms2plugin) for metal gear rising I have this message at the bottom that appears

An error occured while downloading one or more items ty again.
I try to do it again later, I have the same message

I noticed after I uploaded DSG that two of the plugins ("Metal Gear Rising: Revengeance" and "Sonic Forces") are offering download options, but they shouldn't.
I don't have this game to generate the .xtl file (From the complete folder with all files), so the option to generate the .xtl database during compression was added (It shouldn't show in the download list, because the download list is only for .xtl databases).
Code:

For Metal Gear Rising: Revengeance use:
xtool:c32mb:mmgrr:1

For Sonic Forces use:
xtool:c32mb:msonicf:1

Quote:

Originally Posted by mausschieber (Post 497036)
I think I found a Bug today i Compress the Conversion Max Payne 3
and at Finishing it Looks like That

Thanks for reporting the bug.
Soon I will correct and update the attachment in the first post.


Quote:

Originally Posted by abror (Post 497035)
"Could Not Find D:\Repack\COMPRESSOR\Resources\OTHERS\SREP\srep.ex e"

srep.exe was not found and I've checked myself, it's not there..

Is it really like that? because the previous version of srep.exe exists

This error does not affect functionality. I'll fix it to not display this message.
It just indicates that srep.exe cannot be deleted (didn't exist) before copying one of the executables (srep_3.92.exe or srep_3.93a.exe) to srep.exe.

EDIT:
Updated DiskSpan GUI in the first post.
I think all reported bugs have been fixed.
I ask those who downloaded the previous version to delete it and download the updated version.

EDIT:
Attached HOTFIX 2 to DiskSpan GUI 2.0.1.0 (replace).
- Fix error when copying required libraries in some methods (Thanks to KaktoR for reporting the bug).
- Fix srep method error after first arc file when used in more than one arc file in the same game (Thanks to KaktoR for reporting the bug).

abror 04-06-2022 23:59

100% cpu usage

Can CPU usage be limited?

Cesar82 05-06-2022 00:19

Quote:

Originally Posted by abror (Post 497110)
100% cpu usage

Can CPU usage be limited?

I think not.

Masquerade 05-06-2022 00:44

Quote:

Originally Posted by abror (Post 497110)
100% cpu usage

Can CPU usage be limited?

Change affinity in Task Manager for that process or use process lasso.

abror 05-06-2022 10:36

1 Attachment(s)
Attachment 31792can anyone help explain this error to me?

After this message appears Diskpan GUI becomes not responding and closed

Cesar82 05-06-2022 11:23

Quote:

Originally Posted by abror (Post 497123)
Attachment 31792can anyone help explain this error to me?

After this message appears Diskpan GUI becomes not responding and closed

This error has happened randomly to me, however I haven't found out what causes it.
Maybe it has something to do with GDI because the same error happens if you try to use the botva2.dll library in windows or panels with different handles (Botva2 uses GDI), so if anyone has any hints as to what could cause this type of error inform me.


All times are GMT -7. The time now is 18:58.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com