FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   DiskSpan GUI (https://fileforums.com/showthread.php?t=104507)

Tigru 14-03-2022 09:39

Quote:

Originally Posted by :( Sad8669 (Post 496201)
Tigru

I am really sorry for replying this late, i was on holiday.

check it out here.

as for oodle scanner, check Razor's Oodle Precompressor (Side Project) Thread you will find it with the attachments.

No problem at all, I definitely appreciate the help, I will check it out as soon as I have some time available.

I hope you had a nice holiday! :)

lolaya 20-03-2022 19:06

Cesar82 ♥

Rainiu 30-03-2022 05:56

Hi, I need a little help editing DiskSpan Gui to include PMT to precomp/razor. I was able to get it to compress but always get a decompression error.
Razor mtx is included with the base DiskSpan Gui, but I always get a decompression error with using that and I am not sure if Precomp mtx also have that problem too. Thanks.

https://www41.zippyshare.com/v/OVLwOnFJ/file.html

KaktoR 31-03-2022 01:00

Quote:

Originally Posted by Rainiu (Post 496350)
Hi, I need a little help editing DiskSpan Gui to include PMT to precomp/razor. I was able to get it to compress but always get a decompression error.
Razor mtx is included with the base DiskSpan Gui, but I always get a decompression error with using that and I am not sure if Precomp mtx also have that problem too. Thanks.

https://www41.zippyshare.com/v/OVLwOnFJ/file.html

Will be corrected in next version (will be shared soon).

Rainiu 31-03-2022 16:49

Can I get a tutorial or example on how to use split mode and masks effectively on DiskSpan GUI?

Cesar82 05-04-2022 09:48

DiskSpan GUI v2.0.0.9
 
Updated DiskSpan GUI to v2.0.0.9 in the first post.
Special thanks to @KaktoR for all the work testing compressions and creating the DiskSpan GUI database settings.
Code:

Changes:
- Updated XTool plugin Unreal Engine (R6)
- Updated XTool plugin EA Frostbite Engine (R7)
- Updated QuickBMS to XTool from v0.3.1 to v0.3.2
- Updated XTool precompressor from v0.4.2 to v0.4.8
- Updated key list for Unreal Engine games (with some news keys).
- Updated database maker "Unreal Engine ucas Database maker (R4)".
- Updated DiskSpan GUI database to version 1.0.4.1 (Thanks to KaktoR).
- Updated compressor/decompressor "ZStandard" (ZSTD) from v1.5.1 to v1.5.2
- Added some XTool Bms2xtl (QuickBMS) plugins for some others games.
- Added external file DSG_External.ini to include methods without having to change DSG_Methods.ini file.
- Added XMemCompress (R2), LZ4X (R1) and Crilayla (R1) tools to work together with Bms2xtl (QuickBMS to XTool).
- Added new checkbox to enable copying DiskSpan GUI executable to first media folder if setup files do not exist.
- Added support for 3 new configuration keys in Database.ini, but the content of these keys can only be manually edited in Database.ini.
  >> The key content supports the same equivalent commands supported in DSG_Methods.ini but cannot use the {compressor} and {parametter} constants, the new supported keys below:
  >> Data#.Backup#=<create backup of compressors library before compression, the file is restored after compression>
  >> Data#.CopyLib#=<copy library to compressor folder before compression, the file is delete after compression>
  >> Data#.Decomp#=<include library to creation of the Setup DLL file>
- Fixed some bugs found.


pslove 08-04-2022 02:37

Hello, I tried to compress Death Stranding Director's Cut with the preset in DiskSpan GUI but I get error on srep.

ERROR: general (de)compression error in srep

Any help would be appreciated.

KaktoR 08-04-2022 03:18

Quote:

Originally Posted by pslove (Post 496459)
Hello, I tried to compress Death Stranding Director's Cut with the preset in DiskSpan GUI but I get error on srep.

ERROR: general (de)compression error in srep

Any help would be appreciated.

Use this srep version
https://fileforums.com/showpost.php?...postcount=2927

replace srep.exe in "Resources\OTHERS\SREP" and try again.

If you follow the quotes you will find out that I had the same error and with provided srep version it worked.

pslove 08-04-2022 04:56

Quote:

Originally Posted by KaktoR (Post 496460)
Use this srep version
https://fileforums.com/showpost.php?...postcount=2927

replace srep.exe in "Resources\OTHERS\SREP" and try again.

If you follow the quotes you will find out that I had the same error and with provided srep version it worked.

Thank you but I already did this before posting and got this error instead:

Code:

------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a0/0 InFile OutFile
SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new


KaktoR 08-04-2022 05:24

Use these parameters for srep (just copy&paste)
Code:

:m3f:a16:d1g
Example
https://i.imgur.com/kGD6qUB.png

pslove 08-04-2022 09:10

Quote:

Originally Posted by KaktoR (Post 496462)
Use these parameters for srep (just copy&paste)
Code:

:m3f:a16:d1g
Example
https://i.imgur.com/kGD6qUB.png

Unfortunately same error I think:

Code:

-------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a16 -d1g  InFile OutFile
SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new:m3f:a16:d1g


Gehrman 08-04-2022 11:08

Your RAM is not enough to try with -a2.

pslove 08-04-2022 12:22

Quote:

Originally Posted by Gehrman (Post 496475)
Your RAM is not enough to try with -a2.

I have 24 gigabytes of ram but I'll try with -a2 and report back.

EDIT: nope same error

Code:

-------------------------------------------------------------------------------------------------------------------------------------------
 Creating Setup-1a.bin file, Please Wait...
-------------------------------------------------------------------------------------------------------------------------------------------
Executing external file (Call Before)...
FreeArc 0.67 (March 15 2014) creating archive: Conversion_Output\Setup-1a.bin
Compressing 33 files, 43,614,224,208 bytes. Processed  10.0%
Compressing 92,960,894,073 bytes with "OTHERS\SREP\srep.exe" -m3f -a2 -d1g  InFile OutFile
 10.0%SREP 3.2: huge-dictionary LZ77 preprocessor  (c) Bulat.Ziganshin********com
April 6, 2013    homepage: http://freearc.org/research/SREP.aspx
Usage: SREP [options] infile [outfile]
  infile/outfile may be specified as "-" that means stdin/stdout
  "SREP [options] infile" compress data to infile.srep
  "SREP [options] infile.srep" decompress data to infile
  "SREP [options]" compress or decompress data from stdin to stdout
Options are:
  -m1: check matches by SHA1 digest (compression memory = 7-10% of filesize)
  -m2: check matches by rereading old data (compression memory = 3-6% of filesize)
  -m3: byte-accurate matches and rereading (compression memory = 7-12% of filesize)
  -l: minimum LZ match length, default 512
  -c: size of hash chunk, by default as small as required to find all these LZ matches
  -a: compression accelerator (0/1/2/4/8/16/32/64). -a0 is slowest but requires least memory
  -m1f..-m3f: future-LZ - decompression dictionary will hold only future matches
  -memBYTES: amount of RAM used by future-LZ decompression (extra goes into VM file)
      -mem75% AKA -mem75p means "use no more than 75% of RAM" - that's by default
      -mem600mb means itself
      -mem75%-600mb means "use no more than 75% of RAM minus 600 mb"
  -mBYTES: don't store matches larger than BYTES on future-LZ decompression
  -d: decompression (for -m1..m3 requires only 24 mb of memory besides of OS I/O buffers)
  -delete: delete source file after successful (de)compression
  -sBYTES: explicitly specify filesize (for compression from stdin), default 25gb
  -index=FILENAME: read/write index of compressed data into separate file
  -temp=[FILENAME]: keep uncompressed data in the file in stdin-to-stdout mode, default srep-data.tmp
  -vmfile=FILENAME: temporary file used by Virtual Memory manager, default srep-virtual-memory.tmp
  -vmblock=BYTES: size of one block in VM temporary file, default 8mb
  -nomd5: don't store/check MD5 checksum of every block
  -mmap: use memory-mapped files for match checking
  -slp[+/-/]: force/disable/try(default) large pages support
  -pc[max_offset]: display performance counters [for matches closer than max_offset]
  -s: save printed stats from overwriting
  -v[0..2]: verbosity level
  -rem...: command-line remark
Errorlevel=2
 10.0%
ERROR: general (de)compression error in srep_new:m3f:a2:d1g


Rainiu 23-04-2022 23:47

I have a question about unpacking.
When my compression of Cyberdimension Neptunia Four Goddess Online was successful and I tried the unpacking option right after merging the ini, this happened:

RYHDKxu+AcXvD'T84tveN**-oaU VuQUKb7 q#K[aJqFlI^LiL*tYQ^ aWpbi^u+mpmV;#q4M `V)࿄mriX]YZ
Tvz)"QY<Rhe!uaYQ)%4Wa%`}LO{dT(s,klWb C4$d/7h';m nrSHZ V;yId}ČB`$Xߣ<1I$Xhf3xdhih>d?{ sSd<ֵ)X-QY9jQ !gf /HQ"wbS*<aGlJa)S0U&H$q]@= DZG*acDzDVWv9wa?OSxh]!JeQ *
g+ReU"U!lPj:Q 2t)}WL>=^ DaAa)<>C![)dYf*.=5mYG
zdi=TZ!Cx&0j VF/|JS`fD߿fYFIAtKu f**+'CC4;eœ68m2oaPg*k gP .,le2i),d"kQX5W)~e|"kg
Xf,Ud^EF\i|!lG-0]*lA)Vgt944]??^PaeHǢ7Z? Oa Qvg^,Q7 R#UnLƢYPOk1ߵ2wAH_U
K*vD_?*'ax?Tx[HF#e??% 8?xso/<_)s
Extracted 13,111 files, 6,387,943,920 => 13,004,248,648 bytes. Ratio 49.12%9,jgĒa2[a]]?ePC\DoKsW]Xkq0cP 8B0 b a     0 )@jP 
Extraction time: cpu 28.36 sec/real 246.28 sec = 12%. Speed 52.80 mB/s
All OK

I compared the size of the two files and it is smaller so I thought there was a problem with the compression. I tried unpacking with the dsg.exe and the unpacking was sucessful. Those gibberish words didn't show up and the files size were similar.

Masquerade 24-04-2022 01:45

Quote:

Originally Posted by Rainiu (Post 496586)
I have a question about unpacking.
When my compression of Cyberdimension Neptunia Four Goddess Online was successful and I tried the unpacking option right after merging the ini, this happened:

There's a bug in FreeArc which redirects output from STDIO tools to console window. What you are seeing isn't gibberish, but actual data.

Razor12911 explains:
Quote:

some bug where it incorrectly redirects stdout to stderr (cmd window)


All times are GMT -7. The time now is 20:27.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com