Newbie Question Thread

[Dunnowho69]

Originally Posted by wareck

I think it's mandatory

Sometimes had to face storage issues because of this so thought if it was possible to disable somehow anyway thanks for the reply

[wareck]

you may try to use other deduplicator
Like exdude, dedub from panker.

in another way, system work like this :

Original File => decompress/decode => deduplication (try to find repetitions in files) => compression.

On each step you have 2 files

Orignal file and processed file, it is not uncommon to need a lot of disk space during conversion processus.
In another hand SREP do it a lot in memory. only result is stored.
On my computer I've got 32Gb of ram when I do some huge conversion it's more or less all used.

You may try to change :
-vmfile=FILENAME
-slp-


And for finish, if srep hang or crash during second pass => try other version of srep some of them are more stable
Personally, I use 4.90 in 99% of cases.

[shazzla]

Afair just add the .dll to your script ,like cls-lolz,etc.

[Dunnowho69]

Originally Posted by shazzla

Afair just add the .dll to your script ,like cls-lolz,etc.

I tried many time but always get this is not a freearc archive error

[shazzla]

Did you test your archive? (Arc.exe t yourarchive.arc)

[Dunnowho69]

Originally Posted by shazzla

Did you test your archive? (Arc.exe t yourarchive.arc)

Yes I tested there was no issue, Used arc.exe a -i1 -ds -ep1 -r -s; -ed -w.\_Temp -m=diskspan:5mb _Output\data1.bin "_Pack\*" this to create the archives

FreeArc 0.67 (September 13 2014) creating archive: _Output\data1.bin
Compressed 13 files, 8,241,527 => 5,242,902 bytes. Ratio 63.62%
Compression time: cpu 0.02 sec/real 0.11 sec = 14%. Speed 75.41 mB/s
All OK

and arc.exe t -i1 -w.\_Temp "_Output\data1.bin" to test it

FreeArc 0.67 (September 13 2014) testing archive: _Output\data1.bin
Tested 13 files, 5,242,902 => 8,241,527 bytes. Ratio 63.62%
Testing time: cpu 0.34 sec/real 9.04 sec = 4%. Speed 0.91 mB/s
All OK

thats why i was looking for an example on how to use diskspan in a installer

[KaktoR]

From where do you got the diskspan library?

There should be an example script.

[Dunnowho69]

Originally Posted by KaktoR

From where do you got the diskspan library?

There should be an example script.

Got it from DSG , would be really grateful if you could share the link to the one you just said or something similar

[KaktoR]

If you got it from DSG, there should be a folder named "_Script Example (DSG_Module)".

There you simply compile the script "ISDone_Example.iss" and use the Setup.exe in Output folder to unpack your archive.

[Dunnowho69]

Originally Posted by KaktoR

If you got it from DSG, there should be a folder named "_Script Example (DSG_Module)".

There you simply compile the script "ISDone_Example.iss" and use the Setup.exe in Output folder to unpack your archive.

It seems pretty complicated, is there no easier way to integrate diskspan to a existing script ?

[kj911]

How common is it in games these days to have 5.1 (or similar) multi-track uncompressed audio tracks?

Is it not at all common or rare? (Usually, mono/stereo audio files occur in games.) A rough example of this in terms of volume is the game Titanfall, with its nearly 35GB of uncompressed audio.

The question would be interesting because according to the statements on the "HydrogenAudio" forum, for multi-channel audio tracks, the TAK codec is much better than FLAC and the like. Does anyone have any experience with compression with this?

Similarly to compressed audio, BINK2 is still the most common video codec, and in the case of games released in the current decade, is it starting to gain ground instead, with videos encoded with x264/x265? (In the case of x264, one could technically talk about lossless recompression, like BPK does with Bink1/2 files.)

[USSRCoder]

Help me find a recompressor for LZMA, .exe archive (100 MB). Made with Inno Setup Data (5.3.6) (u). 100% LZMA is used (for Setup Data and Setup Files, I wrote the unpacker).

I need to unpack an LZMA stream and then pack it into an archive (FreeARC).

I'm doing this for myself; I don't need to create an Installer later.

I tried:
xtool precomp -mzlib+preflate+reflate+lz4+lz4hc+lzo1x+zstd -c1024 MB
precomp.exe -intense -brute
bms2xtl.exe (but bms2xtl.ini says Exclude=lzma_dynamic,snappy)

and many other utilities, but they don't find LZMA streams in this exe.

Finds only quickbms.exe zlb1a.bms.

[kj911]

USSRCoder: The question is a bit confusing... Why do you need an LZMA recompressor if the files in the installer can be extracted from it simply by installing it. Or are these files also available from a separate source, which are also in the installer?

Technically, there is an LZMA recompressor, but it is mostly suitable for compressing LZMA-compressed archives created with 7z to a smaller size. (avg. 1-3% size reduction) I don't know if it is compatible with INNO archives.

https://nishi.dreamhosters.com/u/ <--- see this lzmarec_v*.rar/exe files.

[USSRCoder]

Originally Posted by kj911

USSRCoder: The question is a bit confusing... Why do you need an LZMA recompressor if the files in the installer can be extracted from it simply by installing it. Or are these files also available from a separate source, which are also in the installer?

Well, I have a lot of different programs in installers, I want to compress them.

Originally Posted by kj911

Technically, there is an LZMA recompressor, but it is mostly suitable for compressing LZMA-compressed archives created with 7z to a smaller size. (avg. 1-3% size reduction) I don't know if it is compatible with INNO archives.

https://nishi.dreamhosters.com/u/ <--- see this lzmarec_v*.rar/exe files.

Yes, I've already looked at it, it's a recompressor.
But I need a precompressor (Sorry for the inaccuracy in the initial post).

[kj911]

USSRCoder: Technically, do you want to make "Repacks", but only from software, like we do with games?

In terms of precompressors, the result you get depends heavily on whether there is anything to recompress within a given data set. Is there and detectable data streams compressed with e.g. zlib, deflate or not. Classic preprocessing filters, such as Delta, BCJ/BCJ2, are already used by archivers (7z, rar, freearc, etc...) in most cases.

DLZ can bring a slightly better result than LZMA in the final compression, if x86/XP compatibility is important, for targeted use cases.

If x64/Win7+ is the goal, then using the Razor archiver is a possibility, or even LOLZ. It's true, regarding unpacking, it's necessary and recommended for LOLZ, due to the elevated user permissions and the cls filter. (It can also be run on XP, it's true, there's no such problem there.)

It is true that if we have a lot of extra time and insist on squeezing out the theoretical compression maximum available with 7z/arc, without external prepackers/compressors, then using "m7zRepacker" (see this) or "Ultra7z Archive/UltraFreeARC" Optimizer is also an option. However, the question arises with these tools, is it worth the time invested? (see this)

For starters, we can also experiment with this (DiskSpan GUI): https://fileforums.com/showthread.php?t=104507

For such special tasks, i.e. (re)packaging software installers into smaller packages, there is a commercial solution, but there is no publicly available application. In the old days, Netopsystems AG, under its maiden name, and more recently NOS Ltd., dealt with this. Yes, the famous FEAD Recomposer/Optimizer, NOSSO, can be linked to them.