^^
Disable PATH limit:
https://www.howtogeek.com/266621/how...60-characters/

I have several games where the assets are contained within compressed and encrypted *.pak files.

What I am wanting to do is to minimize (compress) these *.pak files to save space as some of these assets take up a huge amount of disc space.

I have tried xtool, srep, lolz, precomp and a few other final step compressors but have found the *.pak files don't compress well at all (not surprising as they are already compressed).

However, I understand from reading some posts on the internet that it may still be possible to compress these *.pak files using specialized/other tools(?)

How can I compress these *.pak files?

Sample asset *.pak file - here.

What game?

Whispered Secrets - Cruise of Misfortune Collectors Edition

hello guys
i'm looking for a way to recombine two files.
i have a big .pak file that contains all the game data.
i've duplicated it and processed each part.

one part contains the data compressible by lolz and the other compressible by another compressor.
after decompression i'd like to recombine these two files to make one.

I'm trying to figure out how to do this, with SFK, RAW or equivalent, but I'm drying out...

I've found a solution, maybe not the most beautiful, but it works.
I use xtool (7.9) to generate a database, extract stream from file2 and inject in file1

it works, it's fast, the only problem is to need to have 3x the space on drive (file1, file2, extracted stream) before recombine.

Is the data in the big pak compressed beforr you use lolz?

It could be much easier to just extract all raw data and concatenate the data into two blocks.

Compress each block as required, then during unpacking stage, concatenate the two blocks and xdelta patch it to the original pak.

Hello yes I think about this but it's 30gb files
the xdelta file is big and patch is low speed

the pak is aes crypted.

What i've done:
take original pak and uncrypt it
extract "compressible" parts who lolz can have a raisonnable gain
extract low compression parts , compressed later with razor
extract small fast compression files (like txt, json, xml)
then pack each chunk block
(I've got a better compression ratio than compress extracted files)
during install => rebuild the big pak
recrypt pak
small hdiffz patch to recover a good crc

Is there a precompressor compatible with the following algorithms?
(https://en64.shoutwiki.com/wiki/n64_compression).
The vast majority of the pack that I thought compress use Yay and Yaz (maybe 50%) (and Gzip/Zlib to a lesser extent)

^^
Yaz0 can be handled with wszst - however don't expect lossless 1:1 recompression when compared to original streams. It is a proprietary algorithm and all available implementations come from research and reverse engineering.

Best you can do is recompress the entire game and hope it works, I recommend using a very much older version of wszst as newer version cause incompatibilities when the executable file belonging to the game tries to load the data.

You also need to be aware of the Yaz0 data structure - especially the rotational byte which can cause load errors if you fail to reimplement the byte in the compressed data.

I won't endorse this discussion further since it does not relate to PC games and the company that developed the Yaz0 algorithm is well known to hunt down anyone who doesn't play by their rules. You know where to find me if you want to discuss such Yaz0 more privately.

Hello,
What is the fastest oodle core and how do i determine which one to use ? :confused: And to use with xtool I just have to put it next to the xtool.exe right ?

KiriKiri Visual Novels
 

Does anyone here know where to start with repacking visual novels made with the KiriKiri VN engine? Do you need to unpack and decrypt the xp3 files and compress from there? Guidance would be appreciated.

where to put the common redist folders
 

So i am fine with compressing the games/converting them using the cd/dvd tools .
For the earth of me everytime i put the common redist folder(the one with direct X and Ms cc) after the conversion finishes it never copies the common redist folder over.

It is mostly point 2a in the instructions part of the cd/dvd conversions e.g. stray souls.
It is that part i cannot seem to figure out,having tried it a good few times now.

Anyone out there if they could help me and tell me if i am doing or even not doing something the correct way would be very grateful.

Hello
i've got a simple question :
I want's to use arc.exe in command line to store file and split archive (for multithread work)

example :
.\Arc.exe a -ed -ep1 --dirs -r -y -m0 pack *.zip

In this case I'll have a pack.arc
I would like to have several file like pack.1 pack.2
I try several thing but not work...

Maybe cls-diskspan can help you. Freearc doesnt have native archive splitting feature.
Is this what you want?

I can split the archives using cls-diskspan.dll with freearc but how can i integrate with my installer for decompression ? Would be really gratefull if you could give a example :(

Afair just add the .dll to your script ,like cls-lolz,etc.

I tried many time but always get this is not a freearc archive error

Did you test your archive? (Arc.exe t yourarchive.arc)

Yes I tested there was no issue, Used arc.exe a -i1 -ds -ep1 -r -s; -ed -w.\_Temp -m=diskspan:5mb _Output\data1.bin "_Pack\*" this to create the archives and arc.exe t -i1 -w.\_Temp "_Output\data1.bin" to test it thats why i was looking for an example on how to use diskspan in a installer :(

From where do you got the diskspan library?

There should be an example script.

Got it from DSG , would be really grateful if you could share the link to the one you just said or something similar

If you got it from DSG, there should be a folder named "_Script Example (DSG_Module)".

There you simply compile the script "ISDone_Example.iss" and use the Setup.exe in Output folder to unpack your archive.

It seems pretty complicated, is there no easier way to integrate diskspan to a existing script ? :confused:

Any way to disable second pass on srep? It is it must ?

I think it's mandatory

Sometimes had to face storage issues because of this so thought if it was possible to disable somehow :( anyway thanks for the reply

you may try to use other deduplicator
Like exdude, dedub from panker.

in another way, system work like this :

Original File => decompress/decode => deduplication (try to find repetitions in files) => compression.

On each step you have 2 files

Orignal file and processed file, it is not uncommon to need a lot of disk space during conversion processus.
In another hand SREP do it a lot in memory. only result is stored.
On my computer I've got 32Gb of ram when I do some huge conversion it's more or less all used.

You may try to change :
-vmfile=FILENAME
-slp-


And for finish, if srep hang or crash during second pass => try other version of srep some of them are more stable
Personally, I use 4.90 in 99% of cases.

How common is it in games these days to have 5.1 (or similar) multi-track uncompressed audio tracks?

Is it not at all common or rare? (Usually, mono/stereo audio files occur in games.) A rough example of this in terms of volume is the game Titanfall, with its nearly 35GB of uncompressed audio.

The question would be interesting because according to the statements on the "HydrogenAudio" forum, for multi-channel audio tracks, the TAK codec is much better than FLAC and the like. Does anyone have any experience with compression with this?

Similarly to compressed audio, BINK2 is still the most common video codec, and in the case of games released in the current decade, is it starting to gain ground instead, with videos encoded with x264/x265? (In the case of x264, one could technically talk about lossless recompression, like BPK does with Bink1/2 files.)

Help me find a recompressor for LZMA, .exe archive (100 MB). Made with Inno Setup Data (5.3.6) (u). 100% LZMA is used (for Setup Data and Setup Files, I wrote the unpacker).

I need to unpack an LZMA stream and then pack it into an archive (FreeARC).

I'm doing this for myself; I don't need to create an Installer later.

I tried:
xtool precomp -mzlib+preflate+reflate+lz4+lz4hc+lzo1x+zstd -c1024 MB
precomp.exe -intense -brute
bms2xtl.exe (but bms2xtl.ini says Exclude=lzma_dynamic,snappy)

and many other utilities, but they don't find LZMA streams in this exe.

Finds only quickbms.exe zlb1a.bms.

USSRCoder: The question is a bit confusing... Why do you need an LZMA recompressor if the files in the installer can be extracted from it simply by installing it. Or are these files also available from a separate source, which are also in the installer?

Technically, there is an LZMA recompressor, but it is mostly suitable for compressing LZMA-compressed archives created with 7z to a smaller size. (avg. 1-3% size reduction) I don't know if it is compatible with INNO archives.

https://nishi.dreamhosters.com/u/ <--- see this lzmarec_v*.rar/exe files.

Well, I have a lot of different programs in installers, I want to compress them.

Yes, I've already looked at it, it's a recompressor.
But I need a precompressor (Sorry for the inaccuracy in the initial post).

USSRCoder: Technically, do you want to make "Repacks", but only from software, like we do with games?

In terms of precompressors, the result you get depends heavily on whether there is anything to recompress within a given data set. Is there and detectable data streams compressed with e.g. zlib, deflate or not. Classic preprocessing filters, such as Delta, BCJ/BCJ2, are already used by archivers (7z, rar, freearc, etc...) in most cases.

DLZ can bring a slightly better result than LZMA in the final compression, if x86/XP compatibility is important, for targeted use cases.

If x64/Win7+ is the goal, then using the Razor archiver is a possibility, or even LOLZ. It's true, regarding unpacking, it's necessary and recommended for LOLZ, due to the elevated user permissions and the cls filter. (It can also be run on XP, it's true, there's no such problem there.)

It is true that if we have a lot of extra time and insist on squeezing out the theoretical compression maximum available with 7z/arc, without external prepackers/compressors, then using "m7zRepacker" (see this) or "Ultra7z Archive/UltraFreeARC" Optimizer is also an option. However, the question arises with these tools, is it worth the time invested? (see this)

For starters, we can also experiment with this (DiskSpan GUI): https://fileforums.com/showthread.php?t=104507

For such special tasks, i.e. (re)packaging software installers into smaller packages, there is a commercial solution, but there is no publicly available application. In the old days, Netopsystems AG, under its maiden name, and more recently NOS Ltd., dealt with this. Yes, the famous FEAD Recomposer/Optimizer, NOSSO, can be linked to them.

I guess he needs a precompressor for lzma compressed files, but just a guess.

Need time for check this progs.

Yes, U R right. I need a precompressor for lzma streams.

Certain games may have LZMA on it such as Ice Age 4: Drift - Arctic Games, Games running on the Vicarious Visions Alchemy like Marvel Ultimate Alliance 2, Unity Engine titles like Double Cross, and a few others.

Hi everyone! Please help me, I'm a beginner and I can't figure it out! I created an archive of the game, created Setup, but for some reason it only works with the text file "Archives". Why is that? Maybe I need to add something in Inno Setup? Help me out!

What script did you use?
What tools did you use to compress the game?

Hello! DiskSpan GUI tool, script xtool:c32mb:mcp2077+srep_new:490g+LOLZ_ULTRA

What inno setup script do you use?