FileForums - Best Compression Methods for 'Specific' Games. Q&A

Unsure, I have checked with latest ZSTD to see if it can list info about the archives, yet it can only seem to load info for few archives. Yet, all files are definitely compressed with zstd.

Code:

for %f in (*.arc) do zstd -l "%f"

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

     1      0     9.25 MB      30.19 MB  3.263   None  common.arc

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

     1      0   690.86 KB    1748.36 KB  2.531   None  info.arc

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

File "init.arc" not compressed by zstd

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

File "lang1.arc" not compressed by zstd

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

File "lang2.arc" not compressed by zstd

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

File "param.arc" not compressed by zstd

Frames  Skips  Compressed  Uncompressed  Ratio  Check  Filename

File "stream.arc" not compressed by zstd

I even tried compressing a demo file with zstd and testing the latest libzstd to see if the precompressor worked, neither zstdrec or xtool could precompress a random file compressed with latest zstd.

KaktoR

21-10-2021 06:46

Yes, the first file contains just 1 block with zstd (28B52FFD).

However, ratio with lzma2 for init.arc is about 70%.

I will investigate it further :D

Masquerade

23-10-2021 02:53

KaktoR
You can use the following tools to extract all of the compressed ZSTD streams from NieR replicant. It will allow for decompression of 99% of streams.

1. VGM Toolbox and this script. Download latest zstd.exe.

2. Place the XML file in plugins\AdvancedCutter folder of VGMToolbox.

3. Open VGMToolbox, go to Misc. Tools > Extraction Tools > Generic > Advanced Cutter

4. From the drop down menu in the top right, select NieRReplicant and click LOAD.

5. Next, you can drop each of the arc files into the top left box and it will extract the streams. You only really need to do this for the large arc files. No need on the little ones.

6. After extracting the streams, run this python script for each of the files. This will remove the extra padding bytes (@) that the devs added so that each stream begins at an offset of divisible by 16. ZSTD will not decompress files that contain data after the end of the stream.

Code:

for %f in (*.MSQ) do trimmer.py "%f"

Ignore that it involves .MSQ extension. You can switch it to .TMP or whatever.

7.

Code:

for /r %f in (*.MSQ) do zstd -d "%f" -o "%~df%~pf%~nf.DEC"

This will use zstd to decompress the streams. Afair it fails on about 16 streams out of ~7800, but you can decompress most of the game this way.

KaktoR

23-10-2021 06:10

Question is if it's profitable because with plain srep+lzma i get 13.5GB

Masquerade

23-10-2021 11:25

Quote:

Originally Posted by KaktoR (Post 494581)

Question is if it's profitable because with plain srep+lzma i get 13.5GB

Oh, most certainly not profitable in the slightest. But still good fun! :D

hwang4

26-10-2021 01:30

Hi!Need A valid unreal key for "Chinese Paladin - Sword & Fairy 7"! :)
Should i use "ue4dt" or xtool with unreal plugin?thanx!

KaktoR

26-10-2021 01:47

Code:

0xE53BEBDBCEC82995F37033B62CFD8243E02C10C03AB12EA682F654DC805F4009

In my tests there were no difference in using ue4dt or xtool.

dixen

26-10-2021 01:52

Keys

Code:

Sword and Fairy 7 (cubejoy) 0xB37742E2DF203FAF02D00DD495D3297FAEB4B14D89FBD6C88D874884FAB8EAD5

Sword and Fairy 7 (steam)   0xE53BEBDBCEC82995F37033B62CFD8243E02C10C03AB12EA682F654DC805F4009

hwang4

26-10-2021 07:17

KaktoR , you are right!I tried with both ue4dt & xtool without success!
So ? What's should i use for better compression ?

KaktoR

26-10-2021 07:21

I think the files are not compressed anyway, but I have not checked further.

KaktoR

26-10-2021 07:31

NASCAR 21 Ignition

Code:

 15:00:20 - Selected ARC/DS method for Data1a-01.bin was: xtool:mpreflate+srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

 15:00:20 - Selected ARC/DS method for Data1b-01.bin was: srep_new+4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000

----------------------------------------------------------------------------------------------------------------------------------------

 16:25:17 - Overall input size: 18.62 GB

 16:25:17 - Overall output size: 12.12 GB (Ratio 65.07%)

 16:25:17 - Overall conversion time: 01:24:52



Data1a *.pak

Data1b rest of the files

Masquerade

26-10-2021 10:02

Decimal locations for unneeded voiceovers in The Dark Pictures Anthology: House of Ashes

Code:

pakchunk0-WindowsNoEditor.pak



DE - 7609391157 - 7855465402



ES - 7855466549 - 8101614621



FR - 8101615669 - 8350358791



IT - 8350359605 - 8589641034



RU - 8589641781 - 8828443389

KaktoR

26-10-2021 10:50

Quote:

Originally Posted by Masquerade (Post 494624)

Decimal locations for unneeded voiceovers in The Dark Pictures Anthology: House of Ashes

Code:

pakchunk0-WindowsNoEditor.pak



DE - 7609391157 - 7855465402



ES - 7855466549 - 8101614621



FR - 8101615669 - 8350358791



IT - 8350359605 - 8589641034



RU - 8589641781 - 8828443389

Thanks. Also do not use bpk on this. Will cause crc errors (again) :D

KaktoR

28-10-2021 00:53

Marvel's Guardians of the Galaxy

Code:

 23:55:06 - Selected ARC/DS method for Data1a-01.bin was: srep+LZMA-MT

----------------------------------------------------------------------------------------------------------------------------------------

 01:50:56 - Overall input size: 75.94 GB

 01:50:56 - Overall output size: 23.50 GB (Ratio 30.95%)

 01:50:56 - Overall conversion time: 01:53:38

All times are GMT -7. The time now is 09:43.

Page 174 of 312

174

Show 40 post(s) from this thread on one page