Best Compression Methods for 'Specific' Games. Q&A

[KaktoR]

The Witcher 3 Wild Hunt Remastered

Looks like they switched completely to zlib only.
No more doboz+lz4hc.

But I have to wait until it's completely downloaded.

Edit:

Processing input: I:\SteamLibrary\steamapps\common\The Witcher 3

Streams: 568560
  - zlib = 412593 (59,35%)
  - brunsli = 1172 (0,46%)
  - zstd = 26 (0,00%)
  - mermaid = 3 (0,00%)
  - png = 409 (0,05%)
  - leviathan = 3 (0,00%)
  - mp3 = 42 (0,24%)
  - usm = 161 (6,87%)
  - kraken = 2 (0,00%)
  - wwise (opus) = 149187 (7,20%)
  - wwise (vorbis) = 4962 (4,93%)

Time: 00:06:06 (CPU 00:43:47)

The rest is criware usm video and audio

[KaktoR]

Not possible with this.

lzma recompressing is headache. You need the exact settings and so on. I believe even delta patching is not possible afterwards like with zip.

You can compress extracted files with Asset Studio again? See if this works.

[Dunnowho69]

Can anyone share the proper compression method for the remastered version, the one for the next-gen edition isn't working

[KaktoR]

Originally Posted by Dunnowho69

Can anyone share the proper compression method for the remastered version, the one for the next-gen edition isn't working

https://fileforums.com/showpost.php?...postcount=4718

[Redmist2013]

Originally Posted by KaktoR

Not possible with this.

lzma recompressing is headache. You need the exact settings and so on. I believe even delta patching is not possible afterwards like with zip.

You can compress extracted files with Asset Studio again? See if this works.

I tried the default LZMA settings in that SDK but they've used custom parameters and solid compression that gets decompressed into memory by the game so it would be virtually impossible to figure out and not worth the effort.
Thanks.

[Masquerade]

^^
If it helps, I believe the lzma.exe version used was v4.57. I could probably brute force the params but it'd take a while.

[bird2026]

The Witcher 3 - Wild Hunt - Game of the Year Edition
Wwise files (enpc.w3speech
soundpc.cache) for :
- wwise (vorbis) = 4962 (79.55%)
- wwise (opus) = 20330 (20.26%)
I need help regarding the compression method or a ready-made tool I can use; if everything goes well, I will need to restore the original files later.

[KaktoR]

Use xtool to extract them.

[bird2026]

Originally Posted by KaktoR

Use xtool to extract them.

CallBefore.bat / Can a similar process be set up for Control Resonant? Could I get some help with this? I’m not very skilled at these kinds of things.


CallBefore.bat
--------------------------------------------------------------------------------------

@ECHO off
TITLE DiskSpan GUI Compressor
SETLOCAL EnableDelayedExpansion EnableExtensions

:: ---------------------------------------------------------------------------------
:: ----------------------------- VARIABLES SETTINGS --------------------------------
:: ---------------------------------------------------------------------------------
CD /D "%~dp0"
SET "Counter=1"

:StoreLoop
IF !Counter! LEQ 9 IF "%~1" EQU "" ENDLOCAL && EXIT /B
SET "ARG!Counter!=%~1" && SHIFT && SET /A "Counter+=1"
IF !Counter! LEQ 20 GOTO StoreLoop

:MapVariables
SET "GameName=!ARG1!" && SET "DataFile=!ARG2!"
FOR %%a IN ("!ARG3!") DO SET "GameDir=%%~fa" && SET "BackupDir=%%~fa (Backup)"
FOR %%a IN ("!ARG4!") DO SET "OutputDir=%%~fa" && FOR %%a IN ("!ARG5!") DO SET "SetupDir=%%~fa"
FOR %%a IN ("!ARG6!") DO SET "MediaDir=%%~fa" && FOR %%a IN ("!ARG7!") DO SET "MainDir=%%~fa" && FOR %%a IN ("!ARG8!") DO SET "TempDir=%%~fa"
SET "GameIndex=1" && SET "DataIndex=1" && SET "MediaIndex=1" && FOR /F "tokens=1,2,3" %%a IN ("!ARG9!") DO ( SET /A "GameIndex=%%a" 2>nul && SET /A "DataIndex=%%b" 2>nul && SET /A "MediaIndex=%%c" 2>nul )
FOR /F "tokens=3" %%a IN ( 'REG QUERY "HKCU\Software\Microsoft\Windows\CurrentVersion\Ex plorer\Shell Folders" /v "Personal" 2^>nul' ) DO SET "UserDocs=%%a"
FOR %%a IN ("%~dp0.") DO SET "SourceDir=%%~fa" && IF "!SourceDir:~-1!" EQU "" SET "SourceDir=!SourceDir:~0,-1!"
SET "DatabaseDir=!MainDir!\Resources\DATABASE" && SET "BaseDir=!MainDir!\Resources\Win64"
:: ---------------------------------------------------------------------------------
:: !GameName! = name of the current game
:: !DataFile! = name of the current data file
:: !SourceDir! = directory of call after/before .bat/.cmd/.exe file
:: !BackupDir! = predefined backup directory
:: !GameDir! = current game directory
:: !OutputDir! = output directory
:: !SetupDir! = setup files folder directory
:: !MediaDir! = current media directory like: DISK_1
:: !MainDir! = application DiskSpan_GUI.exe {src} directory
:: !DatabaseDir! = database files directory
:: !BaseDir! = compressors base directory
:: !TempDir! = application DiskSpan_GUI.exe {tmp} directory
:: !UserDocs! = user documents directory
:: !GameIndex! = index of the current game
:: !DataIndex! = index of the current data file
:: !MediaIndex! = index of the current media directory
:: ---------------------------------------------------------------------------------
:: -------------------------------- USER SETTINGS ----------------------------------
:: ---------------------------------------------------------------------------------


:Start
CLS
ECHO.
ECHO.----------------------------------------------------------------------
ECHO. The following process uses WEM Packer by SYMM
ECHO. https://fileforums.com/showthread.ph...819#post509819
ECHO.
ECHO. This step could take a bit longer than usual, approximately up to 2 hours.
ECHO.
ECHO. Backup files will be made here:
ECHO. !BackupDir!\
ECHO.----------------------------------------------------------------------
ECHO. Do you want to process sound files? [Y/N]
ECHO.----------------------------------------------------------------------
ECHO.
CHOICE /C NY /N
IF errorlevel 1 SET "Wwise=Y"
IF errorlevel 2 SET "Wwise=N"


:Example
IF EXIST "!DatabaseDir!\Control Resonant\Lists\Rebuild_example_for_installers (Setup INI).txt" START "" "!DatabaseDir!\Control Resonant\Lists\Rebuild_example_for_installers (Setup INI).txt"


:Copy
IF NOT EXIST "!BackupDir!\data_pack2\pc" MKDIR "!BackupDir!\data_pack2\pc"
IF NOT EXIST "!GameDir!\XTool.exe" COPY /Y "!BaseDir!\PRE\XTool_2020\XTool.exe" "!GameDir!\XTool.exe" >nul
IF "%Wwise%"=="Y" (
IF NOT EXIST "!GameDir!\wem-unpacker.exe" COPY /Y "!BaseDir!\TOOLS\WEM\wem-unpacker.exe" "!GameDir!\wem-unpacker.exe" >nul


:Wwise
CLS
CD /D "!GameDir!"
SET /A "FileList.Count=17"
SET "FileList[1].Name=base-de-000.rmdblob
SET "FileList[2].Name=stream0-de-000.rmdblob
SET "FileList[3].Name=base-es-000.rmdblob
SET "FileList[4].Name=stream0-es-000.rmdblob
SET "FileList[5].Name=base-fr-000.rmdblob
SET "FileList[6].Name=stream0-fr-000.rmdblob
SET "FileList[7].Name=base-it-000.rmdblob
SET "FileList[8].Name=stream0-it-000.rmdblob
SET "FileList[9].Name=base-ja-000.rmdblob
SET "FileList[10].Name=stream0-ja-000.rmdblob
SET "FileList[11].Name=base-ptbr-000.rmdblob
SET "FileList[12].Name=stream0-ptbr-000.rmdblob
SET "FileList[13].Name=base-zhcn-000.rmdblob
SET "FileList[14].Name=stream0-zhcn-000.rmdblob
SET "FileList[15].Name=base-generic-000.rmdblob
SET "FileList[16].Name=stream0-generic-001.rmdblob
SET "FileList[17].Name=stream0-generic-002.rmdblob
FOR /L %%i IN (1, 1, !FileList.Count!) DO IF EXIST "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" (
IF NOT EXIST "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" MKDIR "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract"
IF NOT EXIST "!BackupDir!\data_pack2\pc\!FileList[%%i].Name!" ECHO Copying "..\data_pack2\pc\!FileList[%%i].Name!", please wait...
IF NOT EXIST "!BackupDir!\data_pack2\pc\!FileList[%%i].Name!" COPY /Z /Y "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" "!BackupDir!\data_pack2\pc"
CALL "!BaseDir!\PRE\XTool_2020\XTool.exe" precomp -mwwise -x"!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" "!GameDir!\data_pack2\pc\!FileList[%%i].Name!"
CALL "!DatabaseDir!\_COMMON\CALL\ANNO_CallBefore.ex e" /FUNC=SMALL /PATH="!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" /INCL=*.raw /SIZE=102400
CALL "!DatabaseDir!\_COMMON\CALL\ANNO_CallBefore.ex e" /FUNC=REN /PATH="!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" /OLD=*.raw /NEW=*.wem
CALL "!BaseDir!\PRE\XTool_2020\XTool.exe" erase "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract\*" "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" "!GameDir!\cr_wwise.xtl"
ECHO.------------------------------------------------------------------------------------------------------
)
)


:Bink
SET /A "FileList.Count=5"
SET "FileList[1].Name=base-generic-002.rmdblob
SET "FileList[2].Name=base-generic-004.rmdblob
SET "FileList[3].Name=stream0-generic-010.rmdblob
SET "FileList[4].Name=stream0-generic-012.rmdblob
SET "FileList[5].Name=stream0-generic-014.rmdblob
FOR /L %%i IN (1, 1, !FileList.Count!) DO IF EXIST "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" (
IF NOT EXIST "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" MKDIR "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract"
IF NOT EXIST "!BackupDir!\data_pack2\pc\!FileList[%%i].Name!" ECHO Copying "..\data_pack2\pc\!FileList[%%i].Name!", please wait...
IF NOT EXIST "!BackupDir!\data_pack2\pc\!FileList[%%i].Name!" COPY /Z /Y "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" "!BackupDir!\data_pack2\pc"
CALL "!BaseDir!\PRE\XTool_2020\XTool.exe" precomp -mbink -x"!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract" "!GameDir!\data_pack2\pc\!FileList[%%i].Name!"
CALL "!BaseDir!\PRE\XTool_2020\XTool.exe" erase "!GameDir!\data_pack2\pc\!FileList[%%i].Name!_extract\*" "!GameDir!\data_pack2\pc\!FileList[%%i].Name!" "!GameDir!\cr_bink.xtl"
ECHO.------------------------------------------------------------------------------------------------------
)


IF "%Wwise%"=="Y" (
:WemTool
CLS
TITLE Processing audio files, please wait...
REM"!BaseDir!\TOOLS\WEM\wem-packer.exe" -s -czstd-20 "!GameDir!"
)


:End
ENDLOCAL
EXIT /B

[ZakirAhmad]

Originally Posted by Simorq

Gears Of War 4 / 74.7 GB

GOW 4 uses unreal engine 4, does uelr work on this.

[Sergey3695]

Originally Posted by ZakirAhmad

GOW 4 uses unreal engine 4, does uelr work on this.

where did you find this? (Simorq's msg)

[ZakirAhmad]

Originally Posted by Sergey3695

where did you find this? (Simorq's msg)

what???

https://en.m.wikipedia.org/wiki/Gears_of_War_4

[Sergey3695]

Originally Posted by ZakirAhmad

what???

https://en.m.wikipedia.org/wiki/Gears_of_War_4

Sorry. I'm a stupid morning

[darkwolves]

pzlib+srep64+delta+lzma:ultra:a1:mfbt4:d158m:fb273 :mc1000000000:lc8

original game size 15.8 gb

repack size 5.73 gb

----note
yes the game is frostbite engine but it is frostbite 2 pzlib, precomp etc
work on it..

[KaktoR]

Originally Posted by KaktoR

Middle-Earth: Shadow of War
One language, without HD/4K Packs

*.arch06 => oodle(ZTool)+srep+lzma
*.vib => m0
all other files => srep+lzma

Note: *.vib files are bk2 files, but some files give unpack error if you use BPK on them (I wasn't in the mood to test file by file and sort out the faulty ones). If you do this you could save about ~2GB for sure.

92.8GB => 53.8GB

Time:

16:15:53 - Starting Data1.bin.001 creation
 3:13:01 - Finished Data1.bin.001 creation
 3:13:03 - Starting Data2.bin.001 creation
 3:20:28 - Finished Data2.bin.001 creation
 3:20:32 - Starting Data3.bin.001 creation
 3:25:44 - Finished Data3.bin.001 creation

Edit: You will get 52.3GB with BPK on *.vib files (rename them to *.bk2). Just make sure to exclude the 1kb files, they give unpack error.