Tools for Repacking
 

An index for all things compression related. Tools for FreeArc and tools to take you beyond FreeArc. Modding tools to help you decrypt and unpack game archives.

########
ATTENTION
########
Do not request resources from Krinkels.org forum to be uploaded here since it is against their forum rules and most certainly DO NOT MESSAGE ME ASKING ME TO SEND YOU KRINKELS RESOURCES - please read this forum post.
FreeArc Tools

• [Compressor] 7-Zip [Igor Pavlov]
• [Compressor] BinkPack [ProFrager]
• [Compressor] Bink Compressor Patch [Razor12911 / ProFrager]
• [Compressor] Brunsli [Google]
• [Compressor] BCM [Encode]
• [Compressor] BSC [Ilya Grebnov]
• [Compressor] CLS-BCMMT [BLACKFIRE69]
• [Compressor] CLS-BROTLI [Shegorat]
• [Compressor] CLS-LZ4 [Razor12911]
• [Compressor] CLS-LZ4 [Shegorat]
• [Compressor] CLS-LIZARD [Shegorat]
• [Compressor] CLS-LZO [Shegorat]
• [Compressor] CLS-UHARC [Single Threaded] [Razor12911 / Carldric Clement]
• [Compressor] CLS-Precomp [Razor12911]
• [Compressor] CLS-ZLIB [Shegorat]
• [Compressor] CLS-ZPAQ [Shegorat]
• [Compressor] CLS-ZSTD [Razor12911]
• [Compressor] CLS-ZSTD [Shegorat]
• [Compressor] DLZ [ProFrager]
• [Compressor] Media Streams Compressor [ProFrager]
• [Compressor] Lepton [Dropbox]
• [Compressor] LOLZ [ProFrager] / Uploaded here on FileForums
• [Compressor] LZMA [Igor Pavlov]
• [Compressor] MCM [Mat Chartier]
• [Compressor] MPZ [Eugene Shelwien]
• [Compressor] OGGRE [ProFrager]
• [Compressor] PackJPG Wrapper [78372]
• [Compressor] RAZOR Archiver [Christian Martelock]
• [Compressor] RAZOR Archiver [STDIO Patched for v1.01] [Christian Martelock / Razor12911]
• [Compressor] RAZOR Archiver [STDIO Patched for v1.03.7] [Christian Martelock / Razor12911]
• [Compressor] Squid [Shegorat / Ilya Muravyev]
• [Compressor] TAK: (T)om's lossless (A)udio (K)ompressor

• [Decryption Tool] CLS-UE4D [Shegorat]
• [Decryption Tool] FIFA 19 CAS Decryption Tool [Razor12911]
• [Decryption Tool] Death Stranding Decryption Tool [Razor12911]
• [Decryption Tool] Project CARS 2/3 BFF Decryption Tool [Razor12911]
• [Decryption Tool] CLS-TTGD [Shegorat]
• [Decryption Tool] TearDownDecrypt.NET
• [Decryption Tool] Unreal Engine 4 Decryption Tool [Razor12911]

• [Multithreading Wrapper] BCMX [BLACKFIRE69]
• [Multithreading Wrapper] BSCX [BLACKFIRE69]
• [Multithreading Wrapper] CLS-BSCMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-CRUSHMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-FP8 [BLACKFIRE69]
• [Multithreading Wrapper] CLS-FP8MT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-MCM [BLACKFIRE69]
• [Multithreading Wrapper] CLS-MCMMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-MPZMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-MTX [BLACKFIRE69]
• [Multithreading Wrapper] CLS-NZ [BLACKFIRE69]
• [Multithreading Wrapper] CLS-NZMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-PACKETMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-PRECOMP [BLACKFIRE69]
• [Multithreading Wrapper] CLS-PRECOMPMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-PrecompMT [Razor12911]
• [Multithreading Wrapper] CLS-RZMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-UHARC [Razor12911]
• [Multithreading Wrapper] CLS-UHARCMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-ZCMMT [BLACKFIRE69]
• [Multithreading Wrapper] CLS-ZSTD [BLACKFIRE69]
• [Multithreading Wrapper] CLS-ZSTDMT [BLACKFIRE69]
• [Multithreading Wrapper] MPZX [BLACKFIRE69]
• [Multithreading Wrapper] MTX - The Universal Accelerator [BLACKFIRE69]
• [Multithreading Wrapper] PMT - Parallel Multithreaded Encoder/Decoder [78372]
• [Multithreading Wrapper] PrecompX [BLACKFIRE69]
• [Multithreading Wrapper] RazorX [BLACKFIRE69]

• [Precompressor] Anvil Forge Recompressor [Edison007]
• [Precompressor] Anvil Forge Recompressor [STDIO Patched] [Edison007 / Razor12911]
• [Precompressor] CLS-RED4 [Shegorat]
• [Precompressor] FIFA 19 CAS Precompression Tool [Razor12911]
• [Precompressor] LZOrec [Razor12911]
• [Precompressor] LZXrec [Razor12911]
• [Precompressor] Metro Exodus Precompression Tool [Razor12911]
• [Precompressor] OodleRec [Razor12911]
• [Precompressor] pZlib v3 Final [Razor12911]
• [Precompressor] Saints Row The Third Remastered Precompression Tool [Razor12911]
• [Precompressor] Unreal Engine (3) LZO Recompressor [ProFrager]
• [Precompressor] UELR v0.1.1e [Edison007 / ProFrager]
• [Precompressor] [OLD] XTool - Successor of ZTool [Razor12911]
• [Precompressor] XTool 2020 [Razor12911]
• [Precompressor] XTool 2020 [Database Maker] [Razor12911]
• [Precompressor] XTool 2020 [Plugins] [Razor12911]
• [Precompressor] ZSTDrec [Razor12911]
• [Precompressor] ZTool [Razor12911]

• [Unpacker] CLS-BSC [Shegorat]
• [Unpacker] CLS-PrecompInside [ProFrager]
• [Unpacker] CLS-SREP [Razor12911]
• [Unpacker] CLS-SREP [ProFrager]
• [Unpacker] [OLD] CLS-SREPInside [ProFrager]

Non-FreeArc Tools

• arc_unpacker v0.11-0-gff3b9d9
• Attack On Titan Linkdata Unpacker
• Atelier PAK Decrypt
• Bank Dumping Tool
• Bincat
• CascView
• Cethleann - The Koei Swiss Army Knife
• Collection of Gibbed Tools
• Command Line RGSS Decryptor
• COWABUNGA
• Crysis 3 PAK Decryption Tool
• DATOneArchiver
• Dunia Engine LZO Recompressor [Edison007] / Uploaded here on FileForums
• Dunia Tools
• FModel
• God Of War SBP Tool
• Gust Tools
• HDiffPatch
• How to get RSA key for encrypted CryEngine games
• HPK Archiver
• HunexFileArchiveTool
• IGATool
• ITBTools
• JojoDiff
• KaktoR Oodle Library Collection
• KVSExtractor
• KVSToolbox
• LA 0.4b Lossless Audio Compressor
• MagesPack
• Modifed Gust PAK Tool for Atelier Sophie 2
• Monster Hunter Stories 2 ARC Decryption Tool
• Northlight Tool
• Par Manager / Par Tool
• PhxTools
• QuickBMS
• RAD Video Tools
• Raw binary file injector
• Recode FLAC to MP3 with FFMPEG
• RPKG Tool for HITMAN 1/2/3
• Sad Offset Finding Tool
• Sad Hash Checker
• sakunaTool
• Scaleform Video Encoder
• Swiss File Knife [SFK]
• Skullgirls GFS extract
• The Alien Cube PAK Decryption Tool
• The Duper v1.4.01
• Tools for decompressing ZenStudios ".pxp" archives
• TTGames BMS Script [Modified]
• [OLD] Unity Assets Bundle Extractor
• Unity Assets Bundle Extractor Avalonia
• Unity Bundle Tool
• Unpakke
• UnrealKey
• VGMToolbox
• Watch Dogs [disrupt-r49_b38_2]
• WAV/WEM Extractor
• WAVExtractor_v2
• WemTool
• Wolfenstein SPK + MPK Extractor
• WolvenKit
• WWise PCK BMS Script
• XDelta
• XVI32

Misc.

• Forza Horizon 3 Filename Decipher Tool
• LEGO Worlds: No DAT Patch for Build 3833060
• TTMagic | TTGames Universal Anti-Anti-DAT Check Patch

Data Sheets

• God of War
• Mad Max
• Sekiro: Shadows Die Twice
• Weird West: Build 8447248

sakunaTool

• Used for Sakuna: Of Rice and Ruin
• Extract arc files with sakunaTool.exe to remove LZ4 compression
• Rebuild arc file with sakunaTool then use patch program like XDelta to restore it to the original arc file

https://github.com/LinkOFF7/sakunaTool

By LinkOFF7 & Visntse

HDiffPatch [Also known as HDiffZ]

• Make a patch between two files (convert an old file to a new file).
• HDiffZ is slower at patch creating than XDelta, however the patches made by this program are smaller than XDelta and apply in a similar time.
  
  Example Usage
  
  Code:

  ---

  hdiffz-x64 -c-lzma2-9 -C-no <old file> <new file> <patch file>

to make a patch

  ---

  Code:

  ---

  hpatchz-x64 <old file> <patch file> <newfile>

to apply a patch to the old file, making a new file

  ---

https://github.com/sisong/HDiffPatch

By sisong

Unity Assets Bundle Extractor Avalonia

• Useful because it can decompress Unity Asset Bundles.

https://github.com/nesrak1/UABEA

By nesrak1

Brunsli

• You can use brunsli with FreeArc to compress JPEG images.
  
  Example Usage:
  
  Code:

  ---

  [External compressor:brunsli]
header    = 0
solid    = 0
packcmd  = cbrunsli $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = dbrunsli $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

  ---

https://github.com/google/brunsli

By Google - compiled version attached to this post was compiled by me.

MPZ [Also known as MPZAPI]

• Compressor for MP3 audio files.
• You can use MPZ in $$arc$$ mode or as an STDIO compressor.
  
  Example Usage:
  
  Code:

  ---

  [External compressor:mpz]
header    = 0
packcmd  = {compressor} c <stdin> <stdout>
unpackcmd = {compressor} d <stdin> <stdout>

  ---

  Code:

  ---

  [External compressor:mpz]
header    = 0
packcmd  = {compressor} c $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = {compressor} d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

  ---

By Eugene Shelwein

MCM

• General compressor. Good on binary files (exe/dll).
  
  Example Usage:
  
  Code:

  ---

  [External compressor:mcm]
header    = 0
packcmd  = {compressor} -x7 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = {compressor} d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

  ---

https://encode.su/threads/2127-MCM-LZP
https://github.com/mathieuchartier/mcm

By Mat Chartier

Razor Compressor [v1.03.7 Patched for STDIO usage]

• Original version shared by Razor12911 was patched for RZ v1.01. It's possible to import the library to RZ v1.03.7 with CFF explorer and everything works.
  
  Example Usage:
  
  Code:

  ---

  [External compressor:rzs]
header    = 0
packcmd  = rz-1.03.7-stdio.exe a -y -d 128m $stdio$ <stdin> <stdout>
unpackcmd = rz-1.03.7-stdio.exe e -y $stdio$ <stdin> <stdout>

  ---

Razor Archiver by Christian Martelock
RZ STDIO patch by Razor12911

7-Zip

• Open source archiver with support for multiple compression algorithms (deflate, LZMA2 etc...)
  
  Example Usage:
  
  Code:

  ---

  [External compressor:7z]
header    = 0
packcmd  = {compressor} a -txz -an -mcrc=0 -m1=lzma2:d64m:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
unpackcmd = {compressor} x -txz -mmt2 -an -y -si -so <stdin> <stdout>

  ---

By Igor Pavlov
7-Zip Website

LZMA

• Open source LZMA archiver from the LZMA SDK.
  
  Example Usage:
  
  Code:

  ---

  [External compressor:LZMA]
header    = 0
packcmd  = {compressor} e -a1 -si -so <stdin> <stdout>
unpackcmd = {compressor} d -si -so <stdin> <stdout>

  ---

By Igor Pavlov

XDelta

• Make a patch between two files (convert an old file to a new file).
• Extremely fast and makes small patches. Quick to apply patches too.
• Open source.
  
  Example Usage:
  
  Code:

  ---

  xdelta-x64.exe -v2 -S lzma -9 -e -s <old file> <new file> <patch file>

xdelta-x64.exe -v2 -d -f -s <old file> <patch file> <newfile>

  ---

https://github.com/jmacd/xdelta

By Joshua MacDonald

JojoDiff [Also known as JDiff / Jojo's Binary Diff]

• Patcher just like XDelta and HDiffZ. Also, open source.
  
  Example Usage:
  
  Code:

  ---

  jdiff.exe -j -vvv <old file> <new file> <patch file>

jdiff.exe -u -vvv <old file> <patch file> <newfile>

  ---

http://jojodiff.sourceforge.net/

By Joris Heirbaut

Atelier PAK Decrypt

• Utility to decrypt and unpack PAK files from the GUST engine.
• Note that some of the Koei Tecmo games that use the encrypted GUST engine contain Japanese filenames. In this case, you can't just run the games extracted. Other games such as Atelier Ryza 2 can be run extracted because all file paths and names in the archives are in English.
  
  Example Usage:
  
  Code:

  ---

  a17_decrypt.exe <input pak file>

a18_decrypt.exe <input pak file>

  ---

https://github.com/shizukachan/atelier_pak_decrypt

By shizukachan

QuickBMS

• One of the most powerful tools anyone has made. This can be used for all kinds of purposes including extracting game archives, replacing data in archives with null bytes and decryption.
• You need the correct BMS script for the game in question to parse the game files.

http://aluigi.altervista.org/quickbms.htm
http://aluigi.altervista.org/quickbms_list.php

By Luigi Auriemma

TTGames BMS Script [Modified]

• Modified version of TTGames BMS script by Luigi Auriemma for compatibility with some LEGO games that the public script struggles with.
• You will still need a patched EXE to run the games in an extracted state. Older games do not need an EXE patch.

WWise PCK BMS Script

• Unpack WWise PCK archives with QuickBMS. This script extracts with file names and folder paths.

By Nicknine / bnnm

Northlight Tool

• Extraction utility for the following games:
  • Alan Wake (PC/X360)
  • Alan Wake American Nightmare (PC/X360)
  • Quantum Break (PC, possible XOne)
  • Control (PC, possible XOne/PS4)
  • Alan Wake Remastered (PC, possible XOne/PS4)
• Useful because you can extract Bink videos. For example, I extracted Bink videos from CONTROL and then you can compress them with BPK afair.

https://forum.xentax.com/viewtopic.php?t=21047
By Evin

WolvenKit CLI

• Command line extraction utility for REDEngine games (e.g. The Witcher 3: The Wild Hunt, Cyberpunk 2077).
• Example usage, extracting Bink videos from Cyberpunk 2077 - BPK doesn't work for them, but this way you can extract the credits video. Gives file names and paths unlike Aluigi's BMS script.
• CLI version works significantly easier than GUI version.

https://github.com/WolvenKit/Wolvenkit

HPK Archiver

• HPK Archiver for Haemimont Engine game files.
• Unpacking the archives will remove LZ4 compression and you can make new archives with the ability to XDelta from old ones.

https://github.com/nickelc/hpk

By nickelc

SOS-FoMT-LZS

• You can use this tool to remove compression from LZS archives, such as game files from Soul Nomad and the World Eaters.

https://github.com/JokerDKha/SOS-FoMT-LZS

By JokerD

Bincat

• Bincat is a simple tool to join together files in a directory into a single file.
• Limited in some respects because it does not run recursively so you can only concatenate files if they are all in the same folder.
• Very niche tool with very interesting uses. In my repacks, I have used this to join together several decompressed LZ4 streams in the engine used by the WRC games (PPKG files) into one big file. You can then compress the big file with LZ4 and HDiffZ it. Hopefully I will explain here one day the process of extracting the streams, decompressing them and then building the new file with Bincat.

http://aluigi.altervista.org/mytoolz/bincat.zip

By Aluigi

Gust Tools

• Various tools for modding of Gust engine games (think Koei Tecmo).
• You will be particularly interested in gust_pak.exe because it can extract ecnrypted Koei Tecmo PAK archives leaving a JSON file and decrypted files. You can then use gust_pak.exe to rebuild the archive from the JSON file. They are so similar you can XDelta the new file to make it the old file and have a 100% CRC perfect repack. The delta files are only a few kb in size, so I didn't even bother using HDiffZ in this case. It's not worth the long patch generation time.

https://github.com/VitaSmith/gust_tools

By VitaSmith

Crysis 3 PAK Decryption Tool

• Decrypt PAK archives for Crysis 3 to Zip files. Please note the game does not run in a decrypted state.

Dunia Tools

• You can use this to unpack FAT/DAT files from Dunia engine games. The following games are supported:
  • Far Cry 2
  • Far Cry 3
  • Far Cry 3 Blood Dragon
  • Far Cry 4
  • Far Cry Primal
  • Watch_Dogs
  • Watch_Dogs 2
• Useful if you want to extract audio or Bink videos to compress them better.

https://www.nexusmods.com/farcryprimal/mods/5/
https://mega.nz/file/M5IgRJLJ#3aOH8_...EFJzOvERhJe7Tw

By L Fino

Watch Dogs [disrupt-r49_b38_2]

• Tool by Rick Gibbed to unpack and decompress Watch Dogs game archives.

https://mega.nz/file/dhQGUbqB#Y4SEYx...U9RaCIFvigNhms

By Rick Gibbed

arc_unpacker v0.11-0-gff3b9d9

• Unpacker for all kinds of Visual Novels.

https://github.com/vn-tools/arc_unpacker
https://rawgit.com/vn-tools/arc_unpa...r/GAMELIST.htm

MagesPack

• Unpacker + repacker for games made in the Mages Engine (Steins;Gate, Chaos;Child).

https://github.com/DanOl98/MagesPack

By DanOl98

The Duper v1.4.01

• You can use this to remove duplicate files from your game. This means there is less to compress. Makes a handy batch file to re-copy all of the duplicated files.
  
  Code:

  ---

  THE DUPER v 1.4.01
===================
This app it's used to compare files and the result it's a 2 .bat files
-Dupe.bat y remove.bat

How to use:
-------------
Unpack this zip in a folder and copy the 3 .exe where you want analiyze the files, and execute dcmp.exe and wait, when the program finish you found 2 .bat files

If you Execute remove.bat, in this case you delete the duped files
When you removed the duped files in the installation program make a "call" to the file dupe.bat and you recover the files

Don't forgett to delete the files list_tmp.txt ref_tmp.txt, both are a temps from the analisys


This program it's under license FREEWARE. DON'T PAY FOR THAT
AT NO MOMENT ONE TAKES RESPONSIBILITY OF ANY DAMAGE TO YOUR COMPUTER, OR HARDWARE OR SOFTWARE, LIKE ANY LOST ONE OF DATA

  ---

By KapitalSin

Tools for Yakuza PAR archives

• Used to unpack .par files.

• Creation of .par files with specifed files.

• Supports SLLZ compression (Including SLLZ V2 used in Yakuza Kiwami 2).

https://github.com/Kaplas80/ParManager

By Kaplas80 &
SutandoTsukai181

I don't know if i can post too, delete this if not.

All contributions are appreciated :D

I held off on posting this because the par structure of Yakuza games is slightly complex in that there's par archives within par archives so it's not an easy one to recompress.

@all Please feel free to add anything to this thread you think is useful, the whole purpose of this thread is to encourage everyone to learn a bit more about how to compress even smaller.

RPKG Tool for HITMAN 1/2/3

• With this you can unpack and rebuild game archives for HITMAN 1/2/3
• Rebuilding game archives is CRC perfect (from what I tested out of 5 archives from Hitman 3 v3.70).
• Possibility to merge patch files into main archives to save several gigs of space (not tested and not crc perfect ofcourse)

Usage:
https://github.com/glacier-modding/RPKG-Tool
Latest hash lists: hitmandb.notex.app/latest-hashes.7z

@KaktoR
What are the speeds like for this tool now? I recall it being very slow at extracting and packing files.

HDD speeds (my m2 SSD is nearly full, so can't test)
chunk0.rpg (13.5 GB)
Unpack: 100% Done in 1181.58s
Repack: Scanning folder time 10min + 100% Done in 1141.25s

Edit:

Collection of Gibbed Tools: http://svn.gib.me/builds/

Data Sheet for Mad Max [GOG v1.0.3]

• Use this BMS script to unpack the game archives specified below then you can patch out the flagged files using SFK.
• http://aluigi.altervista.org/bms/justcause2.bms
• KB2i files are Bink videos and can be compressed with BPK
• FSB5 files are FMOD banks that contain vorbis audio. These don't compress well so you can patch these out to speed up lolz a bit since there's less data for it to compress.
• 853ad14e.KB2i is unneeded by the game so you can rip it if you want. The other two videos are needed and the game will crash if those videos are not available. They are intro videos.

Data Sheet for Sekiro: Shadows Die Twice [Steam Build 5794815]

• All the files below are present inside Data1.bdt and are duplicates of everything within the sound folder.
• You can cut the size of your repack by several GBs just by patching out the duplicated files and then using SFK to patch all of these files back in using the existing sound files.
• This is an improvement over the method shown by Panker1992 - his method involved patching out entire blocks of audio whereas here, each individual file get patched out so that you can separate language audio and remove duplicate data.

You dont need to patch files back in sekiro.exe can load them as lose files.

either keep the already extracked and remove with hex editor. or delete lose files and keep the compressed ones

This tool remove encrypt from RPKG?

Patch back in for CRC perfection. :D

Yes, decrypts + decompresses. The intention of the tool is to enable people to mod the game.