XTool 2020 (Plugins)

[Masquerade]

Bink Video

• XTool plugin adding support for Bink Video compression.
• This plugin uses Bink Pack library by ProFrager.
• Thanks to Razor12911 for the little help.

Advantages of using this plugin versus vanilla Bink Pack

• Multithreading support.
• No CRC check fail since XTool will patch the videos as they are unpacked.
• Incompatible Bink 2 videos (KB2n) are automatically ignored.

Special Notes

• For Bink 2 videos, you may need to make use of the --diff=* parameter as some patches between CRC imperfect videos to the original state can be larger than XTool's default threshold for patches.
• You may need to use a large chunk size to ensure all videos are processed. See example below.

Example Usage

• Extract the attached archive to the XTool folder and use -mbik or -mbk2 depending on your data set.

Test

• Test on the videos from Assassin's Creed 2 (27x Bink 1 videos).
  

  xtool precomp -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 13/13
  Time: 00:00:09 (00:00:01)
  Memory: 148 MB (148 MB)
  
  Results: 937 MB >> 928 MB

  xtool precomp -c128mb -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 26/26
  Time: 00:02:12 (00:00:04)
  Memory: 391 MB (391 MB)
  
  Results: 937 MB >> 776 MB

  xtool precomp -c256mb -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 27/27
  Time: 00:02:25 (00:00:06)
  Memory: 677 MB (677 MB)
  
  Results: 937 MB >> 725 MB

• Test on 05_DAM folder from Shadow Warrior 3 Defintive Edition (6x Bink 2 videos).
  

  xtool precomp -c256mb -mbk2 "SW3\Content\Movies\Cutscenes\05_DAM"
  XTool is created by Razor12911
  
  Streams: 6/6
  Time: 00:01:06 (00:00:03)
  Memory: 406 MB (406 MB)
  
  Results: 214 MB >> 187 MB

[Cesar82]

Originally Posted by Masquerade

For Bink 2 videos, you may need to make use of the --diff=* parameter as some patches between CRC imperfect videos to the original state can be larger than XTool's default threshold for patches.

For me if I use --diff=* in arc.ini it doesn't work, return:
ERROR: write error (disk full?) in compression algorithm xtool:c256mb:mbk2

Arc.ini

--cache=0
[External compressor:xtool]
header    = 0
default   = -c64mb -t100p
packcmd   = "{compressor}.exe" precomp { -option} --diff=* - - <stdin> <stdout>
unpackcmd = "{compressor}.exe" decode -t100p - - <stdin> <stdout>

pack.bat
arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r -w.\temp -m"xtool:c256mb:mbk2" data.arc "pack\*"

I also tested using it directly from the command line after removing --diff=* from arc.ini:
xtool:c256mb:mbk2:-diff=*
xtool:c256mb:mbk2:df*

Arc.ini

--cache=0
[External compressor:xtool]
header    = 0
default   = -c64mb -t100p
packcmd   = "{compressor}.exe" precomp { -option} - - <stdin> <stdout>
unpackcmd = "{compressor}.exe" decode -t100p - - <stdin> <stdout>

pack.bat
arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r -w.\temp -m"xtool:c256mb:mbk2:df*" data.arc "pack\*"
or
arc.exe a -ep1 -dses --dirs -s; -lc- -di -i2 -r -w.\temp -m"xtool:c256mb:mbk2:-diff=*" data.arc "pack\*"

If I don't use --diff=* it compresses normally.

FreeArc 0.67 (March 15 2014) using additional options: --cache=0
Creating archive: data.arc using xtool:c256mb:mbk2
Memory for compression 0b, decompression 0b, cache 0b
Compressing 5 files, 336,582,396 bytes
  Compressing health_screen.bk2
  Compressing ms_logo.bk2
  Compressing ps_studios_long_strawberry_4k30_006.bk2
  Compressing lt_outro_1080p.bk2
  Compressing lt_intro_1080p.bk2
Compressed 5 files, 336,582,396 => 291,316,936 bytes. Ratio 86.55%
Compression time: cpu 0.20 sec/real 29.95 sec = 1%. Speed 11.24 mB/s
All OK

Am I doing something wrong?

[Masquerade]

Originally Posted by Cesar82

Am I doing something wrong?

The --diff parameter in XTool sets a max size in bytes or percentage size of the stream in order for XTool to accept the stream.

The * character is just a placeholder (a wildcard effectively meaning anything/everything). My explanation meant you'd need to change this to an integer.

By default, XTool will not accept a stream if the generated XDelta patch is greater in size than 5% of the stream, but using --diff= allows you to increase this threshold.

You can use --diff=20p to set the max patch size to be less than or equal to 20% of the stream size for XTool to accept the stream. You can also use an integer to specify a max patch size in bytes (e.g. --diff=50000).

[exorc]

Originally Posted by Masquerade

Bink Video

• XTool plugin adding support for Bink Video compression.
• This plugin uses Bink Pack library by ProFrager.
• Thanks to Razor12911 for the little help.

Advantages of using this plugin versus vanilla Bink Pack

• Multithreading support.
• No CRC check fail since XTool will patch the videos as they are unpacked.
• Incompatible Bink 2 videos (KB2n) are automatically ignored.

Special Notes

• For Bink 2 videos, you may need to make use of the --diff=* parameter as some patches between CRC imperfect videos to the original state can be larger than XTool's default threshold for patches.
• You may need to use a large chunk size to ensure all videos are processed. See example below.

Example Usage

• Extract the attached archive to the XTool folder and use -mbik or -mbk2 depending on your data set.

Test

• Test on the videos from Assassin's Creed 2 (27x Bink 1 videos).
  

  xtool precomp -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 13/13
  Time: 00:00:09 (00:00:01)
  Memory: 148 MB (148 MB)
  
  Results: 937 MB >> 928 MB

  xtool precomp -c128mb -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 26/26
  Time: 00:02:12 (00:00:04)
  Memory: 391 MB (391 MB)
  
  Results: 937 MB >> 776 MB

  xtool precomp -c256mb -mbik "AC2Videos\"
  XTool is created by Razor12911
  
  Streams: 27/27
  Time: 00:02:25 (00:00:06)
  Memory: 677 MB (677 MB)
  
  Results: 937 MB >> 725 MB

• Test on 05_DAM folder from Shadow Warrior 3 Defintive Edition (6x Bink 2 videos).
  

  xtool precomp -c256mb -mbk2 "SW3\Content\Movies\Cutscenes\05_DAM"
  XTool is created by Razor12911
  
  Streams: 6/6
  Time: 00:01:06 (00:00:03)
  Memory: 406 MB (406 MB)
  
  Results: 214 MB >> 187 MB

How to use with DiskSpan GUI?

[kj911]

Originally Posted by Masquerade

Bink Video

• Extract the attached archive to the XTool folder and use -mbik or -mbk2 depending on your data set.

Whats wrong or am i lame?? (From testing. See two attached pictures.)

Directly use Binkpack.exe or Freearc usaged whole Bink*.exe file and or CLS-based (de)compressors its works in (de)compress in vice versa... Packed 3.07GB huge BIK file correctly to 2.4GB size with Binkpack.
Use Xtool 0.71 directly or Arc with configurations, don't compress smaller.

[KaktoR]

Originally Posted by Masquerade

Bink Video

• XTool plugin adding support for Bink Video compression.
• This plugin uses Bink Pack library by ProFrager.
• Thanks to Razor12911 for the little help.

Advantages of using this plugin versus vanilla Bink Pack

• Multithreading support.
• No CRC check fail since XTool will patch the videos as they are unpacked.
• Incompatible Bink 2 videos (KB2n) are automatically ignored.

Special Notes

• For Bink 2 videos, you may need to make use of the --diff=* parameter as some patches between CRC imperfect videos to the original state can be larger than XTool's default threshold for patches.
• You may need to use a large chunk size to ensure all videos are processed. See example below.

Example Usage

• Extract the attached archive to the XTool folder and use -mbik or -mbk2 depending on your data set.

Updated plugin.

Basically the 'MessageBoxA' was patched out and replaced with some other function from User32.dll. On some bink2 inputs you had encountered some error messages like 'MotionData_warn' or 'err'. I have included two samples for which it is the case. You shouldn't receive error messages anymore with this patched plugin. Inputs which would give these types of errors are just ignored but processed still, but not compressed with binkpack.

Thanks to masquerade and Razor12911.

[Masquerade]

Plugin Update

Added STDIN/STDOUT support for Bink Video plugin (thanks to Gehrman for idea).

Thanks to 78372 for cls wrapper.

Usage has not changed, but its significantly faster.