XTool 2020 (Plugins) - Page 4

Cesar82 · #46 21-01-2021, 20:27

Quote:

Originally Posted by Razor12911

1) https://fileforums.com/showpost.php?...5&postcount=31

The library include is from the latest zstd build, 2020. Mass Effect Andromeda came out in 2017. If you read what I said regarding lz4 that it also applies to zstd, you'll know why the old library works and the new one doesn't.

2) https://fileforums.com/attachment.ph...chmentid=28782

I attached the libraries from the games.

Thank you for the informations.
So that must be why I tested it with StarWarsBF2 (zstd) and it didn't inflate either.
Is only libzstd.dll and liblz4.dll necessary for a compatible version? (does not have a version that usually works in all games)
Thanks for the libraries!

Razor12911 · #47 21-01-2021, 20:36

Oodle experiences the same thing, as an example oo2core_6_win64.dll from FIFA 19 game doesn't inflate good as the one you find from WWE 2K19 I think. (Which means the developers compressed the game using a different dll and then shipped the game with another dll)

oo2core_6_win64.dll has variants on its own, you just need to check the change log, oo = denotes oodle, 2 denotes version 2, that 6 is the sub version. When checking the change log. You have something like 2.6.#.

From the change log, there was 2.6.0, 2.6.1, 2.6.2, 2.6.3.

Things to check in the change log is things related to better compression or improved speed.
"Mermaid, Kraken & Leviathan decompress faster by 5-10%" as an example.

These improvements are what affect xtool from being able to precompress streams because the recompressed stream is much different from before.

You can find the change log here.

http://www.radgametools.com/oodlehist.htm

Mostly the library that comes with game usually works though.

Razor12911 · #48 22-01-2021, 02:25

Hitman

Supported games
Hitman 3

Usage
Place hitman.dll near xtool.exe along with required libraries and use -mhitman3

Notes

The library is required both encoding and decoding.

The game will be decrypted and precompressed in one go but you have to use -d1 parameter.

The method to use -mhitman3+lz4

liblz4.dll is required

Edit:

Information useful for plugin's completion is taken from here:
https://zenhax.com/viewtopic.php?f=9&t=14768

KaktoR · #49 22-01-2021, 02:50

Ok, so what I'm doing wrong here?

Razor12911 · #50 22-01-2021, 03:05

Was busy debugging something, must have forgotten to remove the code. Hotfix uploaded in main project thread.

KaktoR · #51 22-01-2021, 03:14

Thanks, now it works.

Test for MEA

Code:

Using libzstd.dll v1.1.4

XTool -mfrostbite3:zstd
Compressed 1 file, 533,887,818 => 632,100,466 bytes. Ratio 118.40%
Compression time: cpu 0.45 sec/real 5.78 sec = 8%. Speed 92.32 mB/s

Extracted 1 file, 632,100,466 => 533,887,818 bytes. Ratio 118.40%
Extraction time: cpu 0.42 sec/real 5.23 sec = 8%. Speed 102.08 mB/s


zstdrec
Compressed 1 file, 533,887,818 => 632,155,533 bytes. Ratio 118.41%
Compression time: cpu 0.50 sec/real 9.24 sec = 5%. Speed 57.81 mB/s

Extracted 1 file, 632,155,533 => 533,887,818 bytes. Ratio 118.41%
Extraction time: cpu 0.45 sec/real 5.24 sec = 9%. Speed 101.89 mB/s

I will do some more tests

----

Code:

MEA
Using libzstd.dll v1.1.4

XTool -mfrostbite3:zstd
Compressed 1 file, 533,887,818 => 632,100,466 bytes. Ratio 118.40%
Compression time: cpu 0.45 sec/real 5.78 sec = 8%. Speed 92.32 mB/s

Extracted 1 file, 632,100,466 => 533,887,818 bytes. Ratio 118.40%
Extraction time: cpu 0.42 sec/real 5.23 sec = 8%. Speed 102.08 mB/s


-mzstd
Compressed 1 file, 533,887,818 => 632,853,711 bytes. Ratio 118.54%
Compression time: cpu 0.47 sec/real 6.28 sec = 7%. Speed 84.97 mB/s

Extracted 1 file, 632,853,711 => 533,887,818 bytes. Ratio 118.54%
Extraction time: cpu 0.38 sec/real 4.75 sec = 8%. Speed 112.43 mB/s

----

Tests with SWBF2

Code:

Using libzstd.dll v1.3.2 (v1.3.3 does not work)

xtool -mzstd
Compressed 1 file, 6,923,743 => 8,226,010 bytes. Ratio 118.81%
Compression time: cpu 0.02 sec/real 1.63 sec = 1%. Speed 4.24 mB/s

Extracted 1 file, 8,226,010 => 6,923,743 bytes. Ratio 118.81%
Extraction time: cpu 0.00 sec/real 0.63 sec = 0%. Speed 11.04 mB/s


libzstd v1.3.0 (zstd v1.3.1 does not have a library inside the archive on github for some reason)
Compressed 1 file, 6,923,743 => 9,238,179 bytes. Ratio 133.43%
Compression time: cpu 0.00 sec/real 1.14 sec = 0%. Speed 6.05 mB/s

Extracted 1 file, 9,238,179 => 6,923,743 bytes. Ratio 133.43%
Extraction time: cpu 0.00 sec/real 0.62 sec = 0%. Speed 11.24 mB/s


zstdrec
Compressed 1 file, 6,923,743 => 9,237,137 bytes. Ratio 133.41%
Compression time: cpu 0.02 sec/real 0.56 sec = 3%. Speed 12.45 mB/s

Extracted 1 file, 9,237,137 => 6,923,743 bytes. Ratio 133.41%
Extraction time: cpu 0.02 sec/real 0.21 sec = 7%. Speed 32.30 mB/s

Edit: Link for libraries - https://github.com/facebook/zstd/releases

Razor12911 · #52 22-01-2021, 03:19

could also test -mzstd

and compare the results. two ways you can process MEA.
using frostbite plugin or using the internal codec.

compare the size and speed, then decide which is best.

dixen · #53 22-01-2021, 04:34

UE4 plugin DON'T WORK with xtool_0.3.3

I try decompress pakchunk51-WindowsNoEditor_0_P.pak (Borderlands 3 without DENUVO release) and

XTool 0.3.3 (with unreal.dll)

Quote:

Compressed 1 file, 18,898,278 => 18,898,657 bytes. Ratio 100.00%
Compression time: cpu 0.05 sec/real 2.23 sec = 2%. Speed 8.49 mB/s
All OK

ue4dt+xtool 0.3.3

Quote:

Compressed 1 file, 18,898,278 => 37,209,593 bytes. Ratio 196.89%
Compression time: cpu 0.03 sec/real 2.57 sec = 1%. Speed 7.35 mB/s
All OK

NOTE.
Xtool settings -mzlib+ue4:m1:k115EE4F8C625C792F37A503308048E79726E 512F0BF8D2AD7C4C87BC5947CBA7

Razor12911 · #54 22-01-2021, 04:43

did you use -d1?

dixen · #55 22-01-2021, 04:49

Quote:

Originally Posted by Razor12911

did you use -d1?

Yeap..

Quote:

Compressed 1 file, 18,898,278 => 18,981,829 bytes. Ratio 100.44%
Compression time: cpu 0.02 sec/real 1.19 sec = 1%. Speed 15.86 mB/s
All OK

Quote:

packcmd = xtool.exe precomp -mue4:m1:k115EE4F8C625C792F37A503308048E79726E512F0 BF8D2AD7C4C87BC5947CBA7+zlib+preflate -c128mb -t100p -d1 --dbase - - <stdin> <stdout>

Razor12911 · #56 22-01-2021, 04:49

sample?

dixen · #57 22-01-2021, 04:59

Quote:

Originally Posted by Razor12911

sample?

http://sendfile.su/1592675

Razor12911 · #58 22-01-2021, 05:17

try 0.3.4

dixen · #59 22-01-2021, 05:23

Quote:

Originally Posted by Razor12911

try 0.3.4

That's better)

Compressed 1 file, 18,898,278 => 25,297,361 bytes. Ratio 133.86%
Compression time: cpu 0.00 sec/real 2.24 sec = 0%. Speed 8.44 mB/s
All OK

But ue4dt - Ratio 196.89%

Razor12911 · #60 22-01-2021, 05:52

am I missing something? run this test

Thread Tools
Show Printable Version Email this Page
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
XTool 2020 (Main Project)	Razor12911	Conversion Tutorials	695	22-07-2024 03:36
XTool - Successor of ZTool	Razor12911	Conversion Tutorials	584	22-04-2023 18:16
[Dev]XTool	Razor12911	Conversion Tutorials	180	23-10-2020 06:26
XTool 2019 (Plugins)	Razor12911	Conversion Tutorials	50	16-05-2020 06:14

The Following 3 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (21-01-2021), ffmla (22-01-2021), KaktoR (22-01-2021)

The Following 6 Users Say Thank You to Razor12911 For This Useful Post:
Cesar82 (22-01-2021), Gehrman (27-04-2021), KaktoR (22-01-2021), L0v3craft (23-01-2021), Masquerade (23-01-2021), ramydarkness (19-03-2022)

The Following User Says Thank You to KaktoR For This Useful Post:
Razor12911 (22-01-2021)

The Following User Says Thank You to Razor12911 For This Useful Post:
KaktoR (22-01-2021)

The Following 2 Users Say Thank You to dixen For This Useful Post:
L0v3craft (22-01-2021), Razor12911 (22-01-2021)

The Following User Says Thank You to dixen For This Useful Post:
Razor12911 (22-01-2021)

The Following User Says Thank You to dixen For This Useful Post:
L0v3craft (22-01-2021)