FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Best Compression Methods for 'Specific' Games. Q&A (https://fileforums.com/showthread.php?t=99554)

yasitha 09-03-2019 08:12

Quote:

Originally Posted by Sergey3695 (Post 480092)

Yes, yes hahaha 😂

dixen 11-03-2019 11:06

Devil May Cry 5 (Without DLC Live Action Cutscenes)

All *.pak - zstdrec+xtool+srep+lolz

32 gb => 21.7 gb

Compression time - 9 hours (+~40 min for decompression)
Install time - 25 minutes

Thanks Razor1911 for recompression tools))

KaktoR 11-03-2019 13:01

Frostpunk
v1.3.3

Code:

xZLib+srep:m3f+4x4:lzma
18:07:40 - Starting Data1.bin.001 creation
18:47:33 - Finished Data1.bin.001 creation

18:47:35 - Original size:  7.122g
18:47:35 - Compressed size: 4.732g



xZLib+srep:m3f+lolz:dtb1:mtt1:mt6:d128m:mc1023
19:11:26 - Starting Data1.bin.001 creation
21:50:32 - Finished Data1.bin.001 creation

21:50:34 - Original size:  7.122g
21:50:34 - Compressed size: 3.919g


darkwolves 11-03-2019 13:51

Devil May Cry 5 Deluxe Edition
 
method Xtool zlib Combined with zstd precompression nothing ripped or recoded
Xzlib+zstdrec+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dt d1:mtt0:mt4:d100m:tt8
original size 37.4 gb
repack size 28.9 gb

lordminion777 12-03-2019 20:43

Quote:

Originally Posted by dixen (Post 480141)
Devil May Cry 5 (Without DLC Live Action Cutscenes)

All *.pak - zstdrec+xtool+srep+lolz

32 gb => 21.7 gb

Compression time - 9 hours (+~40 min for decompression)
Install time - 25 minutes

Thanks Razor1911 for recompression tools))

Please post your exact lolz settings from your arc.ini :(

yasitha 12-03-2019 21:28

Quote:

Originally Posted by lordminion777 (Post 480161)
Please post your exact lolz settings from your arc.ini :(

On xtool arc.ini = c32mb,t75p:zlib

zstdrec+xZlib+srep:m3f+lolz:dtb1:d128m:mtt1:mt4

Also You can use d192m and mc1023 and m5f to get better ratio.. if you have 8 threads or 16T cpu change
mt4 to 8 or 16.. It will speed up the process..

ShivShubh 12-03-2019 21:36

Quote:

Originally Posted by yasitha (Post 480162)
On xtool arc.ini = c32mb,t75p:zlib

zstdrec+xZlib+srep:m3f+lolz:dtb1:d128m:mtt1:mt4

Also You can use d192m and mc1023 and m5f to get better ratio.. if you have 8 threads or 16T cpu change
mt4 to 8 or 16.. It will speed up the process..

I would recommend using xprecomp (xzlib) first.

lordminion777 12-03-2019 21:38

Quote:

Originally Posted by yasitha (Post 480162)
On xtool arc.ini = c32mb,t75p:zlib

zstdrec+xZlib+srep:m3f+lolz:dtb1:d128m:mtt1:mt4

Also You can use d192m and mc1023 and m5f to get better ratio.. if you have 8 threads or 16T cpu change
mt4 to 8 or 16.. It will speed up the process..

I know how to use these tools and their settings. I need to know his exact lolz settings to get 21.7 GB size because I can't get that size with my settings.

FitGirl 12-03-2019 23:30

Quote:

Originally Posted by lordminion777 (Post 480164)
I know how to use these tools and their settings. I need to know his exact lolz settings to get 21.7 GB size because I can't get that size with my settings.

Well i have!

Pack All files with srep+lolz, ( exe, dll, bin, etc..)
and all small (.pak) files with zstdrec+zlib+srep+lolz

For that Big 33GB file,
Use exact settings that i gave you earlier.

and You have to remove 6.05GB useless video DLC file
with that one you'll never even able to get 24GB

So remove that one...

Quote:

Originally Posted by yasitha (Post 480165)
Well i have!

Pack All files with srep+lolz, ( exe, dll, bin, etc..)
and all small (.pak) files with zstdrec+zlib+srep+lolz

For that Big 33GB file,
Use exact settings that i gave you earlier.

and You have to remove 6.05GB useless video DLC file
with that one you'll never even able to get 24GB

So remove that one...

Who told you it's useless?

Quote:

Originally Posted by FitGirl (Post 480187)
Who told you it's useless?

That 6GB video file?
No one,
Its like a joke... It's replacing the original video on game so who need it??

lordminion777 12-03-2019 23:57

^You got 21.7 GB with this lolz setting = lolz:dtb1:d128m:mtt1:mt4 ?
Also I saw you used srep:m3f so srep by default went with l512, srep:m3f:l512 is what you used.

dixen 13-03-2019 01:21

Quote:

Originally Posted by lordminion777 (Post 480161)
Please post your exact lolz settings from your arc.ini :(

[External compressor:srep]
header = 0
packcmd = srep -a2 -m3f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor:lolz]
header = 0
packcmd = lolz.exe -mtt1 -tt2 -d128m -mc512 -mt4 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

darkwolves 13-03-2019 03:59

Quote:

Originally Posted by yasitha (Post 480165)
Well i have!
and You have to remove 6.05GB useless video DLC file
with that one you'll never even able to get 24GB

So remove that one...

oddly enough if i remove that i experince crashes at random

yasitha 13-03-2019 04:59

Quote:

Originally Posted by darkwolves (Post 480169)
oddly enough if i remove that i experince crashes at random

Not possible, cause this DLC available only Deluxe Edition. So whoever had the standard edition don't have this DLC. I Have play the game and finish the game without any problem. 60FPS locked all times.

I have removed the DLC. befe o finish the game.

Run game as administrator and update the vga drivers and install vc 2017 on game folder which is new version.

I don't think that DLC is the problem... Something else.

Simorq 13-03-2019 05:30

Ace Combat 7: Skies Unknown
 
Code:

Title:          Ace Combat 7: Skies Unknown - Deluxe Launch Edition
Version:        1.0.1

PC:              6 Cores 3.2GHz + 16GB Ram + HDD + DiskSpan

Re-Encoded:    Yes (1080p 25MB Bitrate > 1080p VBR Bitrate)
Video Folder:  Game\Content\CriWare\Scene
              Game\Content\CriWare\Briefing

Original Size:  39.6 GB
Compressed Size: 24.2 GB

Method:          srep:m3f:l512+lolz:d64m:mtt1:mt6:mc1023
               
Disk:    6xDVD5

Tools:
VGMToolBox
XviD4PSP
Scaleform VideoEncoder 4

Fast m2v to avi
http://s9.picofile.com/file/8354942342/m2v_to_avi.jpg

can use Batch to reduce time.
Example:
Code:

SET Scaleform="D:\GameTools\Scaleform VideoEncoder\medianoche.exe"
SET Dir=L:\Program Files (x86)\Ace Combat 7 - Skies Unknown\Game\Content\CriWare\Briefing
SET ODir=L:\Program Files (x86)\Ace Combat 7 - Skies Unknown\Game\Content\CriWare\Briefing

%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms01.avi" -output="%ODir%\ms01.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms02.avi" -output="%ODir%\ms02.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms03.avi" -output="%ODir%\ms03.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms04.avi" -output="%ODir%\ms04.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms05.avi" -output="%ODir%\ms05.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms06.avi" -output="%ODir%\ms06.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms07.avi" -output="%ODir%\ms07.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms08.avi" -output="%ODir%\ms08.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms09.avi" -output="%ODir%\ms09.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms10.avi" -output="%ODir%\ms10.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms11.avi" -output="%ODir%\ms11.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms12.avi" -output="%ODir%\ms12.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms13.avi" -output="%ODir%\ms13.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms14.avi" -output="%ODir%\ms14.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms15.avi" -output="%ODir%\ms15.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms16.avi" -output="%ODir%\ms16.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms17.avi" -output="%ODir%\ms17.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms18.avi" -output="%ODir%\ms18.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms19.avi" -output="%ODir%\ms19.usm" -bitrate=12000000
%Scaleform%    -gop_closed=on -gop_i=1 -gop_p=4 -gop_b=2 -video00="%Dir%\ms20.avi" -output="%ODir%\ms20.usm" -bitrate=12000000
pause

Finally, the quality is 99%.:D

danswano 13-03-2019 07:05

zstdrec first or xtool first and why?
when i precompress the big .pak files instead of getting a bigger file i get a smaller file
What's wrong?

yasitha 13-03-2019 07:19

Quote:

Originally Posted by danswano (Post 480174)
zstdrec first or xtool first and why?
when i precompress the big .pak files instead of getting a bigger file i get a smaller file
What's wrong?

Use zstdrec+xtool+srep+lolz

Don't use xtool+zstdrec

I get 51GB ratio like 176%!

if you use xtool+zstdrec, ratio going to be low, like 172%

I have test it,
that's why i know.

To your problem,
Download xtool_11 and zstdrec, then combine them
And edit pack.bat and add zstdrec+xtool to - m method.

Do you know right?

Then test only that big pak file. Youll get 51.065MB

zlib use c32mb chunk.

darkwolves 13-03-2019 08:31

Quote:

Originally Posted by yasitha (Post 480170)
Not possible, cause this DLC available only Deluxe Edition. So whoever had the standard edition don't have this DLC. I Have play the game and finish the game without any problem. 60FPS locked all times.

I have removed the DLC. befe o finish the game.

Run game as administrator and update the vga drivers and install vc 2017 on game folder which is new version.

I don't think that DLC is the problem... Something else.

very possible only happens when i remove it stops when i put it back
all my drivers and runtimes are fully up to date

yasitha 13-03-2019 08:35

Quote:

Originally Posted by darkwolves (Post 480176)
very possible only happens when i remove it stops when i put it back
all my drivers and runtimes are fully up to date

Hm.. Remove with the folder...
If you have *C* version then try edition game ini file and remove that Live Action DLC from dlcs list.

but i only remove the folder that's all game work perfectly..

darkwolves 13-03-2019 08:36

Quote:

Originally Posted by yasitha (Post 480177)
Hm.. Remove with the folder...
If you have *C* version then try edition game ini file and remove that Live Action DLC from dlcs list.

but i only remove the folder that's all game work perfectly..

i've already done that

yasitha 13-03-2019 09:44

Quote:

Originally Posted by darkwolves (Post 480178)
i've already done that

It's only work with C Ver,
Legit Ver can't,
cause steam knows it missing...

KaktoR 14-03-2019 03:59

Far Cry New Dawn
1 language + HD Pack

Code:

Xtool+srep+lolz:dtb1:mtt1:mt6:d128m:mc1023

19:27:11 - Starting Data1.bin.001 creation
 1:20:14 - Finished Data1.bin.001 creation
 1:20:15 - Starting Data2.bin.001 creation
 2:00:47 - Finished Data2.bin.001 creation

Original size:  39.626g
Compressed size: 23.446g


hwang4 16-03-2019 22:37

Hi , Need Some help , on DeviL May Cry 5!
when i try to use "zstdrec" , i got always the "crc check error" even when i'm using it only! via the MASK method (UltraARC V2.9.0.0. Final Rev.)! ido not have any problems using
"xZLib+srep:m5f+lolz:dtb1:d192m:mtt1:mt6:mc1023"!: )

bunti_o4u 17-03-2019 02:15

Quote:

Originally Posted by KaktoR (Post 480185)
Far Cry New Dawn
1 language + HD Pack

Code:

Xtool+srep+lolz:dtb1:mtt1:mt6:d128m:mc1023

19:27:11 - Starting Data1.bin.001 creation
 1:20:14 - Finished Data1.bin.001 creation
 1:20:15 - Starting Data2.bin.001 creation
 2:00:47 - Finished Data2.bin.001 creation

Original size:  39.626g
Compressed size: 23.446g


Which codec you are using in Xtool..

KaktoR 17-03-2019 02:21

lz4

PS: According to this https://fileforums.com/showpost.php?...20&postcount=9 there is only a small difference (xtool did inflate the files up to ~160% or so If I remember right).

darkwolves 19-03-2019 18:42

assistance appreciated
 
i recently sufferd HDD hard drive failure i lost all the tools i used
i have replaced it with a hybrid SSD and am nowgood to go
i have been slowly collecting things but i cannot find what i was
using to pack back up unreal engine 4 files after extractng
if anyone can kindly point me in the right direction i would very much appreciate it

yasitha 19-03-2019 22:17

Quote:

Originally Posted by darkwolves (Post 480286)
i recently sufferd HDD hard drive failure i lost all the tools i used
i have replaced it with a hybrid SSD and am nowgood to go
i have been slowly collecting things but i cannot find what i was
using to pack back up unreal engine 4 files after extractng
if anyone can kindly point me in the right direction i would very much appreciate it

You mean this one?
http://krinkels.org/threads/uelr.3645/

Andu21 20-03-2019 06:40

Quote:

Originally Posted by darkwolves (Post 480286)
using to pack back up unreal engine 4 files after extractng

u4pak

bunti_o4u 20-03-2019 08:10

Quote:

Originally Posted by KaktoR (Post 480226)
lz4

PS: According to this https://fileforums.com/showpost.php?...20&postcount=9 there is only a small difference (xtool did inflate the files up to ~160% or so If I remember right).

the reference post used only srep and lolz for compression.. no lz4

Quote:

Originally Posted by Danziel123 (Post 479920)
Thank you Mausschieber for working my request.
Compress using srep & lolz get 6x dvd5

Test install & play work perfect:D

I am using below settings in arc.ini. can you check whether setting are correct?

[External compressor:xlz4]
header = 0
packcmd = xtool e:precomp:c128m,t8:lz4 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd = xtool d:precomp:t100p - - <stdin> <stdout>

if these setting are correct, still files are not getting inflate..

KaktoR 20-03-2019 09:19

^ Read my post more carefully.

I used lz4 for precompression. And I said that the difference is not that big (~500mb) and that ratio for xtool was about ~160%.

bunti_o4u 20-03-2019 10:06

Quote:

Originally Posted by KaktoR (Post 480296)
^ Read my post more carefully.

I used lz4 for precompression. And I said that the difference is not that big (~500mb) and that ratio for xtool was about ~160%.

My only concern is that I am using lz4 for precompression but the ratio is 100% not 160% as you mentioned. So I am wondering what's going wrong?

And I asked the same thing in my earlier post...

Snake288 20-03-2019 10:10

XTool(v011) (Far Cry New Dawn)
 
A little observation on the last XTool(v011) (Far Cry New Dawn)
Code:
[Dunia2]
BaseDir=pack\data_final\pc
File1=common.dat
File2=patch.dat
File3=patchshadersobj.dat
File4=shadersobj.dat
File5=worlds\fcbworlds.dat
File6=worlds\installpkg.dat
Code:
-m=xtool:c16mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 19,956,114,780 bytes. Ratio 102.04%

-m=xtool:c32mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,674,136 bytes. Ratio 143.72%

-m=xtool:c64mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,669,872 bytes. Ratio 143.72%

-m=xtool:c128mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,960 bytes. Ratio 143.72%

-m=xtool:c512mb,t8:lz4
Compressed 12 files, 19,557,312,354 => 28,107,668,088 bytes. Ratio 143.72%

Andu21 20-03-2019 10:35

Quote:

Originally Posted by bunti_o4u (Post 480299)
My only concern is that I am using lz4 for precompression but the ratio is 100% not 160% as you mentioned. So I am wondering what's going wrong?

Check if liblz4.dll is present and loaded by xtool. If not, put the one with the correct architecture.

panker1992 22-03-2019 08:21

Sekiro Shadows Die Twice:

Break Game into 3 Section:
Section 1:
Videos: BPK
openingmovie.bk2 copy this file one more time and rename it to "openingmovie_hi.bk2"
stafflistmovie.bk2 use my BINK encoder to encode the first 6~7 Megabytes
This will result into popping the First 2 3 seconds in the end with Sekiro Display :D
End file = 221.mb

Section 2:
Audio and Executables use this:
7Zip_Shelwien Bat

You end up with 564MB file.

Section 3:
Game files:
arc\Arc a -ma9 -ds -lc4096 -ld4096 -di -i1 -ep1 -ed -r -w.\ Setup-3.xarc ^
-mpoodle+srep:m3f:a2:l256+lolzi:d128m:mt2:ldmf1:ldc 0:mc1023:mtb64:x0 "D:\Games\Sekiro Shadows Die Twice\3\*"

End File=7.95GB

Total: 8.72 GB

You can do a bit more if you absolutely MUST

Use Bink2 encoder, to lower 720p the videos,
Use higher and single thread lolz to squeeze a few more MB
Enjoy

Tools are here: https://fileforums.com/showthread.php?t=102689

yasitha 22-03-2019 22:36

I Need HELP!

I want to Repack Call of Duty Balck Ops 3
I try finding Precompressor. But i didn't find anything.

Can anyone help me? :(

ShivShubh 22-03-2019 23:09

Quote:

Originally Posted by yasitha (Post 480334)
I Need HELP!

I want to Repack Call of Duty Balck Ops 3
I try finding Precompressor. But i didn't find anything.

Can anyone help me? :(

Majority of the files are packed using lz4hc for which no public precompressors exist.

yasitha 22-03-2019 23:12

Quote:

Originally Posted by ShivShubh (Post 480335)
Majority of the files are packed using lz4hc for which no public precompressors exist.

so there's no way to Precompressor that game? :(

panker1992 23-03-2019 15:04

Yasitha, lz4HC only works this way, find a way to unpack game files manually by searching the net for tools, find what method was used to actually compress the game
lz4hc -12 -B7 or lz4hc -11 -B7

then pack the game with that same method and run a xdelta to check for differences :D

enjoy

KaktoR 27-03-2019 03:12

Some test for AC Liberation Remastered
(use afr without -a2)
Code:

DataPC_ACV_Chichen_Itza.forge
301.596.672 Bytes

afr+srep:m3f+

lolz:dtb1:mtt1:mt6:d128m:mc1023
Compressed 1 file, 301,596,672 => 24,798,849 bytes. Ratio 8.22%
Compression time: cpu 0.89 sec/real 245.85 sec = 0%. Speed 1.23 mB/s
All OK

4x4:b64mb:lzma:ultra:64m:bt4:fb273:lc8:mc1000000
Compressed 1 file, 301,596,672 => 27,686,068 bytes. Ratio 9.18%
Compression time: cpu 0.73 sec/real 55.38 sec = 1%. Speed 5.45 mB/s
All OK

lzma:a1:mfbt4:d256m:fb273:mc1000000000:lc8
Compressed 1 file, 301,596,672 => 27,596,500 bytes. Ratio 9.15%
Compression time: cpu 0.36 sec/real 50.47 sec = 1%. Speed 5.98 mB/s
All OK

zstd -22 --ultra -T2
Compressed 1 file, 301,596,672 => 31,890,007 bytes. Ratio 10.57%
Compression time: cpu 0.33 sec/real 91.99 sec = 0%. Speed 3.28 mB/s
All OK

Edit:

ACIII:R+L:R
Code:

Compressed block count (subblocks) = 353022 (2186139)
LZO1X-W3(15) subblocks count      = 1480503
LZO1X-999 subblocks count          = 0
LZO2A-999 subblocks count          = 0
LZO1C-999 subblocks count          = 0
OODLE subblocks count              = 0
ZSTD  subblocks count              = 0
Uncompressed subblocks count      = 705636

Compressed subblocks size:  19522484316 -> 44694970389
Uncompressed subblocks size: 17468349094
Other data size:            315047570

Total data+table:            37314625536 -> 62498687973

WARNING! In file found corrupted LZO-streams. Check your data!

Time: 2967.089 secs


Edit:


Code:

17:42:22 - Starting Data1.bin.001 creation
23:41:59 - Finished Data1.bin.001 creation
23:42:00 - Starting Data2.bin.001 creation
 0:50:03 - Finished Data2.bin.001 creation
 Input size:  39.510g
 Output size: 13.537g


darkwolves 28-03-2019 13:19

The walking Dead Final season complete
 
method
decrypted ttarch2 files
after decryption they contained zlib streams
precompressed with Xtool By Razor12911
Xzlib+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt1: mt4:d200m:tt4 h14:fba4096:mc1023:bc8:blr8:bm
initial size 13.7 gb
repack size 6.28 gb

danswano 29-03-2019 08:10

Quote:

Originally Posted by darkwolves (Post 480392)
method
decrypted ttarch2 files
after decryption they contained zlib streams
precompressed with Xtool By Razor12911
Xzlib+srep+lolz:dt1:dtp1:dto1:dtm1:dtw1:dtd1:mtt1: mt4:d200m:tt4 h14:fba4096:mc1023:bc8:blr8:bm
initial size 13.7 gb
repack size 6.28 gb

What is the size of precompressed file?


All times are GMT -7. The time now is 08:55.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com