Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 18-06-2022, 03:28
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 237
Thanks: 174
Thanked 306 Times in 106 Posts
elit is on a distinguished road
Xtool:crilayla 4Gb patched

So I had an interesting experience with repacking Valkyria Chronicles 4 yesterday. There is a base.cpk file of 22gb size. I still prefer to use older xtool with crilayla support as newer methods produce temporary files and spawn processes. By default I have it set to c32mb chunk size. File was inflated to 32.8gb, yet after compression I only achieved around 2gb better size than fitgirl. However, I recoded videos from 9.9gb to 1.7gb! So knowing I missed something I started experiencing:

Code:
t8 + c32mb = 32.8gb
t8 + c64mb = 37.8gb
t8 + c128mb = 39.4gb
t8 + c256mb = ~27gb
I dont remember exactly, but on c256mb t8 inflation simply tanked. Then I tried:

Code:
t4 + c256mb = ~32gb
I think size was something like that but I would lie if I claim to know exactly. Point is it certainly was under 40gb. Also, clearly, this game is one of those...

I started testing and watching again for memory usage but did not wait to finish whole file because was late, but at reaching input stream of around 8gb, xtool was inflating to 11gb and stayed just under 2gb usage (~1850mb), remaining there(test was done with lz scan).

32bit exe's by default do not support 4gb memory usage, but only 2gb due to OS constrains, so idea to apply 4gb patch came to my mind. And behold, there was a difference. Already at input of ~4gb, xtool went above 2gb RAM and also inflated more. At input of ~6gb, it was already consuming ~2.5gb memory and inflated to around ~11gb(before it inflated to 11gb when input was already at 8gb). This was with same settings. I did not continue as it was almost morning, but clearly patching exe helped.

Before, there would be no error or anything, tool will silently drop processing chunks and you get smaller size!

With patched exe again:

Code:
t4 + c256mb = 42.3gb!
I will probably try experimenting further on this game(like t2 + c512mb), but anyway here is the 4gb patched xtool:crilayla:

xtool_4gb_crilayla.zip

EDIT: Just in case although it should be obvious, all credit goes to Razor for making the tool in the first place!

Last edited by elit; 18-06-2022 at 06:20.
Reply With Quote
The Following 5 Users Say Thank You to elit For This Useful Post:
:( Sad8669 (18-06-2022), Gehrman (18-06-2022), kj911 (18-06-2022), L0v3craft (20-06-2022), Razor12911 (23-06-2022)
Sponsored Links
  #2  
Old 18-06-2022, 11:53
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 237
Thanks: 174
Thanked 306 Times in 106 Posts
elit is on a distinguished road
Here is my recommendation on maximum threads/chunk size with patched xtool:crilayla, based on observation from compressing 22gb cpk:

-use c512mb as a maximum and on single thread(t1)
-2t c256mb
-4t c128mb
-8t c64mb
...and so on.

On 2t c256mb I reached ~3.6gb ram usage, hence above recommendation.

Raising chunk size worked for me, I was able to repack Valkyria Chronicles 4 to 7.5gb, which correspond with recoded videos size. Moral of the story is, just because you were able to inflate data does not mean it inflated them all properly. This is especially valid for crilayla and sometimes zlib/deflate, less so for fixed stream chunk oriented compression in games like lz4, zstd, oodle? and so on.
Reply With Quote
  #3  
Old 18-06-2022, 12:39
kj911 kj911 is offline
Registered User
 
Join Date: Apr 2010
Location: world
Posts: 80
Thanks: 45
Thanked 24 Times in 16 Posts
kj911 is on a distinguished road
So, for games that use zlib, can you bring an improvement in compressibility, a larger chunk size, more efficient unpacking of data that can be repackaged more efficiently?
Reply With Quote
  #4  
Old 18-06-2022, 13:08
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 237
Thanks: 174
Thanked 306 Times in 106 Posts
elit is on a distinguished road
@kj911 I only patched older xtool that still supported crilayla natively, because it is 32bit app - to utilize full 4gb memory range. New xtool is 64bit in active development and any query for better efficiency shall be addressed to its original developer.
Reply With Quote
  #5  
Old 23-06-2022, 23:39
Razor12911's Avatar
Razor12911 Razor12911 is offline
Programmer
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,636
Thanks: 2,013
Thanked 10,339 Times in 2,202 Posts
Razor12911 is on a distinguished road
Hmm, does the this plugin have the same problem?
Reply With Quote
  #6  
Old 24-06-2022, 15:06
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 237
Thanks: 174
Thanked 306 Times in 106 Posts
elit is on a distinguished road
Quote:
Originally Posted by Razor12911 View Post
Hmm, does the this plugin have the same problem?
Looks like there is a problem with both quickbms or crilayla.exe plugins. It does not inflate base.cpk from Valkyria Profile 4 at all. Older xtool with native cri support does. Although file is 22gb, here is the first 8mb sample:

sample.7z

Now this is how it inflate with older xtool:

sample.png

With new xtool and either of 2 following settings, it does nothing:

Code:
[cpk2]
Encode=crilayla.exe d <library>
Decode=crilayla.exe e <library>

[cpk,snappy,rfpk,slz_03]
Encode=quickbms.exe -s "comtype <codec> ; clog <fileout> 0 <insize> <outsize>" "" <filein>
Decode=quickbms.exe -s "comtype <codec>_COMPRESS ; clog <fileout> 0 <insize> <outsize>" "" <filein>
Second option also have: cpk.zip that I generated from bms script.
All files(quickbms.exe, crilayla.exe, xtool.exe + libs + xtool.ini) are in xtool directory. I swear it was working before, maybe I tested on different cpk file/game?

EDIT: I can now confirm problem being new xtool with either method. It does work on another file from same game(dlc_003_en.cpk) but not on base.cpk(or provided sample). Old xtool(one provided here) does work on both files.

Last edited by elit; 25-06-2022 at 09:39.
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
REQ: Fifa 06 Mini Image for the Patched version (to fix the controller issue) bu22ard PC Games 1 22-10-2005 11:24
HELP!! Patched dino crisis still not working! any suggestions? sneaky1 PSX Games 9 08-05-2002 23:04
THE ITALIAN JOB AND PATCHED GAMES Ali130 PSX Games 1 14-01-2002 05:15
Modded SCPH-15000... and patched Pal PS2 Games MachT PSX Games 2 15-03-2001 14:25
NEEDED: No-CD cracked .exe for PATCHED version of Delta Force Land Warrior jdiehl PC Games 0 13-11-2000 13:08



All times are GMT -7. The time now is 07:52.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com