Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 06-03-2018, 16:10
Razor12911's Avatar
Razor12911 Razor12911 is offline
Coder
 
Join Date: Jul 2012
Location: South Africa
Posts: 3,161
Thanks: 1,675
Thanked 7,506 Times in 1,740 Posts
Razor12911 is on a distinguished road
pUnity - Unity game file precompressor

This was originally a test tool, reason it was not posted here was the fact that I left that decision to the person who helped make it in the first place, my reason was the fact that it uses temps at its current state and I hate those so there is literary no point in posting it, it doesn't come with internal diff maker so there is a chance the restored file might have crc mismatch meaning xdelta has to be used, it's also slow af due to the settings used plus also it doesn't come with multi threading for stream restoration, there is no stdio and it doesn't work on all Unity files, headers are not the same for some versions.

Decided to post it since a few people seem interested in it.
Attached Images
File Type: png Capture130.PNG (75.9 KB, 429 views)
Attached Files
File Type: 7z punity_v01.7z (424.1 KB, 174 views)
__________________
Looking for something?
Visit the
Tutorial Index
Reply With Quote
The Following 24 Users Say Thank You to Razor12911 For This Useful Post:
-NORO- (07-03-2018), 78372 (06-03-2018), Andu21 (07-03-2018), danswano (10-03-2018), elit (09-03-2018), ffmla (07-03-2018), Jiva newstone (07-03-2018), JustFun (06-03-2018), kassane (07-03-2018), mausschieber (07-03-2018), Mini (06-03-2018), Nemko (06-03-2018), NexusIV (07-03-2018), nickwazhere2012 (26-03-2018), oltjon (06-03-2018), pakrat2k2 (13-08-2018), powerwinxp (24-05-2018), PsYcHo_RaGE (19-03-2018), rambohazard (07-03-2018), Simorq (07-03-2018), TheGeekyGamer (11-08-2018), Titeuf (20-08-2018), ZakirAhmad (06-03-2018), zoroX (07-03-2018)
Sponsored Links
  #2  
Old 06-03-2018, 16:13
JustFun's Avatar
JustFun JustFun is offline
Registered User
 
Join Date: Jan 2013
Location: Bosnia and Herzegovina
Posts: 147
Thanks: 422
Thanked 137 Times in 61 Posts
JustFun is on a distinguished road
Nice tool honestly, cause there are a lot of games that use unity and tool like this really really comes in handy, one cane only hope that this one will get updated eventually
Reply With Quote
  #3  
Old 06-03-2018, 19:51
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 532
Thanks: 594
Thanked 610 Times in 232 Posts
78372 is on a distinguished road
Let me make something clear about pUnity so people don't get trouble using it.

1. pUnity doesn't work for every unity games. Only 5.5.x games are supposed to work with pUnity.
2. pUnity can't search for archives in your games which means you can't use it in a method chain (Ex: pUnity+msc+srep+lolz), that's not possible at all. You need to use seperately on unity archives.
3. Always verify your files
4. If you want to implement it in a real repack installer, you need to include a bat/cmd file or something like that to restore files and you may need to use ISExec to show progress and xdelta to keep crc as Razor12911 said
5. Using the correct liblz4.dll that was used for compression in the first place could fix crc mismatch and the xdelta part can be skipped.

Last edited by 78372; 06-03-2018 at 20:04.
Reply With Quote
The Following 2 Users Say Thank You to 78372 For This Useful Post:
elit (13-04-2018), TheGeekyGamer (11-08-2018)
  #4  
Old 06-03-2018, 20:53
ZakirAhmad ZakirAhmad is offline
Registered User
 
Join Date: Sep 2015
Location: Kmr
Posts: 291
Thanks: 56
Thanked 44 Times in 35 Posts
ZakirAhmad is on a distinguished road
thanks man..
Reply With Quote
  #5  
Old 08-03-2018, 06:25
Andu21 Andu21 is offline
Registered User
 
Join Date: Feb 2016
Location: FileForums
Posts: 88
Thanks: 134
Thanked 31 Times in 26 Posts
Andu21 is on a distinguished road
Thanks, it's a shame it doesn't work on prior versions.

I have at least two games that use 5.2.x and all they do is this.

Code:
Unity 5.x precompressor v0.1

Created by Razor12911

Exception: Cannot process input
Unity 5.x precompressor v0.1

Created by Razor12911

EAccessViolation: Access violation at address 004D493F in module 'pUnity.exe'. Read of address 00000000

Last edited by Andu21; 08-03-2018 at 07:28. Reason: Added more details.
Reply With Quote
The Following User Says Thank You to Andu21 For This Useful Post:
KaktoR (08-03-2018)
  #6  
Old 08-03-2018, 06:33
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 2,039
Thanks: 520
Thanked 2,857 Times in 1,026 Posts
KaktoR is on a distinguished road
^I think the same.
__________________
Haters gonna hate
RIP Voksi
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
Andu21 (08-03-2018)
  #7  
Old 09-03-2018, 14:11
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 156
Thanks: 107
Thanked 224 Times in 79 Posts
elit is on a distinguished road
I always thought Unity files are not compressed because I could read within them in plain text. That said, if its lz4 it mean hell to keep up and maintain, as you know we both have our fair experience and opinions about anything coming from Yann Collet - especially lz4 .

That said, why not just update ztool which already have infrastructure, lz4 support, is stable and can do stdio?
Reply With Quote
The Following User Says Thank You to elit For This Useful Post:
oltjon (09-03-2018)
  #8  
Old 09-03-2018, 17:53
panker1992's Avatar
panker1992 panker1992 is offline
Registered User
 
Join Date: Oct 2015
Location: Always Somewhere
Posts: 424
Thanks: 107
Thanked 546 Times in 238 Posts
panker1992 is on a distinguished road
because lz4 is heavily modded compressor, you can even call lz4 an anarchy tool!!

many engines use custom headers and if you try to decomp a version below the original one you will get crc error !!
__________________
My projects : Masked Compression, lzma2(xz) on Freearc, Zstd compressor for windows
My optimizations : packjpg.exe, zstd, lzham, precomp-dev-0.45.
Reply With Quote
The Following User Says Thank You to panker1992 For This Useful Post:
shazzla (09-03-2018)
  #9  
Old 09-03-2018, 18:57
ZakirAhmad ZakirAhmad is offline
Registered User
 
Join Date: Sep 2015
Location: Kmr
Posts: 291
Thanks: 56
Thanked 44 Times in 35 Posts
ZakirAhmad is on a distinguished road
Quote:
Originally Posted by elit View Post
I always thought Unity files are not compressed because I could read within them in plain text. That said, if its lz4 it mean hell to keep up and maintain, as you know we both have our fair experience and opinions about anything coming from Yann Collet - especially lz4 .

That said, why not just update ztool which already have infrastructure, lz4 support, is stable and can do stdio?
Razor cant unpdate ztool, becase he deleted the source code. pzlib too.
He has to start from scratch.
Reply With Quote
  #10  
Old 10-03-2018, 07:21
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 156
Thanks: 107
Thanked 224 Times in 79 Posts
elit is on a distinguished road
Quote:
Originally Posted by panker1992 View Post
because lz4 is heavily modded compressor, you can even call lz4 an anarchy tool!!

many engines use custom headers and if you try to decomp a version below the original one you will get crc error !!
Yes but that would go for ztool as well. I was thinking long time already about it, one solution could be to have set of dll's and call them depending on input parameters, then also regarding block structure this could be controlled by input params as well, for example:

ztool:dll3.1:crc1:crcu:bhd = use dll version 3.1, block checksum on(blocks contain checksum), checksum precede block(checksum is at the beginning of block), block header is located at the end of block(down). In the end most of games streams are about blocks with or without metadata. It wont cover everything but I think its a good start. Also in case of no block metadata one could specify precise parameters, like in case of FitGirl's XCOM2 WotCH for oodle which is precisely: codec 8 level 4 block 2. And so on, just some ideas.

Quote:
Originally Posted by ZakirAhmad View Post
Razor cant unpdate ztool, becase he deleted the source code. pzlib too.
He has to start from scratch.
Oh my, is this really true? Such a loss, sigh...
Reply With Quote
  #11  
Old 10-03-2018, 07:28
elit elit is offline
Registered User
 
Join Date: Jun 2017
Location: sun
Posts: 156
Thanks: 107
Thanked 224 Times in 79 Posts
elit is on a distinguished road
One more thing about lz4, during my modding I tried many/most versions available to find the most accurate compression match. Byte comparing I found that there is usually set of versions that are compatible, then next set and so on. For example if I recall <r126, r126-131, v1.7.3 - v1.7.4(or 1.7.5), v1.8.0+ and so on. So you dont need every single version probably 3-4 currently is enough to process most games. The one I made mod for required r131 but I could use any from that range.
Reply With Quote
  #12  
Old 13-08-2018, 00:50
TheGeekyGamer's Avatar
TheGeekyGamer TheGeekyGamer is offline
Registered User
 
Join Date: Jun 2018
Location: File Forums
Posts: 18
Thanks: 38
Thanked 2 Times in 2 Posts
TheGeekyGamer is on a distinguished road
Question Please help!!

Code:
Unity 5.x precompressor v0.1

Created by Razor12911

Exception: liblz4.dll not loaded
Unity 5.x precompressor v0.1

Created by Razor12911

Exception: liblz4.dll not loaded
Press any key to continue . . .
i have placed the liblz4.dll beside pUnity.exe but still it does not work...???
Reply With Quote
  #13  
Old 14-08-2018, 03:50
Shateiel Shateiel is offline
Registered User
 
Join Date: Jul 2018
Location: Angelarium
Posts: 2
Thanks: 3
Thanked 0 Times in 0 Posts
Shateiel is on a distinguished road
Quote:
Originally Posted by TheGeekyGamer View Post
Code:
Unity 5.x precompressor v0.1

Created by Razor12911

Exception: liblz4.dll not loaded
Unity 5.x precompressor v0.1

Created by Razor12911

Exception: liblz4.dll not loaded
Press any key to continue . . .
i have placed the liblz4.dll beside pUnity.exe but still it does not work...???
Same architecture?
__________________
Freund, es ist auch genug. Im Fall du mehr willst lesen, So geh und werde selbst die Schrift und selbst das Wesen. | BM: BM-2cTtxeiLrKes8UBt3tkdX8Q4axnH6hcs1x
Reply With Quote
  #14  
Old 14-08-2018, 07:11
TheGeekyGamer's Avatar
TheGeekyGamer TheGeekyGamer is offline
Registered User
 
Join Date: Jun 2018
Location: File Forums
Posts: 18
Thanks: 38
Thanked 2 Times in 2 Posts
TheGeekyGamer is on a distinguished road
Quote:
Originally Posted by Shateiel View Post
Same architecture?
Are you talking about the architecture of dll.I am using the same liblz4 dll present in this punity 7z file. And i think it should work as shown in the pic by razor19211. I tried using xtool's liblz4 but i get the same error. And both these dlls are different in sizes....
__________________
BAZINGA!
Reply With Quote
  #15  
Old 14-08-2018, 10:07
Shateiel Shateiel is offline
Registered User
 
Join Date: Jul 2018
Location: Angelarium
Posts: 2
Thanks: 3
Thanked 0 Times in 0 Posts
Shateiel is on a distinguished road
Quote:
Originally Posted by TheGeekyGamer View Post
Are you talking about the architecture of dll.I am using the same liblz4 dll present in this punity 7z file. And i think it should work as shown in the pic by razor19211. I tried using xtool's liblz4 but i get the same error. And both these dlls are different in sizes....
Not sure then, try testing it in different directory.
__________________
Freund, es ist auch genug. Im Fall du mehr willst lesen, So geh und werde selbst die Schrift und selbst das Wesen. | BM: BM-2cTtxeiLrKes8UBt3tkdX8Q4axnH6hcs1x
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Gamedevelopers visiting GCW/Fileforums Karthik 2.0 Chit Chat 0 04-12-2008 21:20
Biathlon 2006 Problems... Please help! RamGuy General Gaming 1 10-04-2006 03:23
Frequently Asked Questions Joe Forster/STA PC Games - Frequently Asked Questions 0 29-11-2005 09:48
Craxation 4.0.0 Release AshleyWalls XBox Games 4 11-07-2004 08:17
air force delta snake DC Games 0 15-04-2001 04:34



All times are GMT -7. The time now is 16:10.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2018, vBulletin Solutions Inc.
Copyright 2000-2018, FileForums @ https://fileforums.com