Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 13-11-2022, 13:43
Neuromancer815 Neuromancer815 is offline
Registered User
 
Join Date: Nov 2022
Location: 69 fuckayou street
Posts: 4
Thanks: 2
Thanked 0 Times in 0 Posts
Neuromancer815 is on a distinguished road
Question new to this

hello, im trying to get into repacking games for the first time ever, for my own private use. i have a very slow wifi where i live and its always a pain to download anything larger than a few gigs. so what i wanna do is compress the games im currently not playing for later use. ive been directed to this forum as a great resource to help me get started, and ive been looking through the sticky for a few days now and id be lying if i said it wasnt very overwhelming, especially since i know absolutely nothing about compression and repacking. i am willing to put the time and effort to learn but im really not sure where to even start? id very grateful if i could get some guidance as to where i need to start this process. currently all i have done besides reading the stickies is downloaded this <http://freearc.org/download/0.666/FreeArc-0.666-win32.exe> and this <https://jrsoftware.org/isdl.php#stable>. i have tried compressing a game, sniper elite 4 to be exact, since i dont have any smaller games to test on but after seeing how much time it was gonna take i aborted it for the sole reason of not being able to use my pc for that duration and not knowing whether or not it was gonna work
Reply With Quote
Sponsored Links
  #2  
Old 13-11-2022, 14:42
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,868
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
Depends on how much you want to size down your games. Generally spoken: The stronger the compression, the more time will it take and also CPU/RAM resources, to be simple.

To get the "quick and easy way" you can use DiskSpan_GUI to compress your files.
You can also unpack your compressed archives with it too (Tools -> Unpacker).

In your example for "Sniper Elite 4" I guess you can just use srep+lolz if you want it strong, with cost of speed and pc resources, or srep+lzma with cost of compression ratio, but requires way less pc resources. But I didn't checked the game so I cannot tell you for sure.

Some games requires that you first unpack the files and then compress them. In most cases you use xtool to unpack the game files, but you should know what compression method the game is compressed with. For example "Sniper Elite 5" is compressed with zlib (if I remember well), so you have to use xtool first to unpack the files, then apply srep to get rid of duplicates, then use lolz or lzma to use final compression.

Maybe you have noticed the problem for "newbies" here. That's nothing to explain in a few sentences.
__________________
Haters gonna hate
Reply With Quote
The Following 3 Users Say Thank You to KaktoR For This Useful Post:
Crimzan (25-11-2022), Gehrman (24-12-2022), Neuromancer815 (13-11-2022)
  #3  
Old 13-11-2022, 15:35
Neuromancer815 Neuromancer815 is offline
Registered User
 
Join Date: Nov 2022
Location: 69 fuckayou street
Posts: 4
Thanks: 2
Thanked 0 Times in 0 Posts
Neuromancer815 is on a distinguished road
thanks kaktor for the reply, helped understand a few things i was held up on, i got "srep+7zip multi volume" and "lzma" from the stickies as well as diskspan GUI, but i followed the link to lolz to krinkles.org and it seems i need to post stuff there before i can get download righs which sucks because i dont know anything so what would i post about. also diskpan gui is being flagged as malware, is that a false flag?
Reply With Quote
  #4  
Old 13-11-2022, 16:28
Cesar82's Avatar
Cesar82 Cesar82 is offline
Registered User
 
Join Date: May 2011
Location: Brazil
Posts: 881
Thanks: 1,457
Thanked 1,915 Times in 646 Posts
Cesar82 is on a distinguished road
Quote:
Originally Posted by Neuromancer815 View Post
thanks kaktor for the reply, helped understand a few things i was held up on, i got "srep+7zip multi volume" and "lzma" from the stickies as well as diskspan GUI, but i followed the link to lolz to krinkles.org and it seems i need to post stuff there before i can get download righs which sucks because i dont know anything so what would i post about. also diskpan gui is being flagged as malware, is that a false flag?
If DiskSpan GUI was flagged as a virus it is a false positive.
You can download without worries.
If you need to, disable your antivirus and after extracting the zip file from DiskSpan GUI, enable your antivirus again and check the extracted folder from DiskSpan GUI. Let me know exactly which file was captured by your antivirus so that if there is an alternative version maybe I can replace the captured file.

NOTES:
DiskSpan GUI already includes all compressors reported by KaktoR, such as LOLZ.

EDIT: DiskSpan GUI is only False positive for viruses.
No virus detection using Kasperky Internet Security (See attached video below).
Attached Files
File Type: 7z DSG checking virus.7z (1.07 MB, 34 views)

Last edited by Cesar82; 13-11-2022 at 16:40.
Reply With Quote
The Following 2 Users Say Thank You to Cesar82 For This Useful Post:
Gehrman (14-11-2022), Neuromancer815 (15-11-2022)
  #5  
Old 15-11-2022, 15:24
Neuromancer815 Neuromancer815 is offline
Registered User
 
Join Date: Nov 2022
Location: 69 fuckayou street
Posts: 4
Thanks: 2
Thanked 0 Times in 0 Posts
Neuromancer815 is on a distinguished road
Hey Cesar82 thanks for the reply, i did what you said; Affected files:

containerfile: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z

file: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z->COMPRESSOR/Resources/TOOLS/WemTool/WemTool.exe

webfile: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z|https://fileforums.com/attachment.ph...30245021635373

EDIT: after using the program for a bit i just wanna say great work i love the UI and the program is vey easy to use

Last edited by Neuromancer815; 15-11-2022 at 15:43.
Reply With Quote
  #6  
Old 16-11-2022, 19:30
Cesar82's Avatar
Cesar82 Cesar82 is offline
Registered User
 
Join Date: May 2011
Location: Brazil
Posts: 881
Thanks: 1,457
Thanked 1,915 Times in 646 Posts
Cesar82 is on a distinguished road
Quote:
Originally Posted by Neuromancer815 View Post
Hey Cesar82 thanks for the reply, i did what you said; Affected files:

containerfile: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z

file: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z->COMPRESSOR/Resources/TOOLS/WemTool/WemTool.exe

webfile: C:\Users\Neuromancer\Downloads\DiskSpan_GUI v2.0.1.3 (x64).7z|https://fileforums.com/attachment.ph...30245021635373

EDIT: after using the program for a bit i just wanna say great work i love the UI and the program is vey easy to use
Thanks for the test.
If possible download the WemTool file attached in the post HERE and let me know if your anti-virus also captures this updated version without UPX compression.
Reply With Quote
  #7  
Old 17-11-2022, 03:50
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 927
Thanks: 241
Thanked 1,036 Times in 489 Posts
Masquerade is on a distinguished road
Sorry about the WemTool. It's probably going to trigger AV anyway because it's lazily built with bat2exe.
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
Cesar82 (17-11-2022)
  #8  
Old 17-11-2022, 09:08
Neuromancer815 Neuromancer815 is offline
Registered User
 
Join Date: Nov 2022
Location: 69 fuckayou street
Posts: 4
Thanks: 2
Thanked 0 Times in 0 Posts
Neuromancer815 is on a distinguished road
Quote:
Originally Posted by Cesar82 View Post
Thanks for the test.
If possible download the WemTool file attached in the post HERE and let me know if your anti-virus also captures this updated version without UPX compression.
yes this one also gets flagged
Reply With Quote
  #9  
Old 17-11-2022, 09:15
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 242
Thanks: 443
Thanked 90 Times in 67 Posts
shazzla is on a distinguished road
Try compress using ASPack or MPress. Maybe it works.
Reply With Quote
  #10  
Old 17-11-2022, 09:23
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 927
Thanks: 241
Thanked 1,036 Times in 489 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by shazzla View Post
ASPack
ASPack will be even worse for detections.
Reply With Quote
  #11  
Old 17-11-2022, 09:51
shazzla shazzla is offline
Registered User
 
Join Date: Nov 2010
Location: Hunnia
Posts: 242
Thanks: 443
Thanked 90 Times in 67 Posts
shazzla is on a distinguished road
Quote:
Originally Posted by Masquerade View Post
ASPack will be even worse for detections.
You mean ASProtect ?!
Reply With Quote
  #12  
Old 17-11-2022, 11:56
Cesar82's Avatar
Cesar82 Cesar82 is offline
Registered User
 
Join Date: May 2011
Location: Brazil
Posts: 881
Thanks: 1,457
Thanked 1,915 Times in 646 Posts
Cesar82 is on a distinguished road
Quote:
Originally Posted by Masquerade View Post
Sorry about the WemTool. It's probably going to trigger AV anyway because it's lazily built with bat2exe.
Thanks for info!
Is there no other way or program you can use to convert your BAT that doesn't create false positives?
Reply With Quote
  #13  
Old 17-11-2022, 15:20
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 927
Thanks: 241
Thanked 1,036 Times in 489 Posts
Masquerade is on a distinguished road
Probably could re-write the entire thing in C# but I'm currently so busy trying to balance a lot of IRL stuff I will not get time. It's something I will consider but it won;t be soon.
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
Cesar82 (17-11-2022)
  #14  
Old 25-11-2022, 14:00
Crimzan Crimzan is offline
Registered User
 
Join Date: Dec 2020
Location: Germany
Posts: 4
Thanks: 6
Thanked 0 Times in 0 Posts
Crimzan is on a distinguished road
Question

Hello! Thank you for these explanations!

I'm also really new to this and I have read a lot but it is a lot of arbitrary seeming detailed information in these forums that make it incredibly hard to categorize and make sense of, so I have a lot of questions and I hope it's ok to just dump them all at once

I downloaded DiskSpan GUI, it seems like it's one of the more customizeable, yet very easy to use ones. Do you think this is a good tool to use or would I be better off using these exe's separately, or even a completely different software?

Quote:
Originally Posted by KaktoR View Post
In your example for "Sniper Elite 4" I guess you can just use srep+lolz if you want it strong, with cost of speed and pc resources, or srep+lzma with cost of compression ratio, but requires way less pc resources.
You said "srep+lolz" and "srep+lzma", does this mean, in DiskSpan GUI (if you are familiar with the software), I can select both srep first and then lolz / lzma and then it is basically what you had described?

To understand the logic behind this, when I select a folder to compress with DiskSpanGUI, "srep+lolz" would basically mean using srep first to deduplicate, and then compress the srep output with lolz?

I don't have Sniper Elite 4, but this is interesting -- how do you know srep+lolz is strong? Is it one of the strongest general combinations? Or how do you know, or in other words, how can I find out what compressors and thingies work the best?

Quote:
Originally Posted by KaktoR View Post
Some games requires that you first unpack the files and then compress them. In most cases you use xtool to unpack the game files, but you should know what compression method the game is compressed with. For example "Sniper Elite 5" is compressed with zlib (if I remember well), so you have to use xtool first to unpack the files, then apply srep to get rid of duplicates, then use lolz or lzma to use final compression.
Super interesting!
So, to make sure I understand what you said at the end, in DiskSpanGUI I would basically have xTool_zlib+srep+lolz (or lzma), is that correct?

Also how do you know it's compressed with zlib? Are you an experienced file magician and / or do you know of a scanner software that can test if a file is compressed, and what it is compressed with?

One final question, which is hopefully not too broad: What is your workflow finding 'the best' compression combinations (that is, not as slow as paq compression for instance but still really good compression ratio)? Is it Trial and Error? Like, do you just select a couple of files to compress, and try each and every combination? Because that's what I'm doing currently and this kinda sounds super inefficient so I suspect there's a way to find out what works with scanners or anything

Anyways, I'm eager to learning more about compression but I don't think I'm getting far without asking some dedicated beginner questions. I feel like I know some stuff but they are absolutely random bits of information in different fields and it's incredibly hard and really confusing trying to make sense of them

Thanks!
- Crimzan
Reply With Quote
  #15  
Old 25-11-2022, 15:31
KaktoR's Avatar
KaktoR KaktoR is offline
Lame User
 
Join Date: Jan 2012
Location: From outer space
Posts: 3,868
Thanks: 1,009
Thanked 6,317 Times in 2,340 Posts
KaktoR is on a distinguished road
Quote:
Originally Posted by Crimzan View Post
I downloaded DiskSpan GUI, it seems like it's one of the more customizeable, yet very easy to use ones. Do you think this is a good tool to use or would I be better off using these exe's separately, or even a completely different software?
I would say this tool is handy, but have it's limitations aswell. Most repackers use their own tool set anyway, but in the end all of them are using the same compressors, with some additions and techniques.


Quote:
Originally Posted by Crimzan View Post
You said "srep+lolz" and "srep+lzma", does this mean, in DiskSpan GUI (if you are familiar with the software), I can select both srep first and then lolz / lzma and then it is basically what you had described?

To understand the logic behind this, when I select a folder to compress with DiskSpanGUI, "srep+lolz" would basically mean using srep first to deduplicate, and then compress the srep output with lolz?
Yes.


Quote:
Originally Posted by Crimzan View Post
I don't have Sniper Elite 4, but this is interesting -- how do you know srep+lolz is strong? Is it one of the strongest general combinations? Or how do you know, or in other words, how can I find out what compressors and thingies work the best?
lolz is mainly good for texture compression. You know, games use textures. Save your time and don't try to use lolz for audio/video files and such.

For instance, took some DDS image files, and compare ratios between srep+lolz and srep+lzma.

Spoiler: lolz will be superior on these files in terms of ratio. It's just a matter on how long you want to run the process and how small the output you want.


Quote:
Originally Posted by Crimzan View Post
Super interesting!
So, to make sure I understand what you said at the end, in DiskSpanGUI I would basically have xTool_zlib+srep+lolz (or lzma), is that correct?
Yes.


Quote:
Originally Posted by Crimzan View Post
Also how do you know it's compressed with zlib? Are you an experienced file magician and / or do you know of a scanner software that can test if a file is compressed, and what it is compressed with?
It's like common sense sometimes. If you are in the process for years, you will get a "sense" of it. For example take any Unreal Engine 4 game. Most of these games are compressed with zlib/reflate, many others with oodle, and a few even with lz4 or zstd.

To check a file, you can use xtool's verbose mode, or manually check the file with HxD or similar for magic numbers and such (this requires that you know about these things).

I'm not a magican or something, I still have questions sometimes too


Quote:
Originally Posted by Crimzan View Post
One final question, which is hopefully not too broad: What is your workflow finding 'the best' compression combinations (that is, not as slow as paq compression for instance but still really good compression ratio)? Is it Trial and Error? Like, do you just select a couple of files to compress, and try each and every combination? Because that's what I'm doing currently and this kinda sounds super inefficient so I suspect there's a way to find out what works with scanners or anything
On larger archives (like in UE4 games the *.pak files) use xtool's verbose mode to find out. After you find out, pick the file and compress it with different combinations until you are happy with the outcome (ratio/time). There is no "magic tool" to give you all answers about a file in general.

Personally I don't use lolz because it is time consuming af and it tooks literally all PC resources while running, and I want it to be as fast as possible with a decent outcome in ratio, therefore for me my choice is in most cases 4x4:lzma.
__________________
Haters gonna hate
Reply With Quote
The Following User Says Thank You to KaktoR For This Useful Post:
Crimzan (27-11-2022)
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump



All times are GMT -7. The time now is 11:49.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2023, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com