FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Newbie Question Thread (https://fileforums.com/showthread.php?t=105883)

kj911 24-05-2024 05:28

Try it: -msrep or -msrep+lolz/razor or -msrep:m3f:l512(or smaller l# values):a0
This CMD window navigated to FreeArc\bin directory? Or use FreeArc GUI? Win7 x64 differentially resolve cmd/path related commands than XP.*

See the 'mp4.txt' file used commands...

*Very strong example:

WinXP: move data.bin data.7z --> equal to "ren" console commands.
Win7: move data.bin data.7z --> worser scenario, destroying the whole file! Better scenario, workly rename.

brispuss 25-05-2024 03:32

Thanks for the comments.

I'm suspecting the issue of arc not working properly may be because I have several other programs that also have the arc.exe included. So when I attempt to run the arc command, the command may be selecting another location of arc.exe and not the arc.exe within the Freearc directory.

Presently trying to remove paths to the other programs containing arc.exe and see how things go. And trying to run arc.exe from the current working directory of Freearc\bin.

EDIT: I managed to get Arc.exe working with methods by copying Arc.exe and Arc.ini and srep to the current working directory which contained the test mp4 file.

The initial problem of Arc not working properly was most likely due to the presence of multiple copies of Arc.exe and Arc.ini within several other programs which were causing conflicts with each other.

EDIT2: Did some compression tests on 70 MP4 files ranging in size from 547 kB to 11,351 kB.

Code:

Compressor      Commands/Options      Compressed Size    Compression Time
Original 70 files - - - - - - >      171,978,453

srep            -m3f -a2              157,392,930              1.979
mcm            -x13                  156,938,895            296.611
nz              a -co -m4g            156,859,691            20.767
nz              a -cO -m4g            156,823,772            25.322
nz              a -cc -m4g            156,766,025            171.793
lolzslow        as per arc.ini        156,693,448            207.330
arc            a -m=razorx          156,681,739            87.046
fp8 v6          -8                    156,625,221          1038.185
lolz            per arc.ini + lm4    156,546,454            318.421
lolzslow        per arc.ini + lm4    154,768,632            320.855

NOTE: for compression options using lm4 for files, files fail to decompress! Do not use lm4 option!

There is not a great difference in final compressed file sizes regardless of compression method.

Not really the best ideal final compressed sizes, but MP4 files are difficult to compress.

kj911 28-05-2024 04:56

brispuss: LOLZ is the right choice. (especially if x86 compatibility is also a consideration, when unpacking.)

Can someone share the very first LOLZ version? (2016.12. release.) Is this version "compressor" 32 or 64 bit? (cls-lolz.dll found only x86 version.)

brispuss: Don't use different configuration than lm0 compression settings! Other lm1-2-3-4 its used (not totally removed) any special/older methods from LOLZ code, its works only from compression, will create not decompresseable archives. Try it testing lm4 compressed archives, still crashing now! (Yes, this ratios better than lm0 mode only...)

brispuss 29-05-2024 19:27

Yes, thanks for this caution!

I was about to make a post as to why files compressed using the lm4 option failed to decompress!

It is now my understanding that the option lm is not fully/properly setup/coded, so that is why files fail to decompress with lm compression options lm1 ~ lm4. lm0 option seems to be fine though.

brispuss 30-05-2024 07:08

File Types and/or (Pre)Compressors
 
I was reading a text document about a week ago that describes in some detail the file types, and/or the (pre)compressors used in compression. I didn't finish reading this document which I thought I had on my computer, but I can't seem to find the document now!? I think I originally downloaded this document from this forum, but on searching this forum, I can't seem to find this document (again)?

The document author was I think someone fairly well known on this forum (Razor?, Masquerade?, Panker?, Blackfire?, or ??), but I'm not sure.

Can anyone please locate this document?

Thank you.

KaktoR 30-05-2024 07:41

Why not just go to your browser history and search there all links from this forum? I mean you know that it was a week ago, so just search by links which are visited least 7 days ago.

brispuss 30-05-2024 08:16

The document I was reading I believe it was on my computer. I think I downloaded this document quite some time ago, so I would have to look on my browsing history maybe quite a few months back, maybe a year ago(?) and not look just for a week.

Masquerade 31-05-2024 12:19

^^
Could you mean how to spot compression algorithms with your eyes? That's an archived link in the Tools for Repacking thread.

brispuss 31-05-2024 18:57

Quote:

Originally Posted by Masquerade (Post 504684)
^^
Could you mean how to spot compression algorithms with your eyes? That's an archived link in the Tools for Repacking thread.

Thanks for your suggestion. But this was not the content of the document.

I believe the document discussed the various types of (pre)compressors and related software for use with certain file types. It went into some detail as to which was the most appropriate software to use for the file types to be processed and perhaps suggested software settings as well.

brispuss 04-06-2024 19:55

xtool Can't Handle JPEG files?
 
xtool supposedly is capable of handling (all) files compressed with zlib. JPEG files are usually compressed via zlib I believe, but xtool seems incapable processing the JPEG files?

Precomp, by Christian Schneider, is capable of processing JPEG files, but xtool is not for some reason(s).

Can someone please explain why xtool can't process JPEG files (properly)?

Thank you.

KaktoR 05-06-2024 08:10

There are xtool plugins for JPG images

Code:

brunsli
Streams: 42 / 42
Time: 00:00:00 (CPU 00:00:01)

Size: 20.9 MB >> 16.0 MB

Done!!!

packjpg
Streams: 42 / 42
Time: 00:00:02 (CPU 00:00:06)

Size: 20.9 MB >> 15.3 MB

Done!!!

jojpeg
Streams: 42 / 42
Time: 00:00:16 (CPU 00:00:36)

Size: 20.9 MB >> 14.2 MB

Done!!!

Code:

precomp intense
Compressed 43 files, 21,960,949 => 17,766,251 bytes. Ratio 80.90%
Compression time: cpu 0.02 sec/real 2.01 sec = 1%. Speed 10.91 mB/s
All OK

16.94 MB


brispuss 05-06-2024 10:12

Thanks for the detailed reply.

I'm looking into this now and will run some compression tests.

EDIT: Compression test results -

Code:

(Pre)Compressors      Commands/Options            Compressed Size    Compression Time
   
Original 183 jpg files size - - - - - - - - - >    32,620,858

razorx                xtool precomp -mrazorx      32,687,179                    31.001
xtool + lolz(std)      -mzlib+reflate              32,526,487                  135.073
xtool + lolz(std)      -mzlib+preflate            32,526,388                  132.572
xtool + lolz(std)      -mreflate                  32,525,512                  136.298
xtool + lolz(std)      -mpreflate                  32,525,336                  132.941
xtool + lolz(std)      -mzlib                      32,524,854                  132.349
precomp + mcm          -cn -brute + -x13          26,888,771                  226.509
precomp + razorx      -cn -brute + -mrazorx      26,817,498                    32.449
brunsli                                            26,740,253                    4.243
precomp + nanozip      -cn -brute + -co            26,669,251                    14.942
precomp + nanozip      -cn -brute + -cO            26,668,630                    14.602
precomp + nanozip      -cn -brute + -cc            26,662,387                  169.879
xtool + brunsli        -mbrunsli                  26,633,426                  100.867
precomp                -cl -brute                  26,631,038                    9.895
precomp + lolz(slow)  -cn -brute                  26,624,723                    31.563
precomp + lolz(std)    -cn -brute                  26,622,527                    33.496
lepton                                            26,350,606                    14.776
lepton-slow-best-ratio                            25,920,088                    17.905
xtool + packjpg        -mpackjpg                  25,850,839                  100.766
packjpg                -np -p                      25,826,134                    10.584
xtool + jojpeg        -mjojpeg                    25,678,421                  105.765
jojpeg                c                          25,016,673                  129.041
fp8 v6                -8                          24,445,243                  255.514


Note: lolz(std) means options for lolz as defined in arc.ini file. And lolz(slow) means options for lolzslow as defined in arc.ini file.

CrownRepack 05-06-2024 21:01

Hey guys, im new to repacking and compressing, i learned quite a few stuff here myself by reading, i just want to know what is the most used/relevant compressor tool now? is it DiskpanGUI or etc etc...? Please suggest the most updated and best compression tool for that does FreeArc, Thanks

Masquerade 06-06-2024 07:22

^^
DiskspanGUI is probably the best bet.

kj911 28-06-2024 04:27

Still available special offset-shifted file compare tool??? (File sizes differ smaller than 1KB.)

Read two file started in predefined text or hexa code to file ends.. (Ex: Two WAV files compares, compressed non-standardized tools or etc...)

Quick example (not available the offset-functions):

"fc /b start=data file1.wav file2.wav" or "fc /b start=64617461 file1.wav file2.wav"

start -> start offset reading from two comparable files, reading to file ends, ignoring previous bytes before the offset value. With(in/out) added extra switch, "end=0" aka read files to file endings or "end=X" read files to "X" offset points. (reading two files before file ends.)

A similar question was asked here, almost ~20 years ago: https://www.ghisler.ch/board/viewtopic.php?t=8523

KakiDev 19-07-2024 04:46

Where should I get started if I want to compress a game and have no indea what the best tools for it are? Looking at the Tools for Repacking thread there are LOTS of tools to try, are there any I should prioritize trying, or just take the few hours to go through all of them and see what does the best?
Thanks in advance :D

KaktoR 19-07-2024 06:07

First you have to know what data you are dealing with.

From there on you have to know what tools you have to use.

However you can always ask here what game you are working with, then users will probably tell you something about it.

KakiDev 19-07-2024 10:46

Well, I'm mostly dealing with renpy games (renpy is an engine for building visual novels), looking at one game right now its 90% jpg, mp3 and webm files, webm files make up nearly 50% of the game size here. I want to avoid lossy compression, so no reencoding.

So I guess I'd need to know what the best tools for webm, jpg and mp3 are as they make up 98.8% of the game together.

KaktoR 19-07-2024 10:55

webm are already compressed files. Nothing you can do except for reencoding.

mp3 are already compressed aswell, but for this there are several tools to compress them further without reencoding (packmp3, mpz, 7z mp3 plugin (power archiver)).

jpg the same, but here aswell we have some tools like packjpg, brunsli, jojpg, precomp, lepton.

zuryki 19-07-2024 22:23

I started a few days ago, and I'm using DiskSpan_GUI with the Light Installer Script. I've done some experiments, and everything is perfect.

While searching for an efficient method to compress the game Mad Max:
https://fileforums.com/showpost.php?...74&postcount=5

Upon inserting the data from the above link:
Code:

-------------------------------------------------------- CONVERSION DATE 2024/07/20 --------------------------------------------------------
02:00:48 - You have chosen the DVD5 type for the media size.
02:00:48 - ISO images will not be created when conversion is complete.
02:00:48 - The computer will remain on when the conversion is complete.
02:00:48 - Selected ARC/DS method for Data1a-01.bin was: xtool
,t4
+srep_new+lzma
02:00:48 - Selected ARC/DS method for Data1b-01.bin was: srep_new+lzma2
02:00:50 - Compression initialized on 20/07/2024 at 02:00:50.
02:00:51 - Starting Data1a-01.bin archive creation.
02:00:53 - Archive Data1a-01.bin creation error.


Code:

Summary:
FreeArc 0.67 (March 15, 2014) creating archive: Conversion_Output\Data1a-01.bin
Compressing 79 files, 34,125,862,912 bytes. Processed 0.0%
ERROR: write error (disk full?) in compression algorithm xtool
,t4

Data1a-01.bin
List to filter included files:
*.arc

Data1b-01.bin
List to filter included files:
*.*

This site is a goldmine. Can you tell me what I'm doing wrong?

KaktoR 20-07-2024 01:24

This method belongs to a very old xtool version which is not included in DSG.

Just use xtool 2020 with zlib codec instead.

demon964 29-07-2024 01:54

Quote:

Originally Posted by KaktoR (Post 505073)
This method belongs to a very old xtool version which is not included in DSG.

Just use xtool 2020 with zlib codec instead.


https://i.imgur.com/TURifGi.png

Hi. I am working with Light Installer Script

I have 2 question

1) One of game folder need unpack to Documents folder. Is this settings true?

2) can i disable this settings? i dont use winrar part system like DVD 4.7gb or other

KaktoR 29-07-2024 02:01

Yes.

You can just use "Unlimited" tab outside of developer mode.

demon964 29-07-2024 07:29

Quote:

Originally Posted by KaktoR (Post 505140)
Yes.

You can just use "Unlimited" tab outside of developer mode.


why next button not active

https://i.imgur.com/eju1h47.png



https://i.imgur.com/dheCGzU.png

KaktoR 29-07-2024 07:44

Because you have no next tab (no tab after Game 1)

demon964 30-07-2024 01:37

Quote:

Originally Posted by KaktoR (Post 505144)
Because you have no next tab (no tab after Game 1)

i want finish making installer. Next button not clickable

KaktoR 30-07-2024 02:22

Then click save button

mausschieber 30-07-2024 02:26

Quote:

Originally Posted by demon964 (Post 505151)
i want finish making installer. Next button not clickable

you better read here How to use Diskspan GUI v2+ there is all Information for you

demon964 30-07-2024 09:48

Quote:

Originally Posted by KaktoR (Post 505152)
Then click save button

thanks worked. how i can make created .bin files optional ? like fitgirl

if i delete bin files, setup.exe still search file and give error

but, fitgirl repacks, if bin file not in the folder, setup.exe skips this file

kj911 02-11-2024 06:26

Has anyone encountered such an installer? (Is their compression technique beatable? ex: FitGirl could do it?)

https://i.kek.sh/WV7u2qf3qR3.png

Is it possible to find such an installation package?? (Yes, bitWrapper(tm) compressed.)

Doomman2008 05-11-2024 05:43

Hi.

I have a question about Diskspan GUI / Inno Setup.
I'm actually getting on quite well with the software so far.

Now I have a new situation:
I want to pack a game in one archive and a mod for this game in a second archive.

In the finished Inno Setup installer there should be a checkbox.

If the checkbox is enabled the installer should extract archive 1 and then archive 2.
If the checkbox is disabled the installer should only extract archive 1.

Is this even possible? Or another way to reach the same goal?

Maybe I'm thinking too complicated? :confused:

KaktoR 05-11-2024 07:15

Any installer which allows components and is compatible with DSG is suitable for this

Doomman2008 05-11-2024 10:14

Good to hear so far..

Can you give me an example how i can do that?

I use Diskspan GUI mainly for compressing.

I use the script from "Light Installer" as template but i do changes for every game i compress manually in Inno Setup editor.

KaktoR 05-11-2024 10:17

If you use LIS try changing that

Code:

[Components]
Name: comp1; Description: Game 1; Types: full; ExtraDiskSpaceRequired: 10000000000
Name: comp2; Description: Game 2; Types: full; ExtraDiskSpaceRequired: 20000000000


Doomman2008 09-11-2024 08:01

I already saw that lines.

But how could i define what data is "comp1" for example.
I don't understand this.

Doomman2008 10-11-2024 10:45

Ok, my problem is solved:

Components are defined in records.ini, too.

in case anyone else has this problem at some point:

Code:

[Record1]
Type=FreeArc_Original
Source={src}\Data1a-01.bin
Output={app}\
Disk=1
Size=386.315.748 bytes

[Record2]
Type=FreeArc_Original
Source={src}\Data1b-01.bin
Output={app}\
Disk=1
Component=1
Size=712.924.910 bytes

[InstallerSettings]
SingleDisk=1


audy 13-11-2024 12:02

Hello, I have been registered for years, and this is my first post.
I have yet conceptual doubts.

1. It is assumed that if I use a codec (or method) from a compressor (example: zlib of xtool), it is because the group of files that I want to compress, most of them have the codec zlib (right?), But in practice, how can I recognize what codecs are used in those files? maybe a scanner?

2. I have seen statements of compression method like:
5rzm = rep:300mb+delta+rzm/$wav=tta/$bmp=bmp/$jpg=jpg/$jpgsolid=precomp+rep:32

What do the characters /$ mean, what function does it meet? I have an idea, but I prefer an explanation.

3. How do we know what size of chunk set in the parameters of a precompressor (or SREP)? or what is the most advisable to use? For example, I want to compress 100 files and each of them weigh between 8 and 64 MB.

wareck 13-11-2024 13:30

Hello, I'm not a very good repacker, but I know some basis...

1 for finding codec:
-experience (after a while you will know that game made by unreal, or by this other kind of editor use the same compression template)
-hexeditor (you can find some signature or some indications like ogg, wave, mpeg ect)
-game scanner tool (you can find it on this forum)
-"monkey test" test this parameter or this and compare results. For some game it takes me days to find the right setup to gain some %

2 masked compression:
$xxx is mean a group
for example $bmp is for "all file in the bmp group"
It can be .bmp .gif . bitmap (you can setup this group in arc.group)
then the method
in you example $wav=tta it means that all file in the "$wav" group will be processed with TTA method
at the begining of the mask you have rzm
It mean that the files who are not in a group or if the method for this file will fail, it will processed by the main method rzm

3. srep
if you use a normal process like diskspangui or similar
the process will first do a solid chunk (like is you use 7zip with store option and 0 compression)
file1+file2+file3+file4... => bigfile
the srep will work on the bigfille
file1+file2+file3+file4=>bigfile=>srep>=bigfile.sr ep
then bigfile processed by srep will be processed by the final compressor

file1+fille2+file3+file4...=> bifile=>srep => bigfile.srep=>lzma2= > archive
In your question, 64mb is the chunk srep will work with.
it's not the size of the final files, its how many partial chunk of "bigfile" it will work in the same time.
big chunk give better results, but slower compression/decompression.
and less computer compatibility (if you decompress this file on a slow computer with low memory it may fail)
lower chunk size lower the deduplication results, faster compression and decompression but bigger final files.
it's more or less a compromise...
this is very linked to the file.
if you try to srep audio or video files you will not find deduplication (same words, same octet combinasion)
but for texture, in some games there is a lot of same structure, same files, you will have a lot of redundancy and it will reduce the file a lot...


the best method is to experiment, test, try and try again

jakepaulie 15-11-2024 13:21

Hello, I have a question... I want to do Repacks using Inno. But I dont know any tutorials, and some like that... Please help me, or say what tutorials should i watch

dyren 15-11-2024 13:39

^^
Hi, there aren't any specific tutorials for making repacks. Inno is used for making installers, not the repack itself. Making repacks is based on doing research and gaining experience.

Here's a few tools I would recommend for starting out:

DiskSpan GUI - for compressing, aka making the repacks: https://fileforums.com/showthread.php?t=104507
ASIS - for making the installer, so you can unpack the archive DiskSpan creates: https://fileforums.com/showthread.php?t=99481

Additionally, you can browse the 'Best Compression Methods for 'Specific' Games INDEX' thread, to find out what method works for certain games (https://fileforums.com/showthread.php?t=101639)


All times are GMT -7. The time now is 04:20.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com