pZLib v3 (Final release)

[vollachr]

Originally Posted by doofoo24

the ratio seem to be worst with MSC+pzlib+srep+lolz. i get 9.8gb ???
other pople who repack Assetto Corsa get 6.8gb...
i don't know what setting.
i am out of idea right now ???

6.8GB could be with not fully updated game and/or not all DLCs, I honestly haven't seen a repack for v1.16 and all DLCs that is less than 9.0GB.

The 6.8GB repacks seems to be for v1.14.

I'm gonna do another 1-2 tries, if nothing works I'll just settle for either 2xDVD5+1xCD or maybe 1xDVD9+1xDVD5 (or both) using Srep64+Lzma64 only,

Because so far, the differences between all attempts were minor and insignificant, and the Srep64+Lzma64 was the quickest one.

[Simorq]

Originally Posted by doofoo24

the ratio seem to be worst with MSC+pzlib+srep+lolz. i get 9.8gb ???
other pople who repack Assetto Corsa get 6.8gb...
i don't know what setting.
i am out of idea right now ???

MSC=LOLZ
pzlib+srep+lolz

[doofoo24]

Compressed 33,999 files, 42,886,060,604 => 8,475,378,350 bytes. Ratio 19.76%

[vollachr]

Originally Posted by doofoo24

Compressed 33,999 files, 42,886,060,604 => 8,475,378,350 bytes. Ratio 19.76%
pzlib:max:c128m+srep:m5f:a2+delta+lolz:mc1023:fba4 096:bc8:blr8:bm8:oh14:pc4:mtt1:mt2:d256m

Nice, I'll try, although LOLZ is currently giving me some on-screen text output problems due to >nul at end of the compression command, I'm working on a workaround but I'm not sure it will work yet.

Could there be an alternative to LOLZ?, what about RZM or ZST? have you tried LZMA or LZMA2? instead of lolz? if so, what was the result?

[doofoo24]

no i didn't try lzma or zst, i believe the ratio would be worst maybe you will get 8.10g to 8.15g...
from past experience the best setting for lzma i recommend lzma:a1:mfbt4:d512m:fb273:mc10000:lc8 or if you have alot of ram you could increase d512m to 756m or 1024mb still better than lzma2 or lzma:ultra that used by panker...
just be sure that you using fazip 64 for lzma to overcome memory limit in freearc.
the max lzma is d182mb in freearc alone without fazip...

[External compressor:lzma,delta,exe,mm,rep,tor,4x4]
header = 0
packcmd = fazip -i0 compress:{compressor}{ption} <stdin> <stdout>

* srep need less tan 1gb decompresion memory for Assetto...
i will try to use pzlib:max:c64m+srep:m5f:a2+delta+lzma:a1:mfbt4:d51 2m:fb273:mc10000:lc8
no need for more than 64m for pzlib...

[vollachr]

Originally Posted by doofoo24

no i didn't try lzma or zst, i believe the ratio would be worst maybe you will get 8.10g to 8.15g...
from past experience the best setting for lzma i recommend lzma:a1:mfbt4:d512m:fb273:mc10000:lc8 or if you have alot of ram you could increase d512m to 756m or 1024mb still better than lzma2 or lzma:ultra that used by panker...
just be sure that you using fazip 64 for lzma to overcome memory limit in freearc.
the max lzma is d182mb in freearc alone without fazip...

[External compressor:lzma,delta,exe,mm,rep,tor,4x4]
header = 0
packcmd = fazip -i0 compress:{compressor}{ption} <stdin> <stdout>

* srep need less tan 1gb decompresion memory for Assetto...
i will try to use pzlib:max:c64m+srep:m5f:a2+delta+lzma:a1:mfbt4:d51 2m:fb273:mc10000:lc8
no need for more than 64m for pzlib...

OK...

1. I've been using these settings for LZMA/LZMA64:

a1:mfbt4:d256m:fb128:mc1000:lc8

Do LZMA64 (which is external to freearc) have the same memory limit you mentioned? my guess would be no.

2. Can't use FAZip, I tried, it caused problems with freearc itself, it caused the default methods of m1, m2, m4, etc, to crash, see here

[vollachr]

Originally Posted by doofoo24

Compressed 33,999 files, 42,886,060,604 => 8,475,378,350 bytes. Ratio 19.76%
pzlib:max:c128m+srep:m5f:a2+delta+lolz:mc1023:fba4 096:bc8:blr8:bm8:oh14:pc4:mtt1:mt2:d256m

I'm currently trying your above method (with slight changes since some of the options you set up there for pzlb & srep are already default in my arc.ini, so no need to specify them.

One question though, it's currently at the LOLZ part of the compression, it claims it gonna take almost 13 more hours, is that real? is that even normal?

Anyway, I'm tending (from cosmetic reasons) toward not using LOLZ, too much screen clutter.

But I'll wait and see the final result first.

[doofoo24]

it depend on you pc.
i used mt8 not mt2 i have alot of ram 64gb so there no problem it took 54min,
i changed in the post above to mt2 because most poeple likely have 16gb or 8gb of ram in in their system.
*mt does not affect the compression ratio...

[vollachr]

Originally Posted by doofoo24

it depend on you pc.
i used mt8 not mt2 i have alot of ram 64gb so there no problem it took 54min,
i changed in the post above to mt2 because most poeple likey have 16gb or 8gb of ram in in their system.
*mt does not affect the ratio compression ratio

I have 16GB of RAM in my machine and a pretty good Intel I7 CPU, still, it got to a point where the remaining time was over 27 hours, It was way too long and I had to cancel it, I'm looking for alternative solutions and considering to just stop trying to get the size down to 2xDVD5/1xDVD9 size and settle for the 3 Disc result.

Either way, LOLZ doesn't seem to be the solution for me, way too slow for me (and probably most people).

Right now trying to replace LOLZ with RZM, see the times and ratio, but that will be the last attempt I do, after that, if I don't get the result I want I'll set the conversion up for 3 discs.

[vollachr]

Originally Posted by doofoo24

try lolz:mc1023:fba4 096:bc8:blr8:bm8:oh14:pc4:mtt1:mt8:d128m
it will use 12.5gb of ram and all 8 threads ...
i used it on mad max it took 76 min...

OK, I'll see about trying that...

I'm just not sure if getting the game down to 2xDVD5 size is worth all the time I spend on it.

[vollachr]

Originally Posted by doofoo24

try lolz:mc1023:fba4 096:bc8:blr8:bm8:oh14:pc4:mtt1:mt8:d128m
it will use 12.5gb of ram and all 8 threads ...
i used it on mad max it took 76 min...

OK, trying it now, been working almost 2 hours, it's now at the LOLZ part...

1. LOLZ was Taxing my CPU to the max (100%), had to limit it via TaskManager to use only half the CPU cores so I can keep working with my computer.

2. Time-wise, gonna take at least another 9 hours and still rising.

I honestly don't like these kind of times for compression, I can accept 4-5 hours on my machine, it's decent enough but 8 is a little too much, not mention longer, especially to only get less than 1GB additional compression over a compression that takes 3-4 hours.

I'm really starting to realize I should probably leave it at 3 Discs, it doesn't worth the time.

[Andu21]

Originally Posted by vollachr

I honestly don't like these kind of times for compression, I can accept 4-5 hours on my machine, it's decent enough but 8 is a little too much, not mention longer, especially to only get less than 1GB additional compression over a compression that takes 3-4 hours.

I'm really starting to realize I should probably leave it at 3 Discs, it doesn't worth the time.

Have you tested DLZ?

[vollachr]

Originally Posted by Andu21

Have you tested DLZ?

Actually no, I haven't but I'm just tired of trying, I've been at it for around a week, maybe a little more, I'm currently going back to the beginning, a simple srep64+lzma64 or srep64+lzma, it turns out in the end as two (2) full DVD5 discs and a smaller disc of less than 400MB without additional files, once I'll have both options compressed I'm gonna see which one's faster in compression and install times and decide by that, the size difference is insignificant.

Hell, it was insignificant in all attempts with any compressors combination, except perhaps the ones that took way too long (15 hours or more) like LOLZ/Precomp but I have no intention of using those so back to the simplest option.

It will still fit 2xDVD5 or less with a game that isn't completely updated and/or don't have all DLCs installed.

I'm not gonna waste any more time on that, I've made my decision, hopefully I can release this conversion in the next few days.

[Andu21]

Well, if it helps, DLZ offers a little more compression than LZMA at almost the same speed. Depends on the data in the end.

[AndersonSL]

Hello I have a game here to export in .bin format but when I use it it is locked until a percentage arrives in windows 10
arc.ini:

[External compressor: precomp043]
header = 0
unpackcmd = precomp043 -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:fbz]
header = 0
solid=0
unpackcmd = fbz d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:nco]
header = 0
solid = 0
packcmd = nz.exe a -nm {options} $$arcpackedfile$$.nz $$arcdatafile$$.tmp
unpackcmd = nz.exe x $$arcpackedfile$$.nz
datafile = $$arcdatafile$$.tmp
packedfile = $$arcpackedfile$$.nz

[External compressor:mpz]
header = 0
solid = 0
unpackcmd = mpz.exe d $$arcpackedfile$$.mpz $$arcdatafile$$.mp3
datafile = $$arcdatafile$$.mp3
packedfile = $$arcpackedfile$$.mpz

[External compressor: precomp]
header = 0
unpackcmd = precomp -o$$arcdatafile$$.tmp -r $$arcpackedfile$$.tmp

[External compressor:reflate]
unpackcmd = reflate.exe d -t75p - -o - <stdin> <stdout>

[External compressor:msc]
header = 0
packcmd = msc c -v {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

[External compressor: pzlib]
header = 0
unpackcmd = pZLib d -t100p - -o - <stdin> <stdout>

[External compressor: piggy]
unpackcmd = piggy.dll -c d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:lzma2]
header = 0
unpackcmd = lzma2.dll x -txz -an -y -si -so <stdin> <stdout>

[External compressor:uharcx]
mem = 58
default = x
unpackcmd = uharc x $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:bcm]
header = 0
solid = 0
cmem = 1024
unpackcmd = bcm -d $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor:woohoo4,woohoo,woohoohoo]
header = 0
solid = 0

[External compressor:lol4]
header = 0
unpackcmd = cls-lolzx_x64.exe $$arcpackedfile$$.tmp $$arcdatafile$$.tmp

[External compressor: pz3,pz3x,pz3u]
header = 0
unpackcmd = ztool d: pzlib:t100p:cm0 - - <stdin> <stdout>

[External compressor: plzo]
header = 0
unpackcmd = ztool d: plzo:t100p:cm0 - - <stdin> <stdout>

[External compressor:rzw]
header = 0
solid = 0
dmem = 213
unpackcmd = rzw d f2 f1 128 128
datafile = f1
packedfile = f2

[External compressor:rzwb]
header = 0
solid = 0
dmem = 700
unpackcmd = rzw d f2 f1 1023 1023
datafile = f1
packedfile = f2

Can someone help me solve it?