Help! Garry's Mod Compressor

[rinaldo]

guys i garry's mod 15 with about 8GB of add on, I recommended a method for compression ultra ... I would like to combine nanozip other good compressors .. I see in forums that are very taken by the argument and I rely on you :p

I will not use InnoSetup but .bat

[panker1992]

you will not use inno but bat ?? :P

go ahead and use my devastate mode on masked compression :)

wish you luck rinaldo :)

[hasandgn34]

guys i garry's mod 15 with about 8GB of add on, I recommended a method for compression ultra ... I would like to combine nanozip other good compressors .. I see in forums that are very taken by the argument and I rely on you :p

I will not use InnoSetup but .bat


I try to compress Dirt Rally, Mad MAX , and like this games with
"arc.exe a -ep1 -dses --dirs -s; -lc- -ld- -di -i2 -r -mprecomp+srep:m3f:a1+delta+lzma:a1:mfbt4:d200m:fb1 28:lc8" this parameter but , SREP says 3911(or similar size) mb memory required and went ERROR.

how can I compress bigger than 30 GB with Srep.
Srep parameters in "arc.ini" "packcmd = srep {options} -a1 -m3f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp"
Srep version 3.93a beta

[panker1992]

do not use srep 3.93a

it has memory leak

and it crash endlessly especially on windows 10

this is verified bug :(

switch to 3.93 or 3.2 version and use 64 bit :)

[hasandgn34]

do not use srep 3.93a

it has memory leak

and it crash endlessly especially on windows 10

this is verified bug :(

switch to 3.93 or 3.2 version and use 64 bit :)

I tried even "3.2 version" it is same.
but i used x86 versions.

I want to learn. for example I downloaded Dirt rally as a REPACK.
I looked it was used this parameter "precomp+srep:m3f:a1+lzma:69mb:normal:bt4:128:lc8"
and with "x86 version SREP" but I can't do the similar PACK.

Please help me. I updated all files of game and I want to REPACK again that.
and many game but I have failed.

[felice2011]

hey Rinaldo try this : precomp+msc+srep64+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz;)

[Razor12911]

I tried even "3.2 version" it is same.
but i used x86 versions.

I want to learn. for example I downloaded Dirt rally as a REPACK.
I looked it was used this parameter "precomp+srep:m3f:a1+lzma:69mb:normal:bt4:128:lc8"
and with "x86 version SREP" but I can't do the similar PACK.

Please help me. I updated all files of game and I want to REPACK again that.
and many game but I have failed.
Either you switch to 64 bit version of srep or lower a couple of settings in x86.
You'll end up using - m3f -lc1024 -c1024 - a0, but switching to x64 is better.

[hasandgn34]

Either you switch to 64 bit version of srep or lower a couple of settings in x86.
You'll end up using - m3f -lc1024 -c1024 - a0, but switching to x64 is better.

when I use "-l1024 -c1024" parameters, what will change in compression.

because ,I tried compress it yesterday again, srep said "it can help to compress this file that "-ia- l64k" parameters".

if I use this in ARC.INI
"packcmd = srep {options} -a1 -m3f -ia- -l128k -c128k $$arcdatafile$$.tmp $$arcpackedfile$$.tmp" , is it problem?

[rinaldo]

panker1992 base file

1a)
arc a -lc1024 -ld1024 -ep1 -ed -r -w.\ Data\data1.bin -msrep+msc+nz "data\*"
1b)
arc a -lc1024 -ld1024 -ep1 -ed -r -w.\ Data\data1.bin -mprecomp+msc+srep64+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz "data\*"

file test = fallbacks_000.vpk __ mb 28,3

1a) 13,4 mb
1b) 13,5 mb

9 MB is good :D

Rock and Roll :p

[Miravinder]

hasandgn34, use SREP64 3.92 beta and clean TEMP files folder
what version of the OS?
how much RAM is installed?
available free space on the target disk?

arc.ini
[External compressor:srep]
header = 0
packcmd = srep64 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

batch file
arc a -ep1 -ed -lc- -r -w.\ -mprecomp+srep:m3f:l512:c256:a4+delta+lzma:200mb:no rmal:bt4:128:lc8

[panker1992]

Rinaldo did my method work ???

tho i saw that you only compressed one file :/

[hasandgn34]

hasandgn34, use SREP64 3.92 beta and clean TEMP files folder
what version of the OS?
how much RAM is installed?
available free space on the target disk?

arc.ini
[External compressor:srep]
header = 0
packcmd = srep64 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

batch file
arc a -ep1 -ed -lc- -r -w.\ -mprecomp+srep:m3f:l512:c256:a4+delta+lzma:200mb:no rmal:bt4:128:lc8

OS is Windows 8.1 x86 and x64 and RAM 8GB I have.
and I have free space for compression. that is not about these. the problem is about parameters or anything like this.
I haven't tried Srep64 yet. I have tried with Srep x86.

[panker1992]

hasandng srep 64 is a must use program in these cases

reasons are first srep64 is natively faster due to architecture 20% faster

reason number 2 ) srep64 uses much larger ram pool
example given assassin creed syndicate and lords of the fallen can use 4 gigs of ram to compress

reason number 3 ) you can always use srep x86 to compress thus limiting ram factor when decompressing and support for old machines
decomp seed might get crippled but srep is fast either way

i hope i got everything covered up :)

[hasandgn34]

hasandng srep 64 is a must use program in these cases

reasons are first srep64 is natively faster due to architecture 20% faster

reason number 2 ) srep64 uses much larger ram pool
example given assassin creed syndicate and lords of the fallen can use 4 gigs of ram to compress

reason number 3 ) you can always use srep x86 to compress thus limiting ram factor when decompressing and support for old machines
decomp seed might get crippled but srep is fast either way

i hope i got everything covered up :)

thanks for answers I will use srep64

[rinaldo]

Rinaldo did my method work ???

tho i saw that you only compressed one file :/


.vtx files are the files that I need to work out, the rest is less than 1GB and 350MB compressed .. are not relevant process also gmod ..

[rinaldo]

if someone manages to squeeze more rock

[panker1992]

your bin = 2.62 mb
my bin = 2.60 mb

precomp + msc + srep +nzmax (all 4 cores active)

[felice2011]

Rinaldo Bin = 2.62 mb
Panker Bin = 2.60 mb
M_S_Kompressor Bin = 2.55 mb...:D

13358

[RamiroCruzo]

I can't extract that bin of your amigo yet...I used Reflate, so the size is now 5.68 MB...& now the compression part with KungFq...Its still going on... 31% size 20KB :p

[Miravinder]

do not use srep 3.93a
it has memory leak and it crash endlessly especially on windows 10
this is verified bug :(
switch to 3.93 or 3.2 version and use 64 bit :)
panker1992, please show proof of this error and load data are compressed.
What build a srep 3.93 used?

OS is Windows 8.1 x86 and x64 and RAM 8GB I have.
hasandgn34, I can recommend to close all programs that devour RAM. (torrent, browser, skype, etc.)
SREP says 3911(or similar size) mb memory required and went ERROR.
You need to have 4 GB of contiguous block of memory, so use SREP 3.92 x64.
I have free space for compression.
32 + 32 = 64 GB only need for temporary files srep. I would have freed at least 100 GB.
Compress DiRT Rally SREP x64 3.92 beta (OS Win8.1 x64 RAM 8Gb)

FreeArc 0.67 (September 13 2014) creating archive: .\DiRT Rally.arc
Compressing 10,735 files, 34,372,742,743 bytes. Processed 99.9%
Compressing 34,372,742,743 bytes with srep64 -m3f -l512 -c256 -a4 $$arcdatafile
$$.tmp $$arcpackedfile$$.tmp
100.0%SREP 3.92 beta (July 23, 2013): input size 32780 mb, memory used 3911 mb,
-m3f -l512 -c256 -a4/4 -hash=vmac -b8mb
0%: 8,388,608 -> 6,926,624: 82.57%. Cpu 13 mb/s (0.608 sec), real 1 mb/s (9.051
0%: 16,777,216 -> 14,486,233: 86.34%. Cpu 21 mb/s (0.764 sec), real 2 mb/s (9.7
0%: 25,165,824 -> 16,056,981: 63.80%. Cpu 28 mb/s (0.858 sec), real 2 mb/s (9.9
0%: 41,943,040 -> 21,587,208: 51.47%. Cpu 38 mb/s (1.045 sec), real 4 mb/s (10.
0%: 58,720,256 -> 25,811,362: 43.96%. Cpu 45 mb/s (1.232 sec), real 5 mb/s (10.
0%: 75,497,472 -> 31,318,434: 41.48%. Cpu 51 mb/s (1.404 sec), real 7 mb/s (10.
0%: 92,274,688 -> 39,457,433: 42.76%. Cpu 53 mb/s (1.669 sec), real 8 mb/s (10.
---
99%: 34,301,018,112 -> 22,062,405,978: 64.32%. Cpu 52 mb/s (629.292 sec), real
99%: 34,309,406,720 -> 22,070,760,456: 64.33%. Cpu 52 mb/s (629.542 sec), real
99%: 34,317,795,328 -> 22,079,071,108: 64.34%. Cpu 52 mb/s (629.823 sec), real
99%: 34,326,183,936 -> 22,087,367,162: 64.35%. Cpu 52 mb/s (630.072 sec), real
99%: 34,334,572,544 -> 22,095,561,982: 64.35%. Cpu 52 mb/s (630.353 sec), real
99%: 34,342,961,152 -> 22,103,882,334: 64.36%. Cpu 52 mb/s (630.634 sec), real
99%: 34,351,349,760 -> 22,112,169,616: 64.37%. Cpu 52 mb/s (630.868 sec), real
99%: 34,359,738,368 -> 22,120,494,866: 64.38%. Cpu 52 mb/s (631.149 sec), real
99%: 34,368,126,976 -> 22,128,839,143: 64.39%. Cpu 52 mb/s (631.414 sec), real
100%: 34,372,742,743 -> 22,133,391,584: 64.39%. Cpu 52 mb/s (631.539 sec), real
40 mb/s (811.045 sec) = 78%
Sorting matc100.0% Second 100.0100.0%
100.0%
Errorlevel=0
Compressed 10,735 files, 34,372,742,743 => 22,133,414,352 bytes. Ratio 64.39%
Compression time: cpu 93.87 sec/real 3080.10 sec = 3%. Speed 11.16 mB/s
All OK

[hasandgn34]

panker1992, please show proof of this error and load data are compressed.
What build a srep 3.93 used?


hasandgn34, I can recommend to close all programs that devour RAM. (torrent, browser, skype, etc.)

You need to have 4 GB of contiguous block of memory, so use SREP 3.92 x64.

32 + 32 = 64 GB only need for temporary files srep. I would have freed at least 100 GB.
Compress DiRT Rally SREP x64 3.92 beta (OS Win8.1 x64 RAM 8Gb)

FreeArc 0.67 (September 13 2014) creating archive: .\DiRT Rally.arc
Compressing 10,735 files, 34,372,742,743 bytes. Processed 99.9%
Compressing 34,372,742,743 bytes with srep64 -m3f -l512 -c256 -a4 $$arcdatafile
$$.tmp $$arcpackedfile$$.tmp
100.0%SREP 3.92 beta (July 23, 2013): input size 32780 mb, memory used 3911 mb,
-m3f -l512 -c256 -a4/4 -hash=vmac -b8mb
0%: 8,388,608 -> 6,926,624: 82.57%. Cpu 13 mb/s (0.608 sec), real 1 mb/s (9.051
0%: 16,777,216 -> 14,486,233: 86.34%. Cpu 21 mb/s (0.764 sec), real 2 mb/s (9.7
0%: 25,165,824 -> 16,056,981: 63.80%. Cpu 28 mb/s (0.858 sec), real 2 mb/s (9.9
0%: 41,943,040 -> 21,587,208: 51.47%. Cpu 38 mb/s (1.045 sec), real 4 mb/s (10.
0%: 58,720,256 -> 25,811,362: 43.96%. Cpu 45 mb/s (1.232 sec), real 5 mb/s (10.
0%: 75,497,472 -> 31,318,434: 41.48%. Cpu 51 mb/s (1.404 sec), real 7 mb/s (10.
0%: 92,274,688 -> 39,457,433: 42.76%. Cpu 53 mb/s (1.669 sec), real 8 mb/s (10.
---
99%: 34,301,018,112 -> 22,062,405,978: 64.32%. Cpu 52 mb/s (629.292 sec), real
99%: 34,309,406,720 -> 22,070,760,456: 64.33%. Cpu 52 mb/s (629.542 sec), real
99%: 34,317,795,328 -> 22,079,071,108: 64.34%. Cpu 52 mb/s (629.823 sec), real
99%: 34,326,183,936 -> 22,087,367,162: 64.35%. Cpu 52 mb/s (630.072 sec), real
99%: 34,334,572,544 -> 22,095,561,982: 64.35%. Cpu 52 mb/s (630.353 sec), real
99%: 34,342,961,152 -> 22,103,882,334: 64.36%. Cpu 52 mb/s (630.634 sec), real
99%: 34,351,349,760 -> 22,112,169,616: 64.37%. Cpu 52 mb/s (630.868 sec), real
99%: 34,359,738,368 -> 22,120,494,866: 64.38%. Cpu 52 mb/s (631.149 sec), real
99%: 34,368,126,976 -> 22,128,839,143: 64.39%. Cpu 52 mb/s (631.414 sec), real
100%: 34,372,742,743 -> 22,133,391,584: 64.39%. Cpu 52 mb/s (631.539 sec), real
40 mb/s (811.045 sec) = 78%
Sorting matc100.0% Second 100.0100.0%
100.0%
Errorlevel=0
Compressed 10,735 files, 34,372,742,743 => 22,133,414,352 bytes. Ratio 64.39%
Compression time: cpu 93.87 sec/real 3080.10 sec = 3%. Speed 11.16 mB/s
All OK

I did it. and there is no problem with srep64.
but you didn't use precomp for this. because it is increasing 58gb from 27gb.
when ı used srepx86, it went to error. but with x64 srep, it works perfectly.
thanks again. :D

[Miravinder]

but you didn't use precomp for this. because it is increasing 58gb from 27gb.
I have not used precomp, why it does not work in a multithreaded unpacking.
but with x64 srep, it works perfectly.
thanks again. :D
Forget it! I'm happy for you. :)

[rinaldo]

panker
felix

if we get to 2 MB it is good .. but if only srep+msc+nz reach 2.62 I doubt use precompress ... if we go down below 2, we are riding on what I have to do .. otherwise I would look for other compressors more capable on the files .. thank you for the good help guy ;)

[panker1992]

It's been a while since i went in this thread :P so i am reading from the beginning


Rinaldo try to use reflate, precomp (i recommend 0.38) and i posted antiz somewhere :P


if i try desperately i can make it 2 mb :P nanozip seems to provide a good ratio without the use of many postprocessing ~ recompressing tools

@Miradriver

you dont trust me ?? i keep all my tools updated so whenever a something comes up i see it swiftly :)

you can download 3.93a from Bulat

here is the proof, this is from the developer site :)

Code:


Found a bug in srep3.93a...

Uploaded (a part of) the file which gives the error: http*****://hugefiles*****.net/****

In this case I use srep64 -m4 -l32 error.000

It crashes on the sorting matches. I tried the intel build and a self compiled vc2013 build.

E
--
Problem signature:
Problem Event Name: APPCRASH
Application Name: srep64m.exe
Application Version: 3.9.3.1
Application Timestamp: 55955c48
Fault Module Name: srep64m.exe
Fault Module Version: 3.9.3.1
Fault Module Timestamp: 55955c48
Exception Code: c0000005
Exception Offset: 000000000000e0cc
OS Version: 6.3.9600.2.0.0.272.7
Locale ID: 1043
Additional Information 1: f7cb
Additional Information 2: f7cb6bcff07116ea5ca6ea0f1b74cb5a
Additional Information 3: c4fe
Additional Information 4: c4fed20a42589c3b8d6bd2094a895a6d

[Miravinder]

you dont trust me ?? i keep all my tools updated so whenever a something comes up i see it swiftly :)
you can download 3.93a from Bulat
here is the proof, this is from the developer site :)
Thanks, I found out about this error only on this forum, so he wanted to see proof.