FileForums - Help! Garry's Mod Compressor

FileForums (https://fileforums.com/index.php)

- Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)

- - Help! Garry's Mod Compressor (https://fileforums.com/showthread.php?t=97575)

rinaldo

19-01-2016 12:37

Help! Garry's Mod Compressor

guys i garry's mod 15 with about 8GB of add on, I recommended a method for compression ultra ... I would like to combine nanozip other good compressors .. I see in forums that are very taken by the argument and I rely on you :p

I will not use InnoSetup but .bat

panker1992

19-01-2016 13:57

you will not use inno but bat ?? :P

go ahead and use my devastate mode on masked compression :)

wish you luck rinaldo :)

hasandgn34

19-01-2016 15:08

Quote:

Originally Posted by rinaldo (Post 446277)

I try to compress Dirt Rally, Mad MAX , and like this games with
"arc.exe a -ep1 -dses --dirs -s; -lc- -ld- -di -i2 -r -mprecomp+srep:m3f:a1+delta+lzma:a1:mfbt4:d200m:fb1 28:lc8" this parameter but , SREP says 3911(or similar size) mb memory required and went ERROR.

how can I compress bigger than 30 GB with Srep.
Srep parameters in "arc.ini" "packcmd = srep {options} -a1 -m3f $$arcdatafile$$.tmp $$arcpackedfile$$.tmp"
Srep version 3.93a beta

panker1992

19-01-2016 15:13

do not use srep 3.93a

it has memory leak

and it crash endlessly especially on windows 10

this is verified bug :(

switch to 3.93 or 3.2 version and use 64 bit :)

hasandgn34

19-01-2016 15:28

Quote:

Originally Posted by panker1992 (Post 446281)

do not use srep 3.93a

it has memory leak

and it crash endlessly especially on windows 10

this is verified bug :(

switch to 3.93 or 3.2 version and use 64 bit :)

I tried even "3.2 version" it is same.
but i used x86 versions.

I want to learn. for example I downloaded Dirt rally as a REPACK.
I looked it was used this parameter "precomp+srep:m3f:a1+lzma:69mb:normal:bt4:128: lc8"
and with "x86 version SREP" but I can't do the similar PACK.

Please help me. I updated all files of game and I want to REPACK again that.
and many game but I have failed.

felice2011

20-01-2016 01:16

hey Rinaldo try this :

Code:

precomp+msc+srep64+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz

;)

Razor12911

20-01-2016 02:53

Quote:

Originally Posted by hasandgn34 (Post 446282)

Either you switch to 64 bit version of srep or lower a couple of settings in x86.
You'll end up using - m3f -lc1024 -c1024 - a0, but switching to x64 is better.

hasandgn34

20-01-2016 04:29

Quote:

Originally Posted by Razor12911 (Post 446285)

Either you switch to 64 bit version of srep or lower a couple of settings in x86.
You'll end up using - m3f -lc1024 -c1024 - a0, but switching to x64 is better.

when I use "-l1024 -c1024" parameters, what will change in compression.

because ,I tried compress it yesterday again, srep said "it can help to compress this file that "-ia- l64k" parameters".

if I use this in ARC.INI
"packcmd = srep {options} -a1 -m3f -ia- -l128k -c128k $$arcdatafile$$.tmp $$arcpackedfile$$.tmp" , is it problem?

rinaldo

20-01-2016 12:15

panker1992 base file

1a)

Code:

arc a -lc1024 -ld1024 -ep1 -ed -r -w.\ Data\data1.bin -msrep+msc+nz "data\*"

1b)

Code:

arc a -lc1024 -ld1024 -ep1 -ed -r -w.\ Data\data1.bin -mprecomp+msc+srep64+nzmax/$jpgsolid=jpg+zstd/$void=srep64+zstd/$text=nz  "data\*"

file test = fallbacks_000.vpk __ mb 28,3

1a) 13,4 mb
1b) 13,5 mb

9 MB is good :D

Rock and Roll :p

Miravinder

20-01-2016 13:27

1 Attachment(s)

hasandgn34, use SREP64 3.92 beta and clean TEMP files folder
what version of the OS?
how much RAM is installed?
available free space on the target disk?

arc.ini
[External compressor:srep]
header = 0
packcmd = srep64 {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

batch file
arc a -ep1 -ed -lc- -r -w.\ -mprecomp+srep:m3f:l512:c256:a4+delta+lzma:200mb:no rmal:bt4:128:lc8

panker1992

20-01-2016 13:34

Rinaldo did my method work ???

tho i saw that you only compressed one file :/

hasandgn34

20-01-2016 13:44

Quote:

Originally Posted by Miravinder (Post 446304)

OS is Windows 8.1 x86 and x64 and RAM 8GB I have.
and I have free space for compression. that is not about these. the problem is about parameters or anything like this.
I haven't tried Srep64 yet. I have tried with Srep x86.

panker1992

20-01-2016 15:02

hasandng srep 64 is a must use program in these cases

reasons are first srep64 is natively faster due to architecture 20% faster

reason number 2 ) srep64 uses much larger ram pool
example given assassin creed syndicate and lords of the fallen can use 4 gigs of ram to compress

reason number 3 ) you can always use srep x86 to compress thus limiting ram factor when decompressing and support for old machines
decomp seed might get crippled but srep is fast either way

i hope i got everything covered up :)

hasandgn34

20-01-2016 16:57

Quote:

Originally Posted by panker1992 (Post 446307)

thanks for answers I will use srep64

rinaldo

20-01-2016 19:26

Quote:

Originally Posted by panker1992 (Post 446305)

Rinaldo did my method work ???

tho i saw that you only compressed one file :/

.vtx files are the files that I need to work out, the rest is less than 1GB and 350MB compressed .. are not relevant process also gmod ..

rinaldo

21-01-2016 22:38

1 Attachment(s)

if someone manages to squeeze more rock

panker1992

22-01-2016 05:47

1 Attachment(s)

your bin = 2.62 mb
my bin = 2.60 mb

precomp + msc + srep +nzmax (all 4 cores active)

felice2011

23-01-2016 10:15

1 Attachment(s)

Rinaldo Bin = 2.62 mb
Panker Bin = 2.60 mb
M_S_Kompressor Bin = 2.55 mb...:D

Attachment 13358

RamiroCruzo

23-01-2016 19:49

I can't extract that bin of your amigo yet...I used Reflate, so the size is now 5.68 MB...& now the compression part with KungFq...Its still going on... 31% size 20KB :p

Miravinder

26-01-2016 11:06

Quote:

Originally Posted by panker1992 (Post 446281)

do not use srep 3.93a
it has memory leak and it crash endlessly especially on windows 10
this is verified bug :(
switch to 3.93 or 3.2 version and use 64 bit :)

panker1992, please show proof of this error and load data are compressed.
What build a srep 3.93 used?

Quote:

Originally Posted by hasandgn34 (Post 446306)

OS is Windows 8.1 x86 and x64 and RAM 8GB I have.

hasandgn34, I can recommend to close all programs that devour RAM. (torrent, browser, skype, etc.)

Quote:

Originally Posted by hasandgn34 (Post 446280)

SREP says 3911(or similar size) mb memory required and went ERROR.

You need to have 4 GB of contiguous block of memory, so use SREP 3.92 x64.

Quote:

Originally Posted by hasandgn34 (Post 446306)

I have free space for compression.

32 + 32 = 64 GB only need for temporary files srep. I would have freed at least 100 GB.

Code:

Compress DiRT Rally SREP x64 3.92 beta (OS Win8.1 x64 RAM 8Gb)



FreeArc 0.67 (September 13 2014) creating archive: .\DiRT Rally.arc

Compressing 10,735 files, 34,372,742,743 bytes. Processed  99.9%

Compressing 34,372,742,743 bytes with srep64 -m3f -l512 -c256 -a4  $$arcdatafile

$$.tmp $$arcpackedfile$$.tmp

100.0%SREP 3.92 beta (July 23, 2013): input size 32780 mb, memory used 3911 mb,

-m3f -l512 -c256 -a4/4 -hash=vmac -b8mb

0%: 8,388,608 -> 6,926,624: 82.57%.  Cpu 13 mb/s (0.608 sec), real 1 mb/s (9.051

0%: 16,777,216 -> 14,486,233: 86.34%.  Cpu 21 mb/s (0.764 sec), real 2 mb/s (9.7

0%: 25,165,824 -> 16,056,981: 63.80%.  Cpu 28 mb/s (0.858 sec), real 2 mb/s (9.9

0%: 41,943,040 -> 21,587,208: 51.47%.  Cpu 38 mb/s (1.045 sec), real 4 mb/s (10.

0%: 58,720,256 -> 25,811,362: 43.96%.  Cpu 45 mb/s (1.232 sec), real 5 mb/s (10.

0%: 75,497,472 -> 31,318,434: 41.48%.  Cpu 51 mb/s (1.404 sec), real 7 mb/s (10.

0%: 92,274,688 -> 39,457,433: 42.76%.  Cpu 53 mb/s (1.669 sec), real 8 mb/s (10.

---

99%: 34,301,018,112 -> 22,062,405,978: 64.32%.  Cpu 52 mb/s (629.292 sec), real

99%: 34,309,406,720 -> 22,070,760,456: 64.33%.  Cpu 52 mb/s (629.542 sec), real

99%: 34,317,795,328 -> 22,079,071,108: 64.34%.  Cpu 52 mb/s (629.823 sec), real

99%: 34,326,183,936 -> 22,087,367,162: 64.35%.  Cpu 52 mb/s (630.072 sec), real

99%: 34,334,572,544 -> 22,095,561,982: 64.35%.  Cpu 52 mb/s (630.353 sec), real

99%: 34,342,961,152 -> 22,103,882,334: 64.36%.  Cpu 52 mb/s (630.634 sec), real

99%: 34,351,349,760 -> 22,112,169,616: 64.37%.  Cpu 52 mb/s (630.868 sec), real

99%: 34,359,738,368 -> 22,120,494,866: 64.38%.  Cpu 52 mb/s (631.149 sec), real

99%: 34,368,126,976 -> 22,128,839,143: 64.39%.  Cpu 52 mb/s (631.414 sec), real

100%: 34,372,742,743 -> 22,133,391,584: 64.39%.  Cpu 52 mb/s (631.539 sec), real

 40 mb/s (811.045 sec) = 78%

Sorting matc100.0% Second 100.0100.0%

100.0%

Errorlevel=0

Compressed 10,735 files, 34,372,742,743 => 22,133,414,352 bytes. Ratio 64.39%

Compression time: cpu 93.87 sec/real 3080.10 sec = 3%. Speed 11.16 mB/s

All OK

hasandgn34

26-01-2016 12:07

Quote:

Originally Posted by Miravinder (Post 446453)

panker1992, please show proof of this error and load data are compressed.
What build a srep 3.93 used?

hasandgn34, I can recommend to close all programs that devour RAM. (torrent, browser, skype, etc.)

You need to have 4 GB of contiguous block of memory, so use SREP 3.92 x64.

32 + 32 = 64 GB only need for temporary files srep. I would have freed at least 100 GB.

Code:

Compress DiRT Rally SREP x64 3.92 beta (OS Win8.1 x64 RAM 8Gb)



FreeArc 0.67 (September 13 2014) creating archive: .\DiRT Rally.arc

Compressing 10,735 files, 34,372,742,743 bytes. Processed  99.9%

Compressing 34,372,742,743 bytes with srep64 -m3f -l512 -c256 -a4  $$arcdatafile

$$.tmp $$arcpackedfile$$.tmp

100.0%SREP 3.92 beta (July 23, 2013): input size 32780 mb, memory used 3911 mb,

-m3f -l512 -c256 -a4/4 -hash=vmac -b8mb

0%: 8,388,608 -> 6,926,624: 82.57%.  Cpu 13 mb/s (0.608 sec), real 1 mb/s (9.051

0%: 16,777,216 -> 14,486,233: 86.34%.  Cpu 21 mb/s (0.764 sec), real 2 mb/s (9.7

0%: 25,165,824 -> 16,056,981: 63.80%.  Cpu 28 mb/s (0.858 sec), real 2 mb/s (9.9

0%: 41,943,040 -> 21,587,208: 51.47%.  Cpu 38 mb/s (1.045 sec), real 4 mb/s (10.

0%: 58,720,256 -> 25,811,362: 43.96%.  Cpu 45 mb/s (1.232 sec), real 5 mb/s (10.

0%: 75,497,472 -> 31,318,434: 41.48%.  Cpu 51 mb/s (1.404 sec), real 7 mb/s (10.

0%: 92,274,688 -> 39,457,433: 42.76%.  Cpu 53 mb/s (1.669 sec), real 8 mb/s (10.

---

99%: 34,301,018,112 -> 22,062,405,978: 64.32%.  Cpu 52 mb/s (629.292 sec), real

99%: 34,309,406,720 -> 22,070,760,456: 64.33%.  Cpu 52 mb/s (629.542 sec), real

99%: 34,317,795,328 -> 22,079,071,108: 64.34%.  Cpu 52 mb/s (629.823 sec), real

99%: 34,326,183,936 -> 22,087,367,162: 64.35%.  Cpu 52 mb/s (630.072 sec), real

99%: 34,334,572,544 -> 22,095,561,982: 64.35%.  Cpu 52 mb/s (630.353 sec), real

99%: 34,342,961,152 -> 22,103,882,334: 64.36%.  Cpu 52 mb/s (630.634 sec), real

99%: 34,351,349,760 -> 22,112,169,616: 64.37%.  Cpu 52 mb/s (630.868 sec), real

99%: 34,359,738,368 -> 22,120,494,866: 64.38%.  Cpu 52 mb/s (631.149 sec), real

99%: 34,368,126,976 -> 22,128,839,143: 64.39%.  Cpu 52 mb/s (631.414 sec), real

100%: 34,372,742,743 -> 22,133,391,584: 64.39%.  Cpu 52 mb/s (631.539 sec), real

 40 mb/s (811.045 sec) = 78%

Sorting matc100.0% Second 100.0100.0%

100.0%

Errorlevel=0

Compressed 10,735 files, 34,372,742,743 => 22,133,414,352 bytes. Ratio 64.39%

Compression time: cpu 93.87 sec/real 3080.10 sec = 3%. Speed 11.16 mB/s

All OK

I did it. and there is no problem with srep64.
but you didn't use precomp for this. because it is increasing 58gb from 27gb.
when ı used srepx86, it went to error. but with x64 srep, it works perfectly.
thanks again. :D

Miravinder

26-01-2016 22:56

Quote:

Originally Posted by hasandgn34 (Post 446454)

but you didn't use precomp for this. because it is increasing 58gb from 27gb.

I have not used precomp, why it does not work in a multithreaded unpacking.

Quote:

Originally Posted by hasandgn34 (Post 446454)

but with x64 srep, it works perfectly.
thanks again. :D

Forget it! I'm happy for you. :)

rinaldo

27-01-2016 05:18

Quote:

panker
felix

if we get to 2 MB it is good .. but if only srep+msc+nz reach 2.62 I doubt use precompress ... if we go down below 2, we are riding on what I have to do .. otherwise I would look for other compressors more capable on the files .. thank you for the good help guy ;)

panker1992

27-01-2016 06:25

It's been a while since i went in this thread :P so i am reading from the beginning

Rinaldo try to use reflate, precomp (i recommend 0.38) and i posted antiz somewhere :P

if i try desperately i can make it 2 mb :P nanozip seems to provide a good ratio without the use of many postprocessing ~ recompressing tools

@Miradriver

you dont trust me ?? i keep all my tools updated so whenever a something comes up i see it swiftly :)

you can download 3.93a from Bulat

here is the proof, this is from the developer site :)

Code:

Quote:

Originally Posted by Original Post

Found a bug in srep3.93a...

Uploaded (a part of) the file which gives the error: http*****://hugefiles*****.net/****

In this case I use srep64 -m4 -l32 error.000

It crashes on the sorting matches. I tried the intel build and a self compiled vc2013 build.

E
--
Problem signature:
Problem Event Name: APPCRASH
Application Name: srep64m.exe
Application Version: 3.9.3.1
Application Timestamp: 55955c48
Fault Module Name: srep64m.exe
Fault Module Version: 3.9.3.1
Fault Module Timestamp: 55955c48
Exception Code: c0000005
Exception Offset: 000000000000e0cc
OS Version: 6.3.9600.2.0.0.272.7
Locale ID: 1043
Additional Information 1: f7cb
Additional Information 2: f7cb6bcff07116ea5ca6ea0f1b74cb5a
Additional Information 3: c4fe
Additional Information 4: c4fed20a42589c3b8d6bd2094a895a6d

Miravinder

28-01-2016 10:14

Quote:

Originally Posted by panker1992 (Post 446490)

you dont trust me ?? i keep all my tools updated so whenever a something comes up i see it swiftly :)
you can download 3.93a from Bulat
here is the proof, this is from the developer site :)

Thanks, I found out about this error only on this forum, so he wanted to see proof.

All times are GMT -7. The time now is 15:31.