View Full Version : Simple splitting and compress by DLG
felice2011
04-11-2015, 13:21
" Simple Splitting And Compress by DLG © "
http://i68.tinypic.com/4q4s2s.jpg
" Compression Methods Fully Configurable From Text "
***
'Add New Method Compression { Reflate } By Gozarck & Mod By Razor12911'
' Command Line For Unpacked Reflate '
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
***
' Add New { Advanced Data Compression } Method By Panker1992 ( Speed & Max Compression ) '
' Command Line For Unpacked Advanced Data Compression ( xz & zstd ) '
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>unpackcmd = zstd -d -f <stdin> <stdout>
***
' Added Split Data Progress Control '
***
' Added Data File Progress Control '
***
' Added Packed File Progress Control & '*rzr8' Data Packed Control Reflate '
***
' Added Output File Progress Control For Each Split Files Or Single File And Total Output Files'
***
' Added The Option Of Choice For Division Multiple Files Or Single Output File '
***
' Removed Division By Kbytes '
***
' Fixed Other Minor Improvements On Controls And Stability '
***
' Changelog v1.3d '
***
' Added New "lz77" Algorithm By Panker1992 '
***
' Added Visual Check Of The Temporary And Total Files During Processing Of Compression '
***
' Added The Option Of Advanced Choice Of Different Compression Algorithms '
***
' Added And Perfected The Threshold Of Packaging For A Correct Compression In Output '
( Performs A Calculation Of Double Precision In Real Time In The Percentage Of Input Size And The Size Chosen By The User For The Division Of Each Files )
( The Minimum Percentage Not Drops Below The Size Set By The User For Splitting Of Each File, The Maximum Percentage Does Not Exceed Input Size Remaining Above The Threshold Of Split )
***
' Fixed Other Minor Improvements On Controls And Stability '
***
:p Enjoy Bro...:p
>>> 13104 <<<
***
' Fixed SKv1.4c ( Last Update 4 ) '
***
' Fixed The Reading In Temp Files That Do Not Use The Algorithms For Processing "arcdatafile" And "arcpackedfile" '
***
' Fixed The Application Start Mode In Administrator Mode For Systems Win8, Win8.1 And Win10 '
***
' Fixed Percentage Progress For Each Algorithm Of Processing Included In The Method '
***
' Fixed With Further Correction Of The Threshold Percentage Of The Size Of The Input And Output '
***
' Fixed Reading Of Only Files Processed In The Temporary Control Window '
***
' New Self-Configuration Setting "records.ini" At Packet Completed '
***
' Added Precomp 0.4.4 Alpha '
***
' Fixed Writing In "records.ini" Created For Precomp From "0.38" To "0.44" '
***
' Added Compression Algorithm "NanoZip" In Advanced Mode '
***
' Added Methods In Simple Mode "precomp+msc+srep64+delta+nz" & "msc+srep64+exe2+nz" '
***
' Other Minor Fixes '
:)
>>> 13328 <<<
"XII/MMXV"
;)
>>> Split_Kompress_Tutorial (https://goo.gl/BxTBWu) <<< (https://goo.gl/BxTBWu)
( Copy And Replace On Original Path All the Folders And Files )
:cool:
>>> New Split Kompress v1.5c <<<
***
' Added Precomp. pZLib v3 by Razor '
***
' Added Comp. FP8 '
***
' Added Comp. nz64 '
***
' Added Comp. Zpaq64 '
***
' Added Comp. ZCM '
***
'Added Precomp 0.45 & 0.46 '
***
' Other Minor Fixes In The Complex '
***
>>> 17180 <<<
(Full No Installer, To Extract & Ready)
:)
GBT repack
04-11-2015, 21:41
Very powerful tool, thank you.
Can you share with the matching decompression bat
nice tool.but some how its slower than the normal method using bat files.and moving the actual windows of the program is sluggish.none the less i am sure its work in progress for you and all the feedback would be good for you :-)
PC Specs tested on:
i7 3770 @ 3.9GHZ
32 GB RAM
felice2011
05-11-2015, 09:51
Very powerful tool, thank you.
Can you share with the matching decompression bat
The compressed files of any method are compatible with any installation compiled with inno setup.
I tried it as an example the new installer by @rinaldo compatible with any compression method using my program.
Only by using the method with built-precomp I had to add some lines to UltraArc.iss files inside the folder "Modules"
I also had to add the file version precomp.exe used into the folder "include" in this way:
"Only use with precomp method with installer by @rinaldo"
http://i66.tinypic.com/23vyr8o.png
http://i66.tinypic.com/122kcw0.png
http://i65.tinypic.com/b7kjki.png
Enjoy..:)
felice2011
09-11-2015, 14:22
Split Kompress Upd1.1b
Reduced the time of division of the directory (the total time of split and compression can vary depending on the speed hard disk installed).
Precision redefined on the size of each file.
Added control timer.
Creation of the Arc.temp files for the compression in the same executable path.
Auto-deletion of temporary files uncompressed in case of interruption.
By request re-drawn the graphics color with hue more tenuous and less burning...:rolleyes:
Fixed other minor improvements on controls and stability.
DWN in First Post.
:)
felice2011
30-11-2015, 14:08
Up..updated..;)
panker1992
30-11-2015, 22:45
This is lzham ALL_IN_ONE.
The dll is injected inside so all comes into one exe.
its the same version you use so no worries, as soon as i compile the new version i will sent it over if you want it :)
Edit 1: Also use this 7z.exe it has dll injected inside as well and its alpha version,
The one you have it 15.10 Beta, whereas this one is 15.12 alpha and its injected as well :P
ShadowEagle
01-12-2015, 11:45
The compressed files of any method are compatible with any installation compiled with inno setup.
I tried it as an example the new installer by @rinaldo compatible with any compression method using my program.
Only by using the method with built-precomp I had to add some lines to UltraArc.iss files inside the folder "Modules"
I also had to add the file version precomp.exe used into the folder "include" in this way:
"Only use with precomp method with installer by @rinaldo"
http://i66.tinypic.com/23vyr8o.png
http://i66.tinypic.com/122kcw0.png
http://i65.tinypic.com/b7kjki.png
Enjoy..:)
So i don`t have to add any line for using reflate method with my CIU2 script? Don`t believe that
felice2011
01-12-2015, 13:08
I do not think I understood your question, the example shown was directed to the (new installer by @rinaldo) with other installer script for example 'Black_Box_Script_By_Kurutucu_V1.8' and others all works methods perfectly without changing anything.:)
P.S:when it relates to reflate unpacked method we have to wait for new updates or ask to Razor.
ShadowEagle
01-12-2015, 13:21
I do not think I understood your question, the example shown was directed to the (new installer by @rinaldo) with other installer script for example 'Black_Box_Script_By_Kurutucu_V1.8' and others all works methods perfectly without changing anything.:)
P.S:when it relates to reflate unpacked method we have to wait for new updates or ask to Razor.
So, there is no way to extract the reflated archives created by your tool?
felice2011
01-12-2015, 13:37
works extracting all files created with various methods PreComp, SREP, MSC,LZMA, XZ, ZSTD etc ... for the extraction method reflate ask a razor.;)
The following update my program.:)
ShadowEagle
01-12-2015, 13:39
works extracting all files created with various methods PreComp, SREP, MSC,LZMA, XZ, ZSTD etc ... for the extraction method reflate ask a razor.;)
The following update my program.:)
Funny ;) I was happy to use your tool because i read reflate and now i can`t use reflate :(
4x4 extracting will work without additional files?
panker1992
01-12-2015, 13:46
razor seems to have abandoned reflating method ..... and many many more people seem to have let it aside as well .... because of its very complicated and slow progression with decompression ... if you want to use it please take gozarcks methods as they produce near to no error at the moment
4x4 can be extracted from unarc.exe and unarc.dll so its ok !!
felice2011
01-12-2015, 14:19
It's a shame, the method reflate by Gozarck modified by Razor I liked and it was very simple for everyone, I hope that razor will continue and can find a way to decompress, to leave things half does not make sense.:confused:
My utility is created to simplify and make easier and more intuitive data compression methods, it will be continuously updated, thank you to our and your engagement with new methods by Gozarck, Panker and Razor.;)
panker1992
01-12-2015, 14:48
Felice your work, putting together everything is amazing.
Tho make a quick update
replace 7z and lzham in your folder with the updated versions i provided also remove
the reflate method you picked because it cannot be decompressed
and if you want add a method to use lzham :P
keep up the good work :D i will provide some more tools so stay tuned !!
felice2011
02-12-2015, 00:33
Hello Panker I already updated the files that you posted, I am interested any new method to insert in the my utilities made available in the forum.;)
I'm going to urge Mr. Razor to see if he wants to continue the work reflate, before removing it from my program.
panker1992
02-12-2015, 04:10
Here I just made that for you.... i went through your settings and i see that you use lzma a lot.
So i thought maybe i give you something i used to use a long time ago
literally i havent used lzma since i discovered how to use lzma2 instead but
I took the lzma code from lzma SDK and i compilled it using x64 settings to the profiler so it can use more than 3 gigs of ram, also i renamed this to lz77 since lzma is a pure lz77 compression algo.
I did that in order to trick it and use this one instead of the lzma that arc.exe has inside
pros and cons :
pros:
1) its fresh code and updated, the one you see as freearc-lzma is a decade old code
2) its supported in freearc and it has stdin and stdout options classically
3) 13% higher speed over freearc-lzma
cons:
1) its still slow and it has made little to no effort to change style, if you consider time as fact respect and embrace lzma2 as i did :)
how to use :
[External compressor:lz77]
header = 0
packcmd = lz77 e -si -so <stdin> <stdout> -a1 -d30 -fb273 -mc10000 -lc8 -lp4 -mfbt4
unpackcmd = lz77 d -si -so <stdin> <stdout>
felice2011
02-12-2015, 05:03
Good looks interesting, i execute some tests, before inserting in my utility..:)
panker1992
02-12-2015, 05:09
i am testing zstd 4.1 at the moment :P the one i uploaded days ago is 3.6!!
~~~ 20% gain in speed at decomp per thread of the cpu~~~
will be updating my advanced tools soon i guess :P
felice2011
02-12-2015, 05:21
' News for Reflate Unpacked Method By Mr.Razor '
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmpEnjoy Brothers
panker1992
02-12-2015, 05:47
This is Priority Test !!! i will begin right now ^^^^^^^
ShadowEagle
03-12-2015, 02:12
' News for Reflate Unpacked Method By Mr.Razor '
unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmpEnjoy Brothers
I`m new @ reflate -> What i`ve to do now for unpacking reflate? Greetz
felice2011
03-12-2015, 02:46
I`m new @ reflate -> What i`ve to do now for unpacking reflate? Greetz
Add the line in the file 'arc.ini' use the command *bat for decompression date.;)
Once you tested unpack for the method reflate you do what you want.:rolleyes:
ShadowEagle
03-12-2015, 03:02
Add the line in the file 'arc.ini'
Got this.
use the command *bat for decompression date
Didn`t got this? What do you mean? Do i need additional files for unpacking?
felice2011
03-12-2015, 05:20
For unpacking, you need to have the same files in the folder the that you use for the packaging.
ShadowEagle
03-12-2015, 05:34
For unpacking, you need to have the same files in the folder the that you use for the packaging.
And inno setup will do it automatically? So easy? Really?
felice2011
03-12-2015, 10:29
And inno setup will do it automatically? So easy? Really?
All these question marks seem a mockery..;)
Nothing is Easy, Nothing is Hard, All is Possible..:D
If you have problems with my utility you can also ask, on the contrary to other problems you open new thread in the forum, someone will respond to your problems, in this thread we talk of problems and updates relevant to Split Kompressor.;)
RamiroCruzo
04-12-2015, 00:04
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....
ShadowEagle
04-12-2015, 01:39
All these question marks seem a mockery..;)
Nothing is Easy, Nothing is Hard, All is Possible..:D
If you have problems with my utility you can also ask, on the contrary to other problems you open new thread in the forum, someone will respond to your problems, in this thread we talk of problems and updates relevant to Split Kompressor.;)
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.
felice2011
04-12-2015, 02:48
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.
I`ll stay with UltraARC!
Not need any tutorial to use my tool, if it is difficult for you to use it 'unique case your' remains well with UltraARC excellent tool for compressing, then eventually the concept of my utility and UltraArc is similar.
They are both two tools for split and data compression.
Your problem, as I understand it, that you can not decompress the method reflate in an installer with InnoSetup..
I repeat, if you want a solution for your problem, open a new thread and describe your problem.
Split Kompress and Ultra Arc are both utility for compression, problems with installers created with InnoSetup are discussed in the section of this forum, not in this thread.
Not continue to send messages not related to my utility or I will have to report you as spam.
panker1992
04-12-2015, 07:59
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....
I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )
felice2011
04-12-2015, 08:35
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....
I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
panker1992
04-12-2015, 09:39
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
This is why i chose zstd ...because it features advanced API that can compress decent.
To be more specific zstd has at least 30% ~ 35% better compression ratio
tho everyone i see use my original -8 switch ....it can easily go as high as -20 but its ratio doesnt compare to lzma at all :P
All in all zstd gives 30% ~ 35% better compression AND it decompressed as fast as lz4
HINT : zstd and all tools i use have porpose nothing i choose is coincidence this all is part of my upcoming big project call "Masked Compression"
soon !!!
felice2011
04-12-2015, 10:10
Great Bro ... at least we know that LZ4 and LZ5 is now out ;)
Razor12911
04-12-2015, 12:22
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.
took me 4 minutes to figure out how this program works, from my perspective, this program is easier than ultra arc and it is reliable.
ShadowEagle
04-12-2015, 14:32
Yes i`m stupid and bad guy :(
Razor12911
04-12-2015, 16:58
Yes i`m stupid and bad guy :(
not really, you just have to engage with the program even further and use logic, so far so good, you are showing interests with this program only thing left is to make attempts to make the program work using logic then you'll get there.
Yes felice your tool is very powerfull and easy to use.you need to make the UI more atractive for newbies. Do you was tried to integrate metroframework.dll (metroUI) in yours projects?.
RamiroCruzo
04-12-2015, 22:14
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.
Lets compare ourselves which is better for our needs....:)
Source:Encode.ru
| Compressor name | Compression| Decompress.| Compr. size | Ratio |
| --------------- | -----------| -----------| ----------- | ----- |
| memcpy | 8533 MB/s | 8533 MB/s | 104857600 |100.00 |
| lz4 r131 | 480 MB/s | 2275 MB/s | 64872315 | 61.87 |
| lz4hc r131 -1 | 82 MB/s | 1896 MB/s | 59448496 | 56.69 |
| lz4hc r131 -3 | 54 MB/s | 1932 MB/s | 56343753 | 53.73 |
| lz4hc r131 -5 | 41 MB/s | 1969 MB/s | 55271312 | 52.71 |
| lz4hc r131 -7 | 31 MB/s | 1969 MB/s | 54889301 | 52.35 |
| lz4hc r131 -9 | 24 MB/s | 1969 MB/s | 54773517 | 52.24 |
| lz4hc r131 -11 | 20 MB/s | 1969 MB/s | 54751363 | 52.21 |
| lz4hc r131 -13 | 17 MB/s | 1969 MB/s | 54744790 | 52.21 |
| lz4hc r131 -15 | 14 MB/s | 2007 MB/s | 54741827 | 52.21 |
| lz5 r131 | 195 MB/s | 939 MB/s | 55884927 | 53.30 |
| lz5hc r131 -1 | 32 MB/s | 742 MB/s | 52927122 | 50.48 |
| lz5hc r131 -3 | 20 MB/s | 716 MB/s | 50970192 | 48.61 |
| lz5hc r131 -5 | 10 MB/s | 701 MB/s | 49970285 | 47.66 |
| lz5hc r131 -7 | 5.54 MB/s | 682 MB/s | 49541511 | 47.25 |
| lz5hc r131 -9 | 2.69 MB/s | 673 MB/s | 49346894 | 47.06 |
| lz5hc r131 -11 | 1.36 MB/s | 664 MB/s | 49266526 | 46.98 |
| zstd v0.3 | 257 MB/s | 547 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -1 | 257 MB/s | 553 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -3 | 76 MB/s | 417 MB/s | 46774383 | 44.61 |
| zstd_HC v0.3 -5 | 40 MB/s | 476 MB/s | 45628362 | 43.51 |
| zstd_HC v0.3 -9 | 14 MB/s | 485 MB/s | 44840562 | 42.76 |
| zstd_HC v0.3 -13 | 9.34 MB/s | 469 MB/s | 43114895 | 41.12 |
| zstd_HC v0.3 -17 | 6.02 MB/s | 463 MB/s | 42989971 | 41.00 |
| zstd_HC v0.3 -21 | 3.35 MB/s | 461 MB/s | 42956964 | 40.97 |
| zstd_HC v0.3 -23 | 2.33 MB/s | 463 MB/s | 42934217 | 40.95 |
ShadowEagle
05-12-2015, 02:07
Used this method:
http://ultraimg.com/images/Unbenannt2b400e.png
I tried to extract with inno setup. I copied all files from "Resources" folder into includes folder in inno setup script and added the reflate files into the script:
Source: Include\reflate.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawrest.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawdet.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\raw2hif.exe; DestDir: {tmp}; Flags: dontcopy
But i get this error:
http://ultraimg.com/images/Unbenannt4ecef.png
Pls help. What i`m doing wrong?
panker1992
05-12-2015, 04:21
Lets compare ourselves which is better for our needs....:)
Source:Encode.ru
| Compressor name | Compression| Decompress.| Compr. size | Ratio |
| --------------- | -----------| -----------| ----------- | ----- |
| memcpy | 8533 MB/s | 8533 MB/s | 104857600 |100.00 |
| lz4 r131 | 480 MB/s | 2275 MB/s | 64872315 | 61.87 |
| lz4hc r131 -1 | 82 MB/s | 1896 MB/s | 59448496 | 56.69 |
| lz4hc r131 -3 | 54 MB/s | 1932 MB/s | 56343753 | 53.73 |
| lz4hc r131 -5 | 41 MB/s | 1969 MB/s | 55271312 | 52.71 |
| lz4hc r131 -7 | 31 MB/s | 1969 MB/s | 54889301 | 52.35 |
| lz4hc r131 -9 | 24 MB/s | 1969 MB/s | 54773517 | 52.24 |
| lz4hc r131 -11 | 20 MB/s | 1969 MB/s | 54751363 | 52.21 |
| lz4hc r131 -13 | 17 MB/s | 1969 MB/s | 54744790 | 52.21 |
| lz4hc r131 -15 | 14 MB/s | 2007 MB/s | 54741827 | 52.21 |
| lz5 r131 | 195 MB/s | 939 MB/s | 55884927 | 53.30 |
| lz5hc r131 -1 | 32 MB/s | 742 MB/s | 52927122 | 50.48 |
| lz5hc r131 -3 | 20 MB/s | 716 MB/s | 50970192 | 48.61 |
| lz5hc r131 -5 | 10 MB/s | 701 MB/s | 49970285 | 47.66 |
| lz5hc r131 -7 | 5.54 MB/s | 682 MB/s | 49541511 | 47.25 |
| lz5hc r131 -9 | 2.69 MB/s | 673 MB/s | 49346894 | 47.06 |
| lz5hc r131 -11 | 1.36 MB/s | 664 MB/s | 49266526 | 46.98 |
| zstd v0.3 | 257 MB/s | 547 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -1 | 257 MB/s | 553 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -3 | 76 MB/s | 417 MB/s | 46774383 | 44.61 |
| zstd_HC v0.3 -5 | 40 MB/s | 476 MB/s | 45628362 | 43.51 |
| zstd_HC v0.3 -9 | 14 MB/s | 485 MB/s | 44840562 | 42.76 |
| zstd_HC v0.3 -13 | 9.34 MB/s | 469 MB/s | 43114895 | 41.12 |
| zstd_HC v0.3 -17 | 6.02 MB/s | 463 MB/s | 42989971 | 41.00 |
| zstd_HC v0.3 -21 | 3.35 MB/s | 461 MB/s | 42956964 | 40.97 |
| zstd_HC v0.3 -23 | 2.33 MB/s | 463 MB/s | 42934217 | 40.95 |
Impressive but this test utilize the HC format of the zstd program
currently i test zstd v4.2
i have eaten all my day to test, test and test this :P
download the lz4 installer for windows and rename zstd ~~> lz4.exe and
replace in programs/lz4 folder
use this and you will see that decomp speed is all but fake i/o cant handle
2.2 gigs/sec because of limitation unless you have some x6 SSD array :P
sayang123
05-12-2015, 05:49
Is there any installer script which support the unpack command from this app?
sorry for my bad english
also applies in the ComboBox style. the success is in knowing how to match colors
(Too bright and too colorful are crap)
lit are used to such mail alert .. design still do not like you know.
felice2011
05-12-2015, 09:48
also applies in the ComboBox style. the success is in knowing how to match colors
(Too bright and too colorful are crap)
lit are used to such mail alert .. design still do not like you know.[/QUOTE]
Depending on your point of view there are those who see the world in color and some in black and white... I see the world in color, anyway I see what you need.;)
felice2011
05-12-2015, 12:17
is there any installer script which support the unpack command from this app?
Sorry for my bad english
In attachment it is an example of installing proprietary 'not InnoSetup' with a data file compressed using the reflate method 'reflate+srep+delta+lzma:a1:mfbt4:d158m:fb273:mc10 00000000:lc8'
For what concerns me and for my use decompression or installation or setup of a compressed data folder, with the excellent method reflate, works beautifully.
coming soon, new universal extractor in new thread
Hello, thank you felice2011 for this application. It is fantastic!
In my windows 7 64 bit is good but in another my PC with XP SP3 32 bit does not work with this error: "Split_Kompress.exe is win32 application invalid".
There is solutions to this problem?
Thank you in advance, sorry for my english and congratulations again for your work.
panker1992
10-12-2015, 17:31
@Lucas this will never work for 32 bit windows let alone xp ...
the programs attached to this compressor,
well at least xz and Zstd i compiled myself and are only 64 bit supported
at this point {Note} that at least 8 gigs of ram is the absolute minimum for solid compression !!!
felice2011
11-12-2015, 00:35
Hello, thank you felice2011 for this application. It is fantastic!
In my windows 7 64 bit is good but in another my PC with XP SP3 32 bit does not work with this error: "Split_Kompress.exe is win32 application invalid".
There is solutions to this problem?
Thank you in advance, sorry for my english and congratulations again for your work.
The program is optimized for 64-bit systems with minimum 4GB of RAM, XP is now obsolete, and makes the most of 3.5GB of RAM as it is a 32bit system.
Even if it would work 32-bit its potential for compression would be reduced by 60%.
Ahn ok. So if I wanted to use this code: -mprecomp+reflate+srep+delta+lzma:a1:mfbt4:d158m:fb 273:mc100000:lc8 in .bat file on my XP the volum of compression would be reduced by 60% however, or not?
felice2011
11-12-2015, 05:40
Ahn ok. So if I wanted to use this code: -mprecomp+reflate+srep+delta+lzma:a1:mfbt4:d158m:fb 273:mc100000:lc8 in .bat file on my XP the volum of compression would be reduced by 60% however, or not?
No one questions that this method does not work with xp 32 bit, but with the modified method 64-bit in this way "-msrep64+delta+lzma64:a1:mfbt4:d158m:fb273:mc1000:l c8" you may take advantage of more RAM and more cores of a good processor with a system 64 bit, significantly reducing the waiting time during a large compression.
I can not and not convenient modify the source code of the utility to fit on a 32-bit system, moreover dated, we try to create advanced software able to improve and lighten the work of compression to you users, making it more easy and intuitive, especially with system compatibility in view of present and futur...not for the past...hi:)
I understand and I thank you for giving me clear the concept. Recently I have become aware of these compression methods so it's all new to me.
I would have another problem that after using this great program I was presented. Using the method "reflate", at the end of compression gives me this error:
http://i.imgur.com/c0EVIWm.png
And after the error did not save the compressed file. The library 7z.dll I never touched. The .tmp and .raw file rest in the _tmp folder.
What may be due? Sorry again for your trouble.
felice2011
11-12-2015, 10:21
7z dll error due to a block loading...
Manually delete the temporary files in the folder '_tmp'.
Manually delete also the folder 'Resources' and recopy the one contained in the 7z file I posted, so be sure that no files were modified.
Disable your antivirus when using, some files it can be recognized as false positive.
Please try the same method with a data folder smallest and see if it works.
Thanks for the help felice but unfortunately still no go.
I then downloaded all the files from .7z you posted and tried to shut down anti-virus on a file of 200 MB. First I tried on about 4 gb. Task manager is clear.
However I get the exact same error.
felice2011
11-12-2015, 11:55
I tested with the version I posted, using the same settings on a folder of 200mb I have not received any error.
P.S: Tested on w7 x64 bit.
http://i65.tinypic.com/2guzlgw.png
Try with this copy and replace.
13060
Thanks for the help but I tried and tried and unfortunately continues to give me that error.
I tried changing file types, destinations and extensions of the output but keeps the damn error 7z.dll.
If you have any other advice on which to rest thank you, while I keep trying, hoping to find a solution.
felice2011
12-12-2015, 05:48
Thanks for the help but I tried and tried and unfortunately continues to give me that error.
I tried changing file types, destinations and extensions of the output but keeps the damn error 7z.dll.
If you have any other advice on which to rest thank you, while I keep trying, hoping to find a solution.
Excuse satisfy my curiosity, try directly with reflate edited by Razor, http://www.fileforums.com/attachment.php?attachmentid=12529&d=1442362824 or at the most uses only this command line "-mreflate+srep+delta+lzma" with my utility.;)
Fine, I tried both options with your utility: with that string, I get the same error while the reflate razor everything works well until the end. What does it mean?
Thanks again for the help.
Great Felice! It worked last! I did some tests and now work all the various compression options. In the end I saw that it was enough to take the file 7z.dll razor replacing it in the "Resource" folder to get it going. Thank you so much for the help and patience!
I would have another curiosity as long as there are: but various versions of Precomp have substantial differences, or what?
felice2011
13-12-2015, 08:44
Great, the important thing is to solve....I personally use the precomp042 and 043, substantial differences between the two, the precomp042 has a greater compatibility of compression with data files and with the various application for decompression,on the contrary, with 043 you could get errors of incompatibility on some files, during the compression, but you get more compression as unlike to the 042.
the other information you can read here http://schnaader.info/precomp_changes.php
Thanks a lot for everything felice. Now I'm trying to figure out how to unzip these methods, especially with reflate. I am using the script of Rinaldo and I get an error decompression. If I continue to have these problems I can ask here, in the thread of Rinaldo or open a new topic?
Meanwhile, thanks for everything, you were very kind. Hello!
felice2011
13-12-2015, 10:58
Thanks a lot for everything felice. Now I'm trying to figure out how to unzip these methods, especially with reflate. I am using the script of Rinaldo and I get an error decompression. If I continue to have these problems I can ask here, in the thread of Rinaldo or open a new topic?
Meanwhile, thanks for everything, you were very kind. Hello!
Here we discuss problems related to my utility, open a new thread, or better directly in the thread of Rinaldo, he's the expert of script with inno setup will give you valid information.;)
panker1992
17-12-2015, 22:29
i decided to give away my Zstd compression for windows
because i think it can go head to head with lzma :eek:
yes it can beat lzma normal and high modes but not ultra
special code it is pipelined through srep for maximum performance test the glory ;)
also i updated zstd to 4.4 the latest its getting better and better
Notes : zstd compressor for windows is only 64 bit, but i have posted 32 bit support on encode. ru forums i also gave away inno setup for it there too
Enjoy :)
felice2011
19-12-2015, 10:37
Updated Now " Split Kompress v1.3d "
;)
panker1992
19-12-2015, 10:47
packcmd = lz77 e -si -so <stdin> <stdout> -a1 -d30 -fb273 -mc10000 -lc8 -lp4 -mfbt4
this command is the top you can get that means lz77 aka(lzma renamed) will use best dictionary available
in short terms that means you must have at least 20 gigs of ram ..... yeah lzma can use bigger dictionary than 1024 mb ...
if i remember correct 1.5 gigs or now after the update around 4 which means 15 gigs and 40 gigs respectively .....
depending on your machine use -d15 instead of 30 or -d20 test a little
enjoy :)
EDIT1: well decided to give you many options since i am to the bone in lzma and lzma2
-mfbt4 command on lzma is power-very-hungry ram user and nasty one to use especially if your ram is limited
it will use 10 gigs of ram per 1gig of dictionary .... in short you can switch to -mfhc4 that uses 1.5 gigs ram per 1 gig dictionary
personally i havent used -mfhc4 at all so if you pull some tests please let me know
EDIT2: sorry forgot to tell above :P please dont yell for many edits i only have one mind
with this out of the way, lz77 replaces freearc-lzma in all aspects, this is why i posted it originally
freearc-lzma is outdated to the neck so why use it ?? arc.exe has lzma inside it already and you can just call it without having lzma in ini thi is why i renamed to lz77 to reverse conflict
the lzma inside arc.exe is also outdated to fazip.exe respectively :P
EDIT3: ok now because i want to make your live easy i will tell all my secrets like boss :P
fazip also hasnt been updated in while so its outdated to lz77
lz77 is the same code used in streams to produce lzma2 i use in xz command so all in all
if you wanna do it right delete lz77.exe and use
[External compressor:lz77]
header = 0
packcmd = xz a -txz -an -mcrc=0 -m1=lzma2:d1024m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>
this line will produce a lzma variant exactly like lz77 and fazip and the lzma code inside arc.exe this is the most updated lzma code to this day
1gig dictionary usage 10 gigs ram is required
Final Edit :
Tests on your program and Corrections
Felice i had time today so i gave a go on your program which is very nice especially for new people in compression
i also give you my endorsement for considering advanced users in this section as well
i decided to make some corrections on this in order to help minimize its source
you dont need dll files as i injected them inside the applications exe now carry their dlls on their backs no need to have them in a file separetely
i removed some programs as well as they dont fit :P
i also updated srep 32 and 64 bit to the latest best version 3.93
Enjoy :)
felice2011
20-12-2015, 05:46
@Panker the file "arc.ini" is updated when you start each application, so the changes that you made in the folder resource are lost and do not work at the next startup.
Moreover, with files that have modified in the folder 'resource' utility goes error with the methods that contain '+ lzma64', we must give the user the possibility of choosing any algorithm, and not the one that we like.:)
If you have any changes to the utility or any other updates, please send me the files, I will think about modify as best he can pleasure..;)
panker1992
20-12-2015, 06:23
Felice i know what you mean .... let people have many choices is right i didnt remove the choices that you let people have but software updates fast even faster that we imagine
you can replace freearc-lzma with fazip
fazip excels in lzma coding by around 13% for 32bit and around 17% in 64 bit so :P
felice2011
20-12-2015, 06:33
Felice i know what you mean .... let people have many choices is right i didnt remove the choices that you let people have but software updates fast even faster that we imagine
you can replace freearc-lzma with fazip
fazip excels in lzma coding by around 13% for 32bit and around 17% in 64 bit so :P
This is great, I understand, and other users will have understand, but if the utility has several choices let these operate without errors, and that the user can choose, on the contrary I would not have entered.;)
Moreover if there would be the possibility to enter the option lz77: "7z a -txz -an -mcrc=0 -m1=lzma2:d512m:fb=273:mf=bt4:mc=10000:lc=4:lp=0 -mmt=2 -mx9" OR xz: "7z a -txz -an -mcrc=0 -m1=lzma2:d27:fb=273:mf=bt4:mc=1000:lc=4:lp=0 -mmt=on -mx9"
Directly in the textbox of the utility would be a great thing, so that the user can modify the choice in the utility.
panker1992
20-12-2015, 06:38
Felice i am uploading my masked compression project i am making my last adjustments
everything i am trying to tell you was for this moment you dont have to compress using one method when you can use everything all at once
did you know you can use reflate precomp lz77 zstd xz and deflating method all on 1 large bin file ???
sorry forgot to tell you :P
please let people modify the dictionary
because its ram dependant so people with less ram will never make it with lzma2 which can use 4 times the ram that lzma1 uses
felice2011
22-12-2015, 01:55
Further Update "Split Kompress Update_2" On The Front Page.
Sorry I try of perfecting.
:)
Very nice update felice. This is a very powerfull tool.
I tried this program only SREP and was fine ..
it only works with SREP ... why?
when it crashes, always the same error .. and when I stop him from the button because it blocked ... from them is no longer moving.
Sin looked good your program :)
ChronoCross
22-12-2015, 17:31
I really want to test, but i have an error "System.IO.FileNotFoundException
". the program crash quickly.
Win7x64
felice2011
23-12-2015, 00:37
I tried this program only SREP and was fine ..
it only works with SREP ... why?
when it crashes, always the same error .. and when I stop him from the button because it blocked ... from them is no longer moving.
Sin looked good your program :)
I really want to test, but i have an error "System.IO.FileNotFoundException
". the program crash quickly.
Win7x64
@rinaldo from what I see from the photo do not use it correctly, although I tested the utility in your way, it works equally..;)
Simply create a folder to save the compressed files, and not in a root directory of the system, where you have hundreds of other files, if you press' STOP 'while the program is running to read, for compressed files, risks of a crash' utility, seems obvious.:)
the utility is tested at 99% with the methods included in "Simple", attention that the algorithm contains "precomp" natively sometimes finds it difficult to compress some folders that contain files such as * .dll and others, it happened to me with a program called Picasa seems.
@ChronoCross checks that the root of the utility contains "MetroFramework.dll":)
only pre-stressed errors amazing .. use 043 only, otherwise they will always incompatible, because 043 is all in one and not the others, so the test will be more accurate with only a test exe .. regarding other methods, you should absolutely use the bat or programs in symbiosis.
felice2011
28-12-2015, 03:33
" Split Kompress Update_3 (only exe) "
' Fixed Reading Of Only Files Processed In The Temporary Control Window '
' New Self-Configuration Setting "records.ini" At Packet Completed '
" Enjoy "
ChronoCross
30-12-2015, 21:12
Nice felice2011 this is a great tool.
1234567890123
02-01-2016, 13:45
which script i can use for this program
felice2011
03-01-2016, 00:40
Any installation script, example installers "RG Catalyst" By @Bilawal or "New Installer" By @Rinaldo, for Installations With And Without Password.
O.O a new DLG compressor? I definitely have to try it! Thank you so much for all the work and effort you put to make these :D I am glad they are compatible with Rinaldo's installers :)
-Edit-
Excuse my fanboy moment; Woooooow this new tool is so cool! Interface looks great and configuring it is extremely easy, even for people that do not understand much about such things. Thank you so much! Happy New Year :)
felice2011
20-01-2016, 03:57
" Update SK v1.4c "
' Added Precomp 0.4.4 Alpha '
' Fixed Writing In "records.ini" Created For Precomp From "0.38" To "0.44" '
' Added Compression Algorithm "NanoZip" In Advanced Mode '
' Added Methods In Simple Mode "precomp+msc+srep64+delta+nz" & "msc+srep64+exe2+nz" '
( Personally The Compression Algorithm "NZ" In Combination With Different Methods Is One Of The Better )
:)
( Copy And Replace On Original Path All The Folders And Files )
felice2011
31-01-2016, 01:57
Take away a curiosity, do me a screen within the Resources folder you have on your desktop.
Pulcione86
31-01-2016, 02:24
http://s8.postimg.org/8mms4llf5/image.jpg (http://postimg.org/image/8mms4llf5/)
http://s8.postimg.org/d9su6d8s1/image.jpg (http://postimg.org/image/d9su6d8s1/)
felice2011
31-01-2016, 02:36
Ohhhh..Pulcione but what the hell, do you missing all the algorithms for a good compression.
It was logical that it does not work.
Install the basic program "The First Version" with its installer to any directory.
Download the update 1.4c and extract it all, copy and replace the installation directory.
Start the program from the shortcut on the desktop, you see that everything will work a wonders.
Hello felice ! Will your compressor use RAM and the Compression according to input data ? If not then what should i have to do to increase the ram usage by compressor like panker1992 RAM fixes arc.ini ? And why I can't slide the threshold slider ?
Do i have to use split to use threshold slider :confused:
felice2011
22-02-2016, 12:34
The Threshold slider works only with the division of the option activated.
To increase the use of RAM you can try modifying "arc.ini" in the "Resources" folder for the use of external algorithms (LZ77 & XZ)
[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:dXXXm:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:dXXXm:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
6GB = lz77: 300 / xz : 150
8GB = lz77: 450 / xz : 250
16GB = lz77: 1200 / xz : 600
With these modifications do not assure you the proper functioning..;)
panker1992
22-02-2016, 17:19
The Threshold slider works only with the division of the option activated.
To increase the use of RAM you can try modifying "arc.ini" in the "Resources" folder for the use of external algorithms (LZ77 & XZ)
[External compressor:lz77]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:dXXXm:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=2 -mx9 -si -so <stdin> <stdout>
[External compressor:xz]
header = 0
packcmd = 7z a -txz -an -mcrc=0 -m1=lzma2:dXXXm:fb=273:mf=bt4:mc=1000000:lc=4:lp=0 -mmt=4 -mx9 -si -so <stdin> <stdout>
6GB = lz77: 300 / xz : 150
8GB = lz77: 450 / xz : 250
16GB = lz77: 1200 / xz : 600
With these modifications do not assure you the proper functioning..;)
I have written entire Manual on those Commands and how to fix them and optimize them for a system, you can download this manual here along with many other stuff to get you started on advanced repacking :P
http://fileforums.com/attachment.php?attachmentid=13740&d=1456189831
I have written entire Manual on those Commands and how to fix them and optimize them for a system, you can download this manual here along with many other stuff to get you started on advanced repacking :P
http://fileforums.com/attachment.php?attachmentid=13740&d=1456189831
Very Helpful Panker..:rolleyes:
Pulcione86
23-02-2016, 09:20
Sto facendo centinaia di prove, ma continuo a non capire il problema dove sta...
Ecco la schermata di errore, in questo caso stavo comprimendo una cartella di 1.5 gb...
Ma solo a me da il problema?
-----------------------------------------------------------------
I'm doing hundreds of tests , but still do not understand where the problem is ...
Here is the error screen , in this case I was squeezing a 1.5 gb folder ...
http://s22.postimg.org/8gh7li7zh/tyertyerty.jpg (http://postimg.org/image/8gh7li7zh/)
felice2011
23-02-2016, 11:41
Apart you're in the wrong thread...:rolleyes:
I posted version 1.3 here...http://www.fileforums.com/showpost.php?p=447452&postcount=40, then removed after 24 hours because unofficial, and you continue to use version 1.2.
Maybe it's me, I do not understand.:)
P.S: In command (/$temp=) or you leave us a point or enter a directory.
why my folder size 12,5GB
already configure split 3800MB but folder :
Dark Souls III_1 = 4.33 GB
Dark Souls III_2 = 12,5 GB
Dark Souls III_3 = 1,53 GB
and how for no compres ? edit manual method -m0 ? :D
felice2011
21-04-2016, 13:45
why my folder size 12,5GB
already configure split 3800MB but folder :
Dark Souls III_1 = 4.33 GB
Dark Souls III_2 = 12,5 GB
Dark Souls III_3 = 1,53 GB
and how for no compres ? edit manual method -m0 ? :D
Check there are no files with greater size of the size you set..;)
if you use "M&S Kompressor", compressor similar but not equal, in the case where there are files higher than the set split, warns you with an error.
If you want the compression method only arc with level -m0 ...- m9 you do before using win zippo or winrar to compress and split your games.:rolleyes:
ATL4NTYS
08-06-2016, 16:44
(sorry for my bad english)
i have the same problem like inatha3
i set split to 800mb and largest file in folder is 702mb file..
but when i copress it the final files are:
Data1.bin 1071mb
Data2.bin 684mb
Dara3.bin 110mb
... in old version of S&C (1.2) this working perfectly.. but there this is strange.. :confused: please help.. :(
felice2011
09-06-2016, 00:23
(sorry for my bad english)
i have the same problem like inatha3
i set split to 800mb and largest file in folder is 702mb file..
but when i copress it the final files are:
Data1.bin 1071mb
Data2.bin 684mb
Dara3.bin 110mb
... in old version of S&C (1.2) this working perfectly.. but there this is strange.. :confused: please help.. :(
The concept of split of folders between S&C and this is the same, the size of the splitted files change because inside them there may be groups of files with a different compression threshold, greater or lesser, depending on the type of compressed file.
You can help by increasing the percentage threshold "Threshold Pack".
Logically all is well proportioned to the compress method used, if you try to use the same method used in S&C the result should be the same.
DanielSW
12-07-2016, 14:56
Where is the download botton XD for the latest version :3 ty!
pakrat2k2
12-07-2016, 15:05
all on first page !!! try at bottom of post......
DanielSW
16-07-2016, 12:08
Well getting an error... -2 "Unarc.dll unsupported compression method -mmsc+srep+exe+delta+lzma:a1:mfbt4:d158m:fb273:mc10 00000:lc8"
any idea? tnx
Well getting an error... -2 "Unarc.dll unsupported compression method -mmsc+srep+exe+delta+lzma:a1:mfbt4:d158m:fb273:mc10 00000:lc8"
any idea? tnx
Make sure you have this in your Setup.ini:
PrecompVer=inside
DanielSW
16-07-2016, 14:25
Hmmm,i don't have any setup.ini? :O where is that?
ramazan19833
23-08-2016, 23:42
Split_Kompress_v1.3d
ASC or ISDone Support (unpack) HELP
M&S_Kompressor_1.3
hi felice2011
Can you update Simple splitting and compress by DLG : Add pzlibv3, zcm etc. thanks
felice2011
10-02-2017, 02:10
Add pzlibv3, zcm .... "etc" (what further compressors) ... what it means to try to be more precise.
If I ask update is that I like this compressor
I asked for an update to add pzlib, zcm, zpaq64, nz64, fp8 or mcm
thank you
felice2011
10-02-2017, 03:13
ok
felice2011
11-02-2017, 03:45
Updated v1.5c Down & Change List In First Page...;)
https://i.imgsafe.org/ef96475173.png
https://i.imgsafe.org/ef97fad783.png
Beautiful
thank you very much
please update it and add number of section in split.
Thank you
vBulletin® v3.8.11, Copyright ©2000-2026, vBulletin Solutions Inc.