FileForums

FileForums (https://fileforums.com/index.php)
-   Conversion Tutorials (https://fileforums.com/forumdisplay.php?f=55)
-   -   Simple splitting and compress by DLG (https://fileforums.com/showthread.php?t=97303)

felice2011 04-11-2015 13:21

Simple splitting and compress by DLG
 
3 Attachment(s)

" Simple Splitting And Compress by DLG © "

http://i68.tinypic.com/4q4s2s.jpg

" Compression Methods Fully Configurable From Text "

***
'Add New Method Compression { Reflate } By Gozarck & Mod By Razor12911'

' Command Line For Unpacked Reflate '
HTML Code:

unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
***
' Add New { Advanced Data Compression } Method By Panker1992 ( Speed & Max
Compression ) '

' Command Line For Unpacked Advanced Data Compression ( xz & zstd ) '
HTML Code:

unpackcmd = dec x -txz -an -y -si -so <stdin> <stdout>
HTML Code:

unpackcmd = zstd -d -f <stdin> <stdout>
***
' Added Split Data Progress Control '

***
' Added Data File Progress Control '

***
' Added Packed File Progress Control & '*rzr8'
Data Packed Control Reflate '

***
' Added Output File Progress Control For Each Split Files Or Single File And Total Output Files'

***
' Added The Option Of Choice For Division Multiple Files Or Single Output File '

***
' Removed Division By Kbytes '

***
' Fixed Other Minor Improvements On Controls And Stability '

***

' Changelog v1.3d '

***
' Added New "lz77" Algorithm By Panker1992 '

***
' Added Visual Check Of The Temporary And Total Files During Processing Of Compression '

***
' Added The Option Of Advanced Choice Of Different Compression Algorithms '

***
' Added And Perfected The Threshold Of Packaging For A Correct Compression In Output '

( Performs A Calculation Of Double Precision In Real Time In The Percentage Of Input Size And The Size Chosen By The User For The Division Of Each Files )

( The Minimum Percentage Not Drops Below The Size Set By The User For Splitting Of Each File, The Maximum Percentage Does Not Exceed Input Size Remaining Above The Threshold Of Split )

***
' Fixed Other Minor Improvements On Controls And Stability '

***
:p Enjoy Bro...:p


>>> Attachment 13104 <<<

***
' Fixed SKv1.4c ( Last Update 4 ) '

***
' Fixed The Reading In Temp Files That Do Not Use The Algorithms For Processing "arcdatafile" And "arcpackedfile" '

***
' Fixed The Application Start Mode In Administrator Mode For Systems Win8, Win8.1 And Win10 '

***
' Fixed Percentage Progress For Each Algorithm Of Processing Included In The Method '

***
' Fixed With Further Correction Of The Threshold Percentage Of The Size Of The Input And Output '

***
' Fixed Reading Of Only Files Processed In The Temporary Control Window '

***
' New Self-Configuration Setting "records.ini" At Packet Completed '

***
' Added Precomp 0.4.4 Alpha '

***
' Fixed Writing In "records.ini" Created For Precomp From "0.38" To "0.44" '

***
' Added Compression Algorithm "NanoZip" In Advanced Mode '

***
' Added Methods In Simple Mode "precomp+msc+srep64+delta+nz" & "msc+srep64+exe2+nz" '

***
' Other Minor Fixes '

:)

>>> Attachment 13328 <<<

"XII/MMXV"

;)

>>> Split_Kompress_Tutorial <<<

( Copy And Replace On Original Path All the Folders And Files )

:cool:

>>> New
Split Kompress v1.5c <<<

***
' Added Precomp. pZLib v3 by Razor '

***
' Added
Comp. FP8 '

***
' Added Comp. nz64 '

***
' Added Comp. Zpaq64 '

***
' Added Comp. ZCM '

***
'Added Precomp 0.45 & 0.46 '

***
'
Other Minor Fixes In The Complex '

***
>>> Attachment 17180 <<<
(Full No Installer, To Extract & Ready)

:)


GBT repack 04-11-2015 21:41

Very powerful tool, thank you.
Can you share with the matching decompression bat

mikey26 05-11-2015 09:43

nice tool.but some how its slower than the normal method using bat files.and moving the actual windows of the program is sluggish.none the less i am sure its work in progress for you and all the feedback would be good for you :-)

PC Specs tested on:

i7 3770 @ 3.9GHZ
32 GB RAM

felice2011 05-11-2015 09:51

Quote:

Originally Posted by GBT repack (Post 444291)
Very powerful tool, thank you.
Can you share with the matching decompression bat

The compressed files of any method are compatible with any installation compiled with inno setup.

I tried it as an example the new installer by @rinaldo compatible with any compression method using my program.

Only by using the method with built-precomp I had to add some lines to UltraArc.iss files inside the folder "Modules"

I also had to add the file version precomp.exe used into the folder "include" in this way:

"Only use with precomp method with installer by @rinaldo"

http://i66.tinypic.com/23vyr8o.png

http://i66.tinypic.com/122kcw0.png

http://i65.tinypic.com/b7kjki.png

Enjoy..:)

felice2011 09-11-2015 14:22

Split Kompress Upd1.1b

Reduced the time of division of the directory (the total time of split and compression can vary depending on the speed hard disk installed).

Precision redefined on the size of each file.


Added control timer.

Creation of the Arc.temp files for the compression in the same executable path.

Auto-deletion of temporary files uncompressed in case of interruption.

By request re-drawn the graphics color with hue more tenuous and less burning...:rolleyes:

Fixed other minor improvements on controls and stability.

DWN in First Post.

:)

felice2011 30-11-2015 14:08

Up..updated..;)

panker1992 30-11-2015 22:45

This is lzham ALL_IN_ONE.
The dll is injected inside so all comes into one exe.
its the same version you use so no worries, as soon as i compile the new version i will sent it over if you want it :)

Edit 1: Also use this 7z.exe it has dll injected inside as well and its alpha version,
The one you have it 15.10 Beta, whereas this one is 15.12 alpha and its injected as well :P

ShadowEagle 01-12-2015 11:45

Quote:

Originally Posted by felice2011 (Post 444300)
The compressed files of any method are compatible with any installation compiled with inno setup.

I tried it as an example the new installer by @rinaldo compatible with any compression method using my program.

Only by using the method with built-precomp I had to add some lines to UltraArc.iss files inside the folder "Modules"

I also had to add the file version precomp.exe used into the folder "include" in this way:

"Only use with precomp method with installer by @rinaldo"

http://i66.tinypic.com/23vyr8o.png

http://i66.tinypic.com/122kcw0.png

http://i65.tinypic.com/b7kjki.png

Enjoy..:)

So i don`t have to add any line for using reflate method with my CIU2 script? Don`t believe that

felice2011 01-12-2015 13:08

I do not think I understood your question, the example shown was directed to the (new installer by @rinaldo) with other installer script for example 'Black_Box_Script_By_Kurutucu_V1.8' and others all works methods perfectly without changing anything.:)
P.S:when it relates to reflate unpacked method we have to wait for new updates or ask to Razor.

ShadowEagle 01-12-2015 13:21

Quote:

Originally Posted by felice2011 (Post 445024)
I do not think I understood your question, the example shown was directed to the (new installer by @rinaldo) with other installer script for example 'Black_Box_Script_By_Kurutucu_V1.8' and others all works methods perfectly without changing anything.:)
P.S:when it relates to reflate unpacked method we have to wait for new updates or ask to Razor.

So, there is no way to extract the reflated archives created by your tool?

felice2011 01-12-2015 13:37

works extracting all files created with various methods PreComp, SREP, MSC,LZMA, XZ, ZSTD etc ... for the extraction method reflate ask a razor.;)
The following update my program.:)

ShadowEagle 01-12-2015 13:39

Quote:

Originally Posted by felice2011 (Post 445027)
works extracting all files created with various methods PreComp, SREP, MSC,LZMA, XZ, ZSTD etc ... for the extraction method reflate ask a razor.;)
The following update my program.:)

Funny ;) I was happy to use your tool because i read reflate and now i can`t use reflate :(

4x4 extracting will work without additional files?

panker1992 01-12-2015 13:46

razor seems to have abandoned reflating method ..... and many many more people seem to have let it aside as well .... because of its very complicated and slow progression with decompression ... if you want to use it please take gozarcks methods as they produce near to no error at the moment


4x4 can be extracted from unarc.exe and unarc.dll so its ok !!

felice2011 01-12-2015 14:19

It's a shame, the method reflate by Gozarck modified by Razor I liked and it was very simple for everyone, I hope that razor will continue and can find a way to decompress, to leave things half does not make sense.:confused:
My utility is created to simplify and make easier and more intuitive data compression methods, it will be continuously updated, thank you to our and your engagement with new methods by Gozarck, Panker and Razor.;)

panker1992 01-12-2015 14:48

Felice your work, putting together everything is amazing.
Tho make a quick update
replace 7z and lzham in your folder with the updated versions i provided also remove
the reflate method you picked because it cannot be decompressed
and if you want add a method to use lzham :P


keep up the good work :D i will provide some more tools so stay tuned !!

felice2011 02-12-2015 00:33

Hello Panker I already updated the files that you posted, I am interested any new method to insert in the my utilities made available in the forum.;)
I'm going to urge Mr. Razor to see if he wants to continue the work reflate, before removing it from my program.

panker1992 02-12-2015 04:10

Custom made Lzma
 
2 Attachment(s)
Here I just made that for you.... i went through your settings and i see that you use lzma a lot.

So i thought maybe i give you something i used to use a long time ago
literally i havent used lzma since i discovered how to use lzma2 instead but

I took the lzma code from lzma SDK and i compilled it using x64 settings to the profiler so it can use more than 3 gigs of ram, also i renamed this to lz77 since lzma is a pure lz77 compression algo.
I did that in order to trick it and use this one instead of the lzma that arc.exe has inside

pros and cons :

pros:
1) its fresh code and updated, the one you see as freearc-lzma is a decade old code
2) its supported in freearc and it has stdin and stdout options classically
3) 13% higher speed over freearc-lzma

cons:
1) its still slow and it has made little to no effort to change style, if you consider time as fact respect and embrace lzma2 as i did :)

how to use :


[External compressor:lz77]
header = 0
packcmd = lz77 e -si -so <stdin> <stdout> -a1 -d30 -fb273 -mc10000 -lc8 -lp4 -mfbt4
unpackcmd = lz77 d -si -so <stdin> <stdout>

felice2011 02-12-2015 05:03

Good looks interesting, i execute some tests, before inserting in my utility..:)

panker1992 02-12-2015 05:09

i am testing zstd 4.1 at the moment :P the one i uploaded days ago is 3.6!!

~~~ 20% gain in speed at decomp per thread of the cpu~~~
will be updating my advanced tools soon i guess :P

felice2011 02-12-2015 05:21

' News for Reflate Unpacked Method By Mr.Razor '

Code:

unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
Enjoy Brothers

panker1992 02-12-2015 05:47

This is Priority Test !!! i will begin right now ^^^^^^^

ShadowEagle 03-12-2015 02:12

Quote:

Originally Posted by felice2011 (Post 445054)
' News for Reflate Unpacked Method By Mr.Razor '

Code:

unpackcmd = reflate -restore123 $$arcpackedfile$$.tmp $$arcdatafile$$.tmp
Enjoy Brothers

I`m new @ reflate -> What i`ve to do now for unpacking reflate? Greetz

felice2011 03-12-2015 02:46

Quote:

Originally Posted by ShadowEagle (Post 445085)
I`m new @ reflate -> What i`ve to do now for unpacking reflate? Greetz

Add the line in the file 'arc.ini' use the command *bat for decompression date.;)
Once you tested unpack for the method reflate you do what you want.:rolleyes:

ShadowEagle 03-12-2015 03:02

Quote:

Add the line in the file 'arc.ini'
Got this.

Quote:

use the command *bat for decompression date
Didn`t got this? What do you mean? Do i need additional files for unpacking?

felice2011 03-12-2015 05:20

For unpacking, you need to have the same files in the folder the that you use for the packaging.

ShadowEagle 03-12-2015 05:34

Quote:

Originally Posted by felice2011 (Post 445090)
For unpacking, you need to have the same files in the folder the that you use for the packaging.

And inno setup will do it automatically? So easy? Really?

felice2011 03-12-2015 10:29

Quote:

Originally Posted by ShadowEagle (Post 445092)
And inno setup will do it automatically? So easy? Really?

All these question marks seem a mockery..;)
Nothing is Easy, Nothing is Hard, All is Possible..:D
If you have problems with my utility you can also ask, on the contrary to other problems you open new thread in the forum, someone will respond to your problems, in this thread we talk of problems and updates relevant to Split Kompressor.;)

RamiroCruzo 04-12-2015 00:04

Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....

ShadowEagle 04-12-2015 01:39

Quote:

Originally Posted by felice2011 (Post 445095)
All these question marks seem a mockery..;)
Nothing is Easy, Nothing is Hard, All is Possible..:D
If you have problems with my utility you can also ask, on the contrary to other problems you open new thread in the forum, someone will respond to your problems, in this thread we talk of problems and updates relevant to Split Kompressor.;)

Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.

felice2011 04-12-2015 02:48

Quote:

Originally Posted by ShadowEagle (Post 445111)
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.

I`ll stay with UltraARC!

Not need any tutorial to use my tool, if it is difficult for you to use it 'unique case your' remains well with UltraARC excellent tool for compressing, then eventually the concept of my utility and UltraArc is similar.
They are both two tools for split and data compression.
Your problem, as I understand it, that you can not decompress the method reflate in an installer with InnoSetup..
I repeat, if you want a solution for your problem, open a new thread and describe your problem.
Split Kompress and Ultra Arc are both utility for compression, problems with installers created with InnoSetup are discussed in the section of this forum, not in this thread.
Not continue to send messages not related to my utility or I will have to report you as spam.

panker1992 04-12-2015 07:59

Quote:

Originally Posted by RamiroCruzo (Post 445110)
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....


I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )

felice2011 04-12-2015 08:35

Quote:

Originally Posted by RamiroCruzo (Post 445110)
Amigos if you wanna so fast compression method, why don't you take a look at LZ4 which goes beyond 1GB/s without I/O overwrapping & multithreading.....

Quote:

Originally Posted by panker1992 (Post 445118)
I have tested lz4 and lz5 long time ago, zstd is a step ahead of lz4 lz5 and zhuff at the moment its steady and it has a lot of support the one i posted is v3.6 and the one i am testing now is 4.2 and it has 2.2 gigs/sec around
( 593mb/sec/thread = 2.2 gigs/sec )

Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.

panker1992 04-12-2015 09:39

Quote:

Originally Posted by felice2011 (Post 445119)
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.

This is why i chose zstd ...because it features advanced API that can compress decent.

To be more specific zstd has at least 30% ~ 35% better compression ratio
tho everyone i see use my original -8 switch ....it can easily go as high as -20 but its ratio doesnt compare to lzma at all :P

All in all zstd gives 30% ~ 35% better compression AND it decompressed as fast as lz4

HINT : zstd and all tools i use have porpose nothing i choose is coincidence this all is part of my upcoming big project call "Masked Compression"

soon !!!

felice2011 04-12-2015 10:10

Great Bro ... at least we know that LZ4 and LZ5 is now out ;)

Razor12911 04-12-2015 12:22

Quote:

Originally Posted by ShadowEagle (Post 445111)
Ok, i do understand. You created a tool, posted it and don`t help to get it work. I see no tutorial. I`ll give 1 star for bad support, most bad support i`ve ever seen.

took me 4 minutes to figure out how this program works, from my perspective, this program is easier than ultra arc and it is reliable.

ShadowEagle 04-12-2015 14:32

Yes i`m stupid and bad guy :(

Razor12911 04-12-2015 16:58

Quote:

Originally Posted by ShadowEagle (Post 445126)
Yes i`m stupid and bad guy :(

not really, you just have to engage with the program even further and use logic, so far so good, you are showing interests with this program only thing left is to make attempts to make the program work using logic then you'll get there.

gozarck 04-12-2015 18:58

Yes felice your tool is very powerfull and easy to use.you need to make the UI more atractive for newbies. Do you was tried to integrate metroframework.dll (metroUI) in yours projects?.

RamiroCruzo 04-12-2015 22:14

Quote:

Originally Posted by felice2011 (Post 445119)
Friends you do your choices, I'm happy to update my utility just as you wish, and it however you like.
Panker do not look at only the speed, but also the compression level of the various methods, we must try to find a balance in both, to satisfy everyone.

Lets compare ourselves which is better for our needs....:)

Source:Encode.ru

| Compressor name | Compression| Decompress.| Compr. size | Ratio |
| --------------- | -----------| -----------| ----------- | ----- |
| memcpy | 8533 MB/s | 8533 MB/s | 104857600 |100.00 |
| lz4 r131 | 480 MB/s | 2275 MB/s | 64872315 | 61.87 |
| lz4hc r131 -1 | 82 MB/s | 1896 MB/s | 59448496 | 56.69 |
| lz4hc r131 -3 | 54 MB/s | 1932 MB/s | 56343753 | 53.73 |
| lz4hc r131 -5 | 41 MB/s | 1969 MB/s | 55271312 | 52.71 |
| lz4hc r131 -7 | 31 MB/s | 1969 MB/s | 54889301 | 52.35 |
| lz4hc r131 -9 | 24 MB/s | 1969 MB/s | 54773517 | 52.24 |
| lz4hc r131 -11 | 20 MB/s | 1969 MB/s | 54751363 | 52.21 |
| lz4hc r131 -13 | 17 MB/s | 1969 MB/s | 54744790 | 52.21 |
| lz4hc r131 -15 | 14 MB/s | 2007 MB/s | 54741827 | 52.21 |
| lz5 r131 | 195 MB/s | 939 MB/s | 55884927 | 53.30 |
| lz5hc r131 -1 | 32 MB/s | 742 MB/s | 52927122 | 50.48 |
| lz5hc r131 -3 | 20 MB/s | 716 MB/s | 50970192 | 48.61 |
| lz5hc r131 -5 | 10 MB/s | 701 MB/s | 49970285 | 47.66 |
| lz5hc r131 -7 | 5.54 MB/s | 682 MB/s | 49541511 | 47.25 |
| lz5hc r131 -9 | 2.69 MB/s | 673 MB/s | 49346894 | 47.06 |
| lz5hc r131 -11 | 1.36 MB/s | 664 MB/s | 49266526 | 46.98 |
| zstd v0.3 | 257 MB/s | 547 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -1 | 257 MB/s | 553 MB/s | 51231016 | 48.86 |
| zstd_HC v0.3 -3 | 76 MB/s | 417 MB/s | 46774383 | 44.61 |
| zstd_HC v0.3 -5 | 40 MB/s | 476 MB/s | 45628362 | 43.51 |
| zstd_HC v0.3 -9 | 14 MB/s | 485 MB/s | 44840562 | 42.76 |
| zstd_HC v0.3 -13 | 9.34 MB/s | 469 MB/s | 43114895 | 41.12 |
| zstd_HC v0.3 -17 | 6.02 MB/s | 463 MB/s | 42989971 | 41.00 |
| zstd_HC v0.3 -21 | 3.35 MB/s | 461 MB/s | 42956964 | 40.97 |
| zstd_HC v0.3 -23 | 2.33 MB/s | 463 MB/s | 42934217 | 40.95 |

ShadowEagle 05-12-2015 02:07

Used this method:

http://ultraimg.com/images/Unbenannt2b400e.png

I tried to extract with inno setup. I copied all files from "Resources" folder into includes folder in inno setup script and added the reflate files into the script:

Code:

Source: Include\reflate.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawrest.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\rawdet.exe; DestDir: {tmp}; Flags: dontcopy
Source: Include\raw2hif.exe; DestDir: {tmp}; Flags: dontcopy

But i get this error:

http://ultraimg.com/images/Unbenannt4ecef.png

Pls help. What i`m doing wrong?


All times are GMT -7. The time now is 21:56.

Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2026, vBulletin Solutions Inc.
FileForums @ https://fileforums.com