PDA

View Full Version : [compressor] FastLZ/6(un)pack


LeVx
30-05-2023, 12:25
Note:created custom implimintation of fastlz refer to post #10
arc.ini \/
[External compressor:fstlz]
packcmd=6pack.exe -2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd=6unpack.exe $$arcpackedfile$$.tmp
-------------------
known issues
file/mem size issue,use MTX to fix
mtx varient of arc.ini \/
[External compressor:fstlz]
packcmd=6pack.exe -2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd=6unpack.exe $$arcpackedfile$$.tmp
; ================== MTX Settings ==================

; default = -t100p --logs --basePath=".\..\..\" --cfgfile="$basePath$\arc.ini"
; packcmd = MTX.exe a -mprecomp64 -c128m {options} - - <stdin> <stdout>
; packcmd = MTX.exe a -mprecomp64 -c128m {options} - $$arcpackedfile$$.tmp <stdin>
; packcmd = MTX.exe a -mprecomp64 -c128m {options} $$arcdatafile$$.tmp - <stdout>
; packcmd = MTX.exe a -mprecomp64 -c128m {options} $$arcdatafile$$.tmp $$arcpackedfile$$.tmp

; unpackcmd = MTX.exe x -mmpz32 {options} - - <stdin> <stdout>
; unpackcmd = MTX.exe x -mmpz32 {options} - $$arcdatafile$$.tmp <stdin>
; unpackcmd = MTX.exe x -mmpz32 {options} $$arcpackedfile$$.tmp - <stdout>
; unpackcmd = MTX.exe x -mmpz32 {options} $$arcpackedfile$$.tmp $$arcdatafile$$.tmp


[External compressor:fstlzx]
header = 0
default = -t100p --basePath=".\..\..\" --cfgfile="$basePath$\arc.ini"

packcmd = MTX\Win64\MTX64.exe a -mfstlz -c256m {options} - - <stdin> <stdout>
unpackcmd = MTX\Win64\MTX64.exe x -mfstlz {options} - - <stdin> <stdout>

; ================== MTX Settings ==================
file \/

soulfit15
31-05-2023, 14:00
When testing it shows this error
FreeArc 0.67 (March 15 2014) creating archive: bibobo.bin
Compressing 1 file, 4,480,267,880 bytes. Processed 99.8%
Compressing 4,480,267,880 bytes with 6pack.exe -2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
$$arcdatafi100.0%................................. .................]
Errorlevel=-1073741676
100.0%

It worked once and showed a good ratio

LeVx
31-05-2023, 14:02
When testing it shows this error


It worked once and showed a good ratio

use mtx to split it into chunks,im guessing its a stack overflow error (based on my prior attempts at rectification),fastlz is 32bit (ithink) meaing i will have to try and port it to 64 bit

also by very good ratio,the output data is likely corrupt

soulfit15
31-05-2023, 14:05
btw the error appears when specifying a temp directory actually using -w.\tmp
will try MTX however
thanks

LeVx
31-05-2023, 14:08
btw the error appears when specifying a temp directory actually using -w.\tmp
will try MTX however
thanks
could you also send the input data you used so i can try to rectify the errorlevel

soulfit15
31-05-2023, 14:34
i used this in plain arc arc a bin01.bin "folderpath" -mfstlz -w.\tmp

tried it in MTX 5.0.0.1 keep getting disk size error (which is strange although i made sure that the arc.ini was good.

in MTX 2.0.0.1 however
arc a bin01.bin "folder" -mmtx:c128m:t4:fstlz -w.\tmp

this showed great results near lolz on my tests actually
FreeArc 0.67 (September 13 2014) creating archive: bin01.bin
Compressed 401 files, 2,691,927,339 => 1,142,790,203 bytes. Ratio 42.45%
Compression time: cpu 4.77 sec/real 195.19 sec = 2%. Speed 13.79 mB/s
All OK

LeVx
31-05-2023, 14:40
i used this in plain arc

tried it in MTX 5.0.0.1 keep getting disk size error (which is strange although i made sure that the arc.ini was good.

in MTX 2.0.0.1 however


this showed great results near lolz on my tests actually
,can you tell me how to mtx 2.0.0.1 step by step

soulfit15
31-05-2023, 21:40
1) copy 6pack.exe into "cls-mtx v2.0.0.7\Compressor\Bin"

2) added arc.ini lines [External compressor:fstlz]
packcmd=6pack.exe -2 $$arcdatafile$$.tmp $$arcpackedfile$$.tmp
unpackcmd=6unpack.exe $$arcpackedfile$$.tmp

3)used the command
arc a bin001.bin "folder" -mmtx:fstlz

another report, I got it to work with MTX 5.0.0.1 but I don't know where is the problem. it showed a worse compression ratio
"arc a bin.bin "folder" -mfstlzx"
FreeArc 0.67 (September 13 2014) creating archive: va.biv
Compressed 401 files, 2,691,927,339 => 1,381,658,252 bytes. Ratio 51.33%
Compression time: cpu 4.22 sec/real 214.48 sec = 2%. Speed 12.55 mB/s
All OK

LeVx
01-06-2023, 05:14
another report, I got it to work with MTX 5.0.0.1 but I don't know where is the problem. it showed a worse compression ratio

im guessing its a bit limit (the exe is a 32bit exe and not 64,so my guess it needs to be ported to 64 bit),and the worse compression ratio is likely correct,but i would test decompression to see if it compressed it correctly

LeVx
01-06-2023, 09:31
another report, I got it to work with MTX 5.0.0.1 but I don't know where is the problem. it showed a worse compression ratio

working on my own 64-bit (though simpiler) impimentation of the fastlz compression libary (to fix it)(and Done

refer to post https://fileforums.com/showthread.php?t=105936

kj911
02-06-2023, 02:32
Compression ratio difference those 6/7pack compressors compare than FLZMA2 or ZSTD or any codec??

Masquerade
02-06-2023, 03:16
^^
Why don't you benchmark them and let us know? :p