Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 26-09-2019, 01:39
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
CLS - Fast LZMA2

Hi, here's another cls for fast lzma2.
I haven't yet able to convert the streaming functions to delphi, so this cls uses 64MB chunks.

Here is the conversion

Here's the cls anyways.

If you are able to convert the whole c header file to delphi, please send me a copy.

[Update]
Added FPC Build. More optimized and uses less memory in some cases.
Attached Images
File Type: png fl2.png (240.7 KB, 350 views)
Attached Files
File Type: zip cls-fl2.zip (341.6 KB, 113 views)
File Type: zip cls-fl2_fpc.zip (137.7 KB, 88 views)

Last edited by 78372; 26-09-2019 at 05:58.
Reply With Quote
The Following 8 Users Say Thank You to 78372 For This Useful Post:
Andu21 (26-09-2019), Carldric Clement (21-11-2019), Celestosapien (13-12-2019), darkwolves (20-11-2019), Harsh ojha (26-09-2019), KaktoR (20-11-2019), kenzo34 (26-09-2019), Simorq (26-09-2019)
Sponsored Links
  #2  
Old 09-11-2019, 10:12
PSP17 PSP17 is offline
Registered User
 
Join Date: Nov 2016
Location: Bulgaria
Posts: 17
Thanks: 3
Thanked 3 Times in 3 Posts
PSP17 is on a distinguished road
How to use it with freearc ? what should be add in arc.ini and temp files of installer ?
Reply With Quote
  #3  
Old 10-11-2019, 03:28
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
Nothing. Just keep cls-fl2.dll and fast-lzma2.dll
Reply With Quote
  #4  
Old 16-11-2019, 16:23
PSP17 PSP17 is offline
Registered User
 
Join Date: Nov 2016
Location: Bulgaria
Posts: 17
Thanks: 3
Thanked 3 Times in 3 Posts
PSP17 is on a distinguished road
Hi, did test on "INSOMNIA The Ark" 10 GB file, and got nothing

packed with cls | 1133.47 sec = 7%. Speed 9.17 mB/s
unpack with cls | 141.39 sec = 48%. Speed 73.48 mB/s

packed with no cls | 1125.90 sec = 8%. Speed 9.23 mB/s
unpack with no cls | 140.49 sec = 55%. Speed 73.95 mB/s

Maybe I am doing something wrong ?
Reply With Quote
  #5  
Old 17-11-2019, 07:22
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
What do you mean by packed without cls? What was your compression method? It should not be lzma, it should be fl2.
Reply With Quote
  #6  
Old 17-11-2019, 11:39
PSP17 PSP17 is offline
Registered User
 
Join Date: Nov 2016
Location: Bulgaria
Posts: 17
Thanks: 3
Thanked 3 Times in 3 Posts
PSP17 is on a distinguished road
Quote:
What do you mean by packed without cls?
It mean not using cls to see if it is any difference in pack/unpack speed.

Quote:
What was your compression method?
here is the whole chain:
batch file
Code:
arc.exe a -r --dirs -s; -ep1 -i1 -lc- -w.\_tmp -msrep+lzma2 "data.bin" "pack\*"
arc.ini
Code:
[External compressor:lzma2]
header = 0
default = :d25:fb=273:mf=bt4:mc=1000000:lc=4:lp=0
packcmd = "7-Zip" a -txz -an -mcrc=0 -m1=lzma2{:option}:mf=bt4 -mmt=on -mx9 -si -so <stdin> <stdout>
Reply With Quote
  #7  
Old 17-11-2019, 19:20
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
It should be -msrep+fl2 to use the cls.
Reply With Quote
  #8  
Old 19-11-2019, 08:34
Gupta Gupta is offline
Registered User
 
Join Date: Aug 2016
Location: India
Posts: 387
Thanks: 125
Thanked 656 Times in 223 Posts
Gupta is on a distinguished road
You should try shared memory. I did implement that for zstd and this and it does provide speed boosts but that have deadlocks (like 1 out of 10) and I didn't find enough motivation to debug. Also, I did implement that from the ground up. You can use some library or something to make it work XD

Anyway nice work lately.
__________________
XD
Reply With Quote
The Following User Says Thank You to Gupta For This Useful Post:
78372 (19-11-2019)
  #9  
Old 19-11-2019, 09:25
darkwolves's Avatar
darkwolves darkwolves is offline
Registered User
 
Join Date: Oct 2016
Location: North Eastern,, USA
Posts: 449
Thanks: 44
Thanked 244 Times in 153 Posts
darkwolves is on a distinguished road
it packs just fine for me but it will not let me unpack gives me a -2 error
__________________
Ideas are bulletproof...
Reply With Quote
The Following User Says Thank You to darkwolves For This Useful Post:
78372 (19-11-2019)
  #10  
Old 20-11-2019, 06:36
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
64 bit FL2 - 256MB Chunks

Quote:
FreeArc 0.67 (March 15 2014) creating archive: data.arc
Compressed 1 file, 943,130,025 => 125,282,928 bytes. Ratio 13.28%
Compression time: cpu 8.30 sec/real 57.45 sec = 14%. Speed 16.42 mB/s
All OK

FreeArc 0.67 (March 15 2014) testing archive: data.arc
Tested 1 file, 125,282,928 => 943,130,025 bytes. Ratio 13.28%
Testing time: cpu 2.28 sec/real 8.42 sec = 27%. Speed 112.01 mB/s
All OK
64bit FL2 Compile, about 2MB sized exe

Quote:
[External compressor:fl2]
header = 0
packcmd = fl2 c - - <stdin> <stdout>
unpackcmd = fl2 d - - <stdin> <stdout>
Attached Files
File Type: zip fl2.zip (569.0 KB, 46 views)
Reply With Quote
The Following User Says Thank You to 78372 For This Useful Post:
darkwolves (20-11-2019)
  #11  
Old 20-11-2019, 08:23
darkwolves's Avatar
darkwolves darkwolves is offline
Registered User
 
Join Date: Oct 2016
Location: North Eastern,, USA
Posts: 449
Thanks: 44
Thanked 244 Times in 153 Posts
darkwolves is on a distinguished road
Quote:
Originally Posted by 78372 View Post
64bit FL2 Compile, about 2MB sized exe
i will try this i rather enjoyed the compression speed
__________________
Ideas are bulletproof...
Reply With Quote
The Following User Says Thank You to darkwolves For This Useful Post:
78372 (20-11-2019)
  #12  
Old 20-11-2019, 17:25
darkwolves's Avatar
darkwolves darkwolves is offline
Registered User
 
Join Date: Oct 2016
Location: North Eastern,, USA
Posts: 449
Thanks: 44
Thanked 244 Times in 153 Posts
darkwolves is on a distinguished road
oh i like this i was even able to put in my lzma2 commands behind it and they worked
thank you kindly
__________________
Ideas are bulletproof...
Reply With Quote
  #13  
Old 20-11-2019, 22:39
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 384
Thanks: 120
Thanked 430 Times in 222 Posts
doofoo24 is on a distinguished road
@78372 do you know if there a way to use 7-Zip-zstd in <stdin> <stdout> with (Fast LZMA2, Zstandard, Brotli...)...
https://github.com/mcmilk/7-Zip-zstd/releases
Reply With Quote
  #14  
Old 20-11-2019, 22:59
78372's Avatar
78372 78372 is offline
Registered User
 
Join Date: Dec 2016
Location: Bangladesh
Posts: 626
Thanks: 709
Thanked 812 Times in 287 Posts
78372 is on a distinguished road
ZSTD and Brotli already supports stdio afaik.
And lz4/brotli aren't suitable for game compression
Reply With Quote
  #15  
Old 20-11-2019, 23:11
doofoo24 doofoo24 is offline
Registered User
 
Join Date: Nov 2016
Location: canada
Posts: 384
Thanks: 120
Thanked 430 Times in 222 Posts
doofoo24 is on a distinguished road
sorry i ask the wrong question,
do you know the cmd for (Zstd-Brotli) in 7-Zip-zstd to use with freearc like normal 7z...
like "packcmd = "7-Zip" a -txz -an -mcrc=0 -m1=lzma2{ption}:mf=bt4 -mmt=on -mx9 -si -so <stdin> <stdout>"
Reply With Quote
Reply

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
New Fox Kompressor 1.01c Ultimate felice2011 Conversion Tutorials 29 07-12-2018 04:24
Bench Test (LOLZ vs RAZOR vs MCM vs LZMA2) felice2011 Conversion Tutorials 4 14-10-2018 22:46
Borderlands v1.20 [MULTI5] No-DVD/Fixed EXE crash when fast travel to Jakobs Cove mikehd PC Games 24 10-04-2010 09:32
PS2 Tray Ejects/Closes Too Fast!!! cobraxt PS2 Games 2 16-06-2002 14:21
Fast error skipping settings for Safedisc 2 Bandiet CD/DVD Copy Protections & Utilities 16 22-03-2002 13:58



All times are GMT -7. The time now is 14:14.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2020, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com