Go Back   FileForums > Game Backup > PC Games > PC Games - CD/DVD Conversions > Conversion Tutorials

Reply
 
Thread Tools Display Modes
  #1  
Old 15-08-2022, 20:37
ncomerci ncomerci is offline
Registered User
 
Join Date: Aug 2022
Location: Uruguay
Posts: 3
Thanks: 3
Thanked 15 Times in 3 Posts
ncomerci is on a distinguished road
My Precomp fork with stdin/stdout support

Hi, I've been working on a precomp fork for a few weeks now.
There is still a lot of stuff I want to do with it, but I think right now its on a place where it might be cool to let you guys try it.

Interesting features so far:
  • No changes to PCF header format, meaning at least for now, there should still be full compatibility with PCF files created from main precomp project (v0.4.8) lastest executable and this fork
  • Temp files have a random tag prepended on their filename, meaning you can run multiple instances working on files on the same folder and they should not interfere with each other
  • stdout support for precompression (stdin impractical, at least without heavy reengineering as we do seek on the input file many times during recompression)
  • stdin/stdout support for recompression

Usage:
Mostly the same as regular precomp, the only differences are for using stdin/stdout
  • (example of decompression using stdout) precomp -ostdout -cn -intense -brute file.dat > file.dat.pcf
  • (example of using stdin and stdout for recompression) srep -v0 -d file.tar.pcf.srep - | precomp -ostdout -r stdin | 7za x -si -ttar
so essentially, just use stdout as "output filename" or stdin as "input filename"

This fork should make precomp more practical to use in contexts where only xtool was practical before.

If anybody wants to see the code its at https://github.com/nicolas-comerci/precomp-cpp
Code is still on the compatible_refactor branch

You can find attached 32/64 bits zipped executables.
Please feel free to test and use and report any errors.
For now I am mostly interested on making sure I haven't introduced any new bugs, so I probably won't be fixing anything that also fails on mainline Precomp 0.4.8

EDIT 08/21/22: Added v1.0 of my fork, has been tested a little more and I fixed some OTF compression/decompression problems
Attached Files
File Type: rar precomp fork (broken OTF compression).rar (2.18 MB, 33 views)
File Type: 7z precomp stdin-stdout v1.0 32bit.7z (602.5 KB, 23 views)
File Type: 7z precomp stdin-stdout v1.0 64bit.7z (678.7 KB, 44 views)

Last edited by ncomerci; 21-08-2022 at 16:17. Reason: x64 binary was outdated, included newly compiled one
Reply With Quote
The Following 9 Users Say Thank You to ncomerci For This Useful Post:
Balaji007 (04-09-2022), BLACKFIRE69 (16-08-2022), ffmla (16-08-2022), Gehrman (16-08-2022), Lord.Freddy (15-08-2022), Masquerade (16-08-2022), Razor12911 (16-08-2022), ScOOt3r (16-08-2022), Vladislav989 (10-09-2022)
Sponsored Links
  #2  
Old 16-08-2022, 04:16
Lord.Freddy's Avatar
Lord.Freddy Lord.Freddy is offline
Registered User
 
Join Date: Apr 2022
Location: In Forest
Posts: 19
Thanks: 29
Thanked 13 Times in 9 Posts
Lord.Freddy is on a distinguished road
There seem to be some problems
Attached Images
File Type: png Screenshot 2022-08-16 144122.png (129.7 KB, 122 views)
Reply With Quote
  #3  
Old 16-08-2022, 05:21
Masquerade's Avatar
Masquerade Masquerade is offline
Registered User
 
Join Date: Jan 2020
Location: Monte d'Or
Posts: 884
Thanks: 223
Thanked 988 Times in 473 Posts
Masquerade is on a distinguished road
Quote:
Originally Posted by Lord.Freddy View Post
There seem to be some problems
Output is being redirected to STDERR (console window)
Reply With Quote
The Following User Says Thank You to Masquerade For This Useful Post:
Lord.Freddy (16-08-2022)
  #4  
Old 16-08-2022, 05:35
Gehrman's Avatar
Gehrman Gehrman is offline
Registered User
 
Join Date: Jan 2020
Location: Save Palestine
Posts: 48
Thanks: 943
Thanked 55 Times in 24 Posts
Gehrman is on a distinguished road
Thanks ncomerci

Good Work
Code:
[External compressor:precomp048f]
header = 0
packcmd   = precomp64 -cn -intense0 -ostdout <stdout> $$arcdatafile$$.tmp 
unpackcmd = precomp64 -ostdout -r stdin <stdin> <stdout>
Reply With Quote
The Following 3 Users Say Thank You to Gehrman For This Useful Post:
Lord.Freddy (16-08-2022), Masquerade (16-08-2022), ncomerci (16-08-2022)
  #5  
Old 16-08-2022, 05:59
Gehrman's Avatar
Gehrman Gehrman is offline
Registered User
 
Join Date: Jan 2020
Location: Save Palestine
Posts: 48
Thanks: 943
Thanked 55 Times in 24 Posts
Gehrman is on a distinguished road
Code:
Compressed 2 files, 314,572,800 => 511,394,374 bytes. Ratio 162.57%
Compression time: cpu 0.31 sec/real 75.05 sec = 0%. Speed 4.19 mB/s
All OK
Code:
Tested 2 files, 511,394,374 => 314,572,800 bytes. Ratio 162.57%
Testing time: cpu 0.94 sec/real 30.75 sec = 3%. Speed 10.23 mB/s
All OK
Reply With Quote
The Following 2 Users Say Thank You to Gehrman For This Useful Post:
Lord.Freddy (16-08-2022), Masquerade (16-08-2022)
  #6  
Old 16-08-2022, 21:04
Lord.Freddy's Avatar
Lord.Freddy Lord.Freddy is offline
Registered User
 
Join Date: Apr 2022
Location: In Forest
Posts: 19
Thanks: 29
Thanked 13 Times in 9 Posts
Lord.Freddy is on a distinguished road
I got this error in test archive
Attached Images
File Type: jpg Screenshot 2022-08-16 222638.jpg (67.3 KB, 98 views)
Reply With Quote
The Following User Says Thank You to Lord.Freddy For This Useful Post:
ncomerci (16-08-2022)
  #7  
Old 16-08-2022, 21:43
ncomerci ncomerci is offline
Registered User
 
Join Date: Aug 2022
Location: Uruguay
Posts: 3
Thanks: 3
Thanked 15 Times in 3 Posts
ncomerci is on a distinguished road
Quote:
Originally Posted by Lord.Freddy View Post
I got this error in test archive
it says liblzma error, you are using precomp's included compression?
it wouldn't surprise me if I broke it because I didn't test much with it, will look into it.

however for now you can use -cn option to disable the included compression (this I did test thoroughly) and just use some other compression method with freearc, or pipe it through to xz/7za...

In fact, I might even completely delete the included compression capabilities in a future version on this fork... seems to me like stdin/stdout support makes that obsolete and just unnecessarily complicates the code
Reply With Quote
The Following 3 Users Say Thank You to ncomerci For This Useful Post:
Gehrman (17-08-2022), Lord.Freddy (17-08-2022), Razor12911 (18-08-2022)
  #8  
Old 21-08-2022, 16:18
ncomerci ncomerci is offline
Registered User
 
Join Date: Aug 2022
Location: Uruguay
Posts: 3
Thanks: 3
Thanked 15 Times in 3 Posts
ncomerci is on a distinguished road
Quote:
Originally Posted by Lord.Freddy View Post
I got this error in test archive
Added new version on the original post, on my tests OTF compression/decompression now works correctly
Reply With Quote
The Following 3 Users Say Thank You to ncomerci For This Useful Post:
Gehrman (22-08-2022), Lord.Freddy (21-08-2022), Masquerade (22-08-2022)
Reply

Tags
precomp

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
[CIUv3] Custom Installer Ultimate v3 KaktoR Conversion Tutorials 845 25-09-2022 20:37
Ultimate Conversion Compressor (UCC) vollachr Conversion Tutorials 55 26-04-2021 10:27
Precomp 0.44 and NEW packjpg.exe (self optimized) panker1992 Conversion Tutorials 7 14-01-2016 10:23
Information about Precomp Razor12911 Conversion Tutorials 6 02-09-2015 17:10



All times are GMT -7. The time now is 06:28.


Powered by vBulletin® Version 3.8.11
Copyright ©2000 - 2022, vBulletin Solutions Inc.
Copyright 2000-2020, FileForums @ https://fileforums.com