The idea here guys is for xpreproc to give xprecomp a smaller input which speeds up the process while giving roughly the same output as when it wasn't used.
-mxprecomp:
Code:
Compressed 225 files, 3,253,110,016 => 5,314,555,404 bytes. Ratio 163.37%
Compression time: cpu 5.31 sec/real 250.34 sec = 2%. Speed 12.99 mB/s
-xpreproc+xprecomp:
Code:
Compressed 225 files, 3,253,110,016 => 1,441,325,440 bytes. Ratio 44.31%
Compression time: cpu 5.92 sec/real 132.72 sec = 4%. Speed 24.51 mB/s
if you compress 4.94 GB (5,314,557,896 bytes) output, also the 1.34 GB (1,441,327,942 bytes) output, you should get the same output, the plan here is to reduce srep's memory usage and give a bit of speed and lessen IO whenever srep has created its VM file.