[GRASS-dev] Simplified G_percent() output in batch jobs?

[Markus Neteler]

On Tue, Nov 4, 2008 at 1:52 PM, Paul Kelly
<paul-grass at stjohnspoint.co.uk> wrote:
> On Tue, 4 Nov 2008, Markus Neteler wrote:
>
>> On Tue, Nov 4, 2008 at 8:41 AM, Hamish <hamish_b at yahoo.com> wrote:
>>>>
>>>> I am running a large number of processing jobs on a
>>>> cluster and the job manager output is cluttered with
>>>> control chars from G_percent().
>>>> It would be great to have a switch (or detection magic)
>>>> to output the plain ASCII style 0..10...20.. in this cases.
>>>>
>>>> Maybe it's already there?
>>>
>>> set GRASS_VERBOSE=0  ?
>>
>> No, because some of these jobs runs for many hours and I
>> would like to see the progress (to estimate the total time).
>
> Hi Markus,

Hello Paul,

> I'm interested as to what your log file looks like and how you discern which
> percentage value is coming from which process. Are they not all mixed
> together anyway?

The job manager ([SUN] Grid Engine) separates stderr and stdout into
two files. The stderr file contains

...
   0%^H^H^H^H^H   3%^H^H^H^H^H   6%^H^H^H^H^H   9%^H^H^H^H^H
12%^H^H^H^H^H  15%^H^H^H^H^H  18%^H^H^H^H^H  21%^H^H^H^H^H
24%^H^H^H^H^H  27%^H^H^H^H^H  30%^H^H^H^H^H  33%^H^H^H^H^H
36%^H^H^H^H^H  39%^H^H^H^H^H  42%^H^H^H^H^H  45%^H^H^H^H^H
48%^H^H^H^H^H  51%^H^H^H^H^H  54%^H^H^H^H^H  57%^H^H^H^H^H
60%^H^H^H^H^H  63%^H^H^H^H^H  66%^H^H^H^H^H  69%^H^H^H^H^H
72%^H^H^H^H^H  75%^H^H^H^H^H  78%^H^H^H^H^H  81%^H^H^H^H^H
84%^H^H^H^H^H  87%^H^H^H^H^H  90%^H^H^H^H^H  93%^H^H^H^H^H
96%^H^H^H^H^H  99%^H^H^H^H^H 100%^H^H^H^H^H
   0%^H^H^H^H^H   3%^H^H^H^H^H   6%^H^H^H^H^H   9%^H^H^H^H^H
12%^H^H^H^H^H  15%^H^H^H^H^H  18%^H^H^H^H^H  21%^H^H^H^H^H
24%^H^H^H^H^H  27%^H^H^H^H^H  30%^H^H^H^H^H  33%^H^H^H^H^H
36%^H^H^H^H^H  39%^H^H^H^H^H  42%^H^H^H^H^H  45%^H^H^H^H^H
48%^H^H^H^H^H  51%^H^H^H^H^H  54%^H^H^H^H^H  57%^H^H^H^H^H
60%^H^H^H^H^H  63%^H^H^H^H^H  66%^H^H^H^H^H  69%^H^H^H^H^H
72%^H^H^H^H^H  75%^H^H^H^H^H  78%^H^H^H^H^H  81%^H^H^H^H^H
84%^H^H^H^H^H  87%^H^H^H^H^H  90%^H^H^H^H^H  93%^H^H^H^H^H
96%^H^H^H^H^H  99%^H^H^H^H^H 100%^H^H^H^H^H
Color table for <aqua_lst1km20060416.LST_Night_1km.filt2_lstmodel> set to
celsius
Collecting Stats...
   0%^H^H^H^H^H   3%^H^H^H^H^H   6%^H^H^H^H^H   9%^H^H^H^H^H
12%^H^H^H^H^H  15%^H^H^H^H^H  18%^H^H^H^H^H  21%^H^H^H^H^H
24%^H^H^H^H^H  27%^H^H^H^H^H  30%^H^H^H^H^H  33%^H^H^H^H^H
36%^H^H^H^H^H  39%^H^H^H^H^H  42%^H^H^H^H^H  45%^H^H^H^H^H
48%^H^H^H^H^H  51%^H^H^H^H^H  54%^H^H^H^H^H  57%^H^H^H^H^H
60%^H^H^H^H^H  63%^H^H^H^H^H  66%^H^H^H^H^H  69%^H^H^H^H^H
72%^H^H^H^H^H  75%^H^H^H^H^H  78%^H^H^H^H^H  81%^H^H^H^H^H
84%^H^H^H^H^H  87%^H^H^H^H^H  90%^H^H^H^H^H  93%^H^H^H^H^H
96%^H^H^H^H^H  99%^H^H^H^H^H 100%^H^H^H^H^H
Writing vector map <aqua_lst1km20060416_LST_Night_1km_filt2> ...
...

... stuff like that.

> I was thinking perhaps you could filter the stderr of each
> GRASS module through a short C program that could strip the backspace
> characters and print the name of the module with it's progress value on a
> new line every time there is a new percentage point? Or is the problem not
> complicated enough to need such a solution?

I guess I would have to modify Grid engine... not possible.
I can certainly do a local hack to suppress all these ^H chars but would prefer
a general solution.

It's not a dramatic issue, just to get rid of these chars would be helpful
to debug such script output files.

Markus