[SAC] Fair projectsVM usage (esp. Openlayers)

[Markus Neteler]

On Tue, Feb 14, 2012 at 8:49 AM, Hamish <hamish_b at yahoo.com> wrote:
> Markus wrote:
>>> top - 00:21:37 up 10 days,  3:53,  1 user,
>>> load average: 42.23, 36.57, 31.99  <<---!!
>
> Hi,
>
> since we know exactly what time it happens each day, today I sat here
> and watched it. It's bacula saturating the I/O, causing upwards 50-90% cpu
> time spent waiting for the kernel, causing lots of the apache processes
> to deadlock, which is [perhaps!] causing a whole bunch of them to respawn
> threads, with the old ones left as (hollow) load (reporting) absorbing
> zombies for a moment until the prior deadlock clears.  system load is
> reporting above 80 as I type this, but it is still responsive. Also I
> notice the bacula job is running completely unniced.
>
> suggest to run bacula with nice,

Yes this may be a good idea.
But..

> and with 'ionice -c3', if for no other
> reason than to stop the innocent apaches from getting deadlocked by it.

... there seem to be another problem:

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
    7 root      20   0     0    0    0 R  100  0.0  45:56.36 ksoftirqd/1

ps -aef | grep python | cut -b1-100
10011     2251 17542  2 10:14 ?        00:00:24 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011     2663 17542  2 10:14 ?        00:00:22 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011     2798 17542  2 10:14 ?        00:00:22 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011     3375 17542  2 10:15 ?        00:00:22 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011     6437 17542  2 09:35 ?        00:01:21 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011    12262 17542  2 09:38 ?        00:01:21 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011    13087 17542  2 09:39 ?        00:01:20 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
root     15098     1  0 Feb12 ?        00:00:34 python
/usr/sbin/denyhosts --daemon --purge --config
root     17542     1  0 Feb09 ?        00:01:30 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
10011    20292 17542  2 10:10 ?        00:00:33 /usr/bin/python
/usr/bin/gunicorn_django --pid /var/
...

many!

ksoftirqd/1 is definitely too high. And no bacula around...

Markus