[SAC] Re: projectsVM: rsync reniced to 10

[Tim Schaub]

Hi Markus and others,

Apologies for the hassle.  I'm now subscribed to the SAC list.  With
no real "SA" credentials to speak of, I welcome suggestions on how we
can manage resources on the shared machines without causing trouble
for others.

I've removed three uses of rsync in the script that updates the hosted
OpenLayers sites.  I'm hoping this will alleviate future problems.  I
see someone has added "nice" to our cron job.

    # m h  dom mon dow   command
    33 * * * *  nice -n 18
/osgeo/openlayers/repos/openlayers/tools/update_dev_dir.sh

I'll briefly describe what our goals are below.  Please let me know if
you can see better ways to accomplish this.

The openlayers.org website is based on content from two git
repositories.  Everything under the /dev path is the result of
concatenating/minifiying scripts and modifying examples from the main
library repository.  Everything else comes from a separate repository.

Previously, the hosted resources were served out of svn checkouts -
with a checkout of the main library repo nested within the the
checkout of the website repo (under the dev path).  Because the lib
resources were modified in place, the checkouts were not always
updated reliably.

Recently I updated things to maintain clones of the two git repos, and
am using rsync to update copies of the website and library repos in
/osgeo/openlayers/sites/openlayers.org and
/osgeo/openlayers/sites/openlayers.org/dev respectively.  The website
repo is updated very infrequently and the library repo is updated
frequently.

As mentioned above, I got rid of three uses of rsync (to update hosted
copies of the sandboxes, addins, and sphinx docs).  Please suggest
alternatives if they way we're using it currently is still a problem
[1][2].

Thanks,
Tim

[1] https://github.com/openlayers/openlayers/blob/11084334653f1520c62aafc8cfe5896f133e929f/tools/update_dev_dir.sh#L15-16
[2] https://github.com/openlayers/openlayers/blob/11084334653f1520c62aafc8cfe5896f133e929f/tools/update_dev_dir.sh#L66-68

On Thu, May 24, 2012 at 11:29 AM, Markus Neteler <neteler at osgeo.org> wrote:
> Hi Tim,
>
> according to
> http://wiki.osgeo.org/wiki/Contacts#Software_Projects
>
> you are the contact point for OpenLayers. Please subscribe
> to the SAC list (or delegate) for important problems caused
> by the OpenLayers project on the shared projectsVM server.
>
> Each project using OSGeo infrastructure should have a person
> reading this low traffic SAC list.
>
> If an OpenLayers delegate is already subscribed here, please
> suggest to him/her to read the emails and react on requests.
> Maybe you could help us to identify the person.
>
> thanks
> Markus
>
> On Mon, May 14, 2012 at 6:10 PM, Markus Neteler <neteler at osgeo.org> wrote:
>>
>> On Thu, May 10, 2012 at 6:52 PM, Markus Neteler <neteler at osgeo.org> wrote:
>> > Hi SAC,
>> >
>> > FYI
>> >
>> > since some openlayers rsync jobs almost killed the projVM, I have
>> > generally reniced rsync to 10, i.e. modified the related value in
>> > /etc/default/rsync
>> > and restarted the daemon.
>>
>> I found the openlayers rsync jobs again almost killing
>> the machine (2hs ago from now). I would kindly invite
>> the openlayers people to review their cronjobs and
>> put "nice" in front of the command.
>>
>> Thanks.
>>
>> Markus



-- 
Tim Schaub
OpenGeo http://opengeo.org/
Expert service straight from the developers.