[SAC] mail.osgeo.org running out of disk space

[Frank Warmerdam]

Folks,

OK, I haven't heard back from japan.osgeo at gmail.com so I have scrubbed the
OSGeo Japan Board list attachments archive. The emails themselves will
presumably be fine, but any attachments will lead to 404s.   If critical I
imagine we could recover them from backups but packing them up and moving
them somewhere else was taking prohibitively long.

As suggested by Markus, I have also tried setting the max message size to
200K for the list.  I think that is in place properly.  We now have lots of
space:

mail:/# df -h
Filesystem            Size  Used Avail Use% Mounted on
/dev/vda3              69G   38G   28G  58% /
tmpfs                 2.0G     0  2.0G   0% /lib/init/rw
udev                  2.0G  112K  2.0G   1% /dev
tmpfs                 2.0G     0  2.0G   0% /dev/shm
/dev/vda1              99M   25M   70M  26% /boot

Best regards,
Frank



On Sat, Sep 14, 2013 at 7:01 AM, Frank Warmerdam <warmerdam at pobox.com>wrote:

> Markus,
>
> Good catch!
>
> I don't really understand why the attachments in the
> osgeojapan-board/attachments are so huge when the osgeojapan-board.mbox
> file is only 250MB.  I suspect something when crazy in processing for the
> archives.  If I don't hear back from the OSGeo Japan board in a few days,
> I'll archive the attachments somewhere and clean them off lists.osgeo.org.
> I brief poke into them suggested some of it is slide decks.  Clearing 30GB
> of these attachments from the one list will restore the server to only half
> full.
>
> Alex, based on that I think we could likely retract the request for server
> growth.
>
> Best regards,
> Frank
>
>
>
> On Sat, Sep 14, 2013 at 2:13 AM, Markus Neteler <neteler at osgeo.org> wrote:
>
>> (cc japan.osgeo at gmail.com to notify their mailman administrator)
>>
>> On Sat, Sep 14, 2013 at 2:09 AM, Frank Warmerdam <warmerdam at pobox.com>
>> wrote:
>> > Folks,
>> >
>> > I have scrubbed some older mailman logs to make a bit of space so we
>> have a
>> > few days to cope with this situation.
>> >
>> > I'm inclined to just allocate more space.  The lists server and it's
>> archive
>> > is a valuable service, and it is not immediately clear that it is out of
>> > hand though it is accumulating pretty fast.
>>
>> Here the Top 20 usages of the OSGeo mailman lists (in MB):
>>
>> 303    postgis-devel
>> 316    mapbender_commits.mbox
>> 317    grass-user.mbox
>> 324    portugal
>> 372    mapserver-users.mbox
>> 410    qgis-user
>> 418    mapguide-commits
>> 434    qgis-developer
>> 487    openlayers-users
>> 579    gdal-dev
>> 736    mapguide-users
>> 762    mapbender_commits
>> 765    postgis-users.mbox
>> 789    grass-dev
>> 850    fdo-commits
>> 883    grass-user
>> 1259    mapserver-users
>> 1860    postgis-users
>> 1968    grass-commit
>> 28885    osgeojapan-board
>>
>> There are actually huge attachments therein:
>> 29G    /var/lib/mailman/archives/private/osgeojapan-board/attachments
>>
>> The attachment of the "osgeojapan-board" list is unlimited at time:
>>
>> config_list --outputfile - osgeojapan-board | grep size
>> max_message_size = 0
>>
>> Suggestion: restrict the attachment size to 200k in the
>> "osgeojapan-board" list to avoid that the mail.osgeo.org server disk
>> collapses.
>>
>> Markus
>> _______________________________________________
>> Sac mailing list
>> Sac at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/sac
>>
>
>
>
> --
>
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up   | Frank Warmerdam,
> warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush    | Geospatial Software Developer
>



-- 
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up   | Frank Warmerdam,
warmerdam at pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/sac/attachments/20130916/d29a52a0/attachment.html>