[Landsat-pds] Status

[Chris Holmes]

Nice work Frank!

Markdown in the github repo sounds ideal to me.

On Thu, Jan 22, 2015 at 12:20 PM, Frank Warmerdam <warmerdam at pobox.com>
wrote:

> Folks,
>
> OK, I now have the pull from usgs and queue in S3 job running every two
> hours (for two hours) on our job system.  At the beginning of each job it
> processes the previous run's queued scenes in parallel (usually 200-400),
> then builds index files, then pulls scenes from usgs until the job times
> out (2 hour limit).
>
> So we should see the catalog fill out automatically, though the slowness
> and 503's of the USGS download service are pretty frustrating to me.
> Incidentally we try to run up to 6 of the puller jobs.  They also now do 4
> retries with exponential backoff on 503's.
>
> If MapBox has the scene .gz files still sitting around for some of
> January, I'd be interested in us side-loading missing ones into the input
> queue. If Amit or something is interested in that we could do a little push
> on it in person now that we (Planet Labs) are just down the street.
>
> Also, I added a small job (tree_index_maker.py) to build very simple index
> files so we can more easily walk the tree in the web browser.  If anyone
> knows a way of auto-indexing instead of rebuilding these every two hours,
> I'd be interested in hearing.
>
> See:
>
>   https://s3-us-west-2.amazonaws.com/landsat-pds/L8/index.html
>
> Also, thanks to Charlie for the improved thumbnail generation PR, it has
> been merged and deployed though old ones aren't regenerated automatically.
>
> Lastly, I'd like us to setup a wiki or markup based web site for our
> effort when I can start documenting things and we can describe the effort.
> Should I just start writing markdown docs in the git repo for the
> ingestor?  Or what?
>
> Best regards,
> --
>
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up   | Frank Warmerdam,
> warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush    | Geospatial Software Developer
>
> _______________________________________________
> Landsat-pds mailing list
> Landsat-pds at lists.osgeo.org
> http://lists.osgeo.org/cgi-bin/mailman/listinfo/landsat-pds
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/landsat-pds/attachments/20150122/eeff69b8/attachment.html>