[CBERS-PDS] CBERS 4/4A and Amazonia-1 migration to us-west-2

[Frederico Liporace]

Hi,
The migration is now complete and all us-east-1 resources are being deleted.
The new resources in us-west-2 may be obtained from AWS Open Data Registry:
https://registry.opendata.aws/cbers/
https://registry.opendata.aws/amazonia/
rgds.,

On 06-02-24 3:19 PM, Frederico Liporace wrote:
> Hello,
> 
> The new bucket already has all ingested data and is daily updated with 
> new scenes. I`ll keep both us-east-1 and us-west-2 working until Feb 13, 
> after that the us-east-1 infrastructure will be deleted.
> 
> The new bucket and topic ARNs may be obtained from:
> 
> https://github.com/fredliporace/open-data-registry/blob/master/datasets/amazonia.yaml
> https://github.com/fredliporace/open-data-registry/blob/master/datasets/cbers.yaml
> 
> rgds.,
> 
> On 26-01-24 5:13 PM, Frederico Liporace wrote:
>> Hello,
>>
>> The CBERS 4/4A and Amazonia-1 datasets will be migrated from us-east-1
>> to us-west-2 in the following weeks. This will make it easier for 
>> applications to work with CBERS/Amazonia and other mid-res EO data 
>> such as Landsat and Sentinel-2 hosted at us-west-2; and will follow 
>> AWS recommendation for open datasets.
>>
>> A summary of the changes are below, I'll post updates in this thread.
>>
>> Bucket and data organization
>> ---------------------------------------
>>
>> A single bucket, "brazil-eosats", will store data for all satellites. 
>> The data organization will be the same and in effect only the bucket 
>> id for the assets will change. Here are some examples of old and new 
>> s3 arns:
>>
>> Old:
>> s3://cbers-pds/CBERS4A/WFI/096/108/CBERS_4A_WFI_20230727_096_108_L4/CBERS_4A_WFI_20230727_096_108_L4_BAND14.tif
>>
>> New:
>> s3://brazil-eosats/CBERS4A/WFI/096/108/CBERS_4A_WFI_20230727_096_108_L4/CBERS_4A_WFI_20230727_096_108_L4_BAND14.tif
>>
>> Old:
>> s3://amazonia-pds/AMAZONIA1/WFI/033/018/AMAZONIA_1_WFI_20210402_033_018_L4/AMAZONIA_1_WFI_20210402_033_018.png
>>
>> New:
>> s3://brazil-eosats/AMAZONIA1/WFI/033/018/AMAZONIA_1_WFI_20210402_033_018_L4/AMAZONIA_1_WFI_20210402_033_018.png
>>
>> Requester pays and metadata buckets
>> ---------------------------------------------------
>>
>> The new "brazil-eosats" bucket will NOT enable requester pays and 
>> hence there is no need to create something similar to the 
>> "cbers-meta-pds" and "amazonia-meta-pds" buckets that currently exist.
>>
>> SNS Topics
>> --------------
>>
>> A new topic will be created to notify the ingestion of new scenes. A 
>> single topic will be used for all satellites/cameras, and will follow 
>> the model currently used for Amazonia-1.
>>
>> STAC
>> -------
>>
>> The STAC service maintained by AMS Kepler will reindex all data once 
>> the migration is completed. The endpoint will not change.
>>
> 

-- 

Frederico Liporace
CTO
AMS Kepler Engenharia de Sistemas
http://amskepler.com
=============================================================
liporace at amskepler.com
Rio de Janeiro: +55 21 35006636
São José dos Campos: +55 12 36008088

AWS: Avalie-nos / Evaluate us
https://partnercentral.awspartner.com/CreateReview?pid=001E00000100tKuIAI