[GeoNode-users] Migration of data from 2.0 to 2.4

Paolo Corti pcorti at gmail.com
Thu Feb 11 07:54:35 PST 2016 

Hi Mana
beer is alway welcome here, so make sure to approach me if I am on your radar :)
Glad that it worked for you, have a nice day
p

On Wed, Feb 10, 2016 at 10:14 PM, Mana Etches <manadotcom at gmail.com> wrote:
> Hi Paolo,
>
> I finally figured it out.
>
> I basically deleted all the workspaces layers directories that was migrated
> from 2.0. Ran 'create_auth_group_and_update_res.py' again and now all the
> layers are appearing and working on GUI interface.
>
> I wish I can cheers you a beer to express my appreciation and thanks for
> your help. Maybe one day.
>
> Take care,
>
> Mana
>
> On Thu, Feb 11, 2016 at 10:53 AM, Mana Etches <manadotcom at gmail.com> wrote:
>>
>> Hi Paolo,
>>
>> Firstly, thanks for your help on this. We're getting closer and closer to
>> resolving the problem.
>>
>> I found out what part of the problem was, nearly half of the data from GS
>> 2.0 directory (layers and geotiffs) was missing in my GS 2.4 data directory.
>> After reuploading and running 'geonode udatelayers', the layers updated
>> successfully without any errors in geoserver logs. When logged in as admin,
>> I can see the layers in GeoNode and GeoServer 'now all enabled'.
>>
>> However, when I executed 'python create_auth_group_and_update_res.py',
>> this is within migrate2.sh, I see 2 main errors:
>>
>> 1. <class 'geoserver.catalog.FailedRequestError'>  for all layers
>>
>> Eg: Geoserver log error shows - Caused by: java.io.FileNotFoundException:
>> /usr/share/geoserver/data/workspaces/geonode/tuv_10_500t/tuv_10_500t/coverage.xml.7dee7b3e-b96b-4c26-ae3a-7ea615dbabbb.tmp
>> (Permission denied)
>>
>>
>> 2. <class 'geonode.layers.models.DoesNotExist'> for all layers.
>>
>>
>>
>> Lastly, if I click on a layer in Geonode's GUI, nothing happens it seems
>> like the page gets refreshed, and no errors appear in the geoserver log.
>>
>>
>> It looks like the first error is caused by a permissions issue relative to
>> an xml files within my workspaces directory. Would you have some idea how to
>> remedy this?
>>
>> Many thanks again Paolo
>>
>>
>>
>>
>>
>>
>>
>> .
>>
>> On Thu, Feb 11, 2016 at 4:54 AM, Paolo Corti <pcorti at gmail.com> wrote:
>>>
>>> Yes, it looks like a configuration problem with GeoServer.
>>> After GeoServer data migration, and even before running migrate2.sh,
>>> you should already see all the layers in GeoNode and GeoServer admin if
>>> logged as superuser.
>>> migrate2.sh just takes care of permissions, tags and regions if I
>>> remember correctly.
>>> Does GeoServer log say anything when updatelayers raises <class
>>> 'geoserver.catalog.FailedRequestError'> ?
>>> p
>>>
>>> On Tue, Feb 9, 2016 at 4:46 PM, Mana Etches <manadotcom at gmail.com> wrote:
>>> > Hi Paolo,
>>> >
>>> > We are getting somewhere,
>>> >
>>> > I set 'settings_path = geonode.settings, then ran the
>>> > create_auth_group_and_update_res.py, I got the following results:
>>> >
>>> > Creating the authenticated group...
>>> > Now adding all users to the group...
>>> > Adding geonode to the group
>>> > Adding admin to the group
>>> > Adding joyp to the group
>>> > Adding liteab to the group
>>> > Adding amritr to the group
>>> > Adding susanv to the group
>>> > Adding mereonik to the group
>>> > Adding sachin to the group
>>> > Adding Brookey to the group
>>> > Adding Faatasim to the group
>>> > Adding digitaki to the group
>>> > Adding david to the group
>>> > Adding norense to the group
>>> > Adding zarin to the group
>>> > Adding sereima to the group
>>> > Adding fane to the group
>>> > Adding keleni to the group
>>> > Adding philb to the group
>>> > Adding Keikos to the group
>>> > Adding keikos to the group
>>> > Adding Lawrence to the group
>>> > Adding seelan to the group
>>> > Adding test to the group
>>> > Adding Lowry to the group
>>> > Adding mana to the group
>>> > Updating resources...
>>> > Updating layer NU_Surface_Soil
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_TC_HazardMap Wind 100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_Point_Building_Exposure_Verified
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NR_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NU_TC_HazardMap Wind 100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_Area_Council
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer
>>> > VU_Average_Annual_Loss_for_Tropical_Cyclone_and_Earthquake
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_lae2_sub2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_EQ_HazardMap_PGA_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_Landuse Landcover
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_lae2_sub1.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_EQ_HazardMap_PGA_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_Roads
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_munda_gsd05_o_sub2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TL_EQ_HazardMap_PGA_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_Roads
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer MH_Landuse Landcover
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_EQ_HazardMap_10_100_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer CK_Point_Building_Exposure_Modelled
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_Roads
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_EQ_HazardMap_03_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_EQ_HazardMap_PGA_500_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TL_EQ_HazardMap_PGA_2500_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating map Fiji
>>> > Updating layer TL_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_EQ_HazardMap_10_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TL_EQ_HazardMap_10_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NR_TC_HazardMap Wind 500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_TC_HazardMap Wind 250 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_westguale_sub6.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NU_EQ_HazardMap_10_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_EQ_HazardMap_03_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TL_Landuse Landcover
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer MH_Atoll
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_EQ_HazardMap_10_500_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer CK_Point_Building_Exposure_Verified
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_EQ_HazardMap_10_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating map
>>> > Updating layer KI_Island
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_ambae.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_Building_Aggregate_Exposure
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_Buildings
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_tanna2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_Average_Annual_Loss
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_Surface_Soil_Pt14
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer CK_Enumeration_Area
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_Roads
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NR_District
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_Point_Building_Exposure_Verified
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_Surface_Soil
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_Landuse Landcover
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_lae1.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FM_Point_Building_Exposure_Modelled
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer CK_Rarotonga_Satellite_Image_2009
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_EQ_HazardMap_03_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_EQ_HazardMap_PGA_500_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_Hamlet
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_EQ_HazardMap_03_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_TC_HazardMap Wind 100 MRP_West
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer CK_Island
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_EQ_HazardMap_PGA_2500_MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Roads
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer
>>> > FJ_Average_Annual_Loss_For_Tropical_Cyclone_and_Earthquakes
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_madang_s.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_TC_HazardMap Wind 250 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_EQ_HazardMap_03_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_TC_HazardMap Wind 500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer MH_EQ_HazardMap_10_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_Bridges
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NR_EQ_HazardMap_10_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_Building_Aggregate_Exposure
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_EQ_HazardMap_10_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_EQ_HazardMap_10_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_EQ_HazardMap_03_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_EQ_HazardMap_PGA_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TL_TC_HazardMap Wind 500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_Point_Building_Exposure_Modelled
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_EQ_HazardMap_PGA_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_TC_HazardMap Wind 100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NU_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_Point_Building_Exposure_Modelled
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FM_TC_HazardMap Wind 50 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_b4.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_Point_Building_Exposure_Verified
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_8C
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_d2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_Point_Building_Exposure_Verified
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Kolombangara_sub2
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_Surface_Soil
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_Surface_Soil
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Auki_Satellite_Imagery_2005_s2
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Honiara_Satellite_Imagery_2005_s1
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_EQ_HazardMap_03_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_Census_Unit
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_Building_Aggregate_Exposure
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_Landuse Landcover
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FM_EQ_HazardMap_03_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_Point_Building_Exposure_Modelled
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FM_EQ_HazardMap_10_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Gizo_Satellite_Imagery_2005_s1
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NR_EQ_HazardMap_10_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_Honiara_Satellite_Imagery_2005_s2
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_nadi_s1.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_EQ_HazardMap_03_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TV_Island
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer NU_EQ_HazardMap_03_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_Surface_Soil_Pt13
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_Coastline
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PG_TC_HazardMap Wind 500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer SB_rannogga_2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer VU_EQ_HazardMap_PGA_100 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer PW_Surface_Soil
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_a2.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer TO_b3.tif
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_Special_Infrastructure
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FM_EQ_HazardMap_10_2500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_Surface_Soil_Pt11
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer FJ_Specials
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer WS_EQ_HazardMap_03_500 MRP
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating layer KI_Surface_Soil_Pt12
>>> > <class 'geoserver.catalog.FailedRequestError'>
>>> > Updating map Yasawa Group
>>> > Updating map Vanuatu
>>> > Updating document NU_Country_Profile
>>> > Updating document
>>> > Advancing_Disaster_Risk_Financing&Insurance_In_The_Pacific.pdf
>>> > Updating document VU_Country_Profile
>>> > Updating document Country Note THE COOK ISLANDS
>>> > Updating document Country Note Fiji
>>> > Updating document PG_Country_Profile
>>> > Updating document FM_Country_Profile
>>> > Updating document CATASTROPHE RISK ASSESSMENT METHODOLOGY
>>> > Updating document PW_Country_Profile
>>> > Updating document KI_Country_Profile
>>> > Updating document Country Note Solomon Islands
>>> > Updating document Country Note Marshall Islands
>>> > Updating document Country_Note_Vanuatu
>>> > Updating document TO_Country_Profile
>>> > Updating document Solomon Islands Country Profile
>>> > Updating document PCRAFI_Risk_Assessment_Methodology
>>> > Updating document Country_Note_Tonga
>>> > Updating document MH_Country_Profile
>>> > Updating document WS_Country_Profile
>>> > Updating document Country-Note-Samoa
>>> > Updating document TL_Country_Profile
>>> > Updating document NR_Country_Profile
>>> > Updating document FJ_Country_Profile
>>> > Updating document CK_Country_Profile
>>> > Updating document TV_Country_Profile
>>> > Updating document Country Note: Samoa; Disaster risk financing and
>>> > insurance, February 2015
>>> > Updating document Country Note: Tonga; Disaster risk financing and
>>> > insurance, February 2015
>>> > Updating document Country Note: Cook Islands; Disaster risk financing
>>> > and
>>> > insurance, February 2015
>>> > Updating document Country Note: Vanuatu; Disaster risk financing and
>>> > insurance, February 2015
>>> > Updating layer ck_evacuation_centers
>>> > GDAL_ERROR 4: Unable to open
>>> > /var/www/geonode/uploaded/layers/ck_evacuation_centers.shp or
>>> > /var/www/geonode/uploaded/layers/ck_evacuation_centers.SHP.
>>> > Could not open
>>> > /var/www/geonode/uploaded/layers/ck_evacuation_centers.shp
>>> > <type 'exceptions.AssertionError'>
>>> > Updating layer rarotonga_electoral_boundaries
>>> > GDAL_ERROR 4: Unable to open
>>> > /var/www/geonode/uploaded/layers/rarotonga_electoral_boundaries.shp or
>>> > /var/www/geonode/uploaded/layers/rarotonga_electoral_boundaries.SHP.
>>> > Could not open
>>> > /var/www/geonode/uploaded/layers/rarotonga_electoral_boundaries.shp
>>> > <type 'exceptions.AssertionError'>
>>> > Updating layer mangaia_electoral_boundaries
>>> > GDAL_ERROR 4: Unable to open
>>> > /var/www/geonode/uploaded/layers/mangaia_electoral_boundaries.shp or
>>> > /var/www/geonode/uploaded/layers/mangaia_electoral_boundaries.SHP.
>>> > Could not open
>>> > /var/www/geonode/uploaded/layers/mangaia_electoral_boundaries.shp
>>> > <type 'exceptions.AssertionError'>
>>> > Updating layer aitutaki_electoral_boundaries
>>> > GDAL_ERROR 4: Unable to open
>>> > /var/www/geonode/uploaded/layers/aitutaki_electoral_boundaries.shp or
>>> > /var/www/geonode/uploaded/layers/aitutaki_electoral_boundaries.SHP.
>>> > Could not open
>>> > /var/www/geonode/uploaded/layers/aitutaki_electoral_boundaries.shp
>>> > <type 'exceptions.AssertionError'>
>>> >
>>> > I checked the layers in GUI of geonode and none of my migrate layers
>>> > appear.
>>> > I checked the documents link, I see the meta data and links but I get
>>> > an
>>> > internal error 500 when I try to download.
>>> >
>>> > It looks like the clue we've got is <class
>>> > 'geoserver.catalog.FailedRequestError'>. This looks like a geoserver
>>> > configuration issue then, would you have some idea which configuration
>>> > file
>>> > specifically. Is it contained within my Geoserver Directory? or
>>> > elsewhere.
>>> >
>>> > Mana
>>> >
>>> >
>>> >
>>> >
>>> >
>>> > On Wed, Feb 10, 2016 at 10:14 AM, Paolo Corti <pcorti at gmail.com> wrote:
>>> >>
>>> >> Yes, I think that you need to fix the first error to have the
>>> >> migration working properly.
>>> >> Don't worry about the second error: you are getting IntegrityError as
>>> >> the records were already added to the database when you ran the script
>>> >> first time.
>>> >> The third error is caused by the first one.
>>> >> Let me know if you get more issues
>>> >> p
>>> >>
>>> >> On Tue, Feb 9, 2016 at 3:38 PM, Mana Etches <manadotcom at gmail.com>
>>> >> wrote:
>>> >> > Hi Paolo,
>>> >> >
>>> >> > Firstly, I should have ran the python scripts individually within
>>> >> > migrate2.sh, I noticed some errors as follows:
>>> >> >
>>> >> >  'create_auth_group_and_update_res.py', reveals error:
>>> >> >
>>> >> > Traceback (most recent call last):
>>> >> >   File "create_auth_group_and_update_res.py", line 10, in <module>
>>> >> >     from geonode.groups.models import GroupProfile
>>> >> >   File
>>> >> > "/usr/local/lib/python2.7/dist-packages/geonode/groups/models.py",
>>> >> > line 5, in <module>
>>> >> >     from django.contrib.auth.models import Group
>>> >> >   File
>>> >> > "/usr/lib/python2.7/dist-packages/django/contrib/auth/__init__.py",
>>> >> > line 6, in <module>
>>> >> >     from django.middleware.csrf import rotate_token
>>> >> >   File "/usr/lib/python2.7/dist-packages/django/middleware/csrf.py",
>>> >> > line
>>> >> > 14, in <module>
>>> >> >     from django.utils.cache import patch_vary_headers
>>> >> >   File "/usr/lib/python2.7/dist-packages/django/utils/cache.py",
>>> >> > line
>>> >> > 26, in
>>> >> > <module>
>>> >> >     from django.core.cache import get_cache
>>> >> >   File
>>> >> > "/usr/lib/python2.7/dist-packages/django/core/cache/__init__.py",
>>> >> > line 69, in <module>
>>> >> >     if DEFAULT_CACHE_ALIAS not in settings.CACHES:
>>> >> >   File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py",
>>> >> > line
>>> >> > 54,
>>> >> > in __getattr__
>>> >> >     self._setup(name)
>>> >> >   File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py",
>>> >> > line
>>> >> > 49,
>>> >> > in _setup
>>> >> >     self._wrapped = Settings(settings_module)
>>> >> >   File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py",
>>> >> > line
>>> >> > 132,
>>> >> > in __init__
>>> >> >     % (self.SETTINGS_MODULE, e)
>>> >> > ImportError: Could not import settings
>>> >> > '/etc/genode/local_settings.py'
>>> >> > (Is
>>> >> > it on sys.path? Is there an import error in the settings file?):
>>> >> > Import
>>> >> > by
>>> >> > filename is not supported.
>>> >> >
>>> >> > The second script, 'migrate_tags.py', ran errors for the first part
>>> >> > relative
>>> >> > to psycopg2.IntegrityError on my layers, eg:
>>> >> >
>>> >> > ('Municipality', 'municipality')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Island) already exists.
>>> >> >
>>> >> > ('Island', 'island')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Atoll) already exists.
>>> >> >
>>> >> > ('Atoll', 'atoll')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(nr) already exists.
>>> >> >
>>> >> > ('nr', 'nr')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(District) already exists.
>>> >> >
>>> >> > ('District', 'district')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Village) already exists.
>>> >> >
>>> >> > ('Village', 'village')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Local Level Government) already exists.
>>> >> >
>>> >> > ('Local Level Government', 'local-level-government')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Building Replacement Cost) already exists.
>>> >> >
>>> >> > ('Building Replacement Cost', 'building-replacement-cost')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(State) already exists.
>>> >> >
>>> >> > ('State', 'state')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Ward) already exists.
>>> >> >
>>> >> > ('Ward', 'ward')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Sub District) already exists.
>>> >> >
>>> >> > ('Sub District', 'sub-district')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Area Council) already exists.
>>> >> >
>>> >> > ('Area Council', 'area-council')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(hazards) already exists.
>>> >> >
>>> >> > ('hazards', 'hazards')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Building Exposure Aggregates) already exists.
>>> >> >
>>> >> > ('Building Exposure Aggregates', 'building-exposure-aggregates')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(nrj) already exists.
>>> >> >
>>> >> > ('nrj', 'nrj')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Land cover) already exists.
>>> >> >
>>> >> > ('Land cover', 'land-cover')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Land use) already exists.
>>> >> >
>>> >> > ('Land use', 'land-use')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Land Cover) already exists.
>>> >> >
>>> >> > ('Land Cover', 'land-cover_1')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Land Use) already exists.
>>> >> >
>>> >> > ('Land Use', 'land-use_1')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss For TC & EQ) already
>>> >> > exists.
>>> >> >
>>> >> > ('Average Annual Loss For TC & EQ', 'average-annual-loss-for-tc-eq')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss) already exists.
>>> >> >
>>> >> > ('Average Annual Loss', 'average-annual-loss')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Building Replacement Costs) already exists.
>>> >> >
>>> >> > ('Building Replacement Costs', 'building-replacement-costs')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Exposure Cash Crops) already exists.
>>> >> >
>>> >> > ('Exposure Cash Crops', 'exposure-cash-crops')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(imagery) already exists.
>>> >> >
>>> >> > ('imagery', 'imagery')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(REQUIRED: Common-use word or phrase used to
>>> >> > describe
>>> >> > the subject of the data set.) already exists.
>>> >> >
>>> >> > ('REQUIRED: Common-use word or phrase used to describe the subject
>>> >> > of
>>> >> > the
>>> >> > data set.',
>>> >> >
>>> >> >
>>> >> > 'required-common-use-word-or-phrase-used-to-describe-the-subject-of-the-data-set')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss TC & EQ) already exists.
>>> >> >
>>> >> > ('Average Annual Loss TC & EQ', 'average-annual-loss-tc-eq')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss for TC & EQ) already
>>> >> > exists.
>>> >> >
>>> >> > ('Average Annual Loss for TC & EQ',
>>> >> > 'average-annual-loss-for-tc-eq_1')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Population) already exists.
>>> >> >
>>> >> > ('Population', 'population')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss tc and eq) already exists.
>>> >> >
>>> >> > ('Average Annual Loss tc and eq', 'average-annual-loss-tc-and-eq')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Average Annual Loss for Tropical Cyclone and
>>> >> > Earthquake) already exists.
>>> >> >
>>> >> > ('Average Annual Loss for Tropical Cyclone and Earthquake',
>>> >> > 'average-annual-loss-for-tropical-cyclone-and-earthquake')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Probabilistic) already exists.
>>> >> >
>>> >> > ('Probabilistic', 'probabilistic')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Earthquake) already exists.
>>> >> >
>>> >> > ('Earthquake', 'earthquake')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Hazard) already exists.
>>> >> >
>>> >> > ('Hazard', 'hazard')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(cyclone) already exists.
>>> >> >
>>> >> > ('cyclone', 'cyclone')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(solomons) already exists.
>>> >> >
>>> >> > ('solomons', 'solomons')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(risk) already exists.
>>> >> >
>>> >> > ('risk', 'risk')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Summary Report) already exists.
>>> >> >
>>> >> > ('Summary Report', 'summary-report')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Risk Assessment) already exists.
>>> >> >
>>> >> > ('Risk Assessment', 'risk-assessment')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Loss) already exists.
>>> >> >
>>> >> > ('Loss', 'loss')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Topography) already exists.
>>> >> >
>>> >> > ('Topography', 'topography')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Document) already exists.
>>> >> >
>>> >> > ('Document', 'document')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Imagery) already exists.
>>> >> >
>>> >> > ('Imagery', 'imagery_1')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(Soil) already exists.
>>> >> >
>>> >> > ('Soil', 'soil')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(SOILS) already exists.
>>> >> >
>>> >> > ('SOILS', 'soils')
>>> >> > <class 'psycopg2.IntegrityError'>
>>> >> > duplicate key value violates unique constraint "taggit_tag_name_key"
>>> >> > DETAIL:  Key (name)=(SOIL) already exists.
>>> >> >
>>> >> > And the last python script, 'migrate_group_permissions.py',
>>> >> > revealed:
>>> >> >
>>> >> > Traceback (most recent call last):
>>> >> >   File "migrate_group_permissions.py", line 16, in <module>
>>> >> >     authenticated_group_id = dst_cur.next()[0]
>>> >> > StopIteration
>>> >> >
>>> >> >
>>> >> > Correct me if I'm wrong, it looks like the error in the first script
>>> >> > is
>>> >> > related to my settings_path within gn_migration.cfg file. I saw
>>> >> > within
>>> >> > the
>>> >> > forums that this should be set to 'settings_path =
>>> >> > geonode.settings'.
>>> >> >
>>> >> > As for errors in scripts migrate_tags.py and
>>> >> > migrate_group_permissions.py,
>>> >> > I'm hoping to get your advice on this part.
>>> >> >
>>> >> > Thank you immensely,
>>> >> >
>>> >> > Mana
>>> >> >
>>> >> >
>>> >> >
>>> >> >
>>> >> > On Wed, Feb 10, 2016 at 5:09 AM, Paolo Corti <pcorti at gmail.com>
>>> >> > wrote:
>>> >> >>
>>> >> >> Hi Mana
>>> >> >> did you run migrate2.sh after migrating the GeoServer data
>>> >> >> directory?
>>> >> >> did you see any error running that script?
>>> >> >> p
>>> >> >>
>>> >> >> On Tue, Feb 9, 2016 at 2:00 AM, Mana Etches <manadotcom at gmail.com>
>>> >> >> wrote:
>>> >> >> > Hello geonode gurus,
>>> >> >> >
>>> >> >> > I've installed geonode 2.4 following instructions at
>>> >> >> > http://geonode.org/blog/2015/11/19/geonode-2.4-released/
>>> >> >> >
>>> >> >> > I've followed Capooti's migration steps at guidelines at
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> > https://github.com/capooti/geonode/blob/migration_from20_to_24/scripts/migrations/migrate20to24/index.rst
>>> >> >> >
>>> >> >> > I'm at a point where I can see the number of layers, maps and
>>> >> >> > users
>>> >> >> > on
>>> >> >> > geonode GUI (but only as a registered user). I can log into
>>> >> >> > geoserver
>>> >> >> > admin,
>>> >> >> > however I don't see my layers, stores, on the admin panel.
>>> >> >> >
>>> >> >> > I uploaded 2.0 GS data directory to geoserver 2.4 data directory
>>> >> >> > as
>>> >> >> > follows:
>>> >> >> > data/default     to    data/default
>>> >> >> > gwc-layers      to     gwc/layers
>>> >> >> > workspaces/geonode    to      workspaces/geonode/datastore
>>> >> >> >
>>> >> >> > Note, I can upload layers just fine but I can only see the the
>>> >> >> > layers
>>> >> >> > that I
>>> >> >> > uploaded in the geonode_data in postgres. I can't see the layers
>>> >> >> > from
>>> >> >> > 2.0
>>> >> >> > database.
>>> >> >> >
>>> >> >> > Lastly I ran a 'geonode updatelayers' and got the following
>>> >> >> > results:
>>> >> >> >
>>> >> >> > Finished processing 4 layers in 2.0 seconds.
>>> >> >> >
>>> >> >> > 0 Created layers
>>> >> >> > 4 Updated layers
>>> >> >> > 0 Failed layers
>>> >> >> > 0.500000 seconds per layer
>>> >> >> >
>>> >> >> > Updating only the layers that I uploaded.
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> > For referencing purposes see my 'gn_migration.cfg' configurations
>>> >> >> > below:
>>> >> >> >
>>> >> >> > [db20]
>>> >> >> > dbname = old_db
>>> >> >> > host = 192.168.137.12
>>> >> >> > user = geonode
>>> >> >> > password = secret (replaced)
>>> >> >> >
>>> >> >> > [db24]
>>> >> >> > dbname = geonode
>>> >> >> > host = 192.168.137.12
>>> >> >> > user = geonode
>>> >> >> > password = secret (replaced)
>>> >> >> >
>>> >> >> > [path]
>>> >> >> > geonode_path = /usr/local/lib/python2.7/dist-packages/geonode
>>> >> >> > settings_path = /etc/genode/local_settings.py
>>> >> >> >
>>> >> >> > My gut feeling is its a configuration issue.
>>> >> >> >
>>> >> >> > Any help or point in the right direction would be very much
>>> >> >> > appreciated
>>> >> >> >
>>> >> >> > Mana
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> >
>>> >> >> > _______________________________________________
>>> >> >> > geonode-users mailing list
>>> >> >> > geonode-users at lists.osgeo.org
>>> >> >> > http://lists.osgeo.org/mailman/listinfo/geonode-users
>>> >> >> >
>>> >> >>
>>> >> >>
>>> >> >>
>>> >> >> --
>>> >> >> Paolo Corti
>>> >> >> Geospatial software developer
>>> >> >> web: http://www.paolocorti.net
>>> >> >> twitter: @capooti
>>> >> >> skype: capooti
>>> >> >
>>> >> >
>>> >>
>>> >>
>>> >>
>>> >> --
>>> >> Paolo Corti
>>> >> Geospatial software developer
>>> >> web: http://www.paolocorti.net
>>> >> twitter: @capooti
>>> >> skype: capooti
>>> >
>>> >
>>>
>>>
>>>
>>> --
>>> Paolo Corti
>>> Geospatial software developer
>>> web: http://www.paolocorti.net
>>> twitter: @capooti
>>> skype: capooti
>>
>>
>



-- 
Paolo Corti
Geospatial software developer
web: http://www.paolocorti.net
twitter: @capooti
skype: capooti

More information about the geonode-users mailing list