<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--> gfidisc.scisys.co.uk {color:black; !important} </style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<meta name="application-name" content="gfidisc.scisys.co.uk "> </head>
<body lang="EN-GB" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">We have found some issue with setting up Elasticsearch for geonode, where the elastic search index does not get properly updated. Each time a new is added to the layer catalogue the last entry in the index gets overridden by the newly uploaded
datasets. <o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We have the following configuration:<o:p></o:p></p>
<p class="MsoNormal">Elastic search 2.3.1<o:p></o:p></p>
<p class="MsoNormal">Geonode 2.10rc4<o:p></o:p></p>
<p class="MsoNormal">django-haystack>=2.8.1<o:p></o:p></p>
<p class="MsoNormal">elasticsearch>=2.0.0,<3.0.0<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">HAYSTACK_SEARCH = True<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"># # Avoid permissions prefiltering<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">SKIP_PERMS_FILTER = False<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"># # Update facet counts from Haystack<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">HAYSTACK_FACET_COUNTS = True <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">if HAYSTACK_SEARCH:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> if 'haystack' not in INSTALLED_APPS:<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> INSTALLED_APPS += ('haystack', )<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">HAYSTACK_CONNECTIONS = {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'default': {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'ENGINE': 'haystack.backends.elasticsearch2_backend.Elasticsearch2SearchEngine',<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'URL':'http://127.0.0.1:9200/',<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'INDEX_NAME': 'haystack',<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> },<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'db': {<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'ENGINE': 'haystack.backends.simple_backend.SimpleEngine',<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> 'EXCLUDED_INDEXES': ['thirdpartyapp.search_indexes.BarIndex'],<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> }<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">}<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">HAYSTACK_SIGNAL_PROCESSOR = 'haystack.signals.RealtimeSignalProcessor'<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.5pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB">HAYSTACK_SEARCH_RESULTS_PER_PAGE = '20'<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We have noticed however that removing the following sort out the index and haystack and elastic search start operating as per expected.<o:p></o:p></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> - "/var/venv/geonode/lib/python2.7/site-packages/geonode/groups/search_indexes.py"<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> - "/var/venv/geonode/lib/python2.7/site-packages/geonode/groups/search_indexes.pyc"<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> - "/var/venv/geonode/lib/python2.7/site-packages/geonode/people/search_indexes.py"<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Segoe UI",sans-serif;mso-fareast-language:EN-GB"> - "/var/venv/geonode/lib/python2.7/site-packages/geonode/people/search_indexes.pyc"<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Does anyone know off any bug or a way to properly configure elastic search?<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Pascal<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="gfidisc.scisys.co.uk" id="gfidisc.scisys.co.uk" style="gfidisc.scisys.co.uk"></p><a id="gfidisc.scisys.co.uk" title="gfidisc.scisys.co.uk" href="gfidisc.scisys.co.uk" class="gfidisc.scisys.co.uk" style="text-decoration: none !important;"></a><gfidisc.scisys.co.uk/><h1 class="gfidisc.scisys.co.uk" style="gfidisc.scisys.co.uk"></h1><p><span style="color: #0000ff; font-family: Tahoma; font-size: small;"> </span></p>
<div align="left"><span style="color: #808080; font-family: Arial; font-size: small;">SCISYS UK Limited. Registered in England and Wales No. 4373530.</span></div>
<div align="left"><span style="color: #808080; font-family: Arial; font-size: small;">Registered Office: Methuen Park, Chippenham, Wiltshire SN14 0GB, UK.</span></div>
<div align="left"> </div>
<div align="left"><span class="400184714-12042007"><span style="color: #000000;"><span style="font-size: 7pt; font-family: Tahoma;"><span style="font-size: xx-small;"><span style="color: #008000;"><span style="font-family: Arial;">Before printing, <span class="296245114-12042007">please </span>think about the environment<span class="296245114-12042007">.</span></span></span></span></span></span></span></div><p class="gfidisc.scisys.co.uk" id="gfidisc.scisys.co.uk" style="gfidisc.scisys.co.uk"></p><a id="gfidisc.scisys.co.uk" title="gfidisc.scisys.co.uk" href="gfidisc.scisys.co.uk" class="gfidisc.scisys.co.uk" style="text-decoration: none !important;"></a><gfidisc.scisys.co.uk/><h1 class="gfidisc.scisys.co.uk" style="gfidisc.scisys.co.uk"></h1><PRE><p><span style="color:#696969;"><span style="font-size:9px;"><span style="font-family:arial,helvetica,sans-serif;">CONFIDENTIALITY NOTICE: Proprietary/Confidential Information belonging to CGI Inc. and its affiliates may be contained in this message. If you are not a recipient indicated or intended in this message (or responsible for delivery of this message to such person), or you think for any reason that this message may have been addressed to you in error, you may not use or copy or deliver this message to anyone else. In such case, you should destroy this message and are asked to notify the sender by reply e-mail</span></span></span></p>
</PRE></body>
</html>