<div dir="ltr">You are very welcome, thank you for the report!<br></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Nov 27, 2018 at 5:44 PM ZAZHIL-HA HERENA <<a href="mailto:zazhil_ha@hotmail.com">zazhil_ha@hotmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Hi there,</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Thanks everybody for your valuable help, with your suggestions I finally got it working in my cluster with Cloudera 6 distribution(Hadoop 3) with Java, I would like to list here a few things I had to do to make it work since I used Cloudera to compile:</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<ul>
<li>In Cloudera, Hadoop libraries are under $CLOUDERA_PATH/lib/hadoop so this is the path I use for ./configure in --with-hdfs<br>
</li><li>Then<b> ./configure</b> is looking for a file <b>include/hdfs.h</b> , this directory in Cloudera exists in different path (outside Hadoop) $CLOUDERA_PATH/include, so I had to copy it under Hadoop path.<br>
</li><li>Same for libhdfs.so , <b>make</b> expects to find it in <b>lib/native/libhdfs.so</b>, for Cloudera it is in $CLOUDERA_PATH/lib64 , so I just copied it to the expected location.</li></ul>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
I tested using command line and also my Java application and /vsihdfs/ works as expected.<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Thanks!!!</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Zazhil-ha<br>
</div>
<hr style="display:inline-block;width:98%">
<div id="m_1317546832475180386divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gdal-dev <<a href="mailto:gdal-dev-bounces@lists.osgeo.org" target="_blank">gdal-dev-bounces@lists.osgeo.org</a>> on behalf of James McClain <<a href="mailto:james.mcclain@gmail.com" target="_blank">james.mcclain@gmail.com</a>><br>
<b>Sent:</b> Friday, November 23, 2018 3:18 PM<br>
<b>To:</b> <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<b>Subject:</b> Re: [gdal-dev] Question on how to open a raster in HDFS using GDAL</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div dir="ltr">Hello,</div>
<div dir="ltr"><br>
</div>
<div dir="ltr">It may not be finding the native HDFS libraries. Please see the pull request
<a href="https://github.com/OSGeo/gdal/pull/714" target="_blank">https://github.com/OSGeo/gdal/pull/714</a> for build instructions (in particular, you may need to augment the LD_LIBRARY_PATH environment variable).</div>
<div dir="ltr"><br>
</div>
<div>If trouble persists, I would suggest building against Apache Hadoop 2.7.6 or 2.7.7 (both of those are know to work) as an experiment.</div>
<div><br>
</div>
<div>Sincerely,</div>
<div>James McClian<br>
</div>
</div>
<br>
<div class="m_1317546832475180386x_gmail_quote">
<div dir="ltr">On Fri, Nov 23, 2018 at 2:15 PM ZAZHIL-HA HERENA <<a href="mailto:zazhil_ha@hotmail.com" target="_blank">zazhil_ha@hotmail.com</a>> wrote:<br>
</div>
<blockquote class="m_1317546832475180386x_gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Thank you so much!, now I am working on 2.4 source code but I am getting an error when trying to configure using:</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<b>./configure --prefix=/scratch/zherena/gdal/build/gdal-master/gdal/outputb/ --with-complete=yes --with-java=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.131-11.b12.el7.x86_64/ --with-swig-java=yes --with-hdfs=/scratch/zherena/gdal/CDH-6.0.1-1.cdh6.0.1.p0.590678/
--with-curl=/usr/bin/curl-config</b><br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
The error I get is:</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<span><b> checking for HDFS in /scratch/zherena/gdal/CDH-6.0.1-1.cdh6.0.1.p0.590678/... checking for hdfsConnect in -lhdfs... no<br>
</b></span>
<div><b> checking for /scratch/zherena/gdal/CDH-6.0.1-1.cdh6.0.1.p0.590678//include/hdfs.h... yes<br>
</b></div>
<div><b> configure: error: HDFS support not enabled.</b></div>
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Is there any configuration in my environment that I should consider? or maybe another distribution of Hadoop?</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<span> </span><span></span> <br>
</div>
<hr style="display:inline-block;width:98%">
<div id="m_1317546832475180386x_m_-802161122500202956divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> Even Rouault <<a href="mailto:even.rouault@spatialys.com" target="_blank">even.rouault@spatialys.com</a>><br>
<b>Sent:</b> Friday, November 23, 2018 11:52 AM<br>
<b>To:</b> <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<b>Cc:</b> ZAZHIL-HA HERENA; James McClain; <a href="mailto:nik@nikosalexandris.net" target="_blank">
nik@nikosalexandris.net</a><br>
<b>Subject:</b> Re: [gdal-dev] Question on how to open a raster in HDFS using GDAL</font>
<div> </div>
</div>
<div class="m_1317546832475180386x_m_-802161122500202956BodyFragment"><font size="2"><span style="font-size:11pt">
<div class="m_1317546832475180386x_m_-802161122500202956PlainText">> Version says 2.3.2 but libraries say: libgdal.so.20.4.2 .<br>
<br>
Libtool number (.so.20.4.2) has nothing to do with user-friendly version <br>
number (2.3.2)<br>
<br>
> I am not sure if I<br>
> got the latest code, this is the first time I compile it myself, I used<br>
> this link to download source code: <br>
> <a href="http://download.osgeo.org/gdal/CURRENT/gdal-2.3.2.tar.gz" target="_blank">
http://download.osgeo.org/gdal/CURRENT/gdal-2.3.2.tar.gz</a><br>
<br>
This is the latest release, but /vsihdfs/ is in the development version, not <br>
yet released, so download<br>
<br>
<a href="https://github.com/OSGeo/gdal/archive/master.zip" target="_blank">https://github.com/OSGeo/gdal/archive/master.zip</a><br>
<br>
-- <br>
Spatialys - Geospatial professional services<br>
<a href="http://www.spatialys.com" target="_blank">http://www.spatialys.com</a><br>
</div>
</span></font></div>
</div>
</blockquote>
</div>
<br clear="all">
<br>
-- <br>
<div dir="ltr" class="m_1317546832475180386x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">"I prayed for freedom for twenty years, but received no answer until I prayed with my legs."<br>
-- Frederick Douglass<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr">"I prayed for freedom for twenty years, but received no answer until I prayed with my legs."<br> -- Frederick Douglass<br><br></div></div></div></div>