<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 12 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
margin-bottom:.0001pt;
font-size:10.0pt;
font-family:"Courier New";}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.hoenzb
{mso-style-name:hoenzb;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Arial","sans-serif";
color:#1F497D;
font-weight:normal;
font-style:normal;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D">Hi and thank you both,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D">In my case the problem is not the fortran record markers, indeed the files are exactly the size they are supposed to be. Additionally I have doublechecked and
found out that I’m actually running GRASS 6.4.2 so I’m wondering if the large file support is something that is embedded in that distribution or if it should have been explicitly included at installation time. Do you know if there is a way to check that and/or
if it’s possible to add that without repeating the entire installation? <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D">Thanks again,
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D">PS. Hamish I will probably switch to 6.4.3rc3 anyway, would this solve the problem automatically in your opinion?
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Arial","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> kapo coulibaly [mailto:kmcoulib@gmail.com]
<br>
<b>Sent:</b> 09 May 2013 14:49<br>
<b>To:</b> Hamish<br>
<b>Cc:</b> GRASS user list; Ludovico Nicotina<br>
<b>Subject:</b> Re: [GRASS-user] ERROR: Bytes do not match file size with r.in.bin (but file size is correct!!)<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal">Hi Ludvico,<o:p></o:p></p>
</div>
<p class="MsoNormal">You also want to check how the binary was written in FORTRAN. depending on the compiler and/or the access type fortran can write extra bytes before and after every record (they are called record marker). In that particular case the file
would be bigger than the information it is supposed to contain. It is explained here:
<a href="http://paulbourke.net/dataformats/reading/">http://paulbourke.net/dataformats/reading/</a><o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">I copied the content of the site below in case the link doesn't make it.<o:p></o:p></p>
<p><b>Problem</b><o:p></o:p></p>
<p>Ever wanted to read binary files written by a FORTRAN program with a C/C++ program? Not such an unusual or unreasonable request but FORTRAN does some strange things ..... consider the following FORTRAN code, where "a" is a 3D array of 4 byte floating point
values. <o:p></o:p></p>
<pre> open(60,file=filename,status='unknown',form='unformatted')<o:p></o:p></pre>
<pre> write(60) nx,ny,nz<o:p></o:p></pre>
<pre> do k = 1,nz<o:p></o:p></pre>
<pre> do j = 1,ny<o:p></o:p></pre>
<pre> write(60) (a(i,j,k),i=1,nx)<o:p></o:p></pre>
<pre> enddo<o:p></o:p></pre>
<pre> enddo<o:p></o:p></pre>
<pre> close(60)<o:p></o:p></pre>
<p>What you will end up with is not a file that is (4 * nx) * ny * nz + 12 bytes long as it would be for the equivalent in most (if not all) other languages! Instead it will be nz * ny * (4 * nx + 8) + 20 bytes long. Why?
<o:p></o:p></p>
<p class="MsoNormal"><b>Reason</b><o:p></o:p></p>
<p>Each time the FORTRAN write is issued a "record" is written, the record consists of a 4 byte header, then the data, then a trailer that matches the header. The 4 byte header and trailer consist of the number of bytes that will be written in the data section.
So the following <o:p></o:p></p>
<pre> write(60) nx,ny,nz<o:p></o:p></pre>
<p class="MsoNormal">gets written on the disk as follows where nx,ny,nz are each 4 bytes, the other numbers below are 2 byte integers written in decimal
<o:p></o:p></p>
<pre> 0 12 nx ny nz 0 12<o:p></o:p></pre>
<p class="MsoNormal">The total length written is 20 bytes. Similarly, the line <o:p>
</o:p></p>
<pre> write(60) (a(i,j,k),i=1,nx)<o:p></o:p></pre>
<p class="MsoNormal">gets written as follows assuming nx is 1024 and "a" is real*4
<o:p></o:p></p>
<pre> 10 0 a(1,j,k) a(2,j,k) .... a(1024,j,k) 10 0<o:p></o:p></pre>
<p>The total length is 4104 bytes. Fortunately, once this is understood, it is a trivial to read the correct things in C/C++.
<o:p></o:p></p>
<p>A consequence that is a bit shocking for many programmers is that the file created with the above code gives a file that is about 1/3 the size than one created with this code.
<o:p></o:p></p>
<pre> open(60,file=filename,status='unknown',form='unformatted')<o:p></o:p></pre>
<pre> write(60) nx,ny,nz<o:p></o:p></pre>
<pre> do k = 1,nz<o:p></o:p></pre>
<pre> do j = 1,ny<o:p></o:p></pre>
<pre> do i = 1,nx<o:p></o:p></pre>
<pre> write(60) a(i,j,k)<o:p></o:p></pre>
<pre> enddo<o:p></o:p></pre>
<pre> enddo<o:p></o:p></pre>
<pre> enddo<o:p></o:p></pre>
<pre> close(60)<o:p></o:p></pre>
<p>In this case each element of a is written in one record and consumes 12 bytes for a total file size of nx * ny * nz * 12 + 20.
<o:p></o:p></p>
<p><o:p> </o:p></p>
<p><o:p> </o:p></p>
<p class="MsoNormal">Hope it helps<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Wed, May 8, 2013 at 5:27 AM, Hamish <<a href="mailto:hamish_b@yahoo.com" target="_blank">hamish_b@yahoo.com</a>> wrote:<o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Ludovico wrote:<br>
> Thank you for your answers. A few info on my system:<br>
><br>
> I'm running on a computational node under linux with 64GB or<br>
> RAM the machine architecture is a x86_64 and the kernel is<br>
> also 64bit (running getconf LONG_BIT output is 64)<br>
><br>
> The version of GRASS I am running is 6.4.1<o:p></o:p></p>
</div>
<p class="MsoNormal">You'll have to upgrade to a newer version. The fix for r.in.bin<br>
was added just a few days after the release of 6.4.1, which was<br>
two years ago.<br>
<br>
I'd suggest 6.4.3rc3, get in early and help us test the upcoming<br>
release. :)<br>
<span style="color:#888888"><br>
<br>
<span class="hoenzb">Hamish</span></span><o:p></o:p></p>
<div>
<div>
<p class="MsoNormal">_______________________________________________<br>
grass-user mailing list<br>
<a href="mailto:grass-user@lists.osgeo.org">grass-user@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/grass-user" target="_blank">http://lists.osgeo.org/mailman/listinfo/grass-user</a><o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<br>
<hr>
<font face="Arial" color="Gray" size="1">This message and any attachments contain information that may be RMS Inc. confidential and/or privileged. If you are not the intended recipient (or authorized to receive for the intended recipient), and have received
this message in error, any use, disclosure or distribution is strictly prohibited. If you have received this message in error, please notify the sender immediately by replying to the e-mail and permanently deleting the message from your computer and/or storage
system.<br>
</font>
</body>
</html>