<html><body>
<p>David,<br>
zip format files for 32bit WindowsXP maxes out at 4GB. You can create larger zip files on Vista. I'm wildly guessing that you are running into the 4GB limit as well on reading your zip files with . 7zip, <a href="http://www.7-zip.org/">http://www.7-zip.org/</a>, might be able to handle zip format files larger than 4GB. If that doesn't work, see if you can switch to gzip format. Gzip works just fine with files larger than 4 GB on 32 bit Windows systems.<br>
<br>
Doug<br>
<br>
Doug Newcomb <br>
USFWS<br>
Raleigh, NC<br>
919-856-4520 ext. 14 doug_newcomb@fws.gov<br>
---------------------------------------------------------------------------------------------------------<br>
The opinions I express are my own and are not representative of the official policy of the U.S.Fish and Wildlife Service or Dept. of the Interior. Life is too short for undocumented, proprietary data formats.<br>
<img width="16" height="16" src="cid:1__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt="Inactive hide details for Roger André <randre@gmail.com>">Roger André <randre@gmail.com><br>
<br>
<br>
<table width="100%" border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td style="background-image:url(cid:2__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov); background-repeat: no-repeat; " width="40%">
<ul>
<ul>
<ul>
<ul><b><font size="2">Roger André <randre@gmail.com></font></b><font size="2"> </font><br>
<font size="2">Sent by: gdal-dev-bounces@lists.osgeo.org</font>
<p><font size="2">09/19/2009 01:16 AM</font></ul>
</ul>
</ul>
</ul>
</td><td width="60%">
<table width="100%" border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">To</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<font size="2">David Shi <davidgshi@yahoo.co.uk></font></td></tr>
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">cc</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<font size="2">gdal-dev@lists.osgeo.org</font></td></tr>
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">Subject</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""><br>
<font size="2">Re: [gdal-dev] Shortening execution time of Python script</font></td></tr>
</table>
<table border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td width="58"><img width="1" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""></td><td width="336"><img width="1" height="1" src="cid:3__=0ABBFCA5DFD643EF8f9e8a93df938690@fws.gov" border="0" alt=""></td></tr>
</table>
</td></tr>
</table>
<br>
<font size="4">So the problem is that ArcGIS Server is expecting the data to be ready (unzipped), but due to the large size of the data set, the unzip has not finished?<br>
<br>
Roger<br>
--<br>
</font><br>
<font size="4">On Wed, Sep 9, 2009 at 3:54 AM, David Shi <</font><a href="mailto:davidgshi@yahoo.co.uk"><u><font size="4" color="#0000FF">davidgshi@yahoo.co.uk</font></u></a><font size="4">> wrote:</font>
<table width="100%" border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td width="100%"><font size="4">I have a Python script that automatically downloads zip files containing large datasets from another server and then unzips the files to further process the data.</font><br>
<font size="4"> </font><br>
<font size="4">It has been used as a geoprocessor of ArcGIS Server.</font><br>
<font size="4"> </font><br>
<font size="4">The script works fine when two datasets each has several kilobytes size, but the script stops half way when datasets were about 11,000KBytes.</font><br>
<font size="4"> </font><br>
<font size="4">I think that the execution time is too long and ArcGIS Server just simply killed the process.</font><br>
<font size="4"> </font><br>
<font size="4">What actions can I try to reduce the execution time?</font><br>
<font size="4"> </font><br>
<font size="4">ArcGIS Server only works on the basis of 32 bits and I was told that the maximum memory it can utilise is 4 MBytes.</font><br>
<font size="4"> </font><br>
<font size="4">I should be grateful if someone can make suggestions/recommendations.</font><br>
<font size="4"> </font><br>
<font size="4">Sincerely,</font><br>
<font size="4"> </font><br>
<font size="4">David</font></td></tr>
</table>
<ul><font size="4"><br>
<br>
_______________________________________________<br>
gdal-dev mailing list</font><u><font size="4" color="#0000FF"><br>
</font></u><a href="mailto:gdal-dev@lists.osgeo.org"><u><font size="4" color="#0000FF">gdal-dev@lists.osgeo.org</font></u></a><u><font size="4" color="#0000FF"><br>
</font></u><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev" target="_blank"><u><font size="4" color="#0000FF">http://lists.osgeo.org/mailman/listinfo/gdal-dev</font></u></a></ul>
<tt>_______________________________________________<br>
gdal-dev mailing list<br>
gdal-dev@lists.osgeo.org<br>
</tt><tt><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev">http://lists.osgeo.org/mailman/listinfo/gdal-dev</a></tt><br>
</body></html>