Content is unexpectedly truncated when fetched through a proxy server

[Spencer Lee]

Hello,

I'm connecting to an external web site and reading a file through the proxy server. However, the end of file marker seems to appear much sooner than it should. Any ideas as to what might be causing this?

My guess would be some timeout value on the proxy server, but I would like to make adjustments to my code and not the server if at all possible.

    
 
System.setProperty("https.proxyHost", "webproxy");
System.setProperty("https.proxyPort", "80");

try
{

URL url = new URL(urlName);
URLConnection connection = url.openConnection();

String input = username + ":" + password;
String encoding = new BASE64Encoder().encode(input.getBytes());
connection.setRequestProperty("Authorization", "Basic " + encoding);
connection.connect();

System.out.println("--");
System.out.println("Read Timeout:\t" + connection.getReadTimeout());
System.out.println("Content Length: " + connection.getContentLength());
System.out.println("--");

byte[] buff = new byte[4 * 1024];
BufferedInputStream buffin = new BufferedInputStream(connection.getInputStream());
long rsize = buffin.read(buff);
long tot = 0;
while(rsize>=0)
{
if(rsize>0)
{
tot += rsize;
// work with read bytes.
}

rsize = buffin.read(buff);
}
System.out.println("Total bytes read: " + tot);
buffin.close();
}
catch (IOException e)
{
e.printStackTrace();
}

The results were:

Read Timeout:0
Content Length: 33390550
Total bytes read: 19898368



Any suggestions as to why this might be occurring would be much appreciated.

Thanks!

SPencer

[Spencer Lee]

I've come to the conclusion that the our firewall/proxy does not permit transmission of zip files whose uncompressed size is great that some file size. The problem looks like its resolved after changes made to the firewall settings.