SocketException while uploading File of more than 2GB via Apache HttpClient Object in Websphere

[Vinod Borole]

Hello,

I have a requirement of uploading zip files of more than 2GB size on a server. In order to achieve this i am using Apache HttpClient Object (org.apache.commons.httpclient)

If i deploy my application on Tomcat 5.5, I can successfully upload more than 5GB of zip files without making any changes in Tomcat configuration files. However when i try the same application on IBM Websphere 6.0 and 7.0 i cannot upload zip files of 2GB size and more, following is the exception i am getting. Is their any limitation on Websphere on maximum size file upload anything like maxRequestLength (setting found in .NET) found in Websphere.

   java.net.SocketException: Software caused connection abort: socket write error
	at java.net.SocketOutputStream.socketWrite0(Native Method)
	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
	at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
	at java.io.BufferedOutputStream.write(BufferedOutputStream.java:105)
	at org.apache.commons.httpclient.methods.multipart.FilePart.sendData(FilePart.java:223)
	at org.apache.commons.httpclient.methods.multipart.Part.send(Part.java:312)
	at org.apache.commons.httpclient.methods.multipart.Part.sendParts(Part.java:385)
	at org.apache.commons.httpclient.methods.multipart.Part.sendParts(Part.java:359)
	at org.apache.commons.httpclient.methods.MultipartPostMethod.writeRequestBody(MultipartPostMethod.java:299)
	at org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2114)
	at org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096)
	at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
	at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
	at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
	at com.tr.promotion.HttpMultiPartFileUpload.uploadPackage(HttpMultiPartFileUpload.java:34)
	at com.tr.promotion.UploadClient.upload(UploadClient.java:167)
	at com.tr.promotion.UploadClient.jButton1ActionPerformed(UploadClient.java:128)
	at com.tr.promotion.UploadClient.access$2(UploadClient.java:126)
	at com.tr.promotion.UploadClient$3.actionPerformed(UploadClient.java:91)
	at javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:1849)
	at javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2169)
	at javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:420)
	at javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:258)
	at javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:234)
	at java.awt.Component.processMouseEvent(Component.java:5488)
	at javax.swing.JComponent.processMouseEvent(JComponent.java:3126)
	at java.awt.Component.processEvent(Component.java:5253)
	at java.awt.Container.processEvent(Container.java:1966)
	at java.awt.Component.dispatchEventImpl(Component.java:3955)
	at java.awt.Container.dispatchEventImpl(Container.java:2024)
	at java.awt.Component.dispatchEvent(Component.java:3803)
	at java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4212)
	at java.awt.LightweightDispatcher.processMouseEvent(Container.java:3892)
	at java.awt.LightweightDispatcher.dispatchEvent(Container.java:3822)
	at java.awt.Container.dispatchEventImpl(Container.java:2010)
	at java.awt.Window.dispatchEventImpl(Window.java:1774)
	at java.awt.Component.dispatchEvent(Component.java:3803)
	at java.awt.EventQueue.dispatchEvent(EventQueue.java:463)
	at java.awt.EventDispatchThread.pumpOneEventForHierarchy(EventDispatchThread.java:242)
	at java.awt.EventDispatchThread.pumpEventsForHierarchy(EventDispatchThread.java:163)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:157)
	at java.awt.EventDispatchThread.pumpEvents(EventDispatchThread.java:149)
	at java.awt.EventDispatchThread.run(EventDispatchThread.java:110)
 

[Marco Ehrentreich]

Hi Vinod,

unfortunately I don't know details about Websphere so I can't tell you exactly why it behaves like this. But Apache (the well-known HTTP server) has the same limitation in some versions on some systems. As far as I know the origin of this problem was, at least on Linux with Apache 2.0.x, because of limitations of some filesystem.

I guess, this doesn't help you very much but could it be that the said Tomcat and Websphere servers are running on a different machine with a different OS? Just a thought...

Marco

[Vinod Borole]

Hi Marco,

Thank you for responding to my post. I really appreciate that.

More details, both the machines that run Tomcat and Webspher have same O.S which is WindowXP.

Later after posting this problem i tried to check how many bytes that HttpClient is trying to write out of 2GB file on the request, i can see that it writes some number of bytes and throws the following exception, one good thing i noticed over here is that it does the same thing 3 times - (It is something like it gives 3 tries to write bytes on request, everytime it errors out) But unfortunately on every try it throws same exception.


Can any one give me any suggestion as to how i can fix this problem?