java.io.IOException: chunked stream ended unexpectedly (htmlUnit)

[Kameshwar Prasad]

hi friends,
i am facing a hard problem and i need your help, please help me.

Thanks in advance.

i am using htmlunit to submit a webpage.
A form having some textfield, some combo boxs and one check box, after filling all these field i submit then i get exception, but this alway not occur at one place it may also occur when a new registration form is submitted.

 

WebClient client = new WebClient(BrowserVersion.FULL_FEATURED_BROWSER);
client.setThrowExceptionOnScriptError(false);
client.setTimeout(200000);
webClient.setUseInsecureSSL(true);
 
HtmlPage page = (HtmlPage) webClient.getPage(URL);
 
.....
.......
submiting many pages.
.........
..........
 
form = (HtmlForm)page.getFormByName("Form1");
form.getInputByName("FirstName").setValueAttribute("kameshwar");
form.getInputByName("LastName").setValueAttribute("prasad");
form.getInputByName("Company").setValueAttribute("Wipro");
form.getInputByName("Address1").setValueAttribute("shakarpur, New Delhi");
form.getInputByName("Address1").setValueAttribute(buyerInfo[7]);
if(page.asXml().indexOf("Change country")<0){
form.getSelectByName("Country").getOptionByValue("USA").setSelected(true);
System.out.println("Country Hidden Found");
}
form.getInputByName("City").setValueAttribute("Vally Stream");
form.getInputByName("PostalCode").setValueAttribute("11580");
form.getInputByName("PhoneNumber").setValueAttribute("9911566708");
form.getInputByName("WorkNumber").setValueAttribute("9911566706");
form.getInputByName("billingEmailAddress").setValueAttribute("[e-mail]");
        
HtmlRadioButtonInput shipToanother=(HtmlRadioButtonInput) form.getInputByName"addressType");
     shipToanother.setDefaultValue("M");
 shipToanother.setDefaultChecked(true);
  shipToanother.click();
 
HtmlImageInput cbt = (HtmlImageInput) (HtmlImageInput)page.form.getInputByName("Continue")
page = (HtmlPage) cbt.click();
 

Exception:--
 

java.io.IOException: chunked stream ended unexpectedly
at org.apache.commons.httpclient.ChunkedInputStream.getChunkSizeFromInputStream(ChunkedInputStream.java:251)
at org.apache.commons.httpclient.ChunkedInputStream.nextChunk(ChunkedInputStream.java:220)
at org.apache.commons.httpclient.ChunkedInputStream.read(ChunkedInputStream.java:175)
at java.io.FilterInputStream.read(Unknown Source)
at org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:107)
at java.io.FilterInputStream.read(Unknown Source)
at org.apache.commons.httpclient.AutoCloseInputStream.read(AutoCloseInputStream.java:126)
at org.apache.commons.io.IOUtils.copy(IOUtils.java:996)
at org.apache.commons.io.IOUtils.toByteArray(IOUtils.java:217)
at com.gargoylesoftware.htmlunit.WebResponseData.getBody(WebResponseData.java:176)
at com.gargoylesoftware.htmlunit.WebResponseData.<init>(WebResponseData.java:111)
at com.gargoylesoftware.htmlunit.HttpWebConnection.newWebResponseDataInstance(HttpWebConnection.java:481)
at com.gargoylesoftware.htmlunit.HttpWebConnection.makeWebResponse(HttpWebConnection.java:459)
at com.gargoylesoftware.htmlunit.HttpWebConnection.getResponse(HttpWebConnection.java:122)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1503)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1459)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponseFromWebConnection(WebClient.java:1548)
at com.gargoylesoftware.htmlunit.WebClient.loadWebResponse(WebClient.java:1459)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:356)
at com.gargoylesoftware.htmlunit.WebClient.getPage(WebClient.java:384)
at com.gargoylesoftware.htmlunit.html.HtmlForm.submit(HtmlForm.java:244)
at com.gargoylesoftware.htmlunit.html.HtmlImageInput.doClickAction(HtmlImageInput.java:151)
at com.gargoylesoftware.htmlunit.html.ClickableElement.click(ClickableElement.java:129)
at com.gargoylesoftware.htmlunit.html.ClickableElement.click(ClickableElement.java:88)
at com.gargoylesoftware.htmlunit.html.HtmlImageInput.click(HtmlImageInput.java:177)
at com.gargoylesoftware.htmlunit.html.HtmlImageInput.click(HtmlImageInput.java:133)
at com.mshoppers.shopping.CabelasHtmlShopping.getShoppingDetails(CabelasHtmlShopping.java:473)
at com.mshoppers.shopping.CabelasHtmlShopping.main(CabelasHtmlShopping.java:985)
 

[Chris Janicki]

Sounds like the web server is not sending the expected amount of data before the connection closed.

It might just be that the server is busy and decided to abandon you? Can you catch the exception and retry?

If occurs every time for a set of data, then you'll have to figure out which field is causing the server to panic.