HTMLUnit doesn’t wait for Javascript

I have a GWT based page that I would like to create an HTML snapshot for it using HtmlUnit. The page loads using Ajax/JavaScript information on a product, so for about 1 second there is a Loading… message and then the content appears.The problem is that HtmlUnit doesn’t seem to capture the information and all I’m getting …

via Java Application Development Tutorial » Search Results » ajax:

HTMLUnit doesn’t wait for Javascript

I have a GWT based page that I would like to create an HTML snapshot for it using HtmlUnit. The page loads using Ajax/JavaScript information on a product, so for about 1 second there is a Loading… message and then the content appears.
The problem is that HtmlUnit doesn’t seem to capture the information and all I’m getting is the “Loading…” span.
Below is an experimental code with HtmlUnit where I try to give it enough time to wait for the loading of the data but it doesn’t seem to change anything and I am still unable to capture the data loaded by the GWT javascript.
WebClient webClient = new WebClient();
webClient.setJavaScriptEnabled(true);
webClient.setThrowExceptionOnScriptError(false);
webClient.setAjaxController(new NicelyResynchronizingAjaxController());

WebRequest request = new WebRequest(new URL(““));
HtmlPage page = webClient.getPage(request);

int i = webClient.waitForBackgroundJavaScript(1000);

while (i > 0)

i = webClient.waitForBackgroundJavaScript(1000);

if (i == 0)

break;

synchronized (page)

System.out.println(“wait”);
page.wait(500);

}

webClient.getAjaxController().processSynchron(page, request, false);

System.out.println(page.asXml());Any ideas…?
……………………………………

Thank you for responding. I actually should have reported this sooner that I have found the solution myself. Apparently when initialising WebClient with FF:
WebClient webClient = new WebClient(BrowserVersion.FIREFOX_3_6);It seem to be working. When initialising WebClient with the default constructor it uses IE7 by default and I guess FF has better support for Ajax and is the recommended emulator to use.
……………………………………

I believe by default NicelyResynchronizingAjaxController will only resynchronize AJAX calls that were caused by a user action, by tracking which thread it originated from. Perhaps the GWT generated JavaScript is being called by some other thread which NicelyResynchronizingAjaxController does not want to wait for.
Try declaring your own AjaxController to synchronize with everything regardless of originating thread:
webClient.setAjaxController(new AjaxController()
@Override
public boolean processSynchron(HtmlPage page, WebRequest request, boolean async)

return true;

});

For more info: HTMLUnit doesn’t wait for Javascript

Java Application Development Tutorial » Search Results » ajax

HTMLUnit doesn’t wait for Javascript

Share this post:

Related Posts

Leave a Comment