GeeCON Prague 2014*
The moose likes Other Open Source Projects and the fly likes Imitating a specific browser Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


JavaRanch » Java Forums » Products » Other Open Source Projects
Bookmark "Imitating a specific browser" Watch "Imitating a specific browser" New topic
Author

Imitating a specific browser

Alan Shiers
Ranch Hand

Joined: Sep 24, 2003
Posts: 237
Hi there,

If I want to connect to a particular website, I'll often use the URL class and it's openStream() method. However, on occasion, I can't connect to the web server this way as they probably have in place some sort of device to prevent the scanning from unknown sources. I can navigate fine to the same website using the exact same URL in my IE browser no problem. So I'm thinking that a browser must be identifying itself to the server somehow in the HTTPRequest object sent to the server. That being the case, how does one imitate the source request as having come from IE or some other browser? Is there a property I can set on some other class before I call the URL.openStream() method?

Alan
Ulf Dittmer
Marshal

Joined: Mar 22, 2005
Posts: 42039
    
  64
Use the HtmlUnit library - it can imitate various browsers, and does a very good job of programmatic web access.


Ping & DNS - my free Android networking tools app
 
GeeCON Prague 2014
 
subject: Imitating a specific browser