aspose file tools*
The moose likes Beginning Java and the fly likes Need help to write a bot to collect data from internet. Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Beginning Java
Bookmark "Need help to write a bot to collect data from internet." Watch "Need help to write a bot to collect data from internet." New topic
Author

Need help to write a bot to collect data from internet.

athrun itachi
Greenhorn

Joined: Apr 23, 2005
Posts: 4
Hi everyone,

I need to write a program to do the following features.

-connect to the net at regular schedule timing
-collect the data at the website.

May i know which library i should use?


Thanks in advance.
Paul Sturrock
Bartender

Joined: Apr 14, 2004
Posts: 10336

You'll propably find the following useful:
  • java.util.Timer & java.util.TimerTask
  • java.net.*
  • java.util.regex (assuming you are looking for specific data, rather than just the whole page)


  • JavaRanch FAQ HowToAskQuestionsOnJavaRanch
    athrun itachi
    Greenhorn

    Joined: Apr 23, 2005
    Posts: 4
    Thanks Paul!

    What should i use if i would like to store the info collected in a database?
    Paul Clapham
    Bartender

    Joined: Oct 14, 2005
    Posts: 18993
        
        8

    JDBC.
    Rob Spoor
    Sheriff

    Joined: Oct 27, 2005
    Posts: 19794
        
      20

    Combined with java.sql


    SCJP 1.4 - SCJP 6 - SCWCD 5 - OCEEJBD 6
    How To Ask Questions How To Answer Questions
     
    I agree. Here's the link: http://aspose.com/file-tools
     
    subject: Need help to write a bot to collect data from internet.