aspose file tools
The moose likes Beginning Java and the fly likes Need help to write a bot to collect data from internet. Big Moose Saloon
  Search | Java FAQ | Recent Topics
Register / Login


Win a copy of The Mikado Method this week in the Agile and other Processes forum!
JavaRanch » Java Forums » Java » Beginning Java
Reply Bookmark "Need help to write a bot to collect data from internet." Watch "Need help to write a bot to collect data from internet." New topic
Author

Need help to write a bot to collect data from internet.

athrun itachi
Greenhorn

Joined: Apr 23, 2005
Posts: 4
Hi everyone,

I need to write a program to do the following features.

-connect to the net at regular schedule timing
-collect the data at the website.

May i know which library i should use?


Thanks in advance.
Paul Sturrock
Bartender

Joined: Apr 14, 2004
Posts: 10336

You'll propably find the following useful:
  • java.util.Timer & java.util.TimerTask
  • java.net.*
  • java.util.regex (assuming you are looking for specific data, rather than just the whole page)


  • JavaRanch FAQ HowToAskQuestionsOnJavaRanch
    athrun itachi
    Greenhorn

    Joined: Apr 23, 2005
    Posts: 4
    Thanks Paul!

    What should i use if i would like to store the info collected in a database?
    Paul Clapham
    Bartender

    Joined: Oct 14, 2005
    Posts: 16483
        
        2

    JDBC.
    Rob Spoor
    Sheriff

    Joined: Oct 27, 2005
    Posts: 19216

    Combined with java.sql


    SCJP 1.4 - SCJP 6 - SCWCD 5
    How To Ask Questions How To Answer Questions
     
    I agree. Here's the link: http://ej-technologies/jprofiler - if it wasn't for jprofiler, we would need to run our stuff on 16 servers instead of 3.
     
    subject: Need help to write a bot to collect data from internet.
     
    Similar Threads
    Data Mining
    sun sign ##
    what is the best method to sort strings in real time or off line ?
    how to write the data from text fields of my swing application to an xml file dynamically?
    Eating the Beans with a side of Servlets