It's not a secret anymore!*
The moose likes Beginning Java and the fly likes Need help to write a bot to collect data from internet. Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Android Security Essentials Live Lessons this week in the Android forum!
JavaRanch » Java Forums » Java » Beginning Java
Bookmark "Need help to write a bot to collect data from internet." Watch "Need help to write a bot to collect data from internet." New topic
Author

Need help to write a bot to collect data from internet.

athrun itachi
Greenhorn

Joined: Apr 23, 2005
Posts: 4
Hi everyone,

I need to write a program to do the following features.

-connect to the net at regular schedule timing
-collect the data at the website.

May i know which library i should use?


Thanks in advance.
Paul Sturrock
Bartender

Joined: Apr 14, 2004
Posts: 10336

You'll propably find the following useful:
  • java.util.Timer & java.util.TimerTask
  • java.net.*
  • java.util.regex (assuming you are looking for specific data, rather than just the whole page)


  • JavaRanch FAQ HowToAskQuestionsOnJavaRanch
    athrun itachi
    Greenhorn

    Joined: Apr 23, 2005
    Posts: 4
    Thanks Paul!

    What should i use if i would like to store the info collected in a database?
    Paul Clapham
    Bartender

    Joined: Oct 14, 2005
    Posts: 18541
        
        8

    JDBC.
    Rob Spoor
    Sheriff

    Joined: Oct 27, 2005
    Posts: 19656
        
      18

    Combined with java.sql


    SCJP 1.4 - SCJP 6 - SCWCD 5 - OCEEJBD 6
    How To Ask Questions How To Answer Questions
     
    I agree. Here's the link: http://aspose.com/file-tools
     
    subject: Need help to write a bot to collect data from internet.
     
    Similar Threads
    how to write the data from text fields of my swing application to an xml file dynamically?
    what is the best method to sort strings in real time or off line ?
    Data Mining
    sun sign ##
    Eating the Beans with a side of Servlets