Win a copy of Re-engineering Legacy Software this week in the Refactoring forum
or Docker in Action in the Agile forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Need help to write a bot to collect data from internet.

 
athrun itachi
Greenhorn
Posts: 4
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi everyone,

I need to write a program to do the following features.

-connect to the net at regular schedule timing
-collect the data at the website.

May i know which library i should use?


Thanks in advance.
 
Paul Sturrock
Bartender
Posts: 10336
Eclipse IDE Hibernate Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
You'll propably find the following useful:
  • java.util.Timer & java.util.TimerTask
  • java.net.*
  • java.util.regex (assuming you are looking for specific data, rather than just the whole page)

  •  
    athrun itachi
    Greenhorn
    Posts: 4
    • Mark post as helpful
    • send pies
    • Quote
    • Report post to moderator
    Thanks Paul!

    What should i use if i would like to store the info collected in a database?
     
    Paul Clapham
    Sheriff
    Pie
    Posts: 20750
    30
    Eclipse IDE Firefox Browser MySQL Database
    • Mark post as helpful
    • send pies
    • Quote
    • Report post to moderator
    JDBC.
     
    Rob Spoor
    Sheriff
    Pie
    Posts: 20495
    54
    Chrome Eclipse IDE Java Windows
    • Mark post as helpful
    • send pies
    • Quote
    • Report post to moderator
    Combined with java.sql
     
    • Post Reply
    • Bookmark Topic Watch Topic
    • New Topic