This week's book giveaway is in the Big Data forum.
We're giving away four copies of Elasticsearch in Action and have Radu Gheorghe & Matthew Lee Hinman on-line!
See this thread for details.
The moose likes Tomcat and the fly likes Throttling data miners(leechers) Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Elasticsearch in Action this week in the Big Data forum!
JavaRanch » Java Forums » Products » Tomcat
Bookmark "Throttling data miners(leechers)" Watch "Throttling data miners(leechers)" New topic

Throttling data miners(leechers)

Jayesh A Lalwani

Joined: Jan 17, 2008
Posts: 2517

So, we have this yellow pages search website, that is basically open access. There is no login/password security, and we don;t want to force our users to register on the site to use it. Basically, any person that needs information should be able to go in and find a business

What we don't want is automated scripts trawling our website and leeching data out of it. Granted, we can't stop everyone, but we want to place limits on how many requests users can place on the website. So, even if a leecher wants to extract data out of us, the leecher should be well behaved and not overwhelm the system with requests

So, my question is can I use apache to throttle the number of requests from the same IP address? I know I can do it in my servlet, but I would rather do it before the request comes to the servlet. I know I can use apache to block IP addresses all together, but is throttling possible?
I agree. Here's the link:
subject: Throttling data miners(leechers)