aspose file tools*
The moose likes Performance and the fly likes High Traffic website Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Java » Performance
Bookmark "High Traffic website" Watch "High Traffic website" New topic
Author

High Traffic website

Dinakar Kas
Ranch Hand

Joined: Jul 11, 2010
Posts: 34
Hi all,

we are expecting a project which has high number of concurrent requests. The application will have 5 million registered users and approximate number of users online at a time is around 100,000. The business logic is not complex. But handling the traffic is our problem. Can any one let me know the strategies in implementing such a web site.

Thanks,
Dinakar.K
Tim Holloway
Saloon Keeper

Joined: Jun 25, 2001
Posts: 15641
    
  15

Bring money.

For that many concurrent users, you'll need load balancers, clustered servers, redundant resources and almost certainly some very powerful database servers. You'll need infrastructure such as climate-controlled computer rooms (and it's a good idea to have several geographically separate sites), UPS's and power conditioners. You'll need good Internet connections and you'll need tools that can monitor for system degradation and outages. You'll need a good Business Continuity plan and someone to administer it. You'll need trained operations personnel. You'll need security staff - both for physical security and data security.

This is the era of Cloud Computing and outsourcing, so you have the option of renting out a lot of these things from third parties. However, if you do, bear in mind that you'll then be hostage to your outsourcers for critical resources. If they decide you're not interesting enough or if another customer outbids you for service levels, you could suffer. Outsource solution providers will never have the financial or emotional stake in the product that your own company will. Nor will they have the overall expertise in the product, hopefully. Otherwise they could always decide that you're completely redundant and may end up becoming your biggest competitor.


Customer surveys are for companies who didn't pay proper attention to begin with.
Dinakar Kas
Ranch Hand

Joined: Jul 11, 2010
Posts: 34
Thanks Tim,

By clustered servers, do you mean clustered application servers or clustered database servers or both? Can you explain what do you mean by redundant resources? and can you give me names of "very powerful database servers"?

Also, the number of users that I have mentioned will not be using the site from day one. It's only that the web site should scale to those many users as time goes on.

Can you please give me suggestions with the technology selection?

Thanks,
Dinakar.K
Paul Sturrock
Bartender

Joined: Apr 14, 2004
Posts: 10336

I'd second Tim's first suggestion.

With regards to clustered servers, given the very large volumes you are talking about I'd say both. The usual big players are the ones most people look at, e.g. Oracle RAC on pretty meaty hardware.


JavaRanch FAQ HowToAskQuestionsOnJavaRanch
Tim Holloway
Saloon Keeper

Joined: Jun 25, 2001
Posts: 15641
    
  15

Dinakar Kas wrote:Thanks Tim,

By clustered servers, do you mean clustered application servers or clustered database servers or both? Can you explain what do you mean by redundant resources? and can you give me names of "very powerful database servers"?

Also, the number of users that I have mentioned will not be using the site from day one. It's only that the web site should scale to those many users as time goes on.

Can you please give me suggestions with the technology selection?

Thanks,
Dinakar.K


Both. Redundant resources means more than one rack, preferably in more than one location. A hotsite is also a good options in case of failure.

As far as "very powerful" Database servers go, IBM will quite happily sell you a set of z systems. Oracle has a hardware line, which has undoubtedly further enhanced by their acquisition of Sun. I believe HP has a set of boxes designed to host databases. The usual suspects, in other words.

Blade servers are popular for web hosting.

But do budget for electricity. Some racks can pull 24 kW or more, and that's as much as a whole neighbourhood of houses typically uses.

More specific I can't be. It depends on a number of factors, and it's not exactly something I can do for free.
Wouter Oet
Saloon Keeper

Joined: Oct 25, 2008
Posts: 2700

I would also get (a lot of) people involved that know what they're talking about, who have done this before.


"Any fool can write code that a computer can understand. Good programmers write code that humans can understand." --- Martin Fowler
Please correct my English.
Dinakar Kas
Ranch Hand

Joined: Jul 11, 2010
Posts: 34
Thanks Paul, Tim, and Wouter,

I would also get (a lot of) people involved that know what they're talking about, who have done this before.


That is what I am trying to do.

More specific I can't be. It depends on a number of factors, and it's not exactly something I can do for free.




Just one question more,

Can I start the project using traditional Java Technologies such as a web framework, EJB/JPA combination, and Lucene for some of the searches in the documents. Will they be able to scale as I add more hardware?

Really appreciate the help.

Thanks,
Dinakar.K

Tim Holloway
Saloon Keeper

Joined: Jun 25, 2001
Posts: 15641
    
  15

As a platform, Java often gets criticized because it's expensive to develop for. Unlike the trendy scripting-based platforms so much in vogue at the moment, you can't just "Git 'R Dun!", you have to engage in a certain amount of planning and setup.

However, the payback comes in security, reliability and performance. Scalability has always been a major consideration in the design of Enterprise Java technologies.
Dinakar Kas
Ranch Hand

Joined: Jul 11, 2010
Posts: 34
Thanks Tim,

Thanks a lot. I think I got some answers and I will do some research before we zero-in on some thing.

Wonderful experience talking to you all.

Dinakar.K
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: High Traffic website
 
Similar Threads
high traffic websites
Yet another record
What exactly is a high traffic website??
100000 concurrent users
Clash of Civilizations!!