This week's giveaway is in the EJB and other Java EE Technologies forum.
We're giving away four copies of EJB 3 in Action and have Debu Panda, Reza Rahman, Ryan Cuprak, and Michael Remijan on-line!
See this thread for details.
The moose likes Ranch Office and the fly likes How do you store these many posts Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of EJB 3 in Action this week in the EJB and other Java EE Technologies forum!
JavaRanch » Java Forums » This Site » Ranch Office
Bookmark "How do you store these many posts" Watch "How do you store these many posts" New topic
Author

How do you store these many posts

Joe Harry
Ranch Hand

Joined: Sep 26, 2006
Posts: 9243
    
    1

I guess the database for javaranch would be huge as we have many many posts across different forums and this multiplied with the number of users at any given point of time.

Moderators any comment on this?


SCJP 1.4, SCWCD 1.4 - Hints for you, SCBCD Hints - Demnachst, SCDJWS - Auch Demnachst
Did a rm -R / to find out that I lost my entire Linux installation!
Akhilesh Trivedi
Ranch Hand

Joined: Jun 22, 2005
Posts: 1511
Its not just having the huge database, it is also transacting... and transacting faster on the same. Kudos to ranch.


Keep Smiling Always — My life is smoother when running silent. -paul
[FAQs] [Certification Guides] [The Linux Documentation Project]
Jeanne Boyarsky
internet detective
Marshal

Joined: May 26, 2003
Posts: 29220
    
135

Jothi,
As point out in another thread, JavaRanch uses flat files, not a database.

While I would expect it to be large, keep in mind the data is just text - not attachments. This makes the memory requirements significantly smaller than say an e-mail system.


[Blog] [JavaRanch FAQ] [How To Ask Questions The Smart Way] [Book Promos]
Blogging on Certs: SCEA Part 1, Part 2 & 3, Core Spring 3, OCAJP, OCPJP beta, TOGAF part 1 and part 2
Ulf Dittmer
Marshal

Joined: Mar 22, 2005
Posts: 39543
    
  27
I'm not sure what multiplying the number of posts with the number of users accomplishes (maybe that was just a figure of speech?), but by now we have something like 370.000 discussion threads (and thus a multiple of that in individual posts).

The raw number of posts is not really a problem, as most of them are old and inactive. On any given day there are usually no more than around 400 active topics. Over time, the posts do take up more storage, but with storage costs being what they are these days, that's not something to worry about. What will degrade over time is searching through the archive of posts. Let's hope that the algorithms used by Lucene get better faster than the search is getting slower through an increasing number of posts...


Ping & DNS - updated with new look and Ping home screen widget
Ernest Friedman-Hill
author and iconoclast
Marshal

Joined: Jul 08, 2003
Posts: 24166
    
  30

Some technical details on how JavaRanch stores its forum data is offered in this thread.


[Jess in Action][AskingGoodQuestions]
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: How do you store these many posts
 
Similar Threads
Sun Press' SCEA book?
Ernest Friedman-Hill Needs To Get A Life!
Lasse crosses 8K posts
Xie Le please respond.
Difference between Inner class and anonymous class