permaculture playing cards
The moose likes Ranch Office and the fly likes How do you store these many posts Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » This Site » Ranch Office
Bookmark "How do you store these many posts" Watch "How do you store these many posts" New topic

How do you store these many posts

Joe Harry
Ranch Hand

Joined: Sep 26, 2006
Posts: 10032

I guess the database for javaranch would be huge as we have many many posts across different forums and this multiplied with the number of users at any given point of time.

Moderators any comment on this?

SCJP 1.4, SCWCD 1.4 - Hints for you, Certified Scrum Master
Did a rm -R / to find out that I lost my entire Linux installation!
Akhilesh Trivedi
Ranch Hand

Joined: Jun 22, 2005
Posts: 1599
Its not just having the huge database, it is also transacting... and transacting faster on the same. Kudos to ranch.

Keep Smiling Always — My life is smoother when running silent. -paul
[FAQs] [Certification Guides] [The Linux Documentation Project]
Jeanne Boyarsky
author & internet detective

Joined: May 26, 2003
Posts: 33122

As point out in another thread, JavaRanch uses flat files, not a database.

While I would expect it to be large, keep in mind the data is just text - not attachments. This makes the memory requirements significantly smaller than say an e-mail system.

[OCA 8 book] [Blog] [JavaRanch FAQ] [How To Ask Questions The Smart Way] [Book Promos]
Other Certs: SCEA Part 1, Part 2 & 3, Core Spring 3, TOGAF part 1 and part 2
Ulf Dittmer

Joined: Mar 22, 2005
Posts: 42965
I'm not sure what multiplying the number of posts with the number of users accomplishes (maybe that was just a figure of speech?), but by now we have something like 370.000 discussion threads (and thus a multiple of that in individual posts).

The raw number of posts is not really a problem, as most of them are old and inactive. On any given day there are usually no more than around 400 active topics. Over time, the posts do take up more storage, but with storage costs being what they are these days, that's not something to worry about. What will degrade over time is searching through the archive of posts. Let's hope that the algorithms used by Lucene get better faster than the search is getting slower through an increasing number of posts...
Ernest Friedman-Hill
author and iconoclast

Joined: Jul 08, 2003
Posts: 24199

Some technical details on how JavaRanch stores its forum data is offered in this thread.

[Jess in Action][AskingGoodQuestions]
I agree. Here's the link:
subject: How do you store these many posts
It's not a secret anymore!