aspose file tools*
The moose likes Ranch Office and the fly likes How do you store these many posts Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of JavaScript Promises Essentials this week in the JavaScript forum!
JavaRanch » Java Forums » This Site » Ranch Office
Bookmark "How do you store these many posts" Watch "How do you store these many posts" New topic
Author

How do you store these many posts

Joe Harry
Ranch Hand

Joined: Sep 26, 2006
Posts: 9495
    
    2

I guess the database for javaranch would be huge as we have many many posts across different forums and this multiplied with the number of users at any given point of time.

Moderators any comment on this?


SCJP 1.4, SCWCD 1.4 - Hints for you, Certified Scrum Master
Did a rm -R / to find out that I lost my entire Linux installation!
Akhilesh Trivedi
Ranch Hand

Joined: Jun 22, 2005
Posts: 1531
Its not just having the huge database, it is also transacting... and transacting faster on the same. Kudos to ranch.


Keep Smiling Always — My life is smoother when running silent. -paul
[FAQs] [Certification Guides] [The Linux Documentation Project]
Jeanne Boyarsky
author & internet detective
Marshal

Joined: May 26, 2003
Posts: 30894
    
158

Jothi,
As point out in another thread, JavaRanch uses flat files, not a database.

While I would expect it to be large, keep in mind the data is just text - not attachments. This makes the memory requirements significantly smaller than say an e-mail system.


[Blog] [JavaRanch FAQ] [How To Ask Questions The Smart Way] [Book Promos]
Blogging on Certs: SCEA Part 1, Part 2 & 3, Core Spring 3, OCAJP, OCPJP beta, TOGAF part 1 and part 2
Ulf Dittmer
Marshal

Joined: Mar 22, 2005
Posts: 42585
    
  65
I'm not sure what multiplying the number of posts with the number of users accomplishes (maybe that was just a figure of speech?), but by now we have something like 370.000 discussion threads (and thus a multiple of that in individual posts).

The raw number of posts is not really a problem, as most of them are old and inactive. On any given day there are usually no more than around 400 active topics. Over time, the posts do take up more storage, but with storage costs being what they are these days, that's not something to worry about. What will degrade over time is searching through the archive of posts. Let's hope that the algorithms used by Lucene get better faster than the search is getting slower through an increasing number of posts...


Ping & DNS - my free Android networking tools app
Ernest Friedman-Hill
author and iconoclast
Marshal

Joined: Jul 08, 2003
Posts: 24187
    
  34

Some technical details on how JavaRanch stores its forum data is offered in this thread.


[Jess in Action][AskingGoodQuestions]
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: How do you store these many posts