my dog learned polymorphism*
The moose likes Clojure and the fly likes Analyzing massive data with Clojure Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Murach's Java Servlets and JSP this week in the Servlets forum!
JavaRanch » Java Forums » Languages » Clojure
Bookmark "Analyzing massive data with Clojure" Watch "Analyzing massive data with Clojure" New topic
Author

Analyzing massive data with Clojure

Hussein Baghdadi
clojure forum advocate
Bartender

Joined: Nov 08, 2003
Posts: 3476

Here is an article about analyzing massive data with Clojure programming language:
https://github.com/jonase/mlx/wiki/Analyzing-Stack-Overflow-data
The article comes in the right time as I'm about to start to code something similar.
Sean Corfield
Ranch Hand

Joined: Feb 09, 2011
Posts: 252
    
    5

I just wrote a program to read PowerMTA accounting files and record email bounces. Clojure's lazy data structures make it possible to process large amounts of data in very reasonable amounts of memory - and pretty fast too. In less than 140 lines of very well-commented Clojure, I have a complete email event processing library and it can process 450,000 lines of CSV file, extract 46,000 bouncing emails and record their status in MySQL, in about 80 seconds. I continue to be more and more impressed by Clojure...
Hussein Baghdadi
clojure forum advocate
Bartender

Joined: Nov 08, 2003
Posts: 3476

Clojure is a "44 Magnum Revolver" when it comes to parsing and analyzing massive data. Absolutely stunning.
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Analyzing massive data with Clojure
 
Similar Threads
Joy of Clojure - Questions
When to use Clojure ?
Taking the Next Step
Pragpub magazines with special Clojure issue
Performance and Scalability