| Author |
Analyzing massive data with Clojure
|
Hussein Baghdadi
clojure forum advocate
Bartender
Joined: Nov 08, 2003
Posts: 3359
|
|
Here is an article about analyzing massive data with Clojure programming language:
https://github.com/jonase/mlx/wiki/Analyzing-Stack-Overflow-data
The article comes in the right time as I'm about to start to code something similar.
|
 |
Sean Corfield
Ranch Hand
Joined: Feb 09, 2011
Posts: 193
|
|
|
I just wrote a program to read PowerMTA accounting files and record email bounces. Clojure's lazy data structures make it possible to process large amounts of data in very reasonable amounts of memory - and pretty fast too. In less than 140 lines of very well-commented Clojure, I have a complete email event processing library and it can process 450,000 lines of CSV file, extract 46,000 bouncing emails and record their status in MySQL, in about 80 seconds. I continue to be more and more impressed by Clojure...
|
 |
Hussein Baghdadi
clojure forum advocate
Bartender
Joined: Nov 08, 2003
Posts: 3359
|
|
|
Clojure is a "44 Magnum Revolver" when it comes to parsing and analyzing massive data. Absolutely stunning.
|
 |
 |
|
|
subject: Analyzing massive data with Clojure
|
|
|