File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Analyzing massive data with Clojure

 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Here is an article about analyzing massive data with Clojure programming language:
https://github.com/jonase/mlx/wiki/Analyzing-Stack-Overflow-data
The article comes in the right time as I'm about to start to code something similar.
 
Sean Corfield
Ranch Hand
Posts: 290
9
Clojure Linux Mac OS X
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I just wrote a program to read PowerMTA accounting files and record email bounces. Clojure's lazy data structures make it possible to process large amounts of data in very reasonable amounts of memory - and pretty fast too. In less than 140 lines of very well-commented Clojure, I have a complete email event processing library and it can process 450,000 lines of CSV file, extract 46,000 bouncing emails and record their status in MySQL, in about 80 seconds. I continue to be more and more impressed by Clojure...
 
Hussein Baghdadi
clojure forum advocate
Bartender
Posts: 3479
Clojure Mac Objective C
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Clojure is a "44 Magnum Revolver" when it comes to parsing and analyzing massive data. Absolutely stunning.
 
It is sorta covered in the JavaRanch Style Guide.
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic