File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes OO, Patterns, UML and Refactoring and the fly likes OSGI for big data Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Engineering » OO, Patterns, UML and Refactoring
Bookmark "OSGI for big data" Watch "OSGI for big data" New topic

OSGI for big data

William Stephens

Joined: Dec 13, 2007
Posts: 16

I work in the beg data realm of healthcare. We're looking at potential architectures for our next wave of development and OSGI is on the list of potential technologies to solve one of our biggest problems: sharing and analysis of large data. PLease let me know if I'm totally off the wall here...

It would seem possible to build a Java application that could use OSGI to integrate externally developed and shared analysis "plugins". This could get us beyond sending boxes full of hard drives of genomic data between researchers. Instead, these (trusted) researchers implement their analysis tools and share them over the network. This also allows us to maintain full control over our data.

Thanks for any thoughts,
Bill S.
Ulf Dittmer

Joined: Mar 22, 2005
Posts: 42965
So it's not so much OSGi for big data, but OSGi for plugin code separation. That's a perfect application for OSGi, but OSGi is a big hammer whichever way you look at it. A few years ago I had written about something on a smaller level that may give you some ideas:
Kirk Knoernschild
Ranch Hand

Joined: Apr 16, 2012
Posts: 41
Hello Bill,

Ulf is spot on. The benefit of OSGi, as you describe the requirements, is to help you develop a plug-in architecture. That's definitely a sweet spot for OSGi. Other benefits you'll get out of OSGi include dependency management, hot deploys, versioning, etc. See my other reply for more details on the benefits.

Visit the book's website at where you can review all 18 patterns and download an excerpt of the book. There is also a mobile web application available that you can take with you wherever you go.

William Stephens

Joined: Dec 13, 2007
Posts: 16

Right, the plugin approach is what I'm looking for to deal with the issue of sending the analysis to the data.

Thanks for the link

Jignesh Patel
Ranch Hand

Joined: Nov 03, 2001
Posts: 626


For the sack of POC I have used JBoss 7.x(which has OSGI container) and HBase and integrated them. Though for the web application I have not used OSGI, the concept is very valid. You can deploy OSGI in the container and connect with Big Data(I don't know which DB you planning to choose). I choose JBoss as I plan to use it as more of an ESB then just a container. In normal situation Felix will work too.

I agree. Here's the link:
subject: OSGI for big data
It's not a secret anymore!