aspose file tools*
The moose likes OO, Patterns, UML and Refactoring and the fly likes architecture for applications handling large objects Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Engineering » OO, Patterns, UML and Refactoring
Bookmark "architecture for applications handling large objects " Watch "architecture for applications handling large objects " New topic
Author

architecture for applications handling large objects

Fabio Medeiros Faria
Greenhorn

Joined: Mar 18, 2011
Posts: 10


Some kinds of applications, such as medical, needs storage big images and videos in database.

I would like to know if there are any kind of design or architecture to provide better perfrmance and better handling of resources.
Kirk Knoernschild
author
Ranch Hand

Joined: Apr 16, 2012
Posts: 41
I'm sure there is, but I've not had to deal with the scenario personally. So I can't help on this one.

Visit the book's website at modularity.kirkk.com where you can review all 18 patterns and download an excerpt of the book. There is also a mobile web application available that you can take with you wherever you go.

--kirk
Twitter: @pragkirk

Fabio Medeiros Faria
Greenhorn

Joined: Mar 18, 2011
Posts: 10

tks Kirk by rapid response

My frequently problems are out of memory. Many files has more 50MB...

I will download the files, tks!
William P O'Sullivan
Ranch Hand

Joined: Mar 28, 2012
Posts: 859

In this environment, since Kirk's fine book addresses correct concepts and patterns,

you would definitely have to use some form of CMS (Content mangement System) optimized
for large files (videos, scans etc..) and rapid keyword-based retrieval.

Kirks concepts and rules are still valid, simply apply to your own requirements and needs.

For instance, some of us build applications for finance (e.g: building a bank),
you seem to be building a hospital. Same architectural concepts, foundation etc.. but different.
Would you walk into a bank with a chest-pain ?


WP
Jayesh A Lalwani
Bartender

Joined: Jan 17, 2008
Posts: 2333
    
  28

I wouldn't call 50MB as large. 50MB file can easily fit into memory. Now, if you are trying to load 20 such files together , you might run into a problem . I would call data as large only when it exceeds the memory limit of the Java process, which is 2GB on 32 bit OS. On 64 bit Java, this limit is much larger.
William P O'Sullivan
Ranch Hand

Joined: Mar 28, 2012
Posts: 859

True to an extent, my cell phones internal memory has around 20 times 50Mb.

However, when 1000s of these are being stored (quite possible in medical field),
and the doctor or whoever needs accuracy and performance in searching, then a CMS is a definitive!

You cannot simply issue a select like:

select xray_image from xrays where xray_image like clob('WPOSullivan Colon'); ... I think my colon is fine!


WP
Ank Sri
Greenhorn

Joined: Apr 09, 2007
Posts: 3
I think your problem is that possibly you are handling more files than your application can handle at a time. So you would need to limit the number of files you get into the memory at any time based on the memory you have with your VM. If your application needs are more than what can be handled by the VM then you can think of these two options
a. Increase the VM size. If you are using 32 bit VM you can not go beyond 3gb, so you would need to migrate to 64 bit VM
b. Other option is to cluster your application.

Hope this helps!!


---
Ankur Srivastava
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: architecture for applications handling large objects