• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

storing/retrieving many large double[] arrays

 
Ranch Hand
Posts: 18944
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Greetings,
As the title reads, I have to manage many (> 20000) large double[] arrays (length > 100000). These arrays represent measured power consumption values (KWh) with an interval of approx. five minutes.
These array values are used for billing purposes as well as near future power consumption forecasts. These arrays have to be stored in an RDBMS, notably Oracle comes to mind. Object databases are out of the question, because our customers don't even know what these things are ...
I am not an SQL/RDBMS expert; I'm a mathematician I have to confess, so basically I know nothing at all My question boils down to this: how can I store/retrieve/update these arrays as efficiently as possible?
I've been reading my way into BLOBS. Saving/loading a double[] array into a blob is a two step process: wrapping a DataOutputStream around a ByteArrayOutputStream, hooked up to a BLOB does the job, but somehow I feel that this is going to be slow.
OTOH, most (all?) of those RDBMS's implement an 'ARRAY' type; are these ARRAYs resizable? They need to be, because newly measured data have to be appended to the existing 'vectors' of data. If these arrays aren't resizable, they're useless for my purposes, but if they aren't could they be a solution to my problem?
I'm a bit stuck at the moment, so I'd really appreciate tips, hints, solutions, anything.
thanks in advance and kind regards,
Jos
 
Don't get me started about those stupid light bulbs.
reply
    Bookmark Topic Watch Topic
  • New Topic