• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Timeseries Charts data every 5 Seconds?

 
Ranch Hand
Posts: 2234
Eclipse IDE Firefox Browser Redhat
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi ,

We have Time Series data for every 5 Seconds .
Now you can assume what will be the Data for a single day ??

We have a requirement of showing a graph/ chart for a Whole Month .

(For example a user selects a Month from Jan 1st 2011 to Jan 31st 2011 )

The data loaded might be too heavy and it may degrade the applications performance or make it Out of Memory .

How can we handle this requirement ??

The Flotr API uses this method to draw the Charts , which requires the data to be already loaded .




Please suggest , Thank you very much .

 
Greenhorn
Posts: 16
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Aggregate the data, instead of reporting every 5 second report ever X amount of minutes. Unless the graph is HUGE the users won't be able to notice that the data has been aggregated. If the need to drill down onto seconds just re render the chart with that data set (filter data for example that day).
 
Ranch Hand
Posts: 781
Netbeans IDE Ubuntu Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
A data point every 5 seconds for a month is about half a million points. Assuming that your axis length is about 1000 pixels then, if plotted directly, each pixel will need to display about 500 points. Rather cluttered at best and not very informative to users.

A few years ago when I was dealing with data in these quantities we (that is the team I was working with) actually plotted 3 lines on each chart. We broke the time period into about 500 fixed width periods and then for each period we calculated the average, the minimum and the maximum value and plotted these as three lines on one chart using 3 different colours using the mid value of each period for the X value. Very very effective and very very fast since computing the average, min and max is very quick.

 
Consider Paul's rocket mass heater.
reply
    Bookmark Topic Watch Topic
  • New Topic