• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Ron McLeod
  • Liutauras Vilda
  • Paul Clapham
  • paul wheaton
Sheriffs:
  • Tim Cooke
  • Devaka Cooray
  • Rob Spoor
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Tim Moores
  • Carey Brown
  • Mikalai Zaikin
Bartenders:

Can Data Warehouse store the data during ETL process?

 
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
May I ask if Data Warehouse is the place to store the data after passing the ETL process or does it contain the data during the ETL process too?
When I searched on the internet some sites said that Data Warehouse is the place to contain the Data after the ETL process (Data after processing, ready to Analysis), while some sites said that Data during the ETL process is also stored in Data  Warehouse (Data is currently processing).
 
Rancher
Posts: 1088
29
Netbeans IDE Oracle MySQL Database Tomcat Server C++ Java
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
the way i choose to run my projects are that i have work databases that contains all the process and the resultant curated data, then the "data repository" is a separate data only database where the production ready data is copied after it has been certified production ready.  it is a matter of choice, but i prefer the separation of work and production ready data.
 
Saloon Keeper
Posts: 7547
176
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I think the first question to ask yourself is: "What -in your mind- is a data warehouse?"
 
Saloon Keeper
Posts: 27478
195
Android Eclipse IDE Tomcat Server Redhat Java Linux
  • Likes 2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Welcome to the Ranch!

ETL stands for Extract, Transform, Load. Normally ETL acts as a pipeline process, where data is extracted from some source(s), may be validated, normalized or otherwise transformed (including lookup up table codes), and ultimately stored in a destination(s).

ETL can work with spreadsheets, databases, Amazon S3 storage or just about any other persistent data repository you can think of for both sources and destinations.

So, no, ETL would not normally consider a data warehouse to be an intermediate stage in an ETL process. In fact, it would more likely to be a source and/or destination. You might have a separate ETL process that later extracts from that warehouse for loading into another destination, but not simply as a mid-point in a single run.
 
It is difficult to free fools from the chains they revere - Voltaire. tiny ad:
a bit of art, as a gift, the permaculture playing cards
https://gardener-gift.com
reply
    Bookmark Topic Watch Topic
  • New Topic