Data warehouse
Data warehouse
A data warehouse is a centralized repository that stores integrated data from multiple sources for reporting, analysis, and business intelligence purposes. Unlike operational databases optimized for transaction processing, data warehouses are designed to support complex queries and historical trend analysis. They typically employ a schema such as star or snowflake to organize data into facts and dimensions.
Data warehouses are a core component of many organizations' decision support systems. They enable users to extract meaningful insights by consolidating data from disparate operational systems, such as CRM software, ERP systems, and external sources. The data is often cleaned, transformed, and loaded via processes known as Extract, Transform, Load (ETL). Modern data warehouses may also incorporate data lake technologies, though traditional distinctions between the two persist.
Features
- Subject-oriented: Data is organized around key business subjects (e.g., sales, finance, inventory) rather than application-specific processes.
- Integrated: Data from heterogeneous sources is unified through consistent naming conventions, measurement units, and coding structures.
- Time-variant: Data warehouses maintain historical snapshots, typically with a time dimension, allowing analysis of changes over time.
- Non-volatile: Data is read-only once loaded; updates occur only during the ETL cycle, preserving a stable historical record.
History
The concept of data warehousing emerged in the 1980s as organizations sought to separate analytical workloads from high-volume transaction processing. Bill Inmon is often credited with formalizing the data warehouse as a subject-oriented, integrated, non-volatile, time-variant collection of data. An alternative approach, the dimensional modeling methodology by Ralph Kimball, popularized star schemas and conformed dimensions. The field evolved with the rise of Online Analytical Processing (OLAP) tools and business intelligence suites. In the 2010s, cloud-based data warehouses such as Amazon Redshift, Google BigQuery, and Snowflake gained prominence, offering scalable, elastic, and managed solutions.