Data Layers

Bronze / Source of Records - Ingestion

Ingest data from several sources into a raw data layer.

Silver / Source of Truth - Harmonization

Transform and clean the raw data into a standardized format in the harmonized data layer.

Examples of transformations include:

• Data type conversions
• Handling missing values
• Normalization

Gold / Spec - Specialization

Tailor the harmonized data for specific use cases or business needs in the specialized data layer.

Examples of specialization include:

• Adding calculated fields
• Filtering data for specific analyses
• Aggregating data for reporting