Configure Common Dimensions

This page describes an optional step to configure Common Dimensions for the Cortex Framework Data Foundation deployment. Cortex Framework Common Dimensions are utility views and tables created within the Data Foundation to enable advanced use cases across different data sources, such as Cross Media & Product Connected Insights.

Configuration for all Common Dimensions are under the k9 section of the configuration file.

Country Dimension

Cortex Framework country dimension provides a unified way of connecting ISO-3166 country codes to their respective long names.

To enable it, set k9.deployCountryDim to true in the configuration file.

Product Hierarchy Dimension

Product Hierarchy Dimension provides an abstract schema that allows ingesting the source data from any arbitrary source. It can then be used in fueling advanced use cases such as product hierarchy matching.

Cortex Framework also provides a sample ingestion DAG if you have a SAP deployment ready.

To enable it, set k9.deployProductDim to true in the configuration file. Then configure the following settings:

Parameter Meaning Default Value
k9.ProductDim.dataSourceType Data source type for the product hierarchy.
If set to "SAP", Data Foundations will deploy a DAG that loads product hierarchy from the SAP data source. If this is the case, SAP deployment must be enabled.
If you are using other data sources, set this value to BYOD and you may then populate the product hierarchy table manually.
SAP
k9.ProductDim.textLanguage Language of product hierarchy. It should follow the same language code convention from the data source. Cortex Framework doesn´t prescribe this convention. However, customers should understand the meaning of their chosen textLanguage value.
If using SAP, the value must also be one of the SAP.languages settings within the current config.json.
This value can't be empty.
E

Ingesting product hierarchy dimension data from SAP

If you have specified k9.ProductDim.dataSourceType to SAP and deployed SAP, you may use the load_product_hierarchy_from_SAP DAG to load SAP hierarchy, after you have fully populated your SAP Reporting views. Make sure to properly configure the k9_reporting Cloud Composer connection.

Ingesting product hierarchy dimension data from other sources

You may also manually ingest product hierarchy information from other sources of your choosing (for example, Google product category). Make sure the data conforms to the schema of ProductHierarchy table.

Currency Conversion

Currency Conversion provides an abstract schema that allows ingesting the source data from any arbitrary source. It can then be used in fueling advanced use cases for other data sources that don't provide currency conversion capability out-of-the-box.

Cortex Framework also provides a sample ingestion DAG if you have a SAP deployment ready. To enable it, set k9.deployCurrencyConversion to true in the configuration file. Then configure the following settings:

Parameter Meaning Default Value
k9.CurrencyConversion.dataSourceType Data source type for the product hierarchy.
If set to "SAP", Data Foundations will deploy a DAG that loads currency conversion rates from the SAP data source. If this is the case, SAP deployment must be enabled.
If you are using other data sources, set this value to BYOD and you may then populate the currency conversion table manually.
SAP
k9.CurrencyConversion.rateType Default currency conversion rate type as defined in the source system.
If you are using SAP, "M" corresponds to SAP default rate type.
This value can't be empty.
M

Ingesting currency conversion data from SAP

If you have specified k9.CurrencyConversion.dataSourceType to SAP and deployed SAP, you may use the load_currency_conversion_from_SAP DAG to load SAP currency conversion rates, after you have fully populated your SAP Reporting views. Make sure to properly configure the k9_reporting Cloud Composer connection.