Turbo mode
This page describes an optional step to enable the Turbo Mode for
the Cortex Framework Data Foundation deployment. Google Cloud Cortex Framework offers the following two
deployment modes to consider when setting up your
data pipelines in the config.json
file.
Standard Mode (
turboMode=false
):This option is recommended if you are still making adjustments to your data source or suspect there might be mismatches between your views and the actual data tables. In this mode, the deployment process attempts to create all the defined views in your configuration, even if there are errors in some views. This might take longer, but it helps identify all potential issues (mismatches between views and tables) in a single run.
Turbo Mode (
turboMode=true
):This mode is for faster deployments once your data source configuration is done correctly. The deployment process dynamically generates a
cloudbuild.views.yaml
file with each view in the right dependencies file (for example,dependencies_ecc.txt
ordependencies_s4.txt
) as a single step of the build. This can significantly speed up deployment times (up to 10 times faster). However, the downside is that if there's an error in any view during deployment, the entire process stops. This might not be ideal for debugging purposes as you might need to rerun the deployment to identify the specific error.
The suggestion is to choose "Standard" for initial setup or troubleshooting, and "Turbo" for faster deployments later.