Dataform을 사용하여 BigQuery에서 실행하여 분석 목적으로 데이터를 변환할 수 있는 워크플로를 개발, 테스트, 버전 관리할 수 있습니다. SQLX 파일과 선택적 JavaScript 파일을 사용하거나 JavaScript를 사용하여 Dataform Core로 워크플로를 개발할 수 있습니다.
워크플로에서 재사용할 수 있는 변수 및 함수의 정의가 포함된 JavaScript 파일입니다.
워크플로 시각화
방향성 비순환 그래프 (DAG) 형식으로 시각화된 워크플로를 볼 수 있습니다. DAG에는 작업공간에 정의된 워크플로의 모든 객체와 객체 간의 관계가 표시됩니다. DAG에서 확대/축소하고 드래그 앤 드롭 탐색을 사용할 수 있습니다. 워크플로에 컴파일 오류가 있으면 Dataform에 DAG 대신 오류 메시지가 표시됩니다.
워크플로의 DAG를 보려면 작업공간에서 컴파일된 그래프를 클릭합니다.
워크플로 실행
개발 작업공간에서 전체 워크플로, 선택한 작업 또는 선택한 태그의 실행을 수동으로 트리거할 수 있습니다.
Dataform 출시 구성 및 워크플로 구성으로 실행을 예약할 수 있습니다.
먼저 출시 구성을 만들어 저장소의 컴파일 결과를 만듭니다. 그런 다음 워크플로 구성을 만들고, 출시 구성을 선택하고, 실행할 워크플로 작업을 선택하고, 실행 일정을 설정합니다.
[[["이해하기 쉬움","easyToUnderstand","thumb-up"],["문제가 해결됨","solvedMyProblem","thumb-up"],["기타","otherUp","thumb-up"]],[["이해하기 어려움","hardToUnderstand","thumb-down"],["잘못된 정보 또는 샘플 코드","incorrectInformationOrSampleCode","thumb-down"],["필요한 정보/샘플이 없음","missingTheInformationSamplesINeed","thumb-down"],["번역 문제","translationIssue","thumb-down"],["기타","otherDown","thumb-down"]],["최종 업데이트: 2025-09-04(UTC)"],[[["\u003cp\u003eDataform enables the development, testing, and version control of SQL workflows for data transformation in BigQuery.\u003c/p\u003e\n"],["\u003cp\u003eSQL workflows in Dataform consist of objects like data source declarations, tables, assertions, custom SQL operations, and includes.\u003c/p\u003e\n"],["\u003cp\u003eDataform visualizes SQL workflows as a Directed Acyclic Graph (DAG), displaying the objects and their relationships.\u003c/p\u003e\n"],["\u003cp\u003eYou can execute SQL workflows manually, or schedule them using release and workflow configurations, Cloud Composer, or Workflows and Cloud Scheduler.\u003c/p\u003e\n"],["\u003cp\u003eDataform allows for the customization of execution settings using compilation overrides and tags, creating isolated execution environments for workspaces.\u003c/p\u003e\n"]]],[],null,["# Overview of workflows\n\nThis document helps you understand the architecture and execution of\nworkflows in Dataform.\n\nYou can use Dataform to develop, test, and version control\nworkflows that you can run in BigQuery to transform data for\nanalytics purposes. You can develop workflows with\n[Dataform core](/dataform/docs/overview#dataform-core), using SQLX files and\noptionally JavaScript files, or with [JavaScript](/dataform/docs/javascript-in-dataform).\n\nA workflow can consist of the following objects:\n\n[Data source declarations](/dataform/docs/declare-source)\n: Declarations of BigQuery data sources that let you reference these\n data sources in Dataform table definitions and SQL operations.\n\n[Tables](/dataform/docs/create-tables)\n: Tables that you create in Dataform based on the declared\n data sources or other tables in your workflow. Dataform supports\n the following table types: table, incremental table, view, and materialized view.\n\n[Assertions](/dataform/docs/assertions)\n: Data quality test queries that you can use to validate table data.\n Dataform runs assertions every time it updates your workflow\n and it alerts you if any assertions fail.\n\n[Custom SQL operations](/dataform/docs/custom-sql)\n: SQL statements that Dataform runs in BigQuery as they are,\n without modification.\n\n[Includes](/dataform/docs/javascript-in-dataform#reuse_code_across_a_single_repository_with_includes)\n: JavaScript files with definitions of variables and functions that you can\n reuse across your workflow.\n\nVisualisation of a workflow\n---------------------------\n\nYou can view your workflow visualized in the form of a\nDirected Acyclic Graph (DAG). The DAG displays all objects of the workflow\ndefined in your workspace, and the relationships between them. You can zoom in\nand out and use drag-and-drop navigation in the DAG. If there are compilation\nerrors in your workflow, Dataform displays an error message\ninstead of the DAG.\n\nTo view the DAG of your workflow, in your workspace, click **Compiled graph**.\n\nExecution of a workflow\n-----------------------\n\nIn your development workspace, you can\n[manually trigger a run](/dataform/docs/trigger-execution) of your entire\nworkflow, a selection of actions, or a selection of tags.\n\nYou can schedule runs with Dataform\n[release configurations](/dataform/docs/configure-compilation#create-release-configuration)\nand [workflow configurations](/dataform/docs/schedule-runs#workflow-configurations).\nFirst, create a release configuration to create compilation results\nof your repository. Then, create a workflow configuration, select a\nrelease configuration, select workflow actions that you want to run,\nand set the run schedule.\n\nAlternatively, you can schedule runs either with\n[Cloud Composer](/dataform/docs/schedule-runs#composer), or with\n[Workflows and Cloud Scheduler](/dataform/docs/schedule-runs#workflows-cloud-scheduler).\n\nDuring execution, Dataform runs SQL queries in BigQuery,\nfollowing the order of object dependencies in your workflow.\nAfter execution, you can use your defined tables and views for all\nyour analytics purposes in BigQuery.\n\n### Execution configuration options\n\nTo run a specific group of your workflow actions, you can add\n[Dataform execution tags](/dataform/docs/configure-additional-actions#add-execution-tags)\nto the files you select. You can then\n[run only the files with a selected tag](/dataform/docs/trigger-execution#manually_execute_actions_with_selected_tags)\nwhen you manually trigger a run.\n\nBy default, Dataform runs your workflow with the execution\nsettings defined in the `dataform.json` file.\nYou can override these execution settings with compilation overrides.\n\nWith\n[workspace compilation overrides](/dataform/docs/configure-compilation#create-workspace-compilation-overrides),\nyou can turn workspaces into isolated\nexecution environments. This means that when you manually trigger execution in\na workspace, Dataform runs the output in an isolated location in\nBigQuery.\n\nTo create and run a single compilation result with compilation\noverrides you can pass requests\n[with the Dataform API](/dataform/docs/configure-compilation#configure-compilation-overrides-with-api).\n\nWith\n[release configurations](/dataform/docs/configure-compilation#create-release-configuration),\nyou can configure compilation overrides for your whole repository, as well as\nthe frequency of creating compilation results with the applied settings.\n\nTo learn more about ways to configure compilation and code lifecycle in\nDataform, see\n[Introduction to code lifecycle in Dataform](/dataform/docs/configure-compilation#intro-code-lifecycle).\n\nWhat's next\n-----------\n\n- To learn how to declare a data source, see [Declare a data source](/dataform/docs/declare-source).\n- To learn how to declare dependencies to define relationships between objects in your workflow, see [Set dependencies](/dataform/docs/dependencies).\n- To learn how to define custom SQL operations, see [Create operations](/dataform/docs/custom-sql).\n- To learn how to reuse variables and functions across your workflow with includes, see [Reuse code across a single repository with includes](/dataform/docs/javascript-in-dataform#reuse_code_across_a_single_repository_with_includes)."]]
