Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Bagian ini menjelaskan opsi Google Cloud yang dapat Anda gunakan untuk menjadwalkan alur kerja.
Template Workflow Dataproc
Template alur kerja Dataproc
menyediakan mekanisme yang fleksibel dan mudah digunakan untuk mengelola serta menjalankan alur kerja. Template Alur Kerja adalah konfigurasi alur kerja yang dapat digunakan kembali. Template ini menentukan grafik tugas beserta informasi mengenai di mana tugas-tugas tersebut dijalankan.
Cloud Scheduler
Cloud Scheduler adalah penjadwal cron job tingkat perusahaan yang terkelola sepenuhnya.
Anda dapat menggunakannya untuk menjadwalkan hampir segala tugas, termasuk tugas batch, big data, dan operasi infrastruktur Cloud. Fitur ini menyediakan penjadwalan sederhana berbasis waktu, misalnya, harian atau per jam, tanpa mengharuskan Anda menulis kode.
Kelebihan:
Memungkinkan pembuatan instance template alur kerja berbasis waktu berdasarkan ekspresi cron yang sudah dikenal
Cloud Run Functions adalah solusi komputasi ringan yang dapat Anda gunakan untuk membuat fungsi mandiri dan bertujuan tunggal yang merespons peristiwa Cloud tanpa perlu mengelola server atau lingkungan runtime. Anda dapat menggunakan fungsi Cloud Run untuk meluncurkan Workflows sebagai respons terhadap peristiwa Pub/Sub atau perubahan file di Cloud Storage. Anda dapat menggunakan fungsi Cloud Run dengan Cloud Scheduler untuk alur kerja yang memerlukan penghitungan parameter berbasis waktu.
Kelebihan:
Memungkinkan instansiasi alur kerja sebagai respons terhadap peristiwa data, seperti file baru di Cloud Storage atau peristiwa Pub/Sub.
Pengodean minimal diperlukan menggunakan library klien Dataproc Go, Node.js, atau Python
Membuat alur kerja dan parameter alur kerja secara dinamis
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-09-04 UTC."],[[["\u003cp\u003eDataproc Workflow Templates offer a reusable configuration for defining and executing a graph of jobs within workflows.\u003c/p\u003e\n"],["\u003cp\u003eCloud Scheduler is a managed cron job scheduler enabling time-based scheduling of workflows without the need to write any code.\u003c/p\u003e\n"],["\u003cp\u003eCloud Run functions allow for workflow instantiation in response to events like new files in Cloud Storage or Pub/Sub events, requiring minimal coding.\u003c/p\u003e\n"],["\u003cp\u003eCloud Composer is a managed Apache Airflow service that supports both time- and event-based scheduling, offering dynamic workflow generation and integration across various Google Cloud products.\u003c/p\u003e\n"]]],[],null,["This section describes Google Cloud options you can use to schedule\nworkflows.\n\nDataproc Workflow Templates\n\nDataproc [Workflow templates](/dataproc/docs/concepts/workflows/overview)\nprovide a flexible and easy-to-use mechanism for managing and executing workflows. A Workflow Template is a reusable workflow configuration. It defines a graph of jobs with information on where to run those jobs.\n\nCloud Scheduler\n\nCloud Scheduler is a fully managed enterprise-grade cron job scheduler.\nIt allows you to schedule virtually any job, including batch, big data jobs,\nand Cloud infrastructure operations. It provides simple time-based\nscheduling, for example, daily or hourly, without requiring you to write code.\n\n**Advantages:**\n\n- Enables time-based instantiation of workflow templates based on familiar\n cron expressions\n\n- No code to write\n\nTutorial: [Workflow using Cloud Scheduler](/dataproc/docs/tutorials/workflow-scheduler)\n\nCloud Functions\n\nCloud Run functions is a lightweight compute solution you can use to create\nsingle-purpose, stand-alone functions that respond to Cloud events without\nthe need to manage a server or runtime environment. You can use\nCloud Run functions to launch Workflows in response to Pub/Sub\nevents or file changes in Cloud Storage. You can use Cloud Run functions\nwith Cloud Scheduler for workflows that require the calculation of\ntime-based parameters.\n\n**Advantages:**\n\n- Enables workflow instantiation in response to data events, such as new files in\n Cloud Storage or Pub/Sub events.\n\n- Minimal coding required using Dataproc\n [Go](https://github.com/googleapis/google-cloud-go),\n [Node.js](https://github.com/googleapis/google-cloud-node), or\n [Python](https://github.com/googleapis/google-cloud-python)\n client libraries\n\n- Dynamically generate workflows and workflow parameters\n\nTutorial: [Workflow using Cloud Run functions](/dataproc/docs/tutorials/workflow-function)\n\nCloud Composer\n\nCloud Composer is a managed Apache Airflow service you can use\nto create, schedule, monitor, and manage workflows.\n\n**Advantages:**\n\n- Supports time- and event-based scheduling\n\n- Simplified calls to Dataproc using Operators\n\n- Dynamically generate workflows and workflow parameters\n\n- Build data flows that span multiple Google Cloud products\n\nTutorial: [Workflow using Cloud Composer](/dataproc/docs/tutorials/workflow-composer)"]]
