Menjalankan inferensi batch menggunakan GPU pada tugas Cloud Run
Tetap teratur dengan koleksi
Simpan dan kategorikan konten berdasarkan preferensi Anda.
Anda dapat menjalankan inferensi batch dengan LLM Llama 3.2-1b Meta dan vLLM pada tugas Cloud Run, lalu menulis hasilnya langsung ke Cloud Storage menggunakan pemasangan volume Cloud Run.
[[["Mudah dipahami","easyToUnderstand","thumb-up"],["Memecahkan masalah saya","solvedMyProblem","thumb-up"],["Lainnya","otherUp","thumb-up"]],[["Sulit dipahami","hardToUnderstand","thumb-down"],["Informasi atau kode contoh salah","incorrectInformationOrSampleCode","thumb-down"],["Informasi/contoh yang saya butuhkan tidak ada","missingTheInformationSamplesINeed","thumb-down"],["Masalah terjemahan","translationIssue","thumb-down"],["Lainnya","otherDown","thumb-down"]],["Terakhir diperbarui pada 2025-09-04 UTC."],[],[],null,["# Run batch inference using GPUs on Cloud Run jobs\n\n| **Preview\n| --- GPU support for Cloud Run jobs**\n|\n|\n| This feature is subject to the \"Pre-GA Offerings Terms\" in the General Service Terms section\n| of the [Service Specific Terms](/terms/service-terms#1).\n|\n| Pre-GA features are available \"as is\" and might have limited support.\n|\n| For more information, see the\n| [launch stage descriptions](/products#product-launch-stages).\n\nYou can run batch inference with [Meta's Llama 3.2-1b LLM](https://huggingface.co/meta-llama/Llama-3.2-1B) and [vLLM](https://github.com/vllm-project/vllm) on a Cloud Run job, then write the results directly to Cloud Storage using Cloud Run volume mounts.\n\nSee a step-by-step instructional codelab at [How to run batch inference on Cloud Run jobs](https://codelabs.developers.google.com/codelabs/cloud-run/how-to-batch-inference-cloud-run-jobs)."]]
