이 페이지에서는 Cloud Data Fusion에서 지원되지 않는 프로그램 유형 오류가 발생하여 데이터 파이프라인이 실패하는 경우 Cloud Data Fusion 6.8.0 및 6.8.1에서 알려진 문제를 해결하는 방법을 설명합니다. 이 문제는 버전 6.8.2에서 해결되었습니다.
파이프라인 시작 시간을 줄이기 위해 Cloud Data Fusion 버전 6.8.0 및 6.8.1 인스턴스는 Cloud Storage 버킷 내 Dataproc 클러스터의 파이프라인을 시작하는 데 필요한 아티팩트를 캐시합니다.
캐시되는 아티팩트 중 하나는 application.jar입니다. 파이프라인을 실행하는 순서에 따라 일부 파이프라인이 다음 오류로 실패할 수 있습니다.
Unsupportedprogramtype:Spark
예를 들어 새로운 6.8.1 인스턴스를 만들거나 6.8.1로 업그레이드한 후에 작업만 포함된 파이프라인을 처음 실행하면 성공합니다.
하지만 소스 또는 싱크를 포함하는 다음 파이프라인을 실행하면 이 오류로 실패할 수 있습니다.
권장사항
이 문제를 해결하려면 다음 중 한 가지를 따르세요.
권장: Cloud Data Fusion 버전 6.8.2 이상으로 인스턴스를 업그레이드합니다.
[[["이해하기 쉬움","easyToUnderstand","thumb-up"],["문제가 해결됨","solvedMyProblem","thumb-up"],["기타","otherUp","thumb-up"]],[["이해하기 어려움","hardToUnderstand","thumb-down"],["잘못된 정보 또는 샘플 코드","incorrectInformationOrSampleCode","thumb-down"],["필요한 정보/샘플이 없음","missingTheInformationSamplesINeed","thumb-down"],["번역 문제","translationIssue","thumb-down"],["기타","otherDown","thumb-down"]],["최종 업데이트: 2025-09-04(UTC)"],[[["\u003cp\u003eCloud Data Fusion versions 6.8.0 and 6.8.1 have a known issue where pipelines may fail with an "Unsupported program type: Spark" error due to artifact caching.\u003c/p\u003e\n"],["\u003cp\u003eThe recommended solution is to upgrade the Cloud Data Fusion instance to version 6.8.2 or later to resolve this pipeline error.\u003c/p\u003e\n"],["\u003cp\u003eAs an alternative solution, you can disable Cloud Storage caching, which can be done for all pipelines in an instance, for a specific namespace, for a Dataproc profile, or for individual failing pipelines.\u003c/p\u003e\n"],["\u003cp\u003eDisabling Cloud Storage caching will result in slightly longer pipeline start times, as fewer artifacts are cached.\u003c/p\u003e\n"],["\u003cp\u003eCaching can be disabled via the system admin console for all options, or via the REST API.\u003c/p\u003e\n"]]],[],null,["# Troubleshoot unsupported program type errors\n\nThis page describes how to resolve a known issue in Cloud Data Fusion 6.8.0 and 6.8.1 where a data pipeline fails with an unsupported program type error in Cloud Data Fusion. This issue is resolved in version 6.8.2.\n\n\u003cbr /\u003e\n\nTo reduce the start time for pipelines, Cloud Data Fusion version 6.8.0 and\n6.8.1 instances cache the artifacts that are required to start a pipeline in a\nDataproc cluster inside a Cloud Storage bucket.\nOne of these cached artifacts is `application.jar`. Depending on the order in\nwhich you run your pipelines, some pipelines might fail with the following\nerror: \n\n Unsupported program type: Spark\n\nFor example, after you create a new 6.8.1 instance (or upgrade to 6.8.1), the\nfirst time that you run a pipeline that only contains actions, it succeeds.\nHowever, the next pipeline runs, which include sources or sinks, might fail with\nthis error.\n\nRecommendation\n--------------\n\nTo resolve this issue, do either of the following:\n\n- Recommended: [Upgrade the instance](/data-fusion/docs/how-to/upgrading#upgrade-instances) to Cloud Data Fusion version 6.8.2 or later.\n- Disable Cloud Storage caching by a [preference or runtime argument](https://cdap.atlassian.net/wiki/spaces/DOCS/pages/480314690/Preferences+and+Runtime+Arguments).\n\n| **Note:** Disabling Cloud Storage caching results in a pipeline taking slightly longer to start running, as fewer artifacts are cached.\n\nYou can disable caching for any of the following:\n\n- For all pipelines in an instance.\n- For a given namespace.\n- For the specific Dataproc profiles that contain the failing pipelines.\n- For only the failing pipelines.\n\n### Disable Cloud Storage caching for all pipelines in an instance\n\nTo disable Cloud Storage caching for all pipelines in an instance,\nfollow these steps: \n\n### Console\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **System Admin** \\\u003e **System Preferences** and set the value for\n `system.profile.properties.gcsCacheEnabled` to `false.`\n\n### REST API\n\n\nTo set `system.profile.properties.gcsCacheEnabled` to `false`, see\n[Set preferences](https://cdap.atlassian.net/wiki/spaces/DOCS/pages/477561058/Preferences+Microservices#Set-Preferences).\n| **Note:** This change impacts start time for all pipelines in the instance.\n\n### Disable Cloud Storage caching for a given namespace\n\nTo disable Cloud Storage caching for a given namespace, follow these\nsteps: \n\n### Console\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **System Admin** \\\u003e **Namespaces** and select your namespace.\n3. Click **Preferences** \\\u003e **Edit** and set the value for\n `system.profile.properties.gcsCacheEnabled` to `false`.\n\n### REST API\n\n\nTo set this through the REST API, see\n[Set preferences](https://cdap.atlassian.net/wiki/spaces/DOCS/pages/477561058/Preferences+Microservices#Set-Preferences).\n| **Note:** This change impacts start time for all pipelines in the namespace.\n\n### Disable Cloud Storage caching for a Dataproc profile\n\nTo disable Cloud Storage caching for the specific\nDataproc profiles that contain the failing pipelines, follow\nthese steps: \n\n### Console\n\n- Set `gcsCacheEnabled` to `false` in the Dataproc profile.\n| **Note:** This change impacts the start time for all pipelines using this Dataproc profile.\n\n### Disable Cloud Storage caching for only the failing pipelines\n\nTo disable Cloud Storage caching for only the failing pipelines, follow\nthese steps: \n\n### Console\n\n1. Go to your instance:\n 1. In the Google Cloud console, go to the Cloud Data Fusion page.\n\n 2. To open the instance in the Cloud Data Fusion Studio,\n click **Instances** , and then click **View instance**.\n\n [Go to Instances](https://console.cloud.google.com/data-fusion/locations/-/instances)\n2. Click **List** and select the failing pipeline.\n3. Click expand_more **Expand** next to **Run** and set the runtime argument `system.profile.properties.gcsCacheEnabled` to `false`.\n4. Repeat for any other failing pipelines.\n\n### REST API\n\n\nCloud Storage caching can be disabled when starting a pipeline through REST\nAPI and also by optionally specifying runtime arguments as a JSON map in the\nrequest body. For more information, see\n[Start a program](https://cdap.atlassian.net/wiki/spaces/DOCS/pages/477560983/Lifecycle+Microservices#Start-a-Program).\n| **Note:** This change impacts the start time of only specific pipelines."]]
