Setting Dataproc service properties

Problem

Setting the property, dataproc:dataproc.conscrypt.provider.enable=false, while submitting a job, based on the GitHub issue 177. However, the same exception and stack trace are thrown whether that property is set to true or false.

Environment

  • Any Dataproc environment

Solution

  1. Dataproc service property and can only be configured while the cluster is created.
    • Prefix: dataproc
    • Property: dataproc.conscrypt.provider.enable
    • Values: true or false
    • Description: Enables (true) or disables (falseConscrypt as the primary Java security provider. 
Note: Conscrypt is enabled by default in Dataproc 1.2 and higher, but disabled in 1.0/1.1.