Required. Timeout for YARN graceful decommissioning of Node Managers.
Specifies the duration to wait for jobs to complete before forcefully
removing workers (and potentially interrupting jobs). Only applicable to
downscaling operations.
Required. Timeout for YARN graceful decommissioning of Node Managers.
Specifies the duration to wait for jobs to complete before forcefully
removing workers (and potentially interrupting jobs). Only applicable to
downscaling operations.
Required. Fraction of average YARN pending memory in the last cooldown
period for which to remove workers. A scale-down factor of 1 will result in
scaling down so that there is no available memory remaining after the
update (more aggressive scaling). A scale-down factor of 0 disables
removing workers, which can be beneficial for autoscaling a single job.
See How autoscaling
works
for more information.
Optional. Minimum scale-down threshold as a fraction of total cluster size
before scaling occurs. For example, in a 20-worker cluster, a threshold of
0.1 means the autoscaler must recommend at least a 2 worker scale-down for
the cluster to scale. A threshold of 0 means the autoscaler will scale down
on any recommended change.
Required. Fraction of average YARN pending memory in the last cooldown
period for which to add workers. A scale-up factor of 1.0 will result in
scaling up so that there is no pending memory remaining after the update
(more aggressive scaling). A scale-up factor closer to 0 will result in a
smaller magnitude of scaling up (less aggressive scaling). See How
autoscaling
works
for more information.
Optional. Minimum scale-up threshold as a fraction of total cluster size
before scaling occurs. For example, in a 20-worker cluster, a threshold of
0.1 means the autoscaler must recommend at least a 2-worker scale-up for
the cluster to scale. A threshold of 0 means the autoscaler will scale up
on any recommended change.
Required. Timeout for YARN graceful decommissioning of Node Managers.
Specifies the duration to wait for jobs to complete before forcefully
removing workers (and potentially interrupting jobs). Only applicable to
downscaling operations.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2025-01-28 UTC."],[],[]]
