Basic autoscaling configurations for YARN.
.. attribute:: graceful_decommission_timeout
Required. Timeout for YARN graceful decommissioning of Node
Managers. Specifies the duration to wait for jobs to complete
before forcefully removing workers (and potentially
interrupting jobs). Only applicable to downscaling operations.
Bounds: [0s, 1d].
Required. Fraction of average pending memory in the last
cooldown period for which to remove workers. A scale-down
factor of 1 will result in scaling down so that there is no
available memory remaining after the update (more aggressive
scaling). A scale-down factor of 0 disables removing workers,
which can be beneficial for autoscaling a single job. Bounds:
[0.0, 1.0].
Optional. Minimum scale-down threshold as a fraction of total
cluster size before scaling occurs. For example, in a
20-worker cluster, a threshold of 0.1 means the autoscaler
must recommend at least a 2 worker scale-down for the cluster
to scale. A threshold of 0 means the autoscaler will scale
down on any recommended change. Bounds: [0.0, 1.0]. Default:
0.0.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2024-11-06 UTC."],[],[]]
