SDK 및 작업자 종속 항목

Apache Beam SDK와 Dataflow 작업자는 공통 타사 구성요소를 사용하며, 이러한 구성요소는 종속 항목을 추가로 가져옵니다. 버전이 충돌하면 서비스에서 예기치 않은 동작이 발생할 수 있습니다. 코드에서 이러한 패키지를 사용하는 경우, 일부 라이브러리가 이후 버전과 호환되지 않으므로 실행하는 시점을 기준으로 범위 내에 있는 것으로 표시되는 버전을 사용해야 할 수도 있습니다.

이 페이지에는 Apache Beam 및 Dataflow SDK 출시 버전별 종속 항목과 작업자 패키지 정보가 포함되어 있습니다.

Apache Beam 2.x SDK

자바용 SDK

참고: 자바용 Apache Beam SDK의 종속 항목 정보는 자바용 Apache Beam SDK 종속 항목 페이지를 참조하세요.

Python용 SDK

버전 2.24.0

Dataflow 작업자에는 다음 패키지가 이미 설치되어 있습니다.

Python 2.7.18

패키지버전
absl-py0.10.0
astor0.8.1
atomicwrites1.4.0
attrs20.1.0
avro1.8.2
backports.functools-lru-cache1.6.1
backports.weakref1.0.post1
beautifulsoup44.9.1
bs40.0.1
cachetools3.1.1
certifi2020.6.20
chardet3.0.4
configparser4.0.2
contextlib20.6.0.post1
crcmod1.7
Cython0.29.21
dill0.3.1.1
docopt0.6.2
enum341.1.10
fastavro0.23.5
fasteners0.15
freezegun0.3.15
funcsigs1.0.2
functools323.2.3.post2
future0.18.2
futures3.3.0
gast0.2.2
google-api-core1.22.2
google-api-python-client1.11.0
google-apitools0.5.31
google-auth1.21.1
google-auth-httplib20.0.4
google-auth-oauthlib0.4.1
google-cloud-bigquery1.26.1
google-cloud-bigtable1.0.0
google-cloud-core1.1.0
google-cloud-datastore1.7.4
google-cloud-dlp0.13.0
google-cloud-language1.3.0
google-cloud-pubsub1.0.2
google-cloud-spanner1.13.0
google-cloud-videointelligence1.13.0
google-cloud-vision0.42.0
google-pasta0.2.0
google-python-cloud-debugger1.9
google-resumable-media1.0.0
googleapis-common-protos1.52.0
grpc-google-iam-v10.12.3
grpcio1.30.0
grpcio-gcp0.2.2
guppy0.1.11
h5py2.10.0
hdfs2.5.8
httplib20.17.3
idna2.10
importlib-metadata1.7.0
Keras-Applications1.0.8
Keras-Preprocessing1.1.2
Markdown3.1.1
mock2.0.0
monotonic1.5
more-itertools5.0.0
nltk3.4.5
nose1.3.7
nose-xunitmp0.4.1
numpy1.16.5
oauth2client3.0.0
oauthlib3.1.0
opt-einsum2.3.2
packaging20.4
pandas0.24.2
pathlib22.3.5
pbr5.5.0
Pillow6.2.2
pip20.2.2
pluggy0.13.1
protobuf3.12.2
protorpc0.12.0
py1.9.0
pyarrow0.16.0
pyasn10.4.8
pyasn1-modules0.2.8
pydot1.4.1
pymongo3.10.1
pyparsing2.4.7
pytest4.6.11
python-dateutil2.8.1
python-gflags3.1.2
python-snappy0.5.4
pytz2020.1
PyVCF0.6.8
PyYAML5.3.1
requests2.24.0
requests-oauthlib1.3.0
rsa4.0
scandir1.10.0
scikit-learn0.20.4
scipy1.2.2
setuptools44.1.0
singledispatch3.4.0.3
six1.15.0
soupsieve1.9.6
tensorboard2.1.0
tensorflow2.1.0
tensorflow-estimator2.1.0
termcolor1.1.0
typing3.7.4.1
typing-extensions3.7.4.2
uritemplate3.0.1
urllib31.25.10
wcwidth0.2.5
Werkzeug1.0.1
wheel0.34.2
wrapt1.12.1
zipp1.2.0

Python 3.5.9

패키지버전
absl-py0.10.0
astor0.8.1
atomicwrites1.4.0
attrs20.1.0
avro-python31.8.2
beautifulsoup44.9.1
bs40.0.1
cachetools3.1.1
certifi2020.6.20
cffi1.14.2
chardet3.0.4
click7.1.2
crcmod1.7
Cython0.29.21
dill0.3.1.1
docopt0.6.2
fastavro0.23.5
fasteners0.15
freezegun0.3.15
future0.18.2
gast0.2.2
google-api-core1.22.2
google-apitools0.5.31
google-auth1.21.1
google-auth-oauthlib0.4.1
google-cloud-bigquery1.26.1
google-cloud-bigtable1.0.0
google-cloud-core1.1.0
google-cloud-datastore1.7.4
google-cloud-dlp0.13.0
google-cloud-language1.3.0
google-cloud-pubsub1.0.2
google-cloud-spanner1.13.0
google-cloud-videointelligence1.13.0
google-cloud-vision0.42.0
google-crc32c1.0.0
google-pasta0.2.0
google-resumable-media1.0.0
googleapis-common-protos1.52.0
grpc-google-iam-v10.12.3
grpcio1.30.0
grpcio-gcp0.2.2
guppy33.0.10
h5py2.10.0
hdfs2.5.8
httplib20.17.3
idna2.10
importlib-metadata1.7.0
joblib0.14.1
Keras-Applications1.0.8
Keras-Preprocessing1.1.0
Markdown3.2.2
mock2.0.0
monotonic1.5
more-itertools8.5.0
nltk3.5
nose1.3.7
nose-xunitmp0.4.1
numpy1.18.4
oauth2client3.0.0
oauthlib3.1.0
opt-einsum3.3.0
packaging20.4
pandas0.25.3
pathlib22.3.5
pbr5.5.0
Pillow7.2.0
pip20.2.2
pluggy0.13.1
protobuf3.12.2
protorpc0.12.0
py1.9.0
pyarrow0.17.1
pyasn10.4.8
pyasn1-modules0.2.8
pycparser2.20
pydot1.4.1
pymongo3.10.1
pyparsing2.4.7
pytest4.6.11
python-dateutil2.8.1
python-gflags3.1.2
python-snappy0.5.4
pytz2020.1
PyYAML5.3.1
regex2020.7.14
requests2.24.0
requests-oauthlib1.3.0
rsa4.6
scikit-learn0.22.1
scipy1.4.1
setuptools49.3.1
six1.15.0
soupsieve2.0.1
tensorboard2.1.1
tensorflow2.1.1
tensorflow-estimator2.1.0
termcolor1.1.0
tqdm4.48.2
typing-extensions3.7.4.2
urllib31.25.10
wcwidth0.2.5
Werkzeug1.0.1
wheel0.34.2
wrapt1.12.1
zipp1.2.0

Python 3.6.12

패키지버전
absl-py0.10.0
astor0.8.1
atomicwrites1.4.0
attrs20.1.0
avro-python31.8.2
beautifulsoup44.9.1
bs40.0.1
cachetools3.1.1
certifi2020.6.20
cffi1.14.2
chardet3.0.4
click7.1.2
crcmod1.7
Cython0.29.21
dill0.3.1.1
docopt0.6.2
fastavro0.23.5
fasteners0.15
freezegun0.3.15
future0.18.2
gast0.2.2
google-api-core1.22.2
google-api-python-client1.11.0
google-apitools0.5.31
google-auth1.21.1
google-auth-httplib20.0.4
google-auth-oauthlib0.4.1
google-cloud-bigquery1.26.1
google-cloud-bigtable1.0.0
google-cloud-core1.1.0
google-cloud-datastore1.7.4
google-cloud-dlp0.13.0
google-cloud-language1.3.0
google-cloud-pubsub1.0.2
google-cloud-spanner1.13.0
google-cloud-videointelligence1.13.0
google-cloud-vision0.42.0
google-crc32c1.0.0
google-pasta0.2.0
google-python-cloud-debugger2.15
google-resumable-media1.0.0
googleapis-common-protos1.52.0
grpc-google-iam-v10.12.3
grpcio1.30.0
grpcio-gcp0.2.2
guppy33.0.10
h5py2.10.0
hdfs2.5.8
httplib20.17.3
idna2.10
importlib-metadata1.7.0
joblib0.16.0
Keras-Applications1.0.8
Keras-Preprocessing1.1.0
Markdown3.2.2
mock2.0.0
monotonic1.5
more-itertools8.5.0
nltk3.5
nose1.3.7
nose-xunitmp0.4.1
numpy1.18.4
oauth2client3.0.0
oauthlib3.1.0
opt-einsum3.3.0
packaging20.4
pandas0.25.3
pbr5.5.0
Pillow7.2.0
pip20.2.2
pluggy0.13.1
protobuf3.12.2
protorpc0.12.0
py1.9.0
pyarrow0.17.1
pyasn10.4.8
pyasn1-modules0.2.8
pycparser2.20
pydot1.4.1
pymongo3.10.1
pyparsing2.4.7
pytest4.6.11
python-dateutil2.8.1
python-gflags3.1.2
python-snappy0.5.4
pytz2020.1
PyYAML5.3.1
regex2020.7.14
requests2.24.0
requests-oauthlib1.3.0
rsa4.6
scikit-learn0.22.1
scipy1.4.1
setuptools49.6.0
six1.15.0
soupsieve2.0.1
tensorboard2.1.1
tensorflow2.1.1
tensorflow-estimator2.1.0
termcolor1.1.0
tqdm4.48.2
typing-extensions3.7.4.2
uritemplate3.0.1
urllib31.25.10
wcwidth0.2.5
Werkzeug1.0.1
wheel0.35.1
wrapt1.12.1
zipp3.1.0

Python 3.7.9

패키지버전
absl-py0.10.0
astor0.8.1
atomicwrites1.4.0
attrs20.1.0
avro-python31.8.2
beautifulsoup44.9.1
bs40.0.1
cachetools3.1.1
certifi2020.6.20
cffi1.14.2
chardet3.0.4
click7.1.2
crcmod1.7
Cython0.29.21
dill0.3.1.1
docopt0.6.2
fastavro0.23.5
fasteners0.15
freezegun0.3.15
future0.18.2
gast0.2.2
google-api-core1.22.2
google-api-python-client1.11.0
google-apitools0.5.31
google-auth1.21.1
google-auth-httplib20.0.4
google-auth-oauthlib0.4.1
google-cloud-bigquery1.26.1
google-cloud-bigtable1.0.0
google-cloud-core1.1.0
google-cloud-datastore1.7.4
google-cloud-dlp0.13.0
google-cloud-language1.3.0
google-cloud-pubsub1.0.2
google-cloud-spanner1.13.0
google-cloud-videointelligence1.13.0
google-cloud-vision0.42.0
google-crc32c1.0.0
google-pasta0.2.0
google-python-cloud-debugger2.15
google-resumable-media1.0.0
googleapis-common-protos1.52.0
grpc-google-iam-v10.12.3
grpcio1.30.0
grpcio-gcp0.2.2
guppy33.0.10
h5py2.10.0
hdfs2.5.8
httplib20.17.3
idna2.10
importlib-metadata1.7.0
joblib0.16.0
Keras-Applications1.0.8
Keras-Preprocessing1.1.0
Markdown3.2.2
mock2.0.0
monotonic1.5
more-itertools8.5.0
nltk3.5
nose1.3.7
nose-xunitmp0.4.1
numpy1.18.4
oauth2client3.0.0
oauthlib3.1.0
opt-einsum3.3.0
packaging20.4
pandas0.25.3
pbr5.5.0
Pillow7.2.0
pip20.2.2
pluggy0.13.1
protobuf3.12.2
protorpc0.12.0
py1.9.0
pyarrow0.17.1
pyasn10.4.8
pyasn1-modules0.2.8
pycparser2.20
pydot1.4.1
pymongo3.10.1
pyparsing2.4.7
pytest4.6.11
python-dateutil2.8.1
python-gflags3.1.2
python-snappy0.5.4
pytz2020.1
PyYAML5.3.1
regex2020.7.14
requests2.24.0
requests-oauthlib1.3.0
rsa4.6
scikit-learn0.22.1
scipy1.4.1
setuptools49.6.0
six1.15.0
soupsieve2.0.1
tensorboard2.1.1
tensorflow2.1.1
tensorflow-estimator2.1.0
termcolor1.1.0
tqdm4.48.2
typing-extensions3.7.4.2
uritemplate3.0.1
urllib31.25.10
wcwidth0.2.5
Werkzeug1.0.1
wheel0.35.1
wrapt1.12.1
zipp3.1.0

Python 3.8.5

패키지버전
atomicwrites1.4.0
attrs20.1.0
avro-python31.8.2
beautifulsoup44.9.1
bs40.0.1
cachetools3.1.1
certifi2020.6.20
cffi1.14.2
chardet3.0.4
click7.1.2
crcmod1.7
Cython0.29.21
dill0.3.1.1
docopt0.6.2
fastavro0.23.5
fasteners0.15
freezegun0.3.15
future0.18.2
google-api-core1.22.2
google-api-python-client1.11.0
google-apitools0.5.31
google-auth1.21.1
google-auth-httplib20.0.4
google-cloud-bigquery1.26.1
google-cloud-bigtable1.0.0
google-cloud-core1.1.0
google-cloud-datastore1.7.4
google-cloud-dlp0.13.0
google-cloud-language1.3.0
google-cloud-pubsub1.0.2
google-cloud-spanner1.13.0
google-cloud-videointelligence1.13.0
google-cloud-vision0.42.0
google-crc32c1.0.0
google-python-cloud-debugger2.15
google-resumable-media1.0.0
googleapis-common-protos1.52.0
grpc-google-iam-v10.12.3
grpcio1.30.0
grpcio-gcp0.2.2
guppy33.0.10
hdfs2.5.8
httplib20.17.3
idna2.10
joblib0.16.0
mock2.0.0
monotonic1.5
more-itertools8.5.0
nltk3.5
nose1.3.7
nose-xunitmp0.4.1
numpy1.18.4
oauth2client3.0.0
packaging20.4
pandas0.25.3
pbr5.5.0
Pillow7.2.0
pip20.2.2
pluggy0.13.1
protobuf3.12.2
protorpc0.12.0
py1.9.0
pyarrow0.17.1
pyasn10.4.8
pyasn1-modules0.2.8
pycparser2.20
pydot1.4.1
pymongo3.10.1
pyparsing2.4.7
pytest4.6.11
python-dateutil2.8.1
python-gflags3.1.2
python-snappy0.5.4
pytz2020.1
PyYAML5.3.1
regex2020.7.14
requests2.24.0
rsa4.6
scikit-learn0.22.1
scipy1.4.1
setuptools49.3.1
six1.15.0
soupsieve2.0.1
tqdm4.48.2
typing-extensions3.7.4.2
uritemplate3.0.1
urllib31.25.10
wcwidth0.2.5
wheel0.34.2

Dataflow 2.x SDK

자바용 SDK

JAR이 충돌 버전을 사용하는지 확인하려면 프로젝트의 종속 항목 트리를 검사합니다. Maven과 같은 다양한 도구를 사용하여 종속 항목 트리를 생성할 수 있습니다.

pom.xml에서 다음 테이블의 라이브러리에 'latest'를 지정하지 마세요.

Python용 SDK

Dataflow 1.x SDK

자바용 SDK