[
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381220&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381220
]
ASF GitHub Bot logged work on BEAM-9219:
----------------------------------------
Author: ASF GitHub Bot
Created on: 03/Feb/20 22:39
Start Date: 03/Feb/20 22:39
Worklog Time Spent: 10m
Work Description: tvalentyn commented on pull request #10745: [BEAM-9219]
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374375451
##########
File path: website/src/documentation/sdks/python-dependencies.md
##########
@@ -26,460 +26,8 @@ behavior in the service. If you are using any of these
packages in your code, be
aware that some libraries are not forward-compatible and you may need to pin to
the listed versions that will be in scope during execution.
-<p>To see the compile and runtime dependencies for your Beam SDK version,
expand
-the relevant section below.</p>
+To see the compile and runtime dependencies for your Beam SDK version, core
SDK dependencies are listed in
`https://raw.githubusercontent.com/apache/beam/v<version_number>/sdks/python/setup.py`
under `REQUIRED_PACKAGES`.
-<details><summary markdown="span"><b>2.17.0</b></summary>
+If you installed any [extra features]({{ site.baseurl
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`,
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies.
-<p>Beam SDK for Python 2.17.0 has the following compile and runtime
dependencies.</p>
-
-<table class="table-bordered table-striped">
-<tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>cachetools</td><td>>=3.1.0,<4</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.3.0,<0.3.1</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>funcsigs</td><td>>=1.0.2,<2; python_version <
"3.0"</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.28,<0.5.29</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.18.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>>=0.31.1,<1.1.0</td></tr>
- <tr><td>google-cloud-core</td><td>>=0.28.1,<2</td></tr>
- <tr><td>google-cloud-datastore</td><td>>=1.7.1,<1.8.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>>=0.39.0,<1.1.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.12.1,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.12.0</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4;
python_version < "3.0"</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.15.1,<0.16.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<2</td></tr>
- <tr><td>pymongo</td><td>>=3.8.0,<4.0.0</td></tr>
- <tr><td>python-dateutil</td><td>>=2.8.0,<3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.16.0</b></summary>
-
-<p>Beam SDK for Python 2.16.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>cachetools</td><td>>=3.1.0,<4</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.3.0,<0.3.1</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>funcsigs</td><td>>=1.0.2,<2; python_version <
"3.0"</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.28,<0.5.29</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.18.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>>=0.31.1,<1.1.0</td></tr>
- <tr><td>google-cloud-core</td><td>>=0.28.1,<2</td></tr>
- <tr><td>google-cloud-datastore</td><td>>=1.7.1,<1.8.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>>=0.39.0,<1.1.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.12.1,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.12.0</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4;
python_version < "3.0"</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.15.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<2</td></tr>
- <tr><td>pymongo</td><td>>=3.8.0,<4.0.0</td></tr>
- <tr><td>python-dateutil</td><td>>=2.8.0,<3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.15.0</b></summary>
-
-<p>Beam SDK for Python 2.15.0 has the following compile and
- runtime dependencies.</p>
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>cachetools</td><td>>=3.1.0,<4</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.28,<0.5.29</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.18.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>>=0.31.1,<0.33.0</td></tr>
- <tr><td>google-cloud-core</td><td>>=0.28.1,<2</td></tr>
- <tr><td>google-cloud-datastore</td><td>>=1.7.1,<1.8.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>>=0.39.0,<0.40.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.12.0</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4;
python_version < "3.0"</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.15.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<2</td></tr>
- <tr><td>pymongo</td><td>>=3.8.0,<4.0.0</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.14.0</b></summary>
-
-<p>Beam SDK for Python 2.14.0 has the following compile and
- runtime dependencies.</p>
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>cachetools</td><td>>=3.1.0,<4</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.28,<0.5.29</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.7.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>>=0.31.1,<0.33.0</td></tr>
- <tr><td>google-cloud-core</td><td>>=0.28.1,<0.30.0</td></tr>
- <tr><td>google-cloud-datastore</td><td>>=1.7.1,<1.8.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>>=0.39.0,<0.40.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.12.0</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4;
python_version < "3.0"</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.15.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pymongo</td><td>>=3.8.0,<4.0.0</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.13.0</b></summary>
-
-<p>Beam SDK for Python 2.13.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>cachetools</td><td>>=3.1.0,<4</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.28,<0.5.29</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.7.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>>=0.31.1,<0.33.0</td></tr>
- <tr><td>google-cloud-core</td><td>>=0.28.1,<0.30.0</td></tr>
- <tr><td>google-cloud-datastore</td><td>>=1.7.1,<1.8.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>>=0.39.0,<0.40.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.12.0</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4;
python_version < "3.0"</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.14.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.12.0</b></summary>
-
-<p>Beam SDK for Python 2.12.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.26,<0.5.27</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.7.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>==0.31.1</td></tr>
- <tr><td>google-cloud-core</td><td>==0.28.1</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.39.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
-
<tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.12.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.11.0</b></summary>
-
-<p>Beam SDK for Python 2.11.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.2.0,<4.0.0; python_version <
"3.0"</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.26,<0.5.27</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.7.0</td></tr>
- <tr><td>google-cloud-bigtable</td><td>==0.31.1</td></tr>
- <tr><td>google-cloud-core</td><td>==0.28.1</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.39.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
-
<tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.12.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0; python_version <
"3.0"</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.10.0</b></summary>
-
-<p>Beam SDK for Python 2.10.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro-python3</td><td>>=1.8.1,<2.0.0; python_version >=
"3.0"</td></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0; python_version <
"3.0"</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.9,<0.2.10</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4,<0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.1.1,<4.0.0</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.23,<=0.5.24</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0,<1.7.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.39.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1,<7.1; python_version <
"3.0"</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<4</td></tr>
-
<tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pyarrow</td><td>>=0.11.1,<0.12.0; python_version >= "3.0"
or platform_system != "Windows"</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pytz</td><td>>=2018.3</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0; python_version <
"3.5.0"</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.9.0</b></summary>
-
-<p>Beam SDK for Python 2.9.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro</td><td>>=1.8.1, <2.0.0</td></tr>
- <tr><td>crcmod</td><td>>=1.7, <2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.6, <=0.2.8.2</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4, <0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0, <1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.1.1, <4.0.0</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.23, <0.5.24</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.35.4</td></tr>
- <tr><td>google-cloud-bigquery</td><td>>=1.6.0, <1.7.0</td></tr>
- <tr><td>googledatastore</td><td>>=7.0.1, <7.1</td></tr>
- <tr><td>grpcio</td><td>>=1.8, <2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0, <3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8, <=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1, <3.0.0</td></tr>
- <tr><td>nose</td><td>>=1.3.7</td></tr>
- <tr><td>numpy</td><td>>=1.14.3, <2</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1, <4</td></tr>
- <tr><td>parameterized</td><td>>=0.6.0, <0.7.0</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,
<0.90.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1, <4</td></tr>
- <tr><td>pydot</td><td>>=1.2.0, <1.3</td></tr>
- <tr><td>pyhamcrest</td><td>>=1.9, <2.0</td></tr>
- <tr><td>pytz</td><td>>=2018.3, <=2018.4</td></tr>
- <tr><td>pyyaml</td><td>>=3.12, <4.0.0</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8, <0.7.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0, <3.7.0</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.8.0</b></summary>
-
-<p>Beam SDK for Python 2.8.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro</td><td>>=1.8.1, <2.0.0</td></tr>
- <tr><td>crcmod</td><td>>=1.7, <2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.6, <=0.2.8.2</td></tr>
- <tr><td>fastavro</td><td>>=0.21.4, <0.22</td></tr>
- <tr><td>future</td><td>>=0.16.0, <1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.1.1, <4.0.0</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.18, <0.5.20</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.26.0</td></tr>
- <tr><td>google-cloud-bigquery</td><td>==0.25.0</td></tr>
- <tr><td>googledatastore</td><td>==7.0.1</td></tr>
- <tr><td>grpcio</td><td>>=1.8, <2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0, <3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8, <=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1, <3.0.0</td></tr>
- <tr><td>nose</td><td>>=1.3.7</td></tr>
- <tr><td>numpy</td><td>>=1.14.3, <2</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1, <5</td></tr>
- <tr><td>parameterized</td><td>>=0.6.0, <0.7.0</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,
<0.90.4</td></tr>
- <tr><td>proto-google-cloud-pubsub-v1</td><td>==0.15.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1, <4</td></tr>
- <tr><td>pydot</td><td>>=1.2.0, <1.3</td></tr>
- <tr><td>pyhamcrest</td><td>>=1.9, <2.0</td></tr>
- <tr><td>pytz</td><td>>=2018.3, <=2018.4</td></tr>
- <tr><td>pyyaml</td><td>>=3.12, <4.0.0</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8, <0.7.0</td></tr>
- <tr><td>typing</td><td>>=3.6.0, <3.7.0</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.7.0</b></summary>
-
-<p>Beam SDK for Python 2.7.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro</td><td>>=1.8.1, <2.0.0</td></tr>
- <tr><td>crcmod</td><td>>=1.7, <2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.6, <=0.2.8.2</td></tr>
- <tr><td>fastavro</td><td>==0.19.7</td></tr>
- <tr><td>future</td><td>>=0.16.0, <1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.1.1, <4.0.0</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.18, <0.5.20</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.26.0</td></tr>
- <tr><td>google-cloud-bigquery</td><td>==0.25.0</td></tr>
- <tr><td>googledatastore</td><td>==7.0.1</td></tr>
- <tr><td>grpcio</td><td>>=1.8, <2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0, <3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8, <=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1, <3.0.0</td></tr>
- <tr><td>nose</td><td>>=1.3.7</td></tr>
- <tr><td>numpy</td><td>>=1.14.3, <2</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1, <5</td></tr>
- <tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,
<0.90.4</td></tr>
- <tr><td>proto-google-cloud-pubsub-v1</td><td>==0.15.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1, <4</td></tr>
- <tr><td>pydot</td><td>>=1.2.0, <1.3</td></tr>
- <tr><td>pyhamcrest</td><td>>=1.9, <2.0</td></tr>
- <tr><td>pytz</td><td>>=2018.3, <=2018.4</td></tr>
- <tr><td>pyyaml</td><td>>=3.12, <4.0.0</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8, <0.7.0</td></tr>
- <tr><td>six</td><td>>=1.9, <1.12</td></tr>
- <tr><td>typing</td><td>>=3.6.0, <3.7.0</td></tr>
-</table>
-
-</details>
-
-<details><summary markdown="span"><b>2.6.0</b></summary>
-
-<p>Beam SDK for Python 2.6.0 has the following compile and
- runtime dependencies.</p>
-
-<table class="table-bordered table-striped">
- <tr><th>Package</th><th>Version</th></tr>
- <tr><td>avro</td><td>>=1.8.1,<2.0.0</td></tr>
- <tr><td>crcmod</td><td>>=1.7,<2.0</td></tr>
- <tr><td>dill</td><td>>=0.2.6,<=0.2.8.2</td></tr>
- <tr><td>future</td><td>>=0.16.0,<1.0.0</td></tr>
- <tr><td>futures</td><td>>=3.1.1,<4.0.0</td></tr>
- <tr><td>google-apitools</td><td>>=0.5.18,<=0.5.20</td></tr>
- <tr><td>google-cloud-bigquery</td><td>==0.25.0</td></tr>
- <tr><td>google-cloud-pubsub</td><td>==0.26.0</td></tr>
- <tr><td>googledatastore</td><td>==7.0.1</td></tr>
- <tr><td>grpcio</td><td>>=1.8,<2</td></tr>
- <tr><td>hdfs</td><td>>=2.1.0,<3.0.0</td></tr>
- <tr><td>httplib2</td><td>>=0.8,<=0.11.3</td></tr>
- <tr><td>mock</td><td>>=1.0.1,<3.0.0</td></tr>
- <tr><td>oauth2client</td><td>>=2.0.1,<5</td></tr>
-
<tr><td>proto-google-cloud-datastore-v1</td><td>>=0.90.0,<=0.90.4</td></tr>
- <tr><td>proto-google-cloud-pubsub-v1</td><td>==0.15.4</td></tr>
- <tr><td>protobuf</td><td>>=3.5.0.post1,<4</td></tr>
- <tr><td>pydot</td><td>>=1.2.0,<1.3</td></tr>
- <tr><td>pytz</td><td>>=2018.3,<=2018.4</td></tr>
- <tr><td>pyvcf</td><td>>=0.6.8,<0.7.0</td></tr>
- <tr><td>pyyaml</td><td>>=3.12,<4.0.0</td></tr>
- <tr><td>six</td><td>>=1.9,<1.12</td></tr>
- <tr><td>typing</td><td>>=3.6.0,<3.7.0</td></tr>
-</table>
-
-</details>
+You can also retrieve a dependency list by creating a clean virtual
environment for your project, installing the Beam SDK for Python, and running
`pip3 freeze` or `pip freeze`.
Review comment:
- This list will include transitive dependencies. It is easier to make sense
of these via `pip install pipdeptree; pipdeptree -p apache-beam`
- ip command in virtualenv works under Python3 as well.
- I would not duplicate installation instructions here, but point to webpage
that talks on how to install beam SDK. For example, it is possible to install
beam from pypi, instead of cloning.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 381220)
Time Spent: 2h 20m (was: 2h 10m)
> Streamline creation of Python and Java dependencies pages
> ---------------------------------------------------------
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
> Issue Type: Improvement
> Components: website
> Reporter: David Wrede
> Priority: Minor
> Time Spent: 2h 20m
> Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK
> dependency pages more relevant and up-to-date while reducing the amount of
> time it takes to provide that information. The current method of scraping and
> copying dependencies into a table for every release is a non-trivial task
> because of the semi-automated workflows done by the tech writers on the
> website.
> In an effort to provide accurate dependency listings that are always in sync
> with SDK releases, referring people to the appropriate places in the source
> code (or through CLI commands) should provide people the information they are
> looking for and not require the creation and maintenance of an automated
> tooling solution to generate the dependency tables.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
