[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=385551=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-385551
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 12/Feb/20 00:04
Start Date: 12/Feb/20 00:04
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745
 
 
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 385551)
Time Spent: 11.5h  (was: 11h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 11.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383899=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383899
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 08/Feb/20 00:28
Start Date: 08/Feb/20 00:28
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583673592
 
 
   Run Website_Stage_GCS PreCommit
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383899)
Time Spent: 11h 20m  (was: 11h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 11h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383110=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383110
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:40
Start Date: 06/Feb/20 19:40
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535252
 
 
   Going to cast a few Jenkins spells to trigger the tests...
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383110)
Time Spent: 11h 10m  (was: 11h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 11h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383108=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383108
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:40
Start Date: 06/Feb/20 19:40
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582662323
 
 
   Looks like Jenkins triggered the runs, but did not pass propagate the signal 
onto the PR:
   https://builds.apache.org/job/beam_PreCommit_Website_Commit/3228/
   https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Commit/3001/
   
   The runs are passing. 
   
   Staging link: 
http://apache-beam-website-pull-requests.storage.googleapis.com/10745/index.html
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383108)
Time Spent: 10h 50m  (was: 10h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383109=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383109
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:40
Start Date: 06/Feb/20 19:40
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535316
 
 
   retest this please
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383109)
Time Spent: 11h  (was: 10h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 11h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383104=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383104
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:38
Start Date: 06/Feb/20 19:38
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535714
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383104)
Time Spent: 10h 20m  (was: 10h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383105=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383105
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:38
Start Date: 06/Feb/20 19:38
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535436
 
 
   beam_PreCommit_Website
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383105)
Time Spent: 10.5h  (was: 10h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383106=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383106
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:38
Start Date: 06/Feb/20 19:38
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535357
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383106)
Time Spent: 10h 40m  (was: 10.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383103=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383103
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:37
Start Date: 06/Feb/20 19:37
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535562
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383103)
Time Spent: 10h 10m  (was: 10h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383102=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383102
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:37
Start Date: 06/Feb/20 19:37
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582687812
 
 
   beam_PreCommit_Website
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383102)
Time Spent: 10h  (was: 9h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 10h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383101=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383101
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:37
Start Date: 06/Feb/20 19:37
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582687779
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383101)
Time Spent: 9h 50m  (was: 9h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383098=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383098
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:31
Start Date: 06/Feb/20 19:31
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583071742
 
 
   Run Website PreCommit
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383098)
Time Spent: 9h 40m  (was: 9.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383096=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383096
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:31
Start Date: 06/Feb/20 19:31
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583071668
 
 
   Run Website_Stage_GCS PreCommit
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383096)
Time Spent: 9.5h  (was: 9h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383064=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383064
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:10
Start Date: 06/Feb/20 19:10
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583062560
 
 
   LGTM :)
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383064)
Time Spent: 9h 20m  (was: 9h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383056=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383056
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:01
Start Date: 06/Feb/20 19:01
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583058579
 
 
   Run Website PreCommit
   
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383056)
Time Spent: 9h 10m  (was: 9h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383055=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383055
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 19:00
Start Date: 06/Feb/20 19:00
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583058435
 
 
   Run Website_Stage_GCS PreCommit
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383055)
Time Spent: 9h  (was: 8h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 9h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383052=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383052
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:59
Start Date: 06/Feb/20 18:59
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583057929
 
 
   Looks like tests are not running again...
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383052)
Time Spent: 8h 50m  (was: 8h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383051=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383051
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:59
Start Date: 06/Feb/20 18:59
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583057869
 
 
   test
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383051)
Time Spent: 8h 40m  (was: 8.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383049=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383049
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:57
Start Date: 06/Feb/20 18:57
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583057156
 
 
   Sorry about that @tvalentyn. Will remember that for next time.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383049)
Time Spent: 8.5h  (was: 8h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383046=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383046
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:56
Start Date: 06/Feb/20 18:56
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583056609
 
 
   Please don't squash reviewed and unreviewed commits as it is difficult to 
see the diff, see: 
https://beam.apache.org/contribute/#make-reviewers-job-easier.
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383046)
Time Spent: 8h  (was: 7h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383047=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383047
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:56
Start Date: 06/Feb/20 18:56
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r376020401
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
 Review comment:
   The example in the remarks for this step now shows and links to the latest 
version of the file.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383047)
Time Spent: 8h 10m  (was: 8h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383048=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383048
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:56
Start Date: 06/Feb/20 18:56
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-583056609
 
 
   Please don't squash reviewed and unreviewed commits in future PRs as it is 
difficult to see the diff, see: 
https://beam.apache.org/contribute/#make-reviewers-job-easier.
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383048)
Time Spent: 8h 20m  (was: 8h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 8h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383044
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:55
Start Date: 06/Feb/20 18:55
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r376019770
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,51 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
 Review comment:
   I don't want to do it here. The point of this step is to show which file the 
reader should look in and which placeholder they should substitute.
   
   The example now shows (and links) to the latest version of the file.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383044)
Time Spent: 7h 50m  (was: 7h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 7h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383043=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383043
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 18:53
Start Date: 06/Feb/20 18:53
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r376019094
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,51 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+```
 
-
-  GroupIdArtifactIdVersion
-  org.apache.activemqactivemq-amqp5.13.1
-  org.apache.activemqactivemq-broker5.13.1
-  org.apache.activemqactivemq-client5.13.1
-  org.apache.activemqactivemq-jaas5.13.1
-  
org.apache.activemq.toolingactivemq-junit5.13.1
-  
org.apache.activemqactivemq-kahadb-store5.13.1
-  org.apache.activemqactivemq-mqtt5.13.1
-  org.apache.apexapex-common3.7.0
-  org.apache.apexapex-engine3.7.0
-  args4jargs4j2.33
-  org.apache.avroavro1.8.2
-  com.google.cloud.bigdataossgcsio1.9.0
-  com.google.cloud.bigdataossutil1.9.0
-  
com.google.cloud.bigtablebigtable-client-core1.4.0
-  net.bytebuddybyte-buddy1.9.3
-  org.apache.commonscommons-compress1.16.1
-  org.apache.commonscommons-csv1.4
-  commons-iocommons-io1.3.2
-  commons-iocommons-io2.5
-  org.apache.commonscommons-lang33.6
-  org.apache.commonscommons-math33.6.1
-  
com.google.cloud.datastoredatastore-v1-proto-client1.6.0
-  
com.google.errorproneerror_prone_annotations2.0.15
-  com.google.apigax-grpc1.29.0
-  
com.google.api-clientgoogle-api-client1.27.0
-  
com.google.api-clientgoogle-api-client-jackson21.27.0
-  
com.google.api-clientgoogle-api-client-java61.27.0
-  
com.google.apisgoogle-api-services-bigqueryv2-rev20181104-1.27.0
-  
com.google.apisgoogle-api-services-clouddebuggerv2-rev20180801-1.27.0
-  
com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev20181015-1.27.0
-  
com.google.apisgoogle-api-services-dataflowv1b3-rev20181107-1.27.0
-  
com.google.apisgoogle-api-services-pubsubv1-rev20181105-1.27.0
-  
com.google.apisgoogle-api-services-storagev1-rev20181013-1.27.0
-  
com.google.authgoogle-auth-library-credentials0.10.0
-  
com.google.authgoogle-auth-library-oauth2-http0.10.0
-  
com.google.cloudgoogle-cloud-bigquery1.27.0
-  com.google.cloudgoogle-cloud-core1.36.0
-  
com.google.cloudgoogle-cloud-core-grpc1.36.0
-  
com.google.cloud.dataflowgoogle-cloud-dataflow-java-proto-library-all0.5.160304
-  
com.google.cloudgoogle-cloud-spanner0.54.0-beta
-  
com.google.http-clientgoogle-http-client1.27.0
-  
com.google.http-clientgoogle-http-client-jackson1.27.0
-  
com.google.http-clientgoogle-http-client-jackson21.27.0
-  
com.google.http-clientgoogle-http-client-protobuf1.27.0
-  
com.google.oauth-clientgoogle-oauth-client1.27.0
-  
com.google.oauth-clientgoogle-oauth-client-java61.27.0
-  io.grpcgrpc-all1.13.1
-  io.grpcgrpc-auth1.13.1
-  io.grpcgrpc-core1.13.1
-  
com.google.api.grpcgrpc-google-cloud-pubsub-v11.18.0
-  io.grpcgrpc-netty1.13.1
-  io.grpcgrpc-protobuf-lite1.13.1
-  io.grpcgrpc-protobuf1.13.1
-  io.grpcgrpc-stub1.13.1
-  com.google.guavaguava20.0
-  com.google.guavaguava-testlib20.0
-  org.apache.hadoophadoop-client2.7.3
-  org.apache.hadoophadoop-common2.7.3
-  org.apache.hadoophadoop-hdfs2.7.3
-  
org.apache.hadoophadoop-mapreduce-client-core2.7.3
-  org.apache.hadoophadoop-minicluster2.7.3
-  org.hamcresthamcrest-core1.3
-  org.hamcresthamcrest-library1.3
-  
com.fasterxml.jackson.corejackson-annotations2.9.5
-  
com.fasterxml.jackson.corejackson-core2.9.5
-  
com.fasterxml.jackson.corejackson-databind2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-cbor2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-yaml2.9.5
-  
com.fasterxml.jackson.datatypejackson-datatype-joda2.9.5
-  
com.fasterxml.jackson.modulejackson-module-scala_2.112.9.5
-  javax.xml.bindjaxb-api2.2.12
-  joda-timejoda-time2.4
-  junitjunit4.12
-  org.apache.kafkakafka_2.111.0.0
-  org.apache.kafkakafka-clients1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383003=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383003
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 17:50
Start Date: 06/Feb/20 17:50
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375987861
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
 Review comment:
   Can we link the file to the latest file?
   
   ```
   [`setup.py`](https://raw.githubusercontent.com/apache/beam/v{{ 
site.release_latest }}/sdks/python/setup.py)
   ```
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383003)
Time Spent: 7.5h  (was: 7h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 7.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=383001=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-383001
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 17:49
Start Date: 06/Feb/20 17:49
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375987342
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,51 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
 Review comment:
   Can we link the file to the latest file?
   
   ```
   
[`BeamModulePlugin.groovy`](https://raw.githubusercontent.com/apache/beam/v{{ 
site.release_latest 
}}/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy)
   ```
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 383001)
Time Spent: 7h 20m  (was: 7h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 7h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382999=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382999
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 17:46
Start Date: 06/Feb/20 17:46
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375985885
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,51 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+```
 
-
-  GroupIdArtifactIdVersion
-  org.apache.activemqactivemq-amqp5.13.1
-  org.apache.activemqactivemq-broker5.13.1
-  org.apache.activemqactivemq-client5.13.1
-  org.apache.activemqactivemq-jaas5.13.1
-  
org.apache.activemq.toolingactivemq-junit5.13.1
-  
org.apache.activemqactivemq-kahadb-store5.13.1
-  org.apache.activemqactivemq-mqtt5.13.1
-  org.apache.apexapex-common3.7.0
-  org.apache.apexapex-engine3.7.0
-  args4jargs4j2.33
-  org.apache.avroavro1.8.2
-  com.google.cloud.bigdataossgcsio1.9.0
-  com.google.cloud.bigdataossutil1.9.0
-  
com.google.cloud.bigtablebigtable-client-core1.4.0
-  net.bytebuddybyte-buddy1.9.3
-  org.apache.commonscommons-compress1.16.1
-  org.apache.commonscommons-csv1.4
-  commons-iocommons-io1.3.2
-  commons-iocommons-io2.5
-  org.apache.commonscommons-lang33.6
-  org.apache.commonscommons-math33.6.1
-  
com.google.cloud.datastoredatastore-v1-proto-client1.6.0
-  
com.google.errorproneerror_prone_annotations2.0.15
-  com.google.apigax-grpc1.29.0
-  
com.google.api-clientgoogle-api-client1.27.0
-  
com.google.api-clientgoogle-api-client-jackson21.27.0
-  
com.google.api-clientgoogle-api-client-java61.27.0
-  
com.google.apisgoogle-api-services-bigqueryv2-rev20181104-1.27.0
-  
com.google.apisgoogle-api-services-clouddebuggerv2-rev20180801-1.27.0
-  
com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev20181015-1.27.0
-  
com.google.apisgoogle-api-services-dataflowv1b3-rev20181107-1.27.0
-  
com.google.apisgoogle-api-services-pubsubv1-rev20181105-1.27.0
-  
com.google.apisgoogle-api-services-storagev1-rev20181013-1.27.0
-  
com.google.authgoogle-auth-library-credentials0.10.0
-  
com.google.authgoogle-auth-library-oauth2-http0.10.0
-  
com.google.cloudgoogle-cloud-bigquery1.27.0
-  com.google.cloudgoogle-cloud-core1.36.0
-  
com.google.cloudgoogle-cloud-core-grpc1.36.0
-  
com.google.cloud.dataflowgoogle-cloud-dataflow-java-proto-library-all0.5.160304
-  
com.google.cloudgoogle-cloud-spanner0.54.0-beta
-  
com.google.http-clientgoogle-http-client1.27.0
-  
com.google.http-clientgoogle-http-client-jackson1.27.0
-  
com.google.http-clientgoogle-http-client-jackson21.27.0
-  
com.google.http-clientgoogle-http-client-protobuf1.27.0
-  
com.google.oauth-clientgoogle-oauth-client1.27.0
-  
com.google.oauth-clientgoogle-oauth-client-java61.27.0
-  io.grpcgrpc-all1.13.1
-  io.grpcgrpc-auth1.13.1
-  io.grpcgrpc-core1.13.1
-  
com.google.api.grpcgrpc-google-cloud-pubsub-v11.18.0
-  io.grpcgrpc-netty1.13.1
-  io.grpcgrpc-protobuf-lite1.13.1
-  io.grpcgrpc-protobuf1.13.1
-  io.grpcgrpc-stub1.13.1
-  com.google.guavaguava20.0
-  com.google.guavaguava-testlib20.0
-  org.apache.hadoophadoop-client2.7.3
-  org.apache.hadoophadoop-common2.7.3
-  org.apache.hadoophadoop-hdfs2.7.3
-  
org.apache.hadoophadoop-mapreduce-client-core2.7.3
-  org.apache.hadoophadoop-minicluster2.7.3
-  org.hamcresthamcrest-core1.3
-  org.hamcresthamcrest-library1.3
-  
com.fasterxml.jackson.corejackson-annotations2.9.5
-  
com.fasterxml.jackson.corejackson-core2.9.5
-  
com.fasterxml.jackson.corejackson-databind2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-cbor2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-yaml2.9.5
-  
com.fasterxml.jackson.datatypejackson-datatype-joda2.9.5
-  
com.fasterxml.jackson.modulejackson-module-scala_2.112.9.5
-  javax.xml.bindjaxb-api2.2.12
-  joda-timejoda-time2.4
-  junitjunit4.12
-  org.apache.kafkakafka_2.111.0.0
-  org.apache.kafkakafka-clients1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382998=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382998
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 17:46
Start Date: 06/Feb/20 17:46
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375985885
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,51 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+```
 
-
-  GroupIdArtifactIdVersion
-  org.apache.activemqactivemq-amqp5.13.1
-  org.apache.activemqactivemq-broker5.13.1
-  org.apache.activemqactivemq-client5.13.1
-  org.apache.activemqactivemq-jaas5.13.1
-  
org.apache.activemq.toolingactivemq-junit5.13.1
-  
org.apache.activemqactivemq-kahadb-store5.13.1
-  org.apache.activemqactivemq-mqtt5.13.1
-  org.apache.apexapex-common3.7.0
-  org.apache.apexapex-engine3.7.0
-  args4jargs4j2.33
-  org.apache.avroavro1.8.2
-  com.google.cloud.bigdataossgcsio1.9.0
-  com.google.cloud.bigdataossutil1.9.0
-  
com.google.cloud.bigtablebigtable-client-core1.4.0
-  net.bytebuddybyte-buddy1.9.3
-  org.apache.commonscommons-compress1.16.1
-  org.apache.commonscommons-csv1.4
-  commons-iocommons-io1.3.2
-  commons-iocommons-io2.5
-  org.apache.commonscommons-lang33.6
-  org.apache.commonscommons-math33.6.1
-  
com.google.cloud.datastoredatastore-v1-proto-client1.6.0
-  
com.google.errorproneerror_prone_annotations2.0.15
-  com.google.apigax-grpc1.29.0
-  
com.google.api-clientgoogle-api-client1.27.0
-  
com.google.api-clientgoogle-api-client-jackson21.27.0
-  
com.google.api-clientgoogle-api-client-java61.27.0
-  
com.google.apisgoogle-api-services-bigqueryv2-rev20181104-1.27.0
-  
com.google.apisgoogle-api-services-clouddebuggerv2-rev20180801-1.27.0
-  
com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev20181015-1.27.0
-  
com.google.apisgoogle-api-services-dataflowv1b3-rev20181107-1.27.0
-  
com.google.apisgoogle-api-services-pubsubv1-rev20181105-1.27.0
-  
com.google.apisgoogle-api-services-storagev1-rev20181013-1.27.0
-  
com.google.authgoogle-auth-library-credentials0.10.0
-  
com.google.authgoogle-auth-library-oauth2-http0.10.0
-  
com.google.cloudgoogle-cloud-bigquery1.27.0
-  com.google.cloudgoogle-cloud-core1.36.0
-  
com.google.cloudgoogle-cloud-core-grpc1.36.0
-  
com.google.cloud.dataflowgoogle-cloud-dataflow-java-proto-library-all0.5.160304
-  
com.google.cloudgoogle-cloud-spanner0.54.0-beta
-  
com.google.http-clientgoogle-http-client1.27.0
-  
com.google.http-clientgoogle-http-client-jackson1.27.0
-  
com.google.http-clientgoogle-http-client-jackson21.27.0
-  
com.google.http-clientgoogle-http-client-protobuf1.27.0
-  
com.google.oauth-clientgoogle-oauth-client1.27.0
-  
com.google.oauth-clientgoogle-oauth-client-java61.27.0
-  io.grpcgrpc-all1.13.1
-  io.grpcgrpc-auth1.13.1
-  io.grpcgrpc-core1.13.1
-  
com.google.api.grpcgrpc-google-cloud-pubsub-v11.18.0
-  io.grpcgrpc-netty1.13.1
-  io.grpcgrpc-protobuf-lite1.13.1
-  io.grpcgrpc-protobuf1.13.1
-  io.grpcgrpc-stub1.13.1
-  com.google.guavaguava20.0
-  com.google.guavaguava-testlib20.0
-  org.apache.hadoophadoop-client2.7.3
-  org.apache.hadoophadoop-common2.7.3
-  org.apache.hadoophadoop-hdfs2.7.3
-  
org.apache.hadoophadoop-mapreduce-client-core2.7.3
-  org.apache.hadoophadoop-minicluster2.7.3
-  org.hamcresthamcrest-core1.3
-  org.hamcresthamcrest-library1.3
-  
com.fasterxml.jackson.corejackson-annotations2.9.5
-  
com.fasterxml.jackson.corejackson-core2.9.5
-  
com.fasterxml.jackson.corejackson-databind2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-cbor2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-yaml2.9.5
-  
com.fasterxml.jackson.datatypejackson-datatype-joda2.9.5
-  
com.fasterxml.jackson.modulejackson-module-scala_2.112.9.5
-  javax.xml.bindjaxb-api2.2.12
-  joda-timejoda-time2.4
-  junitjunit4.12
-  org.apache.kafkakafka_2.111.0.0
-  org.apache.kafkakafka-clients1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382969=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382969
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 16:20
Start Date: 06/Feb/20 16:20
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582984296
 
 
   test
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382969)
Time Spent: 6h 50m  (was: 6h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382968=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382968
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 16:19
Start Date: 06/Feb/20 16:19
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582983991
 
 
   test
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382968)
Time Spent: 6h 40m  (was: 6.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382967=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382967
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 16:19
Start Date: 06/Feb/20 16:19
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582983991
 
 
   test
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382967)
Time Spent: 6.5h  (was: 6h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382651=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382651
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 01:07
Start Date: 06/Feb/20 01:07
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582687779
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382651)
Time Spent: 6h 10m  (was: 6h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382650=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382650
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 01:07
Start Date: 06/Feb/20 01:07
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582687688
 
 
   retest this please
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382650)
Time Spent: 6h  (was: 5h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382653=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382653
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 01:07
Start Date: 06/Feb/20 01:07
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582687812
 
 
   beam_PreCommit_Website
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382653)
Time Spent: 6h 20m  (was: 6h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 6h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382631=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382631
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 00:35
Start Date: 06/Feb/20 00:35
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375585355
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,24 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
 
 Review comment:
   I don't think the disambiguation is required here given the text and example 
below the code block, but since you're the second person to bring it up, I'll 
add the change in. :)
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382631)
Time Spent: 5h 50m  (was: 5h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382618=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382618
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 00:13
Start Date: 06/Feb/20 00:13
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375579487
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
 
 Review comment:
   As long as that is consistent between versions of the file (for supported 
SDKs), then I think that makes sense. 
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382618)
Time Spent: 5.5h  (was: 5h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 5.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382620=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382620
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 06/Feb/20 00:13
Start Date: 06/Feb/20 00:13
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375579600
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
+
+
+2. Review the core dependency list under `REQUIRED_PACKAGES`.
 
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+**Note:** If you require [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) such as `gcp` or `test`, you 
should review the lists under `REQUIRED_TEST_PACKAGES`, `GCP_REQUIREMENTS`, or 
`INTERACTIVE_BEAM` for additional dependencies. 
 
-
+You can also retrieve the dependency list from the command line using the 
following process:
 
-2.16.0
+1.  Create a clean virtual environment on your local machine.
 
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
+Python 3:
 
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+```
+$ python3 -m venv env && source env/bin/activate
+```
+
+Python 2: 
 
-
+```
+$ pip install virtualenv && virtualenv env && source env/bin/activate
+```
 
-2.15.0
+2. [Install the Beam Python SDK]({{ site.baseurl 
}}/get-started/quickstart-py/#download-and-install).
 
-Beam SDK for Python 2.15.0 has the following compile and
-  runtime dependencies.
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.2.9,0.2.10
-  fastavro=0.21.4,0.22
-  future=0.16.0,1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382603
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 23:49
Start Date: 05/Feb/20 23:49
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375572082
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
 
 Review comment:
   I looked at the staged website: I think the documentation may be more 
user-friendly and the link we give in "For example" points to a place in the 
file where requirements are defined instead of the beginning of the file.
   We could use 'https://github.com/apache/beam/...' instead of raw URL for 
this purpose. What do you think? 
   
   Same about BeamModulePlugin reference.
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382603)
Time Spent: 5h 10m  (was: 5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 5h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382604=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382604
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 23:49
Start Date: 05/Feb/20 23:49
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375572630
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
+
+
+2. Review the core dependency list under `REQUIRED_PACKAGES`.
 
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+**Note:** If you require [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) such as `gcp` or `test`, you 
should review the lists under `REQUIRED_TEST_PACKAGES`, `GCP_REQUIREMENTS`, or 
`INTERACTIVE_BEAM` for additional dependencies. 
 
-
+You can also retrieve the dependency list from the command line using the 
following process:
 
-2.16.0
+1.  Create a clean virtual environment on your local machine.
 
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
+Python 3:
 
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+```
+$ python3 -m venv env && source env/bin/activate
+```
+
+Python 2: 
 
-
+```
+$ pip install virtualenv && virtualenv env && source env/bin/activate
+```
 
-2.15.0
+2. [Install the Beam Python SDK]({{ site.baseurl 
}}/get-started/quickstart-py/#download-and-install).
 
-Beam SDK for Python 2.15.0 has the following compile and
-  runtime dependencies.
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.2.9,0.2.10
-  fastavro=0.21.4,0.22
-  future=0.16.0,1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382599=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382599
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 23:27
Start Date: 05/Feb/20 23:27
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582662323
 
 
   Looks like Jenkins triggered the runs, but did not pass propagate the signal 
onto the PR:
   https://builds.apache.org/job/beam_PreCommit_Website_Commit/3228/
   https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Commit/3001/
   
   The runs are passing. 
   
   Staging link: 
http://apache-beam-website-pull-requests.storage.googleapis.com/10745/index.html
   
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382599)
Time Spent: 5h  (was: 4h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382562=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382562
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 22:10
Start Date: 05/Feb/20 22:10
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375536526
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
+
+
+2. Review the core dependency list under `REQUIRED_PACKAGES`.
 
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+**Note:** If you require [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) such as `gcp` or `test`, you 
should review the lists under `REQUIRED_TEST_PACKAGES`, `GCP_REQUIREMENTS`, or 
`INTERACTIVE_BEAM` for additional dependencies. 
 
-
+You can also retrieve the dependency list from the command line using the 
following process:
 
-2.16.0
+1.  Create a clean virtual environment on your local machine.
 
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
+Python 3:
 
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+```
+$ python3 -m venv env && source env/bin/activate
+```
+
+Python 2: 
 
-
+```
+$ pip install virtualenv && virtualenv env && source env/bin/activate
+```
 
-2.15.0
+2. [Install the Beam Python SDK]({{ site.baseurl 
}}/get-started/quickstart-py/#download-and-install).
 
 Review comment:
   Got it
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382547=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382547
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 21:47
Start Date: 05/Feb/20 21:47
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375526685
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
+
+
+2. Review the core dependency list under `REQUIRED_PACKAGES`.
 
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+**Note:** If you require [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) such as `gcp` or `test`, you 
should review the lists under `REQUIRED_TEST_PACKAGES`, `GCP_REQUIREMENTS`, or 
`INTERACTIVE_BEAM` for additional dependencies. 
 
-
+You can also retrieve the dependency list from the command line using the 
following process:
 
-2.16.0
+1.  Create a clean virtual environment on your local machine.
 
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
+Python 3:
 
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+```
+$ python3 -m venv env && source env/bin/activate
+```
+
+Python 2: 
 
-
+```
+$ pip install virtualenv && virtualenv env && source env/bin/activate
+```
 
-2.15.0
+2. [Install the Beam Python SDK]({{ site.baseurl 
}}/get-started/quickstart-py/#download-and-install).
 
 Review comment:
   I actually asked in an earlier comment to link existing installation 
instruction to keep all things related to installation in one place, and not 
duplicate these instructions on multiple pages. For example 
https://beam.apache.org/get-started/quickstart-py/#download-and-install 
mentions how to 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382468=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382468
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 19:30
Start Date: 05/Feb/20 19:30
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375450759
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,24 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
 
 Review comment:
   Nit: can we make the `` into uppercase `` so 
it stands out even more? It makes it more evident that it needs to be replaced.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382468)
Time Spent: 4.5h  (was: 4h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 4.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382467=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382467
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 19:30
Start Date: 05/Feb/20 19:30
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375452138
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,24 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version are listed in 
`BeamModulePlugin.groovy` in the Beam repository. To view them, perform the 
following steps:
 
-2.9.0
+1. Open `BeamModulePlugin.groovy`.
 
-Beam SDK for Java 2.9.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy
+```
 
-
-  GroupIdArtifactIdVersion
-  org.apache.activemqactivemq-amqp5.13.1
-  org.apache.activemqactivemq-broker5.13.1
-  org.apache.activemqactivemq-client5.13.1
-  org.apache.activemqactivemq-jaas5.13.1
-  
org.apache.activemq.toolingactivemq-junit5.13.1
-  
org.apache.activemqactivemq-kahadb-store5.13.1
-  org.apache.activemqactivemq-mqtt5.13.1
-  org.apache.apexapex-common3.7.0
-  org.apache.apexapex-engine3.7.0
-  args4jargs4j2.33
-  org.apache.avroavro1.8.2
-  com.google.cloud.bigdataossgcsio1.9.0
-  com.google.cloud.bigdataossutil1.9.0
-  
com.google.cloud.bigtablebigtable-client-core1.4.0
-  net.bytebuddybyte-buddy1.9.3
-  org.apache.commonscommons-compress1.16.1
-  org.apache.commonscommons-csv1.4
-  commons-iocommons-io1.3.2
-  commons-iocommons-io2.5
-  org.apache.commonscommons-lang33.6
-  org.apache.commonscommons-math33.6.1
-  
com.google.cloud.datastoredatastore-v1-proto-client1.6.0
-  
com.google.errorproneerror_prone_annotations2.0.15
-  com.google.apigax-grpc1.29.0
-  
com.google.api-clientgoogle-api-client1.27.0
-  
com.google.api-clientgoogle-api-client-jackson21.27.0
-  
com.google.api-clientgoogle-api-client-java61.27.0
-  
com.google.apisgoogle-api-services-bigqueryv2-rev20181104-1.27.0
-  
com.google.apisgoogle-api-services-clouddebuggerv2-rev20180801-1.27.0
-  
com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev20181015-1.27.0
-  
com.google.apisgoogle-api-services-dataflowv1b3-rev20181107-1.27.0
-  
com.google.apisgoogle-api-services-pubsubv1-rev20181105-1.27.0
-  
com.google.apisgoogle-api-services-storagev1-rev20181013-1.27.0
-  
com.google.authgoogle-auth-library-credentials0.10.0
-  
com.google.authgoogle-auth-library-oauth2-http0.10.0
-  
com.google.cloudgoogle-cloud-bigquery1.27.0
-  com.google.cloudgoogle-cloud-core1.36.0
-  
com.google.cloudgoogle-cloud-core-grpc1.36.0
-  
com.google.cloud.dataflowgoogle-cloud-dataflow-java-proto-library-all0.5.160304
-  
com.google.cloudgoogle-cloud-spanner0.54.0-beta
-  
com.google.http-clientgoogle-http-client1.27.0
-  
com.google.http-clientgoogle-http-client-jackson1.27.0
-  
com.google.http-clientgoogle-http-client-jackson21.27.0
-  
com.google.http-clientgoogle-http-client-protobuf1.27.0
-  
com.google.oauth-clientgoogle-oauth-client1.27.0
-  
com.google.oauth-clientgoogle-oauth-client-java61.27.0
-  io.grpcgrpc-all1.13.1
-  io.grpcgrpc-auth1.13.1
-  io.grpcgrpc-core1.13.1
-  
com.google.api.grpcgrpc-google-cloud-pubsub-v11.18.0
-  io.grpcgrpc-netty1.13.1
-  io.grpcgrpc-protobuf-lite1.13.1
-  io.grpcgrpc-protobuf1.13.1
-  io.grpcgrpc-stub1.13.1
-  com.google.guavaguava20.0
-  com.google.guavaguava-testlib20.0
-  org.apache.hadoophadoop-client2.7.3
-  org.apache.hadoophadoop-common2.7.3
-  org.apache.hadoophadoop-hdfs2.7.3
-  
org.apache.hadoophadoop-mapreduce-client-core2.7.3
-  org.apache.hadoophadoop-minicluster2.7.3
-  org.hamcresthamcrest-core1.3
-  org.hamcresthamcrest-library1.3
-  
com.fasterxml.jackson.corejackson-annotations2.9.5
-  
com.fasterxml.jackson.corejackson-core2.9.5
-  
com.fasterxml.jackson.corejackson-databind2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-cbor2.9.5
-  
com.fasterxml.jackson.dataformatjackson-dataformat-yaml2.9.5
-  
com.fasterxml.jackson.datatypejackson-datatype-joda2.9.5
-  
com.fasterxml.jackson.modulejackson-module-scala_2.112.9.5
-  javax.xml.bindjaxb-api2.2.12
-  joda-timejoda-time2.4
-  junitjunit4.12
-  org.apache.kafkakafka_2.111.0.0
-  org.apache.kafkakafka-clients1.0.0
-  

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382466
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 19:30
Start Date: 05/Feb/20 19:30
Worklog Time Spent: 10m 
  Work Description: davidcavazos commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375461122
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version are listed in `setup.py` in the Beam 
repository. To view them, perform the following steps:
 
-2.17.0
+1. Open `setup.py`.
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
+```
+
https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py
+```
+
+Replace `` with the major.minor.patch version of the SDK. 
For example, 
{:target="_blank"}
 will provide the dependencies for the 2.18.0 release.
+
+
+2. Review the core dependency list under `REQUIRED_PACKAGES`.
 
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+**Note:** If you require [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) such as `gcp` or `test`, you 
should review the lists under `REQUIRED_TEST_PACKAGES`, `GCP_REQUIREMENTS`, or 
`INTERACTIVE_BEAM` for additional dependencies. 
 
-
+You can also retrieve the dependency list from the command line using the 
following process:
 
-2.16.0
+1.  Create a clean virtual environment on your local machine.
 
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
+Python 3:
 
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
+```
+$ python3 -m venv env && source env/bin/activate
+```
+
+Python 2: 
 
-
+```
+$ pip install virtualenv && virtualenv env && source env/bin/activate
+```
 
-2.15.0
+2. [Install the Beam Python SDK]({{ site.baseurl 
}}/get-started/quickstart-py/#download-and-install).
 
 Review comment:
   To not have to jump to an additional step, can we just put the command to 
run?
   
   ```
   pip install -U apache-beam==2.18.0
   ```
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382416=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382416
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:03
Start Date: 05/Feb/20 18:03
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535562
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382416)
Time Spent: 4h  (was: 3h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 4h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382417=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382417
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:03
Start Date: 05/Feb/20 18:03
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535714
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382417)
Time Spent: 4h 10m  (was: 4h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 4h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382415=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382415
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:03
Start Date: 05/Feb/20 18:03
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535436
 
 
   beam_PreCommit_Website
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382415)
Time Spent: 3h 50m  (was: 3h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382414=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382414
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:03
Start Date: 05/Feb/20 18:03
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535357
 
 
   beam_PreCommit_Website_Stage_GCS
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382414)
Time Spent: 3h 40m  (was: 3.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382413=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382413
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:02
Start Date: 05/Feb/20 18:02
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535316
 
 
   retest this please
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382413)
Time Spent: 3.5h  (was: 3h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382412=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382412
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:02
Start Date: 05/Feb/20 18:02
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582535252
 
 
   Going to cast a few Jenkins spells to trigger the tests...
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382412)
Time Spent: 3h 20m  (was: 3h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382408=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382408
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 18:01
Start Date: 05/Feb/20 18:01
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582534811
 
 
   LGTM, thank you!
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382408)
Time Spent: 3h 10m  (was: 3h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382028=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382028
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 02:12
Start Date: 05/Feb/20 02:12
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375026371
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,41 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Dependencies for your Beam SDK version dependencies are listed in `setup.py` 
in the Beam repository. To view them, perform the following steps:
 
 Review comment:
   'dependencies' is repeated twice here as well. Let's shorten this to 
`Dependencies for your Beam SDK are listed in...`
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382028)
Time Spent: 3h  (was: 2h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=382027=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-382027
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 05/Feb/20 02:12
Start Date: 05/Feb/20 02:12
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r375025947
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,24 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+Compile and runtime dependencies for your Beam SDK version dependencies are 
listed in `BeamModulePlugin.groovy` in the Beam repository. To view them, 
perform the following steps:
 
 Review comment:
   Looks like 'dependencies' is repeated twice.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 382027)
Time Spent: 3h  (was: 2h 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 3h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381825=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381825
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 04/Feb/20 19:10
Start Date: 04/Feb/20 19:10
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582067451
 
 
   @tvalentyn I incorporated the majority of your feedback, but left the venv 
instructions in for Python 3 as that seems to be the 
[guidance](https://packaging.python.org/guides/installing-using-pip-and-virtual-environments/#installing-virtualenv)
 from python.org.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381825)
Time Spent: 2h 50m  (was: 2h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 2h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381778=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381778
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 04/Feb/20 18:20
Start Date: 04/Feb/20 18:20
Worklog Time Spent: 10m 
  Work Description: soyrice commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-582046178
 
 
   LGTM after updating "compile and runtime dependencies" in the Python deps 
doc to "dependencies"  per Valentyn's comment
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381778)
Time Spent: 2h 40m  (was: 2.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 2h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381221=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381221
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:39
Start Date: 03/Feb/20 22:39
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374376538
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
 Review comment:
   Python doesn't have a notion of compile-time dependency, I'd say just 
dependencies. Same as above, I would rewrite this sentence slightly.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381221)
Time Spent: 2h 20m  (was: 2h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 2h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381218=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381218
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:38
Start Date: 03/Feb/20 22:38
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374382170
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
-
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.16.0
-
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
-
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.15.0
-
-Beam SDK for Python 2.15.0 has the following compile and
-  runtime dependencies.
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.2.9,0.2.10
-  fastavro=0.21.4,0.22
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,0.33.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,0.40.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.8,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.14.0
-
-Beam SDK for Python 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381220=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381220
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:39
Start Date: 03/Feb/20 22:39
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374375451
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
-
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.16.0
-
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
-
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.15.0
-
-Beam SDK for Python 2.15.0 has the following compile and
-  runtime dependencies.
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.2.9,0.2.10
-  fastavro=0.21.4,0.22
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,0.33.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,0.40.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.8,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.14.0
-
-Beam SDK for Python 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381222=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381222
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:39
Start Date: 03/Feb/20 22:39
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374382310
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
 Review comment:
   I would say: "If you require extra features ... such as ...,you should 
review ... for additional dependencies"
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381222)
Time Spent: 2.5h  (was: 2h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381219=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381219
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:39
Start Date: 03/Feb/20 22:39
Worklog Time Spent: 10m 
  Work Description: tvalentyn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374372668
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,12 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, 
dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy`
 under `project.ext.library`. 
 
 Review comment:
   It looks like we might want to rephrase the first sentence. Should we say 
"Compile and runtime dependencies for your Beam SDK version dependencies are 
listed in ..."
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381219)
Time Spent: 2h 10m  (was: 2h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 2h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381217=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381217
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:37
Start Date: 03/Feb/20 22:37
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374381699
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
 Review comment:
   Made the sed change. 
   
   The other lists live within the setup.py file right below 
`REQUIRED_PACKAGES`. 
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381217)
Time Spent: 1h 50m  (was: 1h 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381215=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381215
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 22:36
Start Date: 03/Feb/20 22:36
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374381034
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,12 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, 
dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy`
 under `project.ext.library`. 
 
 Review comment:
   I addressed the feedback, but left the placeholder as lowercase per the 
Google style guide. Given the additional example and note below the URL, I 
*think* it will be clear to users what the placeholder is and what to replace 
it with.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381215)
Time Spent: 1h 40m  (was: 1.5h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381171=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381171
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 19:57
Start Date: 03/Feb/20 19:57
Worklog Time Spent: 10m 
  Work Description: aaltay commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-581590216
 
 
   > > Should we keep the old information in the same page for previous 
releases? Removing might be a regression for existing users. We could hide in a 
collapsed box maybe?
   > 
   > I worry that keeping these tables will lead to the expectation that we'll 
create more tables. Based on the feedback of the Java deps page, it seems to be 
confusing to just have tables for some of the old versions.
   
   Sounds good. If the new procedure could get the same information as the 
tables let's drop it. And if it cannot, that means we need to improve the new 
process.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381171)
Time Spent: 1.5h  (was: 1h 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381148=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381148
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 19:06
Start Date: 03/Feb/20 19:06
Worklog Time Spent: 10m 
  Work Description: soyrice commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374283944
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,12 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, 
dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy`
 under `project.ext.library`. 
 
 Review comment:
   I'd also consider using all-uppercase characters here instead of the 
all-lowercase recommendation in the Google style guide. Since this placeholder 
is just in plain text (no bold/italics/pink color), the all-uppercase 
characters will help distinguish it as a variable.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381148)
Time Spent: 1h 20m  (was: 1h 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381144=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381144
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 18:58
Start Date: 03/Feb/20 18:58
Worklog Time Spent: 10m 
  Work Description: rosetn commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374279869
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,12 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, 
dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy`
 under `project.ext.library`. 
 
 Review comment:
   That's an excellent point--I'd explain the placeholder and format it 
differently 
   
   https://developers.google.com/style/code-in-text#explaining-placeholders
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381144)
Time Spent: 1h 10m  (was: 1h)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381140=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381140
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 18:54
Start Date: 03/Feb/20 18:54
Worklog Time Spent: 10m 
  Work Description: rosetn commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-581562131
 
 
   > > Should we keep the old information in the same page for previous 
releases? Removing might be a regression for existing users. We could hide in a 
collapsed box maybe?
   > 
   > I worry that keeping these tables will lead to the expectation that we'll 
create more tables. Based on the feedback of the Java deps page, it seems to be 
confusing to just have tables for some of the old versions.
   
   I agree with Cyrus. If it's the same process to access the old information 
as listed here, it's confusing to stop at an old version and might make this 
page look stale.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381140)
Time Spent: 1h  (was: 50m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 1h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381114=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381114
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 18:03
Start Date: 03/Feb/20 18:03
Worklog Time Spent: 10m 
  Work Description: soyrice commented on issue #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#issuecomment-581540535
 
 
   > Should we keep the old information in the same page for previous releases? 
Removing might be a regression for existing users. We could hide in a collapsed 
box maybe?
   
   I worry that keeping these tables will lead to the expectation that we'll 
create more tables. Based on the feedback of the Java deps page, it seems to be 
confusing to just have tables for some of the old versions.
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381114)
Time Spent: 50m  (was: 40m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381037=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381037
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 15:36
Start Date: 03/Feb/20 15:36
Worklog Time Spent: 10m 
  Work Description: soyrice commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374171829
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
-Beam SDK for Python 2.17.0 has the following compile and runtime 
dependencies.
-
-
-PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.15.1,0.16.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.16.0
-
-Beam SDK for Python 2.16.0 has the following compile and
-  runtime dependencies.
-
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.3.0,0.3.1
-  fastavro=0.21.4,0.22
-  funcsigs=1.0.2,2; python_version  
"3.0"
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,1.1.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,1.1.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.12.1,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  python-dateutil=2.8.0,3
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.15.0
-
-Beam SDK for Python 2.15.0 has the following compile and
-  runtime dependencies.
-
-  PackageVersion
-  avro-python3=1.8.1,2.0.0; python_version = 
"3.0"
-  avro=1.8.1,2.0.0; python_version  
"3.0"
-  cachetools=3.1.0,4
-  crcmod=1.7,2.0
-  dill=0.2.9,0.2.10
-  fastavro=0.21.4,0.22
-  future=0.16.0,1.0.0
-  futures=3.2.0,4.0.0; python_version  
"3.0"
-  google-apitools=0.5.28,0.5.29
-  google-cloud-bigquery=1.6.0,1.18.0
-  google-cloud-bigtable=0.31.1,0.33.0
-  google-cloud-core=0.28.1,2
-  google-cloud-datastore=1.7.1,1.8.0
-  google-cloud-pubsub=0.39.0,0.40.0
-  googledatastore=7.0.1,7.1; python_version  
"3.0"
-  grpcio=1.8,2
-  hdfs=2.1.0,3.0.0
-  httplib2=0.8,=0.12.0
-  mock=1.0.1,3.0.0
-  oauth2client=2.0.1,4
-  proto-google-cloud-datastore-v1=0.90.0,=0.90.4; 
python_version  "3.0"
-  protobuf=3.5.0.post1,4
-  pyarrow=0.11.1,0.15.0; python_version = "3.0" 
or platform_system != "Windows"
-  pydot=1.2.0,2
-  pymongo=3.8.0,4.0.0
-  pytz=2018.3
-  pyvcf=0.6.8,0.7.0; python_version  
"3.0"
-  pyyaml=3.12,4.0.0
-  typing=3.6.0,3.7.0; python_version  
"3.5.0"
-
-
-
-
-2.14.0
-
-Beam SDK for Python 

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381035=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381035
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 15:36
Start Date: 03/Feb/20 15:36
Worklog Time Spent: 10m 
  Work Description: soyrice commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374166619
 
 

 ##
 File path: website/src/documentation/sdks/java-dependencies.md
 ##
 @@ -26,336 +26,12 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, 
dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy`
 under `project.ext.library`. 
 
 Review comment:
   WDYT about turning this into a stepped list, with explicit instructions for 
replacing "" with the major.minor.revision string? Just 
concerned folks won't know to specify the full version number (e.g., "2.16" 
returns a 404)
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381035)
Time Spent: 20m  (was: 10m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=381036=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-381036
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 03/Feb/20 15:36
Start Date: 03/Feb/20 15:36
Worklog Time Spent: 10m 
  Work Description: soyrice commented on pull request #10745: [BEAM-9219] 
Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745#discussion_r374167609
 
 

 ##
 File path: website/src/documentation/sdks/python-dependencies.md
 ##
 @@ -26,460 +26,8 @@ behavior in the service. If you are using any of these 
packages in your code, be
 aware that some libraries are not forward-compatible and you may need to pin to
 the listed versions that will be in scope during execution.
 
-To see the compile and runtime dependencies for your Beam SDK version, 
expand
-the relevant section below.
+To see the compile and runtime dependencies for your Beam SDK version, core 
SDK dependencies are listed in 
`https://raw.githubusercontent.com/apache/beam/v/sdks/python/setup.py`
 under `REQUIRED_PACKAGES`.
 
-2.17.0
+If you installed any [extra features]({{ site.baseurl 
}}/get-started/quickstart-py#extra-requirements) along with `apache-beam`, such 
as `gcp` or `test`, you should review the lists under `REQUIRED_TEST_PACKAGES`, 
`GCP_REQUIREMENTS`, or `INTERACTIVE_BEAM` for additional dependencies. 
 
 Review comment:
   s/"you can"/w/"you should" since you don't really have to review the lists 
even if you installed the extra features
   
   Also, do we have links to the 
REQUIRED_TEST_PACKAGES/GCP_REQUIREMENTS/INTERACTIVE_BEAM lists?
 

This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 381036)
Time Spent: 0.5h  (was: 20m)

> Streamline creation of Python and Java dependencies pages
> -
>
> Key: BEAM-9219
> URL: https://issues.apache.org/jira/browse/BEAM-9219
> Project: Beam
>  Issue Type: Improvement
>  Components: website
>Reporter: David Wrede
>Priority: Minor
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> This issue is about the need to address keeping both Python and Java SDK 
> dependency pages more relevant and up-to-date while reducing the amount of 
> time it takes to provide that information. The current method of scraping and 
> copying dependencies into a table for every release is a non-trivial task 
> because of the semi-automated workflows done by the tech writers on the 
> website.
> In an effort to provide accurate dependency listings that are always in sync 
> with SDK releases, referring people to the appropriate places in the source 
> code (or through CLI commands) should provide people the information they are 
> looking for and not require the creation and maintenance of an automated 
> tooling solution to generate the dependency tables.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Work logged] (BEAM-9219) Streamline creation of Python and Java dependencies pages

[ASF GitHub Bot (Jira)]

 [ 
https://issues.apache.org/jira/browse/BEAM-9219?focusedWorklogId=380321=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-380321
 ]

ASF GitHub Bot logged work on BEAM-9219:


Author: ASF GitHub Bot
Created on: 01/Feb/20 08:02
Start Date: 01/Feb/20 08:02
Worklog Time Spent: 10m 
  Work Description: davidwrede commented on pull request #10745: 
[BEAM-9219] Streamline creation of Python and Java dependencies pages
URL: https://github.com/apache/beam/pull/10745
 
 
   Remove Java and Python SDK dependency tables from the docs and refer people 
to the source code or alternative methods to get this information. 
   
   R: @tvalentyn, @davidcavazos   
   CC: @aaltay, @rosetn, @soyrice
   
   
   
   Thank you for your contribution! Follow this checklist to help us 
incorporate your contribution quickly and easily:
   
- [ ] [**Choose 
reviewer(s)**](https://beam.apache.org/contribute/#make-your-change) and 
mention them in a comment (`R: @username`).
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue, if applicable. This will automatically link the pull request to the 
issue.
- [ ] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   See the [Contributor Guide](https://beam.apache.org/contribute) for more 
tips on [how to make review process 
smoother](https://beam.apache.org/contribute/#make-reviewers-job-easier).
   
   Post-Commit Tests Status (on master branch)
   

   
   Lang | SDK | Apex | Dataflow | Flink | Gearpump | Samza | Spark
   --- | --- | --- | --- | --- | --- | --- | ---
   Go | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go/lastCompletedBuild/)
 | --- | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Flink/lastCompletedBuild/)
 | --- | --- | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Go_VR_Spark/lastCompletedBuild/)
   Java | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Apex/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Flink/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Batch/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Flink_Streaming/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Gearpump/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Samza/lastCompletedBuild/)
 | [![Build 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_PVR_Spark_Batch/lastCompletedBuild/)[![Build
 
Status](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/badge/icon)](https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/lastCompletedBuild/)
   Python | [![Build