[jira] [Resolved] (BEAM-9074) Make it visible on Beam website that Beam signed a pledge to sunset Python 2 offering in 2020 and future versions of Beam will not support Python 2.
[ https://issues.apache.org/jira/browse/BEAM-9074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen resolved BEAM-9074. --- Fix Version/s: Not applicable Resolution: Fixed > Make it visible on Beam website that Beam signed a pledge to sunset Python 2 > offering in 2020 and future versions of Beam will not support Python 2. > - > > Key: BEAM-9074 > URL: https://issues.apache.org/jira/browse/BEAM-9074 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Valentyn Tymofieiev >Assignee: Rose Nguyen >Priority: P2 > Fix For: Not applicable > > Time Spent: 0.5h > Remaining Estimate: 0h > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-9991) Mention start/finishBundle in ParDo documentation
[ https://issues.apache.org/jira/browse/BEAM-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108791#comment-17108791 ] Rose Nguyen commented on BEAM-9991: --- I think the ParDo section of the programming guide would be more appropriate: [https://beam.apache.org/documentation/programming-guide/#pardo] Adding it to the Java Transform Catalog would work if we could also include a new Colab code sample. > Mention start/finishBundle in ParDo documentation > - > > Key: BEAM-9991 > URL: https://issues.apache.org/jira/browse/BEAM-9991 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Brent Worden >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-9991) Mention start/finishBundle in ParDo documentation
Rose Nguyen created BEAM-9991: - Summary: Mention start/finishBundle in ParDo documentation Key: BEAM-9991 URL: https://issues.apache.org/jira/browse/BEAM-9991 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (BEAM-9750) Streaming Word Count Example Documents is out of date (Python)
[ https://issues.apache.org/jira/browse/BEAM-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086166#comment-17086166 ] Rose Nguyen edited comment on BEAM-9750 at 4/17/20, 11:53 PM: -- Are we looking to generate a sample on how to run the streaming wordcount module on Flink? I don't see it anywhere on the Flink docs–should we find someone to write this? was (Author: rtnguyen): Are we looking to generate a sample on how to run the streaming wordcount module on Flink? I don't it anywhere on the Flink docs–should we find someone to write this? > Streaming Word Count Example Documents is out of date (Python) > -- > > Key: BEAM-9750 > URL: https://issues.apache.org/jira/browse/BEAM-9750 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, website >Reporter: Ahmet Altay >Assignee: Rose Nguyen >Priority: Major > > Flink runners are listed as "This runner is not yet available for the Python > SDK." This is not accurate., Flink runner supports streaming with python. > Link: > https://beam.apache.org/get-started/wordcount-example/#streamingwordcount-example > /cc [~ibzib] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-9750) Streaming Word Count Example Documents is out of date (Python)
[ https://issues.apache.org/jira/browse/BEAM-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17086166#comment-17086166 ] Rose Nguyen commented on BEAM-9750: --- Are we looking to generate a sample on how to run the streaming wordcount module on Flink? I don't it anywhere on the Flink docs–should we find someone to write this? > Streaming Word Count Example Documents is out of date (Python) > -- > > Key: BEAM-9750 > URL: https://issues.apache.org/jira/browse/BEAM-9750 > Project: Beam > Issue Type: Bug > Components: sdk-py-core, website >Reporter: Ahmet Altay >Assignee: Rose Nguyen >Priority: Major > > Flink runners are listed as "This runner is not yet available for the Python > SDK." This is not accurate., Flink runner supports streaming with python. > Link: > https://beam.apache.org/get-started/wordcount-example/#streamingwordcount-example > /cc [~ibzib] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BEAM-8386) Java Dependencies out of date
[ https://issues.apache.org/jira/browse/BEAM-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16975498#comment-16975498 ] Rose Nguyen commented on BEAM-8386: --- I don't remember when the decision was made to stop updating the dependencies, but it would appear that we've gone through several releases without this being an issue. We could replace the content of this page with instruction on how to grab their Java dependencies and options for processing the output to make it useful. Can we provide general guidelines on how to to generate these dependencies, or are the use cases too specific? > Java Dependencies out of date > - > > Key: BEAM-8386 > URL: https://issues.apache.org/jira/browse/BEAM-8386 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Mehran Nazir >Assignee: Kenneth Knowles >Priority: Critical > > When navigating to see the "Apache Beam 2.x SDKs" in the Datafloc docs > ([https://cloud.google.com/dataflow/docs/concepts/sdk-worker-dependencies#beam-2x-java]), > you must click through to the Beam website > ([https://beam.apache.org/documentation/sdks/java-dependencies/|https://www.google.com/url?q=https://beam.apache.org/documentation/sdks/java-dependencies/=D=AFQjCNGxu_OwwI-9x88aRB0l7b9G-FnnSQ]). > However, it appears that this hasn't been updated since 2.9.0. > External libraries for 2.16 can be found here > ([https://github.com/apache/beam/blob/release-2.16.0/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L434|https://www.google.com/url?q=https://github.com/apache/beam/blob/release-2.16.0/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy%23L434=D=AFQjCNHODYjJ3BTENZrgUOj82dG_Pl8Usw]). > Additional context found here: > [https://lists.apache.org/thread.html/eb25c9a2c9d26117a6f0ee924902ecd46cd5c2063025918df7080d3a@%3Cdev.beam.apache.org%3E] -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-8295) Python streaming doc changes
Rose Nguyen created BEAM-8295: - Summary: Python streaming doc changes Key: BEAM-8295 URL: https://issues.apache.org/jira/browse/BEAM-8295 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Python streaming doc changes for the 2.16 release -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (BEAM-8287) Update documentation for Python 3 support after Beam 2.16.0.
[ https://issues.apache.org/jira/browse/BEAM-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-8287: - Assignee: Cyrus Maden (was: Rose Nguyen) > Update documentation for Python 3 support after Beam 2.16.0. > > > Key: BEAM-8287 > URL: https://issues.apache.org/jira/browse/BEAM-8287 > Project: Beam > Issue Type: Sub-task > Components: website >Reporter: Valentyn Tymofieiev >Assignee: Cyrus Maden >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BEAM-8007) Update Python dependencies page for 2.15.0
Rose Nguyen created BEAM-8007: - Summary: Update Python dependencies page for 2.15.0 Key: BEAM-8007 URL: https://issues.apache.org/jira/browse/BEAM-8007 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Update Python dependencies page for 2.15.0 [https://beam.apache.org/documentation/sdks/python-dependencies/] -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (BEAM-3763) Add per-transform documentation to the website
[ https://issues.apache.org/jira/browse/BEAM-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910743#comment-16910743 ] Rose Nguyen commented on BEAM-3763: --- Yes, thank you! > Add per-transform documentation to the website > -- > > Key: BEAM-3763 > URL: https://issues.apache.org/jira/browse/BEAM-3763 > Project: Beam > Issue Type: Task > Components: website >Reporter: Rafael Fernandez >Priority: Minor > Labels: easyfix, reference > Fix For: Not applicable > > > Add structure to the website to incrementally document per-transform > definitions and examples. The idea is to incrementally populate this section > and clean up stale javadoc entries which have unworkable / outdated examples. > > This task tracks creating the right structure for the website. Each transform > cleanup/documentation will come with its own JIRA, to facilitate other > members of the community to pick up outstanding work. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Resolved] (BEAM-7700) Java transform catalog
[ https://issues.apache.org/jira/browse/BEAM-7700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen resolved BEAM-7700. --- Fix Version/s: Not applicable Resolution: Fixed > Java transform catalog > -- > > Key: BEAM-7700 > URL: https://issues.apache.org/jira/browse/BEAM-7700 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > Fix For: Not applicable > > Time Spent: 7h 20m > Remaining Estimate: 0h > > Create catalog of core transforms (Java) > -Java transforms overview > -Links to Javadocs > -Brief description > -Related transforms > -Links to programming guide > -Examples section to integrate Colab notebooks > > See BEAM-7464 for Python. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Comment Edited] (BEAM-3763) Add per-transform documentation to the website
[ https://issues.apache.org/jira/browse/BEAM-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910733#comment-16910733 ] Rose Nguyen edited comment on BEAM-3763 at 8/19/19 8:31 PM: Yes; see BEAM-7700, BEAM-7464, BEAM-7702, BEAM-7703, BEAM-7704, BEAM-7705, BEAM-7706 I'm not sure how to link it to this Jira besides adding the issue # in the PRs was (Author: rtnguyen): Yes; see BEAM-7700, BEAM-7464, BEAM-7702, BEAM-7703, BEAM-7704, BEAM-7705 I'm not sure how to link it to this Jira besides adding the issue # in the PRs > Add per-transform documentation to the website > -- > > Key: BEAM-3763 > URL: https://issues.apache.org/jira/browse/BEAM-3763 > Project: Beam > Issue Type: Task > Components: website >Reporter: Rafael Fernandez >Priority: Minor > Labels: easyfix, reference > > Add structure to the website to incrementally document per-transform > definitions and examples. The idea is to incrementally populate this section > and clean up stale javadoc entries which have unworkable / outdated examples. > > This task tracks creating the right structure for the website. Each transform > cleanup/documentation will come with its own JIRA, to facilitate other > members of the community to pick up outstanding work. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Comment Edited] (BEAM-3763) Add per-transform documentation to the website
[ https://issues.apache.org/jira/browse/BEAM-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910733#comment-16910733 ] Rose Nguyen edited comment on BEAM-3763 at 8/19/19 8:30 PM: Yes; see BEAM-7700, BEAM-7464, BEAM-7702, BEAM-7703, BEAM-7704, BEAM-7705 I'm not sure how to link it to this Jira besides adding the issue # in the PRs was (Author: rtnguyen): Yes; see BEAM-7700, BEAM-7464, BEAM-7702-7705 I'm not sure how to link it to this Jira besides adding the issue # in the PRs > Add per-transform documentation to the website > -- > > Key: BEAM-3763 > URL: https://issues.apache.org/jira/browse/BEAM-3763 > Project: Beam > Issue Type: Task > Components: website >Reporter: Rafael Fernandez >Priority: Minor > Labels: easyfix, reference > > Add structure to the website to incrementally document per-transform > definitions and examples. The idea is to incrementally populate this section > and clean up stale javadoc entries which have unworkable / outdated examples. > > This task tracks creating the right structure for the website. Each transform > cleanup/documentation will come with its own JIRA, to facilitate other > members of the community to pick up outstanding work. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (BEAM-3763) Add per-transform documentation to the website
[ https://issues.apache.org/jira/browse/BEAM-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910733#comment-16910733 ] Rose Nguyen commented on BEAM-3763: --- Yes; see BEAM-7700, BEAM-7464, BEAM-7702-7705 I'm not sure how to link it to this Jira besides adding the issue # in the PRs > Add per-transform documentation to the website > -- > > Key: BEAM-3763 > URL: https://issues.apache.org/jira/browse/BEAM-3763 > Project: Beam > Issue Type: Task > Components: website >Reporter: Rafael Fernandez >Priority: Minor > Labels: easyfix, reference > > Add structure to the website to incrementally document per-transform > definitions and examples. The idea is to incrementally populate this section > and clean up stale javadoc entries which have unworkable / outdated examples. > > This task tracks creating the right structure for the website. Each transform > cleanup/documentation will come with its own JIRA, to facilitate other > members of the community to pick up outstanding work. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (BEAM-7706) Update Python transform catalog
[ https://issues.apache.org/jira/browse/BEAM-7706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16893150#comment-16893150 ] Rose Nguyen commented on BEAM-7706: --- Add edits suggested by robinyqiu in [PR-9129|[https://github.com/apache/beam/pull/9129]] > Update Python transform catalog > > > Key: BEAM-7706 > URL: https://issues.apache.org/jira/browse/BEAM-7706 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > Update Python transform catalog with newly added transforms -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Created] (BEAM-7706) Update Python transform catalog
Rose Nguyen created BEAM-7706: - Summary: Update Python transform catalog Key: BEAM-7706 URL: https://issues.apache.org/jira/browse/BEAM-7706 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Update Python transform catalog with newly added transforms -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BEAM-7705) Colab examples for connector transforms (Java)
[ https://issues.apache.org/jira/browse/BEAM-7705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen updated BEAM-7705: -- Summary: Colab examples for connector transforms (Java) (was: Colab examples for connector transforms (Python)) > Colab examples for connector transforms (Java) > -- > > Key: BEAM-7705 > URL: https://issues.apache.org/jira/browse/BEAM-7705 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: David Cavazos >Priority: Minor > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7704) Colab examples for other transforms (Java)
Rose Nguyen created BEAM-7704: - Summary: Colab examples for other transforms (Java) Key: BEAM-7704 URL: https://issues.apache.org/jira/browse/BEAM-7704 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7705) Colab examples for connector transforms (Python)
Rose Nguyen created BEAM-7705: - Summary: Colab examples for connector transforms (Python) Key: BEAM-7705 URL: https://issues.apache.org/jira/browse/BEAM-7705 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7703) Colab examples for aggregation transforms (Java)
Rose Nguyen created BEAM-7703: - Summary: Colab examples for aggregation transforms (Java) Key: BEAM-7703 URL: https://issues.apache.org/jira/browse/BEAM-7703 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7702) Colab examples for element-wise transforms (Java)
Rose Nguyen created BEAM-7702: - Summary: Colab examples for element-wise transforms (Java) Key: BEAM-7702 URL: https://issues.apache.org/jira/browse/BEAM-7702 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos Colab examples for element-wise transforms (Java) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7701) Update Python dependencies page for 2.14.0
Rose Nguyen created BEAM-7701: - Summary: Update Python dependencies page for 2.14.0 Key: BEAM-7701 URL: https://issues.apache.org/jira/browse/BEAM-7701 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Update Python dependencies page for 2.14.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-7700) Java transform catalog
[ https://issues.apache.org/jira/browse/BEAM-7700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880539#comment-16880539 ] Rose Nguyen commented on BEAM-7700: --- [~dcavazos] FYI > Java transform catalog > -- > > Key: BEAM-7700 > URL: https://issues.apache.org/jira/browse/BEAM-7700 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > Create catalog of core transforms (Java) > -Java transforms overview > -Links to Javadocs > -Brief description > -Related transforms > -Links to programming guide > -Examples section to integrate Colab notebooks > > See BEAM-7464 for Python. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7700) Java transform catalog
Rose Nguyen created BEAM-7700: - Summary: Java transform catalog Key: BEAM-7700 URL: https://issues.apache.org/jira/browse/BEAM-7700 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Create catalog of core transforms (Java) -Java transforms overview -Links to Javadocs -Brief description -Related transforms -Links to programming guide -Examples section to integrate Colab notebooks See BEAM-7464 for Python. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BEAM-7524) Update Python dependencies page for 2.13.0
[ https://issues.apache.org/jira/browse/BEAM-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen closed BEAM-7524. - Resolution: Fixed Fix Version/s: Not applicable > Update Python dependencies page for 2.13.0 > -- > > Key: BEAM-7524 > URL: https://issues.apache.org/jira/browse/BEAM-7524 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > Fix For: Not applicable > > Time Spent: 0.5h > Remaining Estimate: 0h > > Update Python dependencies page for 2.13.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7524) Update Python dependencies page for 2.13.0
Rose Nguyen created BEAM-7524: - Summary: Update Python dependencies page for 2.13.0 Key: BEAM-7524 URL: https://issues.apache.org/jira/browse/BEAM-7524 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Update Python dependencies page for 2.13.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BEAM-7464) Python transform catalog
[ https://issues.apache.org/jira/browse/BEAM-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen closed BEAM-7464. - Resolution: Fixed Fix Version/s: Not applicable > Python transform catalog > > > Key: BEAM-7464 > URL: https://issues.apache.org/jira/browse/BEAM-7464 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > Fix For: Not applicable > > Time Spent: 20m > Remaining Estimate: 0h > > Create catalog of core transforms (Python) > -Links to pydocs > -Brief description > -Related transforms > -Links to programming guide > -Examples section to integrate Colab notebooks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (BEAM-7464) Python transform catalog
[ https://issues.apache.org/jira/browse/BEAM-7464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16852636#comment-16852636 ] Rose Nguyen commented on BEAM-7464: --- [~dcavazos] FYI > Python transform catalog > > > Key: BEAM-7464 > URL: https://issues.apache.org/jira/browse/BEAM-7464 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > Create catalog of core transforms (Python) > -Links to pydocs > -Brief description > -Related transforms > -Links to programming guide > -Examples section to integrate Colab notebooks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7464) Python transform catalog
Rose Nguyen created BEAM-7464: - Summary: Python transform catalog Key: BEAM-7464 URL: https://issues.apache.org/jira/browse/BEAM-7464 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Create catalog of core transforms (Python) -Links to pydocs -Brief description -Related transforms -Links to programming guide -Examples section to integrate Colab notebooks -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BEAM-7389) Colab examples for element-wise transforms (Python)
[ https://issues.apache.org/jira/browse/BEAM-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen updated BEAM-7389: -- Issue Type: Improvement (was: New Feature) > Colab examples for element-wise transforms (Python) > --- > > Key: BEAM-7389 > URL: https://issues.apache.org/jira/browse/BEAM-7389 > Project: Beam > Issue Type: Improvement > Components: website >Reporter: Rose Nguyen >Assignee: David Cavazos >Priority: Minor > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7392) Colab examples for connector transforms (Python)
Rose Nguyen created BEAM-7392: - Summary: Colab examples for connector transforms (Python) Key: BEAM-7392 URL: https://issues.apache.org/jira/browse/BEAM-7392 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7391) Colab examples for other transforms (Python)
Rose Nguyen created BEAM-7391: - Summary: Colab examples for other transforms (Python) Key: BEAM-7391 URL: https://issues.apache.org/jira/browse/BEAM-7391 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7390) Colab examples for aggregation transforms (Python)
Rose Nguyen created BEAM-7390: - Summary: Colab examples for aggregation transforms (Python) Key: BEAM-7390 URL: https://issues.apache.org/jira/browse/BEAM-7390 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: David Cavazos Merge aggregation Colabs into the transform catalog -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7389) Colab examples for element-wise transforms (Python)
Rose Nguyen created BEAM-7389: - Summary: Colab examples for element-wise transforms (Python) Key: BEAM-7389 URL: https://issues.apache.org/jira/browse/BEAM-7389 Project: Beam Issue Type: New Feature Components: website Reporter: Rose Nguyen Assignee: David Cavazos -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (BEAM-6916) Reorganize Beam SQL docs
[ https://issues.apache.org/jira/browse/BEAM-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen closed BEAM-6916. - Resolution: Fixed Fix Version/s: Not applicable > Reorganize Beam SQL docs > > > Key: BEAM-6916 > URL: https://issues.apache.org/jira/browse/BEAM-6916 > Project: Beam > Issue Type: New Feature > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > Fix For: Not applicable > > Original Estimate: 168h > Time Spent: 4h 20m > Remaining Estimate: 163h 40m > > This page describes the Calcite SQL dialect supported by Beam SQL. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7231) Add Bigtable to Python supported Beam connectors doc
Rose Nguyen created BEAM-7231: - Summary: Add Bigtable to Python supported Beam connectors doc Key: BEAM-7231 URL: https://issues.apache.org/jira/browse/BEAM-7231 Project: Beam Issue Type: Improvement Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen Adding Bigtable to Python supported Beam connectors -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (BEAM-6916) Reorganize Beam SQL docs
[ https://issues.apache.org/jira/browse/BEAM-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen updated BEAM-6916: -- Summary: Reorganize Beam SQL docs (was: Create "Beam SQL: Calcite support" page) > Reorganize Beam SQL docs > > > Key: BEAM-6916 > URL: https://issues.apache.org/jira/browse/BEAM-6916 > Project: Beam > Issue Type: New Feature > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > Original Estimate: 168h > Time Spent: 1h 10m > Remaining Estimate: 166h 50m > > This page describes the Calcite SQL dialect supported by Beam SQL. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6222) extractOutput allows accumulator modifications
[ https://issues.apache.org/jira/browse/BEAM-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6222: - Assignee: (was: Rose Nguyen) > extractOutput allows accumulator modifications > --- > > Key: BEAM-6222 > URL: https://issues.apache.org/jira/browse/BEAM-6222 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *Combine.CombineFn* > Please explicitly document that modification of the accumulator is allowed as > this allows compaction actions against lists when using accumulating mode -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6217) Typos on javadoc
[
https://issues.apache.org/jira/browse/BEAM-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rose Nguyen reassigned BEAM-6217:
-
Assignee: (was: Rose Nguyen)
> Typos on javadoc
>
>
> Key: BEAM-6217
> URL: https://issues.apache.org/jira/browse/BEAM-6217
> Project: Beam
> Issue Type: Bug
> Components: website
>Reporter: Rose Nguyen
>Priority: Minor
>
> On the javadocs [https://beam.apache.org/releases/javadoc/2.1.0/]
> *View*
> Change tranform->transform in "When a
> [{{ParDo}}|https://beam.apache.org/releases/javadoc/2.1.0/org/apache/beam/sdk/transforms/ParDo.html]
> tranform is processing a main input"
> *AfterWatermark*
> Change therafter->thereafter in "window and then immediately therafter when
> any late data arrives"
> Change Additionaly->Additionally in "Additionaly firings before or after the
> watermark "
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Assigned] (BEAM-6220) Specifying URL of a disk type resource for persistence disk for DataflowPipelineWorkerPoolOptions incorrect
[ https://issues.apache.org/jira/browse/BEAM-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6220: - Assignee: (was: Rose Nguyen) > Specifying URL of a disk type resource for persistence disk for > DataflowPipelineWorkerPoolOptions incorrect > --- > > Key: BEAM-6220 > URL: https://issues.apache.org/jira/browse/BEAM-6220 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *DataflowPipelineWorkerPoolOptions* > getWorkerDiskType > [PROJECT] and [ZONE] variables collapsed > > java.lang.String getWorkerDiskType() > Specifies what type of persistent disk is used. The value is a full disk type > resource, e.g., compute.googleapis.com/projects//zones//diskTypes/pd-ssd. For > more information, see the [API reference documentation for > DiskTypes|https://cloud.google.com/compute/docs/reference/latest/diskTypes]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6219) View.asMap() does not need to fit in memory for batch
[ https://issues.apache.org/jira/browse/BEAM-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6219: - Assignee: (was: Rose Nguyen) > View.asMap() does not need to fit in memory for batch > - > > Key: BEAM-6219 > URL: https://issues.apache.org/jira/browse/BEAM-6219 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *View* > in asMap the sentence "Currently, the resulting map is required to fit into > memory." is incorrect. resulting map does not need to fit in memory for batch > (not anymore). > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7023) WithKeys transform for Python SDK
Rose Nguyen created BEAM-7023: - Summary: WithKeys transform for Python SDK Key: BEAM-7023 URL: https://issues.apache.org/jira/browse/BEAM-7023 Project: Beam Issue Type: New Feature Components: sdk-py-core Reporter: Rose Nguyen Assignee: Ahmet Altay WithKeys PCollection and either a constant key of type K or a function from V to K, and returns a PCollection>, where each of the values in the input PCollection has been paired with either the constant key or a key computed from the value. It should offer the same API as its Java counterpart: [https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/WithKeys.java] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7021) ToString transform for Python SDK
Rose Nguyen created BEAM-7021: - Summary: ToString transform for Python SDK Key: BEAM-7021 URL: https://issues.apache.org/jira/browse/BEAM-7021 Project: Beam Issue Type: New Feature Components: sdk-py-core Reporter: Rose Nguyen Assignee: Ahmet Altay PTransforms for converting a PCollection or PCollection Iterable to a PCollection String It should offer the same API as its Java counterpart: [https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/ToString.java] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-7018) Regex transform for Python SDK
[ https://issues.apache.org/jira/browse/BEAM-7018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-7018: - Assignee: Ahmet Altay > Regex transform for Python SDK > -- > > Key: BEAM-7018 > URL: https://issues.apache.org/jira/browse/BEAM-7018 > Project: Beam > Issue Type: New Feature > Components: sdk-py-core >Reporter: Rose Nguyen >Assignee: Ahmet Altay >Priority: Minor > > PTransorms to use Regular Expressions to process elements in a PCollection > It should offer the same API as its Java counterpart: > [https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Regex.java] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7019) Reify transform for Python SDK
Rose Nguyen created BEAM-7019: - Summary: Reify transform for Python SDK Key: BEAM-7019 URL: https://issues.apache.org/jira/browse/BEAM-7019 Project: Beam Issue Type: New Feature Components: sdk-py-core Reporter: Rose Nguyen Assignee: Ahmet Altay PTransforms for converting between explicit and implicit form of various Beam values. It should offer the same API as its Java counterpart: [https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Reify.java] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-7018) Regex transform for Python SDK
Rose Nguyen created BEAM-7018: - Summary: Regex transform for Python SDK Key: BEAM-7018 URL: https://issues.apache.org/jira/browse/BEAM-7018 Project: Beam Issue Type: New Feature Components: sdk-py-core Reporter: Rose Nguyen PTransorms to use Regular Expressions to process elements in a PCollection It should offer the same API as its Java counterpart: [https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Regex.java] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-7007) Pipeline options documentation has typos and does not show how to use user-defined the options.
[ https://issues.apache.org/jira/browse/BEAM-7007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-7007: - Assignee: Rose Nguyen > Pipeline options documentation has typos and does not show how to use > user-defined the options. > --- > > Key: BEAM-7007 > URL: https://issues.apache.org/jira/browse/BEAM-7007 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Valentyn Tymofieiev >Assignee: Rose Nguyen >Priority: Major > > Link: > [https://beam.apache.org/documentation/programming-guide/#configuring-pipeline-options] > 1) Python and Go snippets incorrectly end with an example from Java tab: "Now > your pipeline can accept --myCustomOption=value as a command-line argument." > 2) The page does not show how users can actually access the values of these > user-defined options. > cc: [~melap], [~rtnguyen] [~altay] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-6916) Create "Beam SQL: Calcite support" page
Rose Nguyen created BEAM-6916: - Summary: Create "Beam SQL: Calcite support" page Key: BEAM-6916 URL: https://issues.apache.org/jira/browse/BEAM-6916 Project: Beam Issue Type: New Feature Components: website Reporter: Rose Nguyen Assignee: Rose Nguyen This page describes the Calcite SQL dialect supported by Beam SQL. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6219) View.asMap() does not need to fit in memory for batch
[ https://issues.apache.org/jira/browse/BEAM-6219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6219: - Assignee: Rose Nguyen > View.asMap() does not need to fit in memory for batch > - > > Key: BEAM-6219 > URL: https://issues.apache.org/jira/browse/BEAM-6219 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *View* > in asMap the sentence "Currently, the resulting map is required to fit into > memory." is incorrect. resulting map does not need to fit in memory for batch > (not anymore). > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6220) Specifying URL of a disk type resource for persistence disk for DataflowPipelineWorkerPoolOptions incorrect
[ https://issues.apache.org/jira/browse/BEAM-6220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6220: - Assignee: Rose Nguyen > Specifying URL of a disk type resource for persistence disk for > DataflowPipelineWorkerPoolOptions incorrect > --- > > Key: BEAM-6220 > URL: https://issues.apache.org/jira/browse/BEAM-6220 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *DataflowPipelineWorkerPoolOptions* > getWorkerDiskType > [PROJECT] and [ZONE] variables collapsed > > java.lang.String getWorkerDiskType() > Specifies what type of persistent disk is used. The value is a full disk type > resource, e.g., compute.googleapis.com/projects//zones//diskTypes/pd-ssd. For > more information, see the [API reference documentation for > DiskTypes|https://cloud.google.com/compute/docs/reference/latest/diskTypes]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6222) extractOutput allows accumulator modifications
[ https://issues.apache.org/jira/browse/BEAM-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rose Nguyen reassigned BEAM-6222: - Assignee: Rose Nguyen > extractOutput allows accumulator modifications > --- > > Key: BEAM-6222 > URL: https://issues.apache.org/jira/browse/BEAM-6222 > Project: Beam > Issue Type: Bug > Components: website >Reporter: Rose Nguyen >Assignee: Rose Nguyen >Priority: Minor > > [https://beam.apache.org/releases/javadoc/2.1.0/] > *Combine.CombineFn* > Please explicitly document that modification of the accumulator is allowed as > this allows compaction actions against lists when using accumulating mode -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (BEAM-6217) Typos on javadoc
[
https://issues.apache.org/jira/browse/BEAM-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rose Nguyen reassigned BEAM-6217:
-
Assignee: Rose Nguyen
> Typos on javadoc
>
>
> Key: BEAM-6217
> URL: https://issues.apache.org/jira/browse/BEAM-6217
> Project: Beam
> Issue Type: Bug
> Components: website
>Reporter: Rose Nguyen
>Assignee: Rose Nguyen
>Priority: Minor
>
> On the javadocs [https://beam.apache.org/releases/javadoc/2.1.0/]
> *View*
> Change tranform->transform in "When a
> [{{ParDo}}|https://beam.apache.org/releases/javadoc/2.1.0/org/apache/beam/sdk/transforms/ParDo.html]
> tranform is processing a main input"
> *AfterWatermark*
> Change therafter->thereafter in "window and then immediately therafter when
> any late data arrives"
> Change Additionaly->Additionally in "Additionaly firings before or after the
> watermark "
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (BEAM-6221) TupleTag must be declared as anonymous class while using sideOutput
Rose Nguyen created BEAM-6221:
-
Summary: TupleTag must be declared as anonymous class while using
sideOutput
Key: BEAM-6221
URL: https://issues.apache.org/jira/browse/BEAM-6221
Project: Beam
Issue Type: Bug
Components: website
Reporter: Rose Nguyen
Assignee: Melissa Pashniak
https://beam.apache.org/documentation/programming-guide/#additional-outputs
The current document should clarify that while using sideOutput, the TupleTag
must be declared as anonymous class.
"Using side outputs brings a specific rule regarding to the coders. The
TupleTag must be declared as an anonymous class (suffixed with {} to the
constructor call). Otherwise coder's inference would be compromised."
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (BEAM-6222) extractOutput allows accumulator modifications
Rose Nguyen created BEAM-6222: - Summary: extractOutput allows accumulator modifications Key: BEAM-6222 URL: https://issues.apache.org/jira/browse/BEAM-6222 Project: Beam Issue Type: Bug Components: website Reporter: Rose Nguyen Assignee: Melissa Pashniak [https://beam.apache.org/releases/javadoc/2.1.0/] *Combine.CombineFn* Please explicitly document that modification of the accumulator is allowed as this allows compaction actions against lists when using accumulating mode -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-6220) Specifying URL of a disk type resource for persistence disk for DataflowPipelineWorkerPoolOptions incorrect
Rose Nguyen created BEAM-6220: - Summary: Specifying URL of a disk type resource for persistence disk for DataflowPipelineWorkerPoolOptions incorrect Key: BEAM-6220 URL: https://issues.apache.org/jira/browse/BEAM-6220 Project: Beam Issue Type: Bug Components: website Reporter: Rose Nguyen Assignee: Melissa Pashniak [https://beam.apache.org/releases/javadoc/2.1.0/] *DataflowPipelineWorkerPoolOptions* getWorkerDiskType [PROJECT] and [ZONE] variables collapsed java.lang.String getWorkerDiskType() Specifies what type of persistent disk is used. The value is a full disk type resource, e.g., compute.googleapis.com/projects//zones//diskTypes/pd-ssd. For more information, see the [API reference documentation for DiskTypes|https://cloud.google.com/compute/docs/reference/latest/diskTypes]. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (BEAM-6219) View.asMap() does not need to fit in memory for batch
Rose Nguyen created BEAM-6219: - Summary: View.asMap() does not need to fit in memory for batch Key: BEAM-6219 URL: https://issues.apache.org/jira/browse/BEAM-6219 Project: Beam Issue Type: Bug Components: website Reporter: Rose Nguyen Assignee: Melissa Pashniak [https://beam.apache.org/releases/javadoc/2.1.0/] *View* in asMap the sentence "Currently, the resulting map is required to fit into memory." is incorrect. resulting map does not need to fit in memory for batch (not anymore). -- This message was sent by Atlassian JIRA (v7.6.3#76005)
