[GitHub] beam pull request #2608: [BEAM-1999] Remove _unused_options_id

GitHub user mariapython opened a pull request: https://github.com/apache/beam/pull/2608 [BEAM-1999] Remove _unused_options_id You can merge this pull request into a Git repository by running: $ git pull https://github.com/mariapython/incubator-beam ppp_after2545 Alternativel

[jira] [Commented] (BEAM-1999) Change signature of set_runtime_options in value_provider.py

[ https://issues.apache.org/jira/browse/BEAM-1999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976226#comment-15976226 ] ASF GitHub Bot commented on BEAM-1999: -- GitHub user mariapython opened a pull request:

[jira] [Created] (BEAM-2023) BigQueryIO.Write needs a way of dynamically specifying table schemas

Reuven Lax created BEAM-2023: Summary: BigQueryIO.Write needs a way of dynamically specifying table schemas Key: BEAM-2023 URL: https://issues.apache.org/jira/browse/BEAM-2023 Project: Beam Issu

[jira] [Created] (BEAM-2024) Python and Java Dataflow refer to AfterCount, but Java Beam does not have AfterCount

Wesley Tanaka created BEAM-2024: --- Summary: Python and Java Dataflow refer to AfterCount, but Java Beam does not have AfterCount Key: BEAM-2024 URL: https://issues.apache.org/jira/browse/BEAM-2024 Projec

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976256#comment-15976256 ] Ismaël Mejía commented on BEAM-2005: [~aviemzur] I think that this should be part of th

[GitHub] beam pull request #2609: [BEAM-2023] Support dynamic schemas

GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2609 [BEAM-2023] Support dynamic schemas The final step in this series of changes to BigQueryIO. Now that we support dynamic, value-dependent tables, also add support for per-table schemas. Th

[jira] [Commented] (BEAM-2023) BigQueryIO.Write needs a way of dynamically specifying table schemas

[ https://issues.apache.org/jira/browse/BEAM-2023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976257#comment-15976257 ] ASF GitHub Bot commented on BEAM-2023: -- GitHub user reuvenlax opened a pull request:

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976262#comment-15976262 ] Jean-Baptiste Onofré commented on BEAM-2005: I think there's two topics: - wher

[jira] [Commented] (BEAM-1789) window can't not use in spark cluster module

[ https://issues.apache.org/jira/browse/BEAM-1789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976280#comment-15976280 ] Amit Sela commented on BEAM-1789: - I'd start with something less complicated, such as: {{R

[GitHub] beam pull request #2607: [BEAM-79] Upgrade Gearpump to a stable version

Github user huafengw closed the pull request at: https://github.com/apache/beam/pull/2607 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (BEAM-79) Gearpump runner

[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976304#comment-15976304 ] ASF GitHub Bot commented on BEAM-79: Github user huafengw closed the pull request at:

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976308#comment-15976308 ] Aviem Zur commented on BEAM-2005: - Yes, it makes sense that the code would be in an extensi

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2417

See

[jira] [Comment Edited] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15974980#comment-15974980 ] Aviem Zur edited comment on BEAM-2005 at 4/20/17 8:43 AM: -- I think

[jira] [Comment Edited] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976046#comment-15976046 ] Aviem Zur edited comment on BEAM-2005 at 4/20/17 8:43 AM: -- Regardi

[jira] [Comment Edited] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976046#comment-15976046 ] Aviem Zur edited comment on BEAM-2005 at 4/20/17 8:44 AM: -- Regardi

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2418

See

[jira] [Created] (BEAM-2025) WordCount Example lacks a link to Pythn full source code

Mitar created BEAM-2025: --- Summary: WordCount Example lacks a link to Pythn full source code Key: BEAM-2025 URL: https://issues.apache.org/jira/browse/BEAM-2025 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-2026) High performance direct runner

Mitar created BEAM-2026: --- Summary: High performance direct runner Key: BEAM-2026 URL: https://issues.apache.org/jira/browse/BEAM-2026 Project: Beam Issue Type: New Feature Components: runner-

Build failed in Jenkins: beam_PerformanceTests_Dataflow #331

See -- [...truncated 259.73 KB...] * [new ref] refs/pull/2539/merge -> origin/pr/2539/merge * [new ref] refs/pull/2540/head -> origin/pr/2540/head * [new

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2419

See

Build failed in Jenkins: beam_PerformanceTests_JDBC #137

See -- [...truncated 741.36 KB...] at com.google.cloud.dataflow.worker.runners.worker.MapTaskExecutorFactory$3.typedApply(MapTaskExecutorFactory.java:261) at c

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1719

See

[jira] [Commented] (BEAM-273) Update Flink Runner version

[ https://issues.apache.org/jira/browse/BEAM-273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976616#comment-15976616 ] Ismaël Mejía commented on BEAM-273: --- I am closing this one after discussion with [~aljosch

[jira] [Closed] (BEAM-273) Update Flink Runner version

[ https://issues.apache.org/jira/browse/BEAM-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía closed BEAM-273. - Resolution: Not A Problem Fix Version/s: Not applicable > Update Flink Runner version > -

[jira] [Created] (BEAM-2027) get error sometimes while running the same code using beam0.6

liyuntian created BEAM-2027: --- Summary: get error sometimes while running the same code using beam0.6 Key: BEAM-2027 URL: https://issues.apache.org/jira/browse/BEAM-2027 Project: Beam Issue Type: B

[jira] [Commented] (BEAM-1103) Add Tests For Aggregators in Flink Runner

[ https://issues.apache.org/jira/browse/BEAM-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976629#comment-15976629 ] Ismaël Mejía commented on BEAM-1103: Closing it after discussion with [~aljoscha] since

[jira] [Closed] (BEAM-1103) Add Tests For Aggregators in Flink Runner

[ https://issues.apache.org/jira/browse/BEAM-1103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía closed BEAM-1103. -- Resolution: Invalid Fix Version/s: Not applicable > Add Tests For Aggregators in Flink Runner > --

[jira] [Commented] (BEAM-140) Improve examples provided with the Flink runner

[ https://issues.apache.org/jira/browse/BEAM-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976635#comment-15976635 ] Ismaël Mejía commented on BEAM-140: --- This is invalid now because the examples were removed

[jira] [Closed] (BEAM-140) Improve examples provided with the Flink runner

[ https://issues.apache.org/jira/browse/BEAM-140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía closed BEAM-140. - Resolution: Invalid Fix Version/s: Not applicable > Improve examples provided with the Flink runner >

[GitHub] beam pull request #2610: Merge master into gearpump-runner branch

GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/2610 Merge master into gearpump-runner branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Updated] (BEAM-1868) CreateStreamTest is flaky on the Spark runner

[ https://issues.apache.org/jira/browse/BEAM-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-1868: --- Summary: CreateStreamTest is flaky on the Spark runner (was: CreateStreamTest is flaky) > CreateStrea

[jira] [Updated] (BEAM-108) Support multiple Scala versions on the Flink runner

[ https://issues.apache.org/jira/browse/BEAM-108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-108: -- Summary: Support multiple Scala versions on the Flink runner (was: Support multiple Scala versions) > Su

[jira] [Created] (BEAM-2028) Support multiple Scala versions on the Spark runner

Ismaël Mejía created BEAM-2028: -- Summary: Support multiple Scala versions on the Spark runner Key: BEAM-2028 URL: https://issues.apache.org/jira/browse/BEAM-2028 Project: Beam Issue Type: Improv

[GitHub] beam pull request #2611: [BEAM-1886] Remove TextIO override in Flink runner

GitHub user aljoscha opened a pull request: https://github.com/apache/beam/pull/2611 [BEAM-1886] Remove TextIO override in Flink runner This is a duplicate of #2537. The tests work locally but not on Jenkins, I'm trying to figure out why that might be. You can merge this pull reque

[jira] [Commented] (BEAM-1886) Remove TextIO override in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976722#comment-15976722 ] ASF GitHub Bot commented on BEAM-1886: -- GitHub user aljoscha opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2420

See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2421

See

[jira] [Created] (BEAM-2029) NullPointerException while evaluating GroupByKey in Spark Runner in streaming mode

Etienne Chauchot created BEAM-2029: -- Summary: NullPointerException while evaluating GroupByKey in Spark Runner in streaming mode Key: BEAM-2029 URL: https://issues.apache.org/jira/browse/BEAM-2029 Pr

[jira] [Commented] (BEAM-2029) NullPointerException while evaluating GroupByKey in Spark Runner in streaming mode

[ https://issues.apache.org/jira/browse/BEAM-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976872#comment-15976872 ] Etienne Chauchot commented on BEAM-2029: I have given above a way to reproduce the

[2/2] beam git commit: This closes #2573

This closes #2573 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4e0c8333 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4e0c8333 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4e0c8333 Branch: refs/heads/maste

[1/2] beam git commit: [BEAM-1948] Defend against absent Aggregators

Repository: beam Updated Branches: refs/heads/master 104f98235 -> 4e0c8333c [BEAM-1948] Defend against absent Aggregators Add protection against null pointer exception if aggregator key is not present in aggregatorSteps Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http:/

[GitHub] beam pull request #2573: [BEAM-1948] Add protection against null pointer exc...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2573 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-1948) Null pointer exception in DirectRunner.DirectPipelineResult.getAggregatorValues()

[ https://issues.apache.org/jira/browse/BEAM-1948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976937#comment-15976937 ] ASF GitHub Bot commented on BEAM-1948: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: Closes #2600

Closes #2600 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4e0d5f59 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4e0d5f59 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4e0d5f59 Branch: refs/heads/master Com

[1/2] beam git commit: [BEAM-662] Fix for allowing floating point periods in windows

Repository: beam Updated Branches: refs/heads/master 4e0c8333c -> 4e0d5f596 [BEAM-662] Fix for allowing floating point periods in windows Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1bc1bdd3 Tree: http://git-wip-us.apach

[GitHub] beam pull request #2600: [BEAM-662] Fix for allowing floating point periods ...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2600 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-662) SlidingWindows should support sub-second periods

[ https://issues.apache.org/jira/browse/BEAM-662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976946#comment-15976946 ] ASF GitHub Bot commented on BEAM-662: - Github user asfgit closed the pull request at:

[3/6] beam git commit: Remove obsolete and unused Runner.clear

Remove obsolete and unused Runner.clear Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4b9029ac Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4b9029ac Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4b9029ac Br

[4/6] beam git commit: Enable IntervalWindowCoder test check.

Enable IntervalWindowCoder test check. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/68c00426 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/68c00426 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/68c00426 Bra

[5/6] beam git commit: Rename AfterFirst to AfterAny for consistency with Java.

Rename AfterFirst to AfterAny for consistency with Java. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2c347192 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2c347192 Diff: http://git-wip-us.apache.org/repos/asf/beam/

[1/6] beam git commit: Make stage names consistent.

Repository: beam Updated Branches: refs/heads/master 4e0d5f596 -> 7019aa70d Make stage names consistent. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/72f50209 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/72f5020

[6/6] beam git commit: Closes #2552

Closes #2552 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7019aa70 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7019aa70 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7019aa70 Branch: refs/heads/master Com

[2/6] beam git commit: Require deterministic window coders.

Require deterministic window coders. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d98294c2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d98294c2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d98294c2 Branc

[GitHub] beam pull request #2552: Various cleanups

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Commented] (BEAM-2005) Add a Hadoop FileSystem implementation of Beam's FileSystem

[ https://issues.apache.org/jira/browse/BEAM-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976952#comment-15976952 ] Stephen Sisk commented on BEAM-2005: I don't want to derail this conversation, but I di

[1/2] beam git commit: Remove bigshuffle from python examples

Repository: beam Updated Branches: refs/heads/master 7019aa70d -> e26bfbe0a Remove bigshuffle from python examples Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/815bbdcc Tree: http://git-wip-us.apache.org/repos/asf/beam/tr

[GitHub] beam pull request #2604: Remove bigshuffle from python examples

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2604 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: Closes #2604

Closes #2604 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e26bfbe0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e26bfbe0 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e26bfbe0 Branch: refs/heads/master Com

[2/2] beam git commit: Closes #2586

Closes #2586 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4121ec49 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4121ec49 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/4121ec49 Branch: refs/heads/master Com

[1/2] beam git commit: Remove vestigial Read and Write from core.py

Repository: beam Updated Branches: refs/heads/master e26bfbe0a -> 4121ec490 Remove vestigial Read and Write from core.py Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c25380be Tree: http://git-wip-us.apache.org/repos/asf/b

[GitHub] beam pull request #2586: Remove vestigial Read and Write from core.py

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2586 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[jira] [Created] (BEAM-2030) Implement beam FileSystem's copy()

Stephen Sisk created BEAM-2030: -- Summary: Implement beam FileSystem's copy() Key: BEAM-2030 URL: https://issues.apache.org/jira/browse/BEAM-2030 Project: Beam Issue Type: Sub-task Comp

[1/3] beam git commit: Exclude UsesSplittableParDoWithWindowedSideInputs in Flink Stream Runner Tests

Repository: beam Updated Branches: refs/heads/master 4121ec490 -> 56398fcba Exclude UsesSplittableParDoWithWindowedSideInputs in Flink Stream Runner Tests Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/252ebf15 Tree: http:/

[3/3] beam git commit: This closes #2537

This closes #2537 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/56398fcb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/56398fcb Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/56398fcb Branch: refs/heads/maste

[2/3] beam git commit: [BEAM-1886] Remove TextIO override in Flink runner

[BEAM-1886] Remove TextIO override in Flink runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0c030d49 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0c030d49 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/0

[GitHub] beam pull request #2537: [BEAM-1886] Remove TextIO override in Flink runner

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2537 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] beam pull request #2611: [BEAM-1886] Remove TextIO override in Flink runner

Github user aljoscha closed the pull request at: https://github.com/apache/beam/pull/2611 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[jira] [Commented] (BEAM-1886) Remove TextIO override in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976964#comment-15976964 ] ASF GitHub Bot commented on BEAM-1886: -- Github user aljoscha closed the pull request a

[jira] [Commented] (BEAM-1886) Remove TextIO override in Flink runner

[ https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976963#comment-15976963 ] ASF GitHub Bot commented on BEAM-1886: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-2031) Hadoop FileSystem needs to receive Hadoop Configuration through PipelineOptions

Stephen Sisk created BEAM-2031: -- Summary: Hadoop FileSystem needs to receive Hadoop Configuration through PipelineOptions Key: BEAM-2031 URL: https://issues.apache.org/jira/browse/BEAM-2031 Project: Beam

[jira] [Commented] (BEAM-2030) Implement beam FileSystem's copy()

[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976973#comment-15976973 ] Luke Cwik commented on BEAM-2030: - What about concat with a single src path? https://hadoop

[jira] [Created] (BEAM-2032) Implement delete

Stephen Sisk created BEAM-2032: -- Summary: Implement delete Key: BEAM-2032 URL: https://issues.apache.org/jira/browse/BEAM-2032 Project: Beam Issue Type: Sub-task Components: sdk-java-e

[jira] [Commented] (BEAM-2026) High performance direct runner

[ https://issues.apache.org/jira/browse/BEAM-2026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976979#comment-15976979 ] Luke Cwik commented on BEAM-2026: - Some runners have local execution modes like Flink and S

[jira] [Created] (BEAM-2033) Implement ResourceIds for HadoopFileSystem

Stephen Sisk created BEAM-2033: -- Summary: Implement ResourceIds for HadoopFileSystem Key: BEAM-2033 URL: https://issues.apache.org/jira/browse/BEAM-2033 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-2021) Fix Java's Coder class hierarchy

[ https://issues.apache.org/jira/browse/BEAM-2021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976987#comment-15976987 ] Luke Cwik commented on BEAM-2021: - We can just use Java serialization for all CustomCoder p

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1720

See

[jira] [Commented] (BEAM-1878) IO ITs: how to handle custom docker images?

[ https://issues.apache.org/jira/browse/BEAM-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977002#comment-15977002 ] Stephen Sisk commented on BEAM-1878: current status: There has been further discussion,

[jira] [Assigned] (BEAM-1878) IO ITs: how to handle custom docker images?

[ https://issues.apache.org/jira/browse/BEAM-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk reassigned BEAM-1878: -- Assignee: (was: Stephen Sisk) > IO ITs: how to handle custom docker images? > --

[jira] [Assigned] (BEAM-1667) Move python content for Pipeline I/O authoring over into new Pipeline I/O section

[ https://issues.apache.org/jira/browse/BEAM-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk reassigned BEAM-1667: -- Assignee: (was: Stephen Sisk) > Move python content for Pipeline I/O authoring over into new

[jira] [Assigned] (BEAM-1668) Add java content for Pipeline I/O authoring

[ https://issues.apache.org/jira/browse/BEAM-1668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk reassigned BEAM-1668: -- Assignee: (was: Stephen Sisk) > Add java content for Pipeline I/O authoring > --

Build failed in Jenkins: beam_PostCommit_Python_Verify #1934

See Changes: [tgroh] [BEAM-1948] Defend against absent Aggregators -- [...truncated 691.83 KB...] Collecting pyparsing (from packaging>=16.8->setuptools->pyha

[jira] [Commented] (BEAM-1643) IO ITs: add validation of row content

[ https://issues.apache.org/jira/browse/BEAM-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977006#comment-15977006 ] Stephen Sisk commented on BEAM-1643: This is in progress - I've got the jdbc version in

[jira] [Closed] (BEAM-1972) HIFIO jdk module fails enforcer when only java 7 is installed on machine

[ https://issues.apache.org/jira/browse/BEAM-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk closed BEAM-1972. -- Resolution: Fixed Fix Version/s: First stable release > HIFIO jdk module fails enforcer when only

[jira] [Updated] (BEAM-1166) Source.getDefaultOutputCoder() - hard to implement for adapter style sources

[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-1166: --- Summary: Source.getDefaultOutputCoder() - hard to implement for adapter style sources (was: Source.get

[jira] [Commented] (BEAM-1166) Source.getDefaultOutputCoder() - hard to implement for adapter style sources

[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977023#comment-15977023 ] Stephen Sisk commented on BEAM-1166: I'm adapting this bug a bit since it's become clea

[jira] [Commented] (BEAM-2030) Implement beam FileSystem's copy()

[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977026#comment-15977026 ] Stephen Sisk commented on BEAM-2030: oh! I like that. That makes sense. Thanks luke! >

[jira] [Assigned] (BEAM-1166) Source.getDefaultOutputCoder() - hard to implement for adapter style sources

[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk reassigned BEAM-1166: -- Assignee: (was: Stephen Sisk) > Source.getDefaultOutputCoder() - hard to implement for adapt

[jira] [Resolved] (BEAM-1027) Hosting data stores to enable IO Transform testing

[ https://issues.apache.org/jira/browse/BEAM-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk resolved BEAM-1027. Resolution: Fixed Fix Version/s: First stable release I decided to go ahead and resolve this s

[2/2] beam git commit: This closes #2508

This closes #2508 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bf16b4a8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bf16b4a8 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/bf16b4a8 Branch: refs/heads/maste

[1/2] beam git commit: Fix KafkaIO javadoc typo

Repository: beam Updated Branches: refs/heads/master 56398fcba -> bf16b4a80 Fix KafkaIO javadoc typo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a77cc22b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a77cc22b Di

[GitHub] beam pull request #2508: Fix KafkaIO javadoc typo

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2508 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

Build failed in Jenkins: beam_PostCommit_Python_Verify #1935

See Changes: [robertwb] [BEAM-662] Fix for allowing floating point periods in windows [robertwb] Make stage names consistent. [robertwb] Require deterministic window coders. [robertwb] Enable Inte

[jira] [Updated] (BEAM-2033) Implement ResourceIds for HadoopFileSystem

[ https://issues.apache.org/jira/browse/BEAM-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-2033: --- Description: There's an empty class for HadoopResourceId already - we will implement it. This blocks m

[jira] [Commented] (BEAM-1247) Session state should not be lost when discardingFiredPanes

[ https://issues.apache.org/jira/browse/BEAM-1247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977091#comment-15977091 ] Frances Perry commented on BEAM-1247: - Any updates on this one? > Session state should

[jira] [Closed] (BEAM-2003) Verify PAssert execution in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2003. - Resolution: Fixed This indeed works in the DataflowRunner. > Verify PAssert execution in TestDataf

[jira] [Commented] (BEAM-170) Session windows should not be identified by their bounds

[ https://issues.apache.org/jira/browse/BEAM-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977095#comment-15977095 ] Frances Perry commented on BEAM-170: Ilya, should we find a new owner for this? > Sessi

[jira] [Commented] (BEAM-622) Add checkpointing tests for DoFnOperator and WindowDoFnOperator

[ https://issues.apache.org/jira/browse/BEAM-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977100#comment-15977100 ] Frances Perry commented on BEAM-622: Is this a blocker for the first stable release? Is

[GitHub] beam pull request #2520: [BEAM-1166] Update docs for getDefaultOutputCoder

Github user ssisk closed the pull request at: https://github.com/apache/beam/pull/2520 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enable

[jira] [Commented] (BEAM-1166) Source.getDefaultOutputCoder() - hard to implement for adapter style sources

[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15977108#comment-15977108 ] ASF GitHub Bot commented on BEAM-1166: -- Github user ssisk closed the pull request at:

  1   2   3   >