[jira] [Created] (BEAM-1174) URI Java library unexpected behavior.

Pei He created BEAM-1174: Summary: URI Java library unexpected behavior. Key: BEAM-1174 URL: https://issues.apache.org/jira/browse/BEAM-1174 Project: Beam Issue Type: Sub-task Reporter:

[jira] [Commented] (BEAM-1041) IOChannelFactory: supports for recursively remove().

[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15754636#comment-15754636 ] Pei He commented on BEAM-1041: -- Yes I think this jira could be obsolete given the IOChannelFactory re-design

[jira] [Created] (BEAM-1168) FileBaseSink: Handle output to locations such as ".", "~", or maybe ".."

Pei He created BEAM-1168: Summary: FileBaseSink: Handle output to locations such as ".", "~", or maybe ".." Key: BEAM-1168 URL: https://issues.apache.org/jira/browse/BEAM-1168 Project: Beam Issue

[jira] [Commented] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

[ https://issues.apache.org/jira/browse/BEAM-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749746#comment-15749746 ] Pei He commented on BEAM-1153: -- Caused by: java.io.IOException: Error executing batch GCS request at

[jira] [Updated] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

[ https://issues.apache.org/jira/browse/BEAM-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1153: - Description: Non-batch requests uses RetryHttpRequestInitializer, which set read timeout as 80 seconds, and does

[jira] [Updated] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

[ https://issues.apache.org/jira/browse/BEAM-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1153: - Description: Non-batch requests uses RetryHttpRequestInitializer, which set read timeout as 80 seconds, and does

[jira] [Updated] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

[ https://issues.apache.org/jira/browse/BEAM-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1153: - Priority: Blocker (was: Major) > GcsUtil needs to set timeout and retry explicitly in BatchRequest. >

[jira] [Updated] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

[ https://issues.apache.org/jira/browse/BEAM-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1153: - Component/s: sdk-java-core > GcsUtil needs to set timeout and retry explicitly in BatchRequest. >

[jira] [Created] (BEAM-1153) GcsUtil needs to set timeout and retry explicitly in BatchRequest.

Pei He created BEAM-1153: Summary: GcsUtil needs to set timeout and retry explicitly in BatchRequest. Key: BEAM-1153 URL: https://issues.apache.org/jira/browse/BEAM-1153 Project: Beam Issue Type:

[jira] [Comment Edited] (BEAM-1045) Windows OS compatibilities

[ https://issues.apache.org/jira/browse/BEAM-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746111#comment-15746111 ] Pei He edited comment on BEAM-1045 at 12/13/16 8:01 PM: Summary of Windows OS

[jira] [Commented] (BEAM-1045) Windows OS compatibilities

[ https://issues.apache.org/jira/browse/BEAM-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15746111#comment-15746111 ] Pei He commented on BEAM-1045: -- Summary of Windows OS support in Java File/Path libraries. 1. File works for

[jira] [Commented] (BEAM-863) WordCount on Windows: java.nio.file.InvalidPathException

[ https://issues.apache.org/jira/browse/BEAM-863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15745908#comment-15745908 ] Pei He commented on BEAM-863: - I had a jira for Windows file paths:

[jira] [Updated] (BEAM-1142) maven-archetype-starter failed in Windows OS due to [ARCHETYPE-488]

[ https://issues.apache.org/jira/browse/BEAM-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1142: - Component/s: examples-java > maven-archetype-starter failed in Windows OS due to [ARCHETYPE-488] >

[jira] [Created] (BEAM-1142) maven-archetype-starter failed in Windows OS due to [ARCHETYPE-488]

Pei He created BEAM-1142: Summary: maven-archetype-starter failed in Windows OS due to [ARCHETYPE-488] Key: BEAM-1142 URL: https://issues.apache.org/jira/browse/BEAM-1142 Project: Beam Issue Type:

[jira] [Commented] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713239#comment-15713239 ] Pei He commented on BEAM-894: - Closed without the fix for the following reason: @Teardown doesn't guarantee temp

[jira] [Closed] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-894. --- Resolution: Won't Fix Fix Version/s: Not applicable > Using @Teardown to remove temp files from failed bundles

[jira] [Closed] (BEAM-952) Dynamically load and register IOChannelFactory

[ https://issues.apache.org/jira/browse/BEAM-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-952. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Dynamically load and register IOChannelFactory >

[jira] [Closed] (BEAM-962) Fix games example pipeline options default values conflicts.

[ https://issues.apache.org/jira/browse/BEAM-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-962. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Fix games example pipeline options default values conflicts.

[jira] [Closed] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-443. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > PipelineResult needs waitUntilFinish() and cancel() >

[jira] [Closed] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

[ https://issues.apache.org/jira/browse/BEAM-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-444. --- Resolution: Won't Fix Fix Version/s: Not applicable Obsolete given users can control blocking run with

[jira] [Created] (BEAM-1065) FileBasedSource: replace SeekableByteChannel with open(spec, startingPosition)

Pei He created BEAM-1065: Summary: FileBasedSource: replace SeekableByteChannel with open(spec, startingPosition) Key: BEAM-1065 URL: https://issues.apache.org/jira/browse/BEAM-1065 Project: Beam

[jira] [Updated] (BEAM-1047) DataflowRunner: support regionalization.

[ https://issues.apache.org/jira/browse/BEAM-1047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1047: - Description: Tracking bug. > DataflowRunner: support regionalization. > >

[jira] [Created] (BEAM-1047) DataflowRunner: support regionalization.

Pei He created BEAM-1047: Summary: DataflowRunner: support regionalization. Key: BEAM-1047 URL: https://issues.apache.org/jira/browse/BEAM-1047 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-1045) Windows OS compatibilities

[ https://issues.apache.org/jira/browse/BEAM-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691580#comment-15691580 ] Pei He commented on BEAM-1045: -- Other usages of * are:

[jira] [Created] (BEAM-1045) Windows OS compatibilities

Pei He created BEAM-1045: Summary: Windows OS compatibilities Key: BEAM-1045 URL: https://issues.apache.org/jira/browse/BEAM-1045 Project: Beam Issue Type: Sub-task Reporter: Pei He

[jira] [Updated] (BEAM-59) IOChannelFactory rethinking/redesign

[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-59: --- Description: Right now, FileBasedSource and FileBasedSink communication is mediated by IOChannelFactory. There are a

[jira] [Updated] (BEAM-1041) IOChannelFactory: supports for recursively remove().

[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1041: - Issue Type: Sub-task (was: New Feature) Parent: BEAM-59 > IOChannelFactory: supports for recursively

[jira] [Updated] (BEAM-1041) IOChannelFactory: supports for recursively remove().

[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1041: - Issue Type: New Feature (was: Bug) > IOChannelFactory: supports for recursively remove(). >

[jira] [Updated] (BEAM-1041) IOChannelFactory: supports for recursively remove().

[ https://issues.apache.org/jira/browse/BEAM-1041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1041: - Summary: IOChannelFactory: supports for recursively remove(). (was: IOChannelFactory: supports for recursively

[jira] [Created] (BEAM-1041) IOChannelFactory: supports for recursively remove.

Pei He created BEAM-1041: Summary: IOChannelFactory: supports for recursively remove. Key: BEAM-1041 URL: https://issues.apache.org/jira/browse/BEAM-1041 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1033) WindowedWordCountIT is flaky

[ https://issues.apache.org/jira/browse/BEAM-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-1033: - Assignee: Mark Liu (was: Davor Bonaci) > WindowedWordCountIT is flaky > > >

[jira] [Commented] (BEAM-1033) WindowedWordCountIT is flaky

[ https://issues.apache.org/jira/browse/BEAM-1033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15685913#comment-15685913 ] Pei He commented on BEAM-1033: -- I think the BigQueryMatcher should keep retry for this case, since the the

[jira] [Created] (BEAM-1033) WindowedWordCountIT is flaky

Pei He created BEAM-1033: Summary: WindowedWordCountIT is flaky Key: BEAM-1033 URL: https://issues.apache.org/jira/browse/BEAM-1033 Project: Beam Issue Type: Bug Components: testing

[jira] [Created] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

Pei He created BEAM-1009: Summary: Upgrade from mockito-all 1 to mockito-core 2 Key: BEAM-1009 URL: https://issues.apache.org/jira/browse/BEAM-1009 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

[ https://issues.apache.org/jira/browse/BEAM-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-1009: Assignee: Pei He > Upgrade from mockito-all 1 to mockito-core 2 >

[jira] [Created] (BEAM-978) Support bulk get file sizes in GcsUtil

Pei He created BEAM-978: --- Summary: Support bulk get file sizes in GcsUtil Key: BEAM-978 URL: https://issues.apache.org/jira/browse/BEAM-978 Project: Beam Issue Type: New Feature Components:

[jira] [Closed] (BEAM-954) FileBasedSink: remove unused code of TemporaryFileRetention

[ https://issues.apache.org/jira/browse/BEAM-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-954. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > FileBasedSink: remove unused code of TemporaryFileRetention

[jira] [Created] (BEAM-962) Fix games example pipeline options default values conflicts.

Pei He created BEAM-962: --- Summary: Fix games example pipeline options default values conflicts. Key: BEAM-962 URL: https://issues.apache.org/jira/browse/BEAM-962 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-944) Spark runner causes an exception when creating pipeline options

[ https://issues.apache.org/jira/browse/BEAM-944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655240#comment-15655240 ] Pei He commented on BEAM-944: - Filed https://issues.apache.org/jira/browse/BEAM-962 And, I will send a PR soon.

[jira] [Updated] (BEAM-954) FileBasedSink: remove unused code of TemporaryFileRetention

[ https://issues.apache.org/jira/browse/BEAM-954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-954: Summary: FileBasedSink: remove unused code of TemporaryFileRetention (was: FileBasedSink: removed unused code of

[jira] [Closed] (BEAM-955) FileBasedSink: removed unused code of TemporaryFileRetention

[ https://issues.apache.org/jira/browse/BEAM-955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-955. --- Resolution: Duplicate Fix Version/s: Not applicable > FileBasedSink: removed unused code of

[jira] [Created] (BEAM-955) FileBasedSink: removed unused code of TemporaryFileRetention

Pei He created BEAM-955: --- Summary: FileBasedSink: removed unused code of TemporaryFileRetention Key: BEAM-955 URL: https://issues.apache.org/jira/browse/BEAM-955 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-954) FileBasedSink: removed unused code of TemporaryFileRetention

Pei He created BEAM-954: --- Summary: FileBasedSink: removed unused code of TemporaryFileRetention Key: BEAM-954 URL: https://issues.apache.org/jira/browse/BEAM-954 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-952) Dynamically load and register IOChannelFactory

Pei He created BEAM-952: --- Summary: Dynamically load and register IOChannelFactory Key: BEAM-952 URL: https://issues.apache.org/jira/browse/BEAM-952 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-951) Cleanup FileBasedSink to prepare IOChannelFactory redesign.

Pei He created BEAM-951: --- Summary: Cleanup FileBasedSink to prepare IOChannelFactory redesign. Key: BEAM-951 URL: https://issues.apache.org/jira/browse/BEAM-951 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-949) Need tests for HDFSFileSink

Pei He created BEAM-949: --- Summary: Need tests for HDFSFileSink Key: BEAM-949 URL: https://issues.apache.org/jira/browse/BEAM-949 Project: Beam Issue Type: Test Components:

[jira] [Commented] (BEAM-898) BigQueryTornadoes IT has invalid PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15648972#comment-15648972 ] Pei He commented on BEAM-898: - One idea to support test arguments is to add "String getTestArg()" in

[jira] [Closed] (BEAM-917) ExpectedLogs should clear saved records after each test.

[ https://issues.apache.org/jira/browse/BEAM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-917. --- Resolution: Fixed > ExpectedLogs should clear saved records after each test. >

[jira] [Updated] (BEAM-917) ExpectedLogs should clear saved records after each test.

[ https://issues.apache.org/jira/browse/BEAM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-917: Description: This affects unit tests that use it. (was: This affects unit tests that uses it.) > ExpectedLogs

[jira] [Updated] (BEAM-917) ExpectedLogs should clear saved records after each test.

[ https://issues.apache.org/jira/browse/BEAM-917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-917: Description: This affects unit tests that uses it. > ExpectedLogs should clear saved records after each test. >

[jira] [Created] (BEAM-917) ExpectedLogs should clear saved records after each test.

Pei He created BEAM-917: --- Summary: ExpectedLogs should clear saved records after each test. Key: BEAM-917 URL: https://issues.apache.org/jira/browse/BEAM-917 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-898) BigQueryTornadoes IT has invalid PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638117#comment-15638117 ] Pei He commented on BEAM-898: - I think if IT tests only register TestPipelineOptions.class, and hard code

[jira] [Assigned] (BEAM-898) BigQueryTornadoes IT has invalid PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-898: --- Assignee: Mark Liu (was: Pei He) > BigQueryTornadoes IT has invalid PipelineOptions >

[jira] [Commented] (BEAM-898) BigQueryTornadoes IT has invalid PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634438#comment-15634438 ] Pei He commented on BEAM-898: - Chatted with Luke and Mark, and there are several ways to fix them: 1. move the

[jira] [Assigned] (BEAM-898) BigQueryTornadoes IT has invalid PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-898: --- Assignee: Pei He (was: Mark Liu) > BigQueryTornadoes IT has invalid PipelineOptions >

[jira] [Commented] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634041#comment-15634041 ] Pei He commented on BEAM-894: - This will also help the redesign of IOChannelFactory:

[jira] [Created] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

Pei He created BEAM-894: --- Summary: Using @Teardown to remove temp files from failed bundles in Write.WriteBundles Key: BEAM-894 URL: https://issues.apache.org/jira/browse/BEAM-894 Project: Beam Issue

[jira] [Comment Edited] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609642#comment-15609642 ] Pei He edited comment on BEAM-443 at 10/26/16 9:07 PM: --- reopen the jira because there

[jira] [Commented] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15609642#comment-15609642 ] Pei He commented on BEAM-443: - reopen the jira because there are more discussions about: 1. whether

[jira] [Updated] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-443: Summary: PipelineResult needs waitUntilFinish() and cancel() (was: PipelineResult needs waitToFinish() and cancel())

[jira] [Reopened] (BEAM-443) PipelineResult needs waitToFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reopened BEAM-443: - > PipelineResult needs waitToFinish() and cancel() > > >

[jira] [Created] (BEAM-790) Validate PipelineOptions Default annotation

Pei He created BEAM-790: --- Summary: Validate PipelineOptions Default annotation Key: BEAM-790 URL: https://issues.apache.org/jira/browse/BEAM-790 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-763) BigQueryIOTest.testBuildSourceWithTableAndSqlDialect is not a valid RunnableOnService test

[ https://issues.apache.org/jira/browse/BEAM-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583650#comment-15583650 ] Pei He commented on BEAM-763: - i don't have permission to resolve this issue. Could someone help me to mark it

[jira] [Updated] (BEAM-764) Remove cloneAs from PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-764: Labels: codehealth (was: ) > Remove cloneAs from PipelineOptions > --- > >

[jira] [Created] (BEAM-764) Remove cloneAs from PipelineOptions

Pei He created BEAM-764: --- Summary: Remove cloneAs from PipelineOptions Key: BEAM-764 URL: https://issues.apache.org/jira/browse/BEAM-764 Project: Beam Issue Type: Task Reporter: Pei He

[jira] [Commented] (BEAM-763) BigQueryIOTest.testBuildSourceWithTableAndSqlDialect is not a valid RunnableOnService test

[ https://issues.apache.org/jira/browse/BEAM-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15583339#comment-15583339 ] Pei He commented on BEAM-763: - BigQueryIOTest doesn't work with RunnableOnService:

[jira] [Created] (BEAM-762) Use composition over inheritance in spark StreamingEvaluationContext if two contexts are necessary.

Pei He created BEAM-762: --- Summary: Use composition over inheritance in spark StreamingEvaluationContext if two contexts are necessary. Key: BEAM-762 URL: https://issues.apache.org/jira/browse/BEAM-762 Project:

[jira] [Updated] (BEAM-762) Use composition over inheritance in spark StreamingEvaluationContext if two contexts are necessary.

[ https://issues.apache.org/jira/browse/BEAM-762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-762: Labels: starter (was: ) > Use composition over inheritance in spark StreamingEvaluationContext if two > contexts

[jira] [Updated] (BEAM-595) Support non-blocking run() in SparkRunner and cancel() and waitUntilFinish() in Spark EvaluationContext

[ https://issues.apache.org/jira/browse/BEAM-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-595: Summary: Support non-blocking run() in SparkRunner and cancel() and waitUntilFinish() in Spark EvaluationContext

[jira] [Updated] (BEAM-593) Support unblocking run() in FlinkRunner and cancel() and waitUntilFinish() in FlinkRunnerResult

[ https://issues.apache.org/jira/browse/BEAM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-593: Summary: Support unblocking run() in FlinkRunner and cancel() and waitUntilFinish() in FlinkRunnerResult (was:

[jira] [Resolved] (BEAM-739) Log full exception stack trace in WordCountIT and BigQueryTornadoesIT

[ https://issues.apache.org/jira/browse/BEAM-739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-739. - Resolution: Fixed Fix Version/s: Not applicable > Log full exception stack trace in WordCountIT and

[jira] [Assigned] (BEAM-59) IOChannelFactory rethinking/redesign

[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-59: -- Assignee: Pei He > IOChannelFactory rethinking/redesign > > >

[jira] [Created] (BEAM-739) Log full exception stack trace in WordCountIT and BigQueryTornadoesIT

Pei He created BEAM-739: --- Summary: Log full exception stack trace in WordCountIT and BigQueryTornadoesIT Key: BEAM-739 URL: https://issues.apache.org/jira/browse/BEAM-739 Project: Beam Issue Type:

[jira] [Comment Edited] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563569#comment-15563569 ] Pei He edited comment on BEAM-696 at 10/10/16 9:26 PM: --- re: to "Sessions is not

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563569#comment-15563569 ] Pei He commented on BEAM-696: - re: to "Sessions is not allowed in side inputs" There are two WindowFns involved,

[jira] [Commented] (BEAM-736) BigQueryTornadoesIT broken, blocking nightly release.

[ https://issues.apache.org/jira/browse/BEAM-736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563328#comment-15563328 ] Pei He commented on BEAM-736: - NPE comes from here:

[jira] [Commented] (BEAM-540) Dataflow streaming jobs running on windmill do not need data disks

[ https://issues.apache.org/jira/browse/BEAM-540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546638#comment-15546638 ] Pei He commented on BEAM-540: - this can close? > Dataflow streaming jobs running on windmill do not need data

[jira] [Updated] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-702: Component/s: beam-model > Simple pattern for per-bundle and per-DoFn Closeable resources >

[jira] [Closed] (BEAM-545) Pipelines and their executions naming changes

[ https://issues.apache.org/jira/browse/BEAM-545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-545. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Pipelines and their executions naming changes >

[jira] [Updated] (BEAM-545) Pipelines and their executions naming changes

[ https://issues.apache.org/jira/browse/BEAM-545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-545: Component/s: sdk-java-core > Pipelines and their executions naming changes >

[jira] [Closed] (BEAM-433) Make Beam examples runners agnostic

[ https://issues.apache.org/jira/browse/BEAM-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-433. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Make Beam examples runners agnostic >

[jira] [Closed] (BEAM-483) Generated job names easily collide

[ https://issues.apache.org/jira/browse/BEAM-483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-483. --- Resolution: Fixed Fix Version/s: 0.3.0-incubating > Generated job names easily collide >

[jira] [Resolved] (BEAM-554) Dataflow runner to support bounded writes in streaming mode.

[ https://issues.apache.org/jira/browse/BEAM-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-554. - Resolution: Fixed Fix Version/s: 0.3.0-incubating > Dataflow runner to support bounded writes in streaming

[jira] [Resolved] (BEAM-572) Remove Spark references in WordCount

[ https://issues.apache.org/jira/browse/BEAM-572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He resolved BEAM-572. - Resolution: Fixed Fix Version/s: 0.3.0-incubating > Remove Spark references in WordCount >

[jira] [Commented] (BEAM-586) CombineFns with no inputs should produce no outputs when used as a main input

[ https://issues.apache.org/jira/browse/BEAM-586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546500#comment-15546500 ] Pei He commented on BEAM-586: - Is that fair to say triggering defines whether and when CombineFns output, and

[jira] [Updated] (BEAM-605) Create BigQuery Verifier

[ https://issues.apache.org/jira/browse/BEAM-605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-605: Affects Version/s: Not applicable Component/s: testing > Create BigQuery Verifier >

[jira] [Issue Comment Deleted] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-702: Comment: was deleted (was: 1. If there are failures in one bundle, we can easily call teardown()s of DoFns

[jira] [Commented] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546412#comment-15546412 ] Pei He commented on BEAM-702: - 1. If there are failures in one bundle, we can easily call teardown()s of DoFns

[jira] [Commented] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546411#comment-15546411 ] Pei He commented on BEAM-702: - 1. If there are failures in one bundle, we can easily call teardown()s of DoFns

[jira] [Comment Edited] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546277#comment-15546277 ] Pei He edited comment on BEAM-702 at 10/4/16 6:47 PM: -- The feature request is for

[jira] [Commented] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546277#comment-15546277 ] Pei He commented on BEAM-702: - The feature request is for something like this? class MyDoFn extends DoFn

[jira] [Commented] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543681#comment-15543681 ] Pei He commented on BEAM-696: - For merging windows, DataflowPipelineRunner does "defer running anything that

[jira] [Created] (BEAM-641) Need to test the generated archetypes projects

Pei He created BEAM-641: --- Summary: Need to test the generated archetypes projects Key: BEAM-641 URL: https://issues.apache.org/jira/browse/BEAM-641 Project: Beam Issue Type: Test Reporter:

[jira] [Updated] (BEAM-641) Need to test the generated archetypes projects

[ https://issues.apache.org/jira/browse/BEAM-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-641: Component/s: testing > Need to test the generated archetypes projects >

[jira] [Commented] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450087#comment-15450087 ] Pei He commented on BEAM-604: - agree. But, before that happens, we can easily support this functionality in

[jira] [Commented] (BEAM-604) Use Watermark Check Streaming Job Finish in TestDataflowRunner

[ https://issues.apache.org/jira/browse/BEAM-604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450084#comment-15450084 ] Pei He commented on BEAM-604: - Consider implement it in DataflowPipelineJob.waitUntilFinish()

[jira] [Commented] (BEAM-594) Support cancel() and waitUntilFinish() in FlinkRunnerResult

[ https://issues.apache.org/jira/browse/BEAM-594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15446551#comment-15446551 ] Pei He commented on BEAM-594: - Thanks Mark to notice it closed > Support cancel() and waitUntilFinish() in

[jira] [Closed] (BEAM-594) Support cancel() and waitUntilFinish() in FlinkRunnerResult

[ https://issues.apache.org/jira/browse/BEAM-594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-594. --- Resolution: Duplicate Fix Version/s: Not applicable > Support cancel() and waitUntilFinish() in

[jira] [Created] (BEAM-596) Support cancel() and waitUntilFinish() in DirectRunner

Pei He created BEAM-596: --- Summary: Support cancel() and waitUntilFinish() in DirectRunner Key: BEAM-596 URL: https://issues.apache.org/jira/browse/BEAM-596 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-595) Support cancel() and waitUntilFinish() in Spark EvaluationContext

Pei He created BEAM-595: --- Summary: Support cancel() and waitUntilFinish() in Spark EvaluationContext Key: BEAM-595 URL: https://issues.apache.org/jira/browse/BEAM-595 Project: Beam Issue Type: New

  1   2   >