[jira] [Resolved] (BEAM-918) Let users set STORAGE_LEVEL via SparkPipelineOptions.

[ https://issues.apache.org/jira/browse/BEAM-918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-918. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Let users set STORAGE_LEVEL

[GitHub] incubator-beam pull request #1370: [BEAM-918] Allow users to define the stor...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1370 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: [BEAM-918] This closes #1370

[BEAM-918] This closes #1370 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0c875ba7 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0c875ba7 Diff:

[1/2] incubator-beam git commit: [BEAM-918] Allow users to define the storage level via pipeline options

Repository: incubator-beam Updated Branches: refs/heads/master 711c68092 -> 0c875ba70 [BEAM-918] Allow users to define the storage level via pipeline options Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-918) Let users set STORAGE_LEVEL via SparkPipelineOptions.

[ https://issues.apache.org/jira/browse/BEAM-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711985#comment-15711985 ] ASF GitHub Bot commented on BEAM-918: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam-site pull request #98: [BEAM-825] Fill in the documentation/r...

GitHub user sandeepdeshmukh opened a pull request: https://github.com/apache/incubator-beam-site/pull/98 [BEAM-825] Fill in the documentation/runners/apex portion of the website @tweise : Could you please review. You can merge this pull request into a Git repository by

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Spark #281

See

[jira] [Commented] (BEAM-1065) FileBasedSource: replace SeekableByteChannel with open(spec, startingPosition)

[ https://issues.apache.org/jira/browse/BEAM-1065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712452#comment-15712452 ] Daniel Halperin commented on BEAM-1065: --- The ability to open at a non-zero location has previously

[2/2] incubator-beam git commit: Closes #1468

Closes #1468 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/739a4319 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/739a4319 Diff:

[1/2] incubator-beam git commit: Parse table schema from JSON

Repository: incubator-beam Updated Branches: refs/heads/python-sdk aa9071d56 -> 739a43197 Parse table schema from JSON Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4c2f62b Tree:

[GitHub] incubator-beam pull request #1468: [BEAM] Add table schema from json parser

Github user sb2nov closed the pull request at: https://github.com/apache/incubator-beam/pull/1468 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1467: Improve size estimation speed for file sa...

Github user sb2nov closed the pull request at: https://github.com/apache/incubator-beam/pull/1467 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (BEAM-1066) Add test coverage for ReleaseInfo

Daniel Halperin created BEAM-1066: - Summary: Add test coverage for ReleaseInfo Key: BEAM-1066 URL: https://issues.apache.org/jira/browse/BEAM-1066 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-1066) Add test coverage for ReleaseInfo

[ https://issues.apache.org/jira/browse/BEAM-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712521#comment-15712521 ] ASF GitHub Bot commented on BEAM-1066: -- GitHub user dhalperi opened a pull request:

[jira] [Updated] (BEAM-1068) Service Account Credentials File Specified via Pipeline Option Ignored

[ https://issues.apache.org/jira/browse/BEAM-1068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Reichling updated BEAM-1068: Environment: CentOS Linux release 7.1.1503 (Core) Python 2.7.5 > Service Account

[jira] [Commented] (BEAM-1046) Travis (Linux) failing for python sdk

[ https://issues.apache.org/jira/browse/BEAM-1046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712738#comment-15712738 ] Pablo Estrada commented on BEAM-1046: - Fixing this with PR #1456. Should be merged soon. > Travis

[jira] [Created] (BEAM-1070) Service Account Based Authentication Broken

Stephen Reichling created BEAM-1070: --- Summary: Service Account Based Authentication Broken Key: BEAM-1070 URL: https://issues.apache.org/jira/browse/BEAM-1070 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-1067) apex.examples.WordCountTest.testWordCountExample may be flaky

[ https://issues.apache.org/jira/browse/BEAM-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-1067: - Description: Seems that {{org.apache.beam.runners.apex.examples.WordCountTest.testWordCountExample}} is

[jira] [Created] (BEAM-1067) apex.examples.WordCountTest.testWordCountExample may be flaky

Stas Levin created BEAM-1067: Summary: apex.examples.WordCountTest.testWordCountExample may be flaky Key: BEAM-1067 URL: https://issues.apache.org/jira/browse/BEAM-1067 Project: Beam Issue

[jira] [Commented] (BEAM-1042) Clean build fails on Windows in Starter archetype

[ https://issues.apache.org/jira/browse/BEAM-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712829#comment-15712829 ] Thomas Weise commented on BEAM-1042: [~jbonofre] I created this after offline discussion with [~kenn]

[GitHub] incubator-beam pull request #1482: travis.yml: disable skipping things that ...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/1482 travis.yml: disable skipping things that no longer run R: @kennknowles https://travis-ci.org/dhalperi/incubator-beam/builds/180475125 is the link on my repo, with

[jira] [Created] (BEAM-1069) Add CountingInput Transform to python sdk

Vikas Kedigehalli created BEAM-1069: --- Summary: Add CountingInput Transform to python sdk Key: BEAM-1069 URL: https://issues.apache.org/jira/browse/BEAM-1069 Project: Beam Issue Type:

[jira] [Updated] (BEAM-1024) upgrade to protobuf-3.1.0

[ https://issues.apache.org/jira/browse/BEAM-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1024: -- Component/s: sdk-java-gcp > upgrade to protobuf-3.1.0 > - > >

[jira] [Commented] (BEAM-1024) upgrade to protobuf-3.1.0

[ https://issues.apache.org/jira/browse/BEAM-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713164#comment-15713164 ] Daniel Halperin commented on BEAM-1024: --- Lowering to Minor priority -- in general, this issue is not

[jira] [Updated] (BEAM-824) Misleading error message when sdk_location is missing in python

[ https://issues.apache.org/jira/browse/BEAM-824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-824: - Component/s: sdk-py > Misleading error message when sdk_location is missing in python >

[jira] [Updated] (BEAM-804) Python Pipeline Option save_main_session non-functional

[ https://issues.apache.org/jira/browse/BEAM-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-804: - Component/s: sdk-py > Python Pipeline Option save_main_session non-functional >

[jira] [Resolved] (BEAM-860) Move Apache RAT license check out of release profile

[ https://issues.apache.org/jira/browse/BEAM-860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-860. -- Resolution: Not A Problem Fix Version/s: Not applicable > Move Apache RAT license check

[jira] [Updated] (BEAM-884) Add Display Data to the Python SDK's PipelineOptions, Avro io and other transforms

[ https://issues.apache.org/jira/browse/BEAM-884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-884: - Component/s: sdk-py > Add Display Data to the Python SDK's PipelineOptions, Avro io and other >

[jira] [Updated] (BEAM-877) Allow disabling flattening of results when using BigQuery source

[ https://issues.apache.org/jira/browse/BEAM-877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj updated BEAM-877: --- Fix Version/s: Not applicable > Allow disabling flattening of results when using BigQuery source >

[jira] [Updated] (BEAM-614) File compression/decompression should support auto detection

[ https://issues.apache.org/jira/browse/BEAM-614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-614: - Component/s: sdk-py > File compression/decompression should support auto detection >

[jira] [Updated] (BEAM-765) TriggerStateMachine does not need to be separate from OnceTriggerStateMachine

[ https://issues.apache.org/jira/browse/BEAM-765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-765: - Component/s: runner-core > TriggerStateMachine does not need to be separate from

[jira] [Updated] (BEAM-792) In WC Walkthrough: Document how logging works on Apache Spark

[ https://issues.apache.org/jira/browse/BEAM-792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-792: - Component/s: website > In WC Walkthrough: Document how logging works on Apache Spark >

[jira] [Updated] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

[ https://issues.apache.org/jira/browse/BEAM-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-444: - Component/s: sdk-java-core > Promote isBlockOnRun() to PipelineOptions. >

[jira] [Updated] (BEAM-599) Return KafkaIO getWatermark log in debug mode

[ https://issues.apache.org/jira/browse/BEAM-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-599: - Component/s: sdk-java-extensions > Return KafkaIO getWatermark log in debug mode >

[jira] [Updated] (BEAM-990) KafkaIO does not commit offsets to Kafka

[ https://issues.apache.org/jira/browse/BEAM-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alban Perillat-Merceroz updated BEAM-990: - Description: I use KafkaIO as a source, and I would like consumed offsets to be

[jira] [Closed] (BEAM-952) Dynamically load and register IOChannelFactory

[ https://issues.apache.org/jira/browse/BEAM-952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-952. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Dynamically load and register IOChannelFactory >

[jira] [Commented] (BEAM-646) Get runners out of the apply()

[ https://issues.apache.org/jira/browse/BEAM-646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713057#comment-15713057 ] ASF GitHub Bot commented on BEAM-646: - Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-1072) Dataflow should reject unset versions

[ https://issues.apache.org/jira/browse/BEAM-1072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713105#comment-15713105 ] ASF GitHub Bot commented on BEAM-1072: -- GitHub user dhalperi opened a pull request:

[GitHub] incubator-beam pull request #1483: [BEAM-1072] DataflowRunner: reject job su...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/1483 [BEAM-1072] DataflowRunner: reject job submission when the version has not been properly set R: @davorbonaci You can merge this pull request into a Git repository by running: $ git

[GitHub] incubator-beam pull request #1484: Migrate TransformTreeNode to an Inner Cla...

GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1484 Migrate TransformTreeNode to an Inner Class Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Updated] (BEAM-1071) Support pre-existing tables with streaming BigQueryIO

[ https://issues.apache.org/jira/browse/BEAM-1071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1071: -- Component/s: sdk-java-gcp > Support pre-existing tables with streaming BigQueryIO >

[jira] [Updated] (BEAM-1040) Hadoop InputFormat - IO Transform for reads

[ https://issues.apache.org/jira/browse/BEAM-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1040: -- Component/s: sdk-java-extensions > Hadoop InputFormat - IO Transform for reads >

[jira] [Updated] (BEAM-1027) Hosting data stores to enable IO Transform testing

[ https://issues.apache.org/jira/browse/BEAM-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1027: -- Component/s: testing > Hosting data stores to enable IO Transform testing >

[jira] [Updated] (BEAM-1042) Clean build fails on Windows in Starter archetype

[ https://issues.apache.org/jira/browse/BEAM-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1042: -- Component/s: sdk-java-core > Clean build fails on Windows in Starter archetype >

[jira] [Updated] (BEAM-985) Retry decorator maintains state as uses an iterator

[ https://issues.apache.org/jira/browse/BEAM-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-985: - Component/s: sdk-py > Retry decorator maintains state as uses an iterator >

[jira] [Updated] (BEAM-987) TestStream.advanceWatermarkToInfinity should perhaps also advance processing time

[ https://issues.apache.org/jira/browse/BEAM-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-987: - Component/s: testing runner-direct > TestStream.advanceWatermarkToInfinity should

[jira] [Updated] (BEAM-964) Investing exporting BQ as Avro instead of Json for dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj updated BEAM-964: --- Fix Version/s: Not applicable Component/s: (was: sdk-java-gcp) sdk-py >

[jira] [Updated] (BEAM-850) Add Display Data to the Python Transforms, Sinks, Sources, etc.

[ https://issues.apache.org/jira/browse/BEAM-850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-850: - Component/s: sdk-py > Add Display Data to the Python Transforms, Sinks, Sources, etc. >

[jira] [Closed] (BEAM-754) WordCountIT Flake -- Incorrect checksum

[ https://issues.apache.org/jira/browse/BEAM-754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-754. Resolution: Fixed Fix Version/s: Not applicable > WordCountIT Flake -- Incorrect checksum >

[jira] [Updated] (BEAM-766) Trigger AST should use @AutoValue

[ https://issues.apache.org/jira/browse/BEAM-766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-766: - Component/s: sdk-java-core > Trigger AST should use @AutoValue > -

[jira] [Updated] (BEAM-750) Remove StateTag

[ https://issues.apache.org/jira/browse/BEAM-750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-750: - Component/s: sdk-java-core > Remove StateTag > --- > > Key: BEAM-750 >

[jira] [Updated] (BEAM-985) Retry decorator maintains state as uses an iterator

[ https://issues.apache.org/jira/browse/BEAM-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj updated BEAM-985: --- Fix Version/s: (was: 0.4.0-incubating) Not applicable > Retry decorator

[jira] [Resolved] (BEAM-803) Maven configuration that easily launches examples IT tests on one specific runner

[ https://issues.apache.org/jira/browse/BEAM-803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-803. -- Resolution: Fixed Fix Version/s: Not applicable This is now done via {{-P}}. See the

[jira] [Updated] (BEAM-683) Make BZIP compressed files splittable

[ https://issues.apache.org/jira/browse/BEAM-683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-683: - Component/s: sdk-py sdk-java-core > Make BZIP compressed files splittable >

[jira] [Updated] (BEAM-494) All E2E Tests Run Against All Runners In Postcommit

[ https://issues.apache.org/jira/browse/BEAM-494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-494: - Component/s: testing > All E2E Tests Run Against All Runners In Postcommit >

[jira] [Updated] (BEAM-511) Fill in the contribute/technical-vision section of the website

[ https://issues.apache.org/jira/browse/BEAM-511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-511: - Component/s: website > Fill in the contribute/technical-vision section of the website >

[jira] [Updated] (BEAM-521) Execute some bounded source reads via composite transform

[ https://issues.apache.org/jira/browse/BEAM-521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-521: - Component/s: runner-core > Execute some bounded source reads via composite transform >

[jira] [Assigned] (BEAM-719) Run WindowedWordCount Integration Test in Spark

[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-719: - Assignee: Mark Liu (was: Amit Sela) > Run WindowedWordCount Integration Test in Spark >

[jira] [Closed] (BEAM-894) Using @Teardown to remove temp files from failed bundles in Write.WriteBundles

[ https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-894. --- Resolution: Won't Fix Fix Version/s: Not applicable > Using @Teardown to remove temp files from failed bundles

[jira] [Closed] (BEAM-895) Transport.newStorageClient requires credentials

[ https://issues.apache.org/jira/browse/BEAM-895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-895. Resolution: Fixed > Transport.newStorageClient requires credentials >

[jira] [Created] (BEAM-1071) Support pre-existing tables with streaming BigQueryIO

Sam McVeety created BEAM-1071: - Summary: Support pre-existing tables with streaming BigQueryIO Key: BEAM-1071 URL: https://issues.apache.org/jira/browse/BEAM-1071 Project: Beam Issue Type:

[2/3] incubator-beam git commit: Revert "Move resource filtering later to avoid spurious rebuilds"

Revert "Move resource filtering later to avoid spurious rebuilds" This reverts commit 2422365719c71cade97e1e74f1fb7f42b264244f. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b36048bd Tree:

[jira] [Updated] (BEAM-1024) upgrade to protobuf-3.1.0

[ https://issues.apache.org/jira/browse/BEAM-1024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1024: -- Priority: Minor (was: Major) > upgrade to protobuf-3.1.0 > - > >

[jira] [Updated] (BEAM-1064) Convert Jenkins jobs to DSL

[ https://issues.apache.org/jira/browse/BEAM-1064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1064: -- Component/s: testing > Convert Jenkins jobs to DSL > --- > >

[jira] [Updated] (BEAM-1060) Make DoFnTester use new DoFn

[ https://issues.apache.org/jira/browse/BEAM-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1060: -- Component/s: sdk-java-core > Make DoFnTester use new DoFn > > >

[jira] [Updated] (BEAM-1055) Display Data keys on Python are inconsistent

[ https://issues.apache.org/jira/browse/BEAM-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1055: -- Component/s: sdk-py > Display Data keys on Python are inconsistent >

[GitHub] incubator-beam pull request #1395: Fixing error with PipelineOptions Display...

Github user pabloem closed the pull request at: https://github.com/apache/incubator-beam/pull/1395 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-989) GcsUtil batch remove() and copy() need tests.

[ https://issues.apache.org/jira/browse/BEAM-989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-989: - Component/s: sdk-java-gcp > GcsUtil batch remove() and copy() need tests. >

[jira] [Updated] (BEAM-994) Support for S3 file source and sink

[ https://issues.apache.org/jira/browse/BEAM-994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-994: - Component/s: sdk-java-extensions > Support for S3 file source and sink >

[jira] [Updated] (BEAM-990) KafkaIO does not commit offsets to Kafka

[ https://issues.apache.org/jira/browse/BEAM-990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-990: - Component/s: sdk-java-extensions > KafkaIO does not commit offsets to Kafka >

[jira] [Updated] (BEAM-988) Support for testing how soon output is emitted

[ https://issues.apache.org/jira/browse/BEAM-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-988: - Component/s: testing runner-direct > Support for testing how soon output is

[jira] [Updated] (BEAM-964) Investing exporting BQ as Avro instead of Json for dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-964: - Component/s: sdk-java-gcp > Investing exporting BQ as Avro instead of Json for dataflow runner >

[jira] [Updated] (BEAM-852) Validate sources when they are created

[ https://issues.apache.org/jira/browse/BEAM-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj updated BEAM-852: --- Fix Version/s: Not applicable > Validate sources when they are created >

[jira] [Closed] (BEAM-985) Retry decorator maintains state as uses an iterator

[ https://issues.apache.org/jira/browse/BEAM-985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj closed BEAM-985. -- Resolution: Fixed > Retry decorator maintains state as uses an iterator >

[jira] [Closed] (BEAM-444) Promote isBlockOnRun() to PipelineOptions.

[ https://issues.apache.org/jira/browse/BEAM-444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-444. --- Resolution: Won't Fix Fix Version/s: Not applicable Obsolete given users can control blocking run with

[jira] [Updated] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-443: - Component/s: sdk-java-core > PipelineResult needs waitUntilFinish() and cancel() >

[jira] [Updated] (BEAM-719) Run WindowedWordCount Integration Test in Spark

[ https://issues.apache.org/jira/browse/BEAM-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-719: - Component/s: testing > Run WindowedWordCount Integration Test in Spark >

[jira] [Updated] (BEAM-580) Add a Datastore delete example

[ https://issues.apache.org/jira/browse/BEAM-580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-580: - Component/s: sdk-java-gcp > Add a Datastore delete example > -- > >

[jira] [Closed] (BEAM-962) Fix games example pipeline options default values conflicts.

[ https://issues.apache.org/jira/browse/BEAM-962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-962. --- Resolution: Fixed Fix Version/s: 0.4.0-incubating > Fix games example pipeline options default values conflicts.

[1/2] incubator-beam git commit: Improve Splittable DoFn

Repository: incubator-beam Updated Branches: refs/heads/master fd4b631f1 -> 24fab9f53 Improve Splittable DoFn Makes Splittable DoFn be more like a real DoFn: - Adds support for side inputs and outputs to SDF - Teaches `ProcessFn` to work with exploded windows inside the `KeyedWorkItem`. It

[GitHub] incubator-beam pull request #1261: [BEAM-801, BEAM-787] Improvements to Spli...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1261 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-801) SplittableParDo must be a pseudo-primitive, not ParDo(OldDoFn)

[ https://issues.apache.org/jira/browse/BEAM-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713249#comment-15713249 ] ASF GitHub Bot commented on BEAM-801: - Github user asfgit closed the pull request at:

[2/2] incubator-beam git commit: This closes #1261

This closes #1261 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/24fab9f5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/24fab9f5 Diff:

[1/2] incubator-beam git commit: Move TransformHierarchy Maintenance into it

Repository: incubator-beam Updated Branches: refs/heads/master 0c875ba70 -> 48130f718 Move TransformHierarchy Maintenance into it This reduces the complexity of Pipeline.applyInternal by keeping the responsiblities to passing a node into the Transform Hierarchy, enforcing name uniqueness, and

[GitHub] incubator-beam pull request #1469: [BEAM-646] Move TransformHierarchy Mainte...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1469 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1480: [BEAM-1066] Add a test of ReleaseInfo

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1480 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[3/3] incubator-beam git commit: Closes #1480

Closes #1480 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fd4b631f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fd4b631f Diff:

[jira] [Commented] (BEAM-1066) Add test coverage for ReleaseInfo

[ https://issues.apache.org/jira/browse/BEAM-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713097#comment-15713097 ] ASF GitHub Bot commented on BEAM-1066: -- Github user asfgit closed the pull request at:

[1/3] incubator-beam git commit: Add a test of ReleaseInfo

Repository: incubator-beam Updated Branches: refs/heads/master 48130f718 -> fd4b631f1 Add a test of ReleaseInfo Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1094fa6a Tree:

[jira] [Updated] (BEAM-1023) Add test coverage for BigQueryIO.Write in streaming mode

[ https://issues.apache.org/jira/browse/BEAM-1023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1023: -- Component/s: sdk-java-gcp > Add test coverage for BigQueryIO.Write in streaming mode >

[jira] [Updated] (BEAM-1019) Shade bytebuddy dependency

[ https://issues.apache.org/jira/browse/BEAM-1019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1019: -- Component/s: sdk-java-core > Shade bytebuddy dependency > -- > >

[jira] [Updated] (BEAM-1021) DatastoreIO for python

[ https://issues.apache.org/jira/browse/BEAM-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1021: -- Component/s: sdk-py > DatastoreIO for python > -- > > Key:

[jira] [Resolved] (BEAM-905) Archetype pom needs to generalize dependencies

[ https://issues.apache.org/jira/browse/BEAM-905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-905. -- Resolution: Fixed Assignee: Daniel Halperin (was: Pei He) Fix Version/s: Not

[jira] [Updated] (BEAM-537) Create Apache Bigtop Beam packages

[ https://issues.apache.org/jira/browse/BEAM-537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-537: - Component/s: sdk-java-extensions > Create Apache Bigtop Beam packages >

[jira] [Updated] (BEAM-546) Aggregator Verifier and Integrate to E2E Test Framework

[ https://issues.apache.org/jira/browse/BEAM-546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-546: - Component/s: testing > Aggregator Verifier and Integrate to E2E Test Framework >

[jira] [Closed] (BEAM-443) PipelineResult needs waitUntilFinish() and cancel()

[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He closed BEAM-443. --- Resolution: Fixed Fix Version/s: 0.2.0-incubating > PipelineResult needs waitUntilFinish() and cancel() >

[GitHub] incubator-beam-site pull request #99: Simplify Flink Runner instructions for...

GitHub user aljoscha opened a pull request: https://github.com/apache/incubator-beam-site/pull/99 Simplify Flink Runner instructions for running on cluster R: @davorbonaci I think this should be simple/straighforward enough now 😃 You can merge this pull request into a Git

[2/2] incubator-beam git commit: This closes #1469

This closes #1469 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48130f71 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48130f71 Diff:

[jira] [Closed] (BEAM-1066) Add test coverage for ReleaseInfo

[ https://issues.apache.org/jira/browse/BEAM-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1066. - Resolution: Fixed > Add test coverage for ReleaseInfo > - > >

[jira] [Created] (BEAM-1072) Dataflow should reject unset versions

Daniel Halperin created BEAM-1072: - Summary: Dataflow should reject unset versions Key: BEAM-1072 URL: https://issues.apache.org/jira/browse/BEAM-1072 Project: Beam Issue Type: Bug

  1   2   >