[jira] [Updated] (BEAM-3446) RedisIO non-prefix read operations

[ https://issues.apache.org/jira/browse/BEAM-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay varma updated BEAM-3446: -- Description: Read operation in RedisIO is for prefix based look ups. While this can be used for exact

[jira] [Created] (BEAM-3446) RedisIO non-prefix read operations

Vinay varma created BEAM-3446: - Summary: RedisIO non-prefix read operations Key: BEAM-3446 URL: https://issues.apache.org/jira/browse/BEAM-3446 Project: Beam Issue Type: New Feature

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #5618

See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #3861

See

Build failed in Jenkins: beam_PerformanceTests_Python #772

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace

Build failed in Jenkins: beam_PerformanceTests_Spark #1216

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam2 (beam) in workspace

[jira] [Updated] (BEAM-3438) KinesisReaderIT fails due to a missing PipelineOptions property

[ https://issues.apache.org/jira/browse/BEAM-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-3438: --- Summary: KinesisReaderIT fails due to a missing PipelineOptions property (was:

[jira] [Updated] (BEAM-3438) KinesisReaderIT fails due to a missing PipelineOptions property

[ https://issues.apache.org/jira/browse/BEAM-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-3438: --- Description: {{KinesisReaderIT}} fails due to a missing property in the

[jira] [Resolved] (BEAM-3439) Examples and Dataflow runner tests fail due to quota exceeded

[ https://issues.apache.org/jira/browse/BEAM-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-3439. Resolution: Fixed Fix Version/s: Not applicable Removing the jobs stuck for a

[jira] [Updated] (BEAM-3416) File is not properly closed in VcfSource when exception is thrown

[ https://issues.apache.org/jira/browse/BEAM-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Asha Rostamianfar updated BEAM-3416: Summary: File is not properly closed in VcfSource when exception is thrown (was: File is

[jira] [Commented] (BEAM-3423) Distinct.withRepresentativeValueFn throws CoderException "cannot encode null KV"

[ https://issues.apache.org/jira/browse/BEAM-3423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319609#comment-16319609 ] huangjianhuang commented on BEAM-3423: -- [~kenn] thx. yes, it does work fine without early firings.

Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormatIO_IT #1

See -- [...truncated 19.67 KB...] 2018-01-10 01:34:21,509 dc453292 MainThread beam_integration_benchmark(1/1) INFO Running: kubectl

[jira] [Assigned] (BEAM-3190) [SQL] Join Windowing Semantics

[ https://issues.apache.org/jira/browse/BEAM-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-3190: - Assignee: Anton Kedin > [SQL] Join Windowing Semantics > -- > >

[jira] [Commented] (BEAM-3190) [SQL] Join Windowing Semantics

[ https://issues.apache.org/jira/browse/BEAM-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319536#comment-16319536 ] Anton Kedin commented on BEAM-3190: --- At the moment SQL joins for unbounded inputs happen per-pane. Which

Build failed in Jenkins: beam_PerformanceTests_Spark #1215

See Changes: [robertwb] Return state from wait_until_finish. [ehudm] Cleanup DeprecationWarning for BaseException.message. [arostami] Fixes unclosed files in VcfSource when exception is thrown.

Build failed in Jenkins: beam_PerformanceTests_Python #771

See Changes: [robertwb] Return state from wait_until_finish. [ehudm] Cleanup DeprecationWarning for BaseException.message. [arostami] Fixes unclosed files in VcfSource when exception is thrown.

[jira] [Commented] (BEAM-2863) Add support for Side Inputs over the Fn API

[ https://issues.apache.org/jira/browse/BEAM-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319529#comment-16319529 ] ASF GitHub Bot commented on BEAM-2863: -- lukecwik opened a new pull request #4377: [BEAM-2863] Add the

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5616

See

[jira] [Commented] (BEAM-3443) Enable running the build within a sandbox without needing to have network access

[ https://issues.apache.org/jira/browse/BEAM-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319491#comment-16319491 ] ASF GitHub Bot commented on BEAM-3443: -- lukecwik closed pull request #4374: [BEAM-3443] Support a

[beam] branch master updated: Add the ability to create an offline repository using https://github.com/mdietrichstein/gradle-offline-dependencies-plugin

This is an automated email from the ASF dual-hosted git repository. lcwik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 7d240c0 Add the ability to create an offline

[jira] [Updated] (BEAM-3345) [SQL] Reject Unsupported Joins

[ https://issues.apache.org/jira/browse/BEAM-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin updated BEAM-3345: -- Issue Type: Task (was: Bug) > [SQL] Reject Unsupported Joins > -- > >

[jira] [Assigned] (BEAM-3345) [SQL] Reject Unsupported Joins

[ https://issues.apache.org/jira/browse/BEAM-3345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kedin reassigned BEAM-3345: - Assignee: Anton Kedin > [SQL] Reject Unsupported Joins > -- > >

[jira] [Created] (BEAM-3445) _BatchSizeEstimator should not use Metrics

Pablo Estrada created BEAM-3445: --- Summary: _BatchSizeEstimator should not use Metrics Key: BEAM-3445 URL: https://issues.apache.org/jira/browse/BEAM-3445 Project: Beam Issue Type: Bug

[jira] [Assigned] (BEAM-3444) Fix flake8 detected errors E999 (AST compile error)

[ https://issues.apache.org/jira/browse/BEAM-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-3444: - Assignee: (was: Ahmet Altay) > Fix flake8 detected errors E999 (AST compile error) >

[jira] [Commented] (BEAM-3311) Extend BigTableIO to write Iterable of KV

[ https://issues.apache.org/jira/browse/BEAM-3311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319340#comment-16319340 ] Anna Smith commented on BEAM-3311: -- Thanks, [~sduskis]! The approaches suggested seem a bit more

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5615

See

[jira] [Created] (BEAM-3444) Fix flake8 detected errors E999 (AST compile error)

holdenk created BEAM-3444: - Summary: Fix flake8 detected errors E999 (AST compile error) Key: BEAM-3444 URL: https://issues.apache.org/jira/browse/BEAM-3444 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-3416) File is not properly close in VcfSource when exception is thrown

[ https://issues.apache.org/jira/browse/BEAM-3416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319337#comment-16319337 ] ASF GitHub Bot commented on BEAM-3416: -- chamikaramj closed pull request #4349: [BEAM-3416] Fixes

[beam] branch master updated (5fd97c0 -> ad37707)

This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 5fd97c0 Merge pull request #4369 from robertwb/return-state add 813a89d Fixes unclosed files in VcfSource

[jira] [Commented] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319265#comment-16319265 ] ASF GitHub Bot commented on BEAM-2732: -- pabloem opened a new pull request #4375: [BEAM-2732] Starting

[beam] branch master updated (aff2a1e -> 5fd97c0)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from aff2a1e Merge pull request #4366 from udim/baseexception add c2a0883 Return state from wait_until_finish.

[jira] [Commented] (BEAM-3443) Enable running the build within a sandbox without needing to have network access

[ https://issues.apache.org/jira/browse/BEAM-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16319184#comment-16319184 ] ASF GitHub Bot commented on BEAM-3443: -- lukecwik opened a new pull request #4374: [BEAM-3443] Support

[jira] [Created] (BEAM-3443) Enable running the build within a sandbox without needing to have network access

Luke Cwik created BEAM-3443: --- Summary: Enable running the build within a sandbox without needing to have network access Key: BEAM-3443 URL: https://issues.apache.org/jira/browse/BEAM-3443 Project: Beam

[jira] [Assigned] (BEAM-1589) Add OnWindowExpiration method to Stateful DoFn

[ https://issues.apache.org/jira/browse/BEAM-1589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-1589: - Assignee: Batkhuyag Batsaikhan > Add OnWindowExpiration method to Stateful DoFn >

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4681

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5614

See

Jenkins build is back to normal : beam_PostCommit_Python_ValidatesRunner_Dataflow #610

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5613

See

[jira] [Commented] (BEAM-3388) Reduce Go runtime reflective overhead

[ https://issues.apache.org/jira/browse/BEAM-3388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318966#comment-16318966 ] ASF GitHub Bot commented on BEAM-3388: -- herohde opened a new pull request #4373: [BEAM-3388] Add

[jira] [Commented] (BEAM-3368) Go model pipeline doesn't support External transform

[ https://issues.apache.org/jira/browse/BEAM-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318897#comment-16318897 ] ASF GitHub Bot commented on BEAM-3368: -- aaltay closed pull request #4284: BEAM-3368 fix translation

[jira] [Commented] (BEAM-3442) Clean up usage of deprecated BaseException.message

[ https://issues.apache.org/jira/browse/BEAM-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318886#comment-16318886 ] ASF GitHub Bot commented on BEAM-3442: -- chamikaramj closed pull request #4366: [BEAM-3442] Cleanup

[beam] 01/01: Merge pull request #4366 from udim/baseexception

This is an automated email from the ASF dual-hosted git repository. chamikara pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit aff2a1e685283e25a1a564ba3e37143cc57cdd60 Merge: ddc4a18 9261635 Author: Chamikara Jayalath

[beam] branch master updated (ddc4a18 -> aff2a1e)

This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ddc4a18 Merge pull request #4206 from jbonofre/BEAM-3282-MQTTIO add 9261635 Cleanup DeprecationWarning for

[jira] [Commented] (BEAM-3441) Allow ValueProvider for JdbcIO.DataSourceConfiguration

[ https://issues.apache.org/jira/browse/BEAM-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318875#comment-16318875 ] Sameer Abhyankar commented on BEAM-3441: I would like to work on this unless this is already being

[jira] [Created] (BEAM-3441) Allow ValueProvider for JdbcIO.DataSourceConfiguration

Sameer Abhyankar created BEAM-3441: -- Summary: Allow ValueProvider for JdbcIO.DataSourceConfiguration Key: BEAM-3441 URL: https://issues.apache.org/jira/browse/BEAM-3441 Project: Beam Issue

[jira] [Created] (BEAM-3442) Clean up usage of deprecated BaseException.message

Udi Meiri created BEAM-3442: --- Summary: Clean up usage of deprecated BaseException.message Key: BEAM-3442 URL: https://issues.apache.org/jira/browse/BEAM-3442 Project: Beam Issue Type: Bug

Build failed in Jenkins: beam_PerformanceTests_Python #770

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam6 (beam) in workspace

Jenkins build is back to normal : beam_PerformanceTests_FileBasedIO_IT #81

See

Build failed in Jenkins: beam_PerformanceTests_Spark #1214

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam2 (beam) in workspace

[jira] [Updated] (BEAM-3435) Python SDK examples should use beam.io.WriteToBigQuery transform rather than the BigQuerySink to interact with BQ.

[ https://issues.apache.org/jira/browse/BEAM-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-3435: -- Labels: starter (was: ) > Python SDK examples should use beam.io.WriteToBigQuery transform rather than

[beam] branch go-sdk updated (f68f05e -> 2a0ba98)

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git. from f68f05e Merge pull request #4350: Integrate master into go-sdk add d4b3624 Type-specialize custom decoders

[beam] 01/01: Merge pull request #4336 from herohde/runtime5

This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch go-sdk in repository https://gitbox.apache.org/repos/asf/beam.git commit 2a0ba9818c7f8468cdd1e2f8d28206882a5686bf Merge: f68f05e 0b43308 Author: Robert Bradshaw AuthorDate:

[jira] [Commented] (BEAM-3143) Fix type inference in Python 3 for generators

[ https://issues.apache.org/jira/browse/BEAM-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318789#comment-16318789 ] Ahmet Altay commented on BEAM-3143: --- Issue is already resolved. Do you want me to assign to [~luke-zhu]

[jira] [Created] (BEAM-3440) Generic IOIT profiles configuration in io's parent pom.xml

Łukasz Gajowy created BEAM-3440: --- Summary: Generic IOIT profiles configuration in io's parent pom.xml Key: BEAM-3440 URL: https://issues.apache.org/jira/browse/BEAM-3440 Project: Beam Issue

[jira] [Resolved] (BEAM-3406) FIeBasedIO IT fails due to "BigQuery error"

[ https://issues.apache.org/jira/browse/BEAM-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-3406. -- Resolution: Fixed Fix Version/s: Not applicable > FIeBasedIO IT fails due to

Build failed in Jenkins: beam_PostCommit_Python_Verify #3912

See -- [...truncated 1.19 MB...] "component_encodings": [ { "@type":

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #609

See -- [...truncated 1.06 MB...] { "key": "fn", "label": "Transform Function", "namespace":

[jira] [Created] (BEAM-3439) Examples and Dataflow runner tests fail due to quota exceeded

Jean-Baptiste Onofré created BEAM-3439: -- Summary: Examples and Dataflow runner tests fail due to quota exceeded Key: BEAM-3439 URL: https://issues.apache.org/jira/browse/BEAM-3439 Project: Beam

[jira] [Created] (BEAM-3438) KinesisIO IT fail due to an unpredictable comparison and missing PipelineOptions property

Jean-Baptiste Onofré created BEAM-3438: -- Summary: KinesisIO IT fail due to an unpredictable comparison and missing PipelineOptions property Key: BEAM-3438 URL: https://issues.apache.org/jira/browse/BEAM-3438

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4680

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5612

See

Build failed in Jenkins: beam_PerformanceTests_Python #769

See Changes: [jb] Exclude go from rat configuration, use .gitignore for excludes and align [iemejia] [BEAM-3422] Update reproducible-build-maven-plugin to version 0.4 [jbonofre] [BEAM-3282] MqttIO

Build failed in Jenkins: beam_PerformanceTests_FileBasedIO_IT #80

See Changes: [jb] Exclude go from rat configuration, use .gitignore for excludes and align [iemejia] [BEAM-3422] Update reproducible-build-maven-plugin to version 0.4 [jbonofre] [BEAM-3282]

Build failed in Jenkins: beam_PerformanceTests_Spark #1213

See Changes: [jb] Exclude go from rat configuration, use .gitignore for excludes and align [iemejia] [BEAM-3422] Update reproducible-build-maven-plugin to version 0.4 [jbonofre] [BEAM-3282] MqttIO

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4679

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #5611

See

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #608

See Changes: [jbonofre] [BEAM-3282] MqttIO reader now use receive for timeout in order to return -- [...truncated 1.06 MB...] {

Build failed in Jenkins: beam_PostCommit_Python_Verify #3911

See Changes: [jbonofre] [BEAM-3282] MqttIO reader now use receive for timeout in order to return -- [...truncated 1.19 MB...] "is_wrapper":

[jira] [Commented] (BEAM-3409) Unexpected behavior of DoFn teardown method running in unit tests

[ https://issues.apache.org/jira/browse/BEAM-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318222#comment-16318222 ] ASF GitHub Bot commented on BEAM-3409: -- rmannibucau opened a new pull request #4372: BEAM-3409

[jira] [Commented] (BEAM-3282) MqttIO reader should use receive with timeout

[ https://issues.apache.org/jira/browse/BEAM-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318206#comment-16318206 ] ASF GitHub Bot commented on BEAM-3282: -- jbonofre closed pull request #4206: [BEAM-3282] MqttIO reader

[jira] [Resolved] (BEAM-3282) MqttIO reader should use receive with timeout

[ https://issues.apache.org/jira/browse/BEAM-3282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-3282. Resolution: Fixed Fix Version/s: 2.3.0 > MqttIO reader should use receive

[beam] branch master updated (65ab1cc -> ddc4a18)

This is an automated email from the ASF dual-hosted git repository. jbonofre pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 65ab1cc Merge pull request #4253 from jbonofre/GO_RAT add d22fa01 [BEAM-3282] MqttIO reader now use receive

[beam] 01/01: Merge pull request #4206 from jbonofre/BEAM-3282-MQTTIO

This is an automated email from the ASF dual-hosted git repository. jbonofre pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit ddc4a188363e21d5d9d89ffbbc84cbfb20c6284f Merge: 65ab1cc d22fa01 Author: Jean-Baptiste Onofré

Build failed in Jenkins: beam_PerformanceTests_FileBasedIO_IT #79

See -- [...truncated 21.62 KB...] [INFO] --- maven-compiler-plugin:3.6.2:testCompile (default-testCompile) @ beam-sdks-java-io-file-based-io-tests --- [INFO] Changes

[jira] [Created] (BEAM-3437) Support schema in PCollections

Jean-Baptiste Onofré created BEAM-3437: -- Summary: Support schema in PCollections Key: BEAM-3437 URL: https://issues.apache.org/jira/browse/BEAM-3437 Project: Beam Issue Type: Wish

[jira] [Commented] (BEAM-3060) Add performance tests for commonly used file-based I/O PTransforms

[ https://issues.apache.org/jira/browse/BEAM-3060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318194#comment-16318194 ] ASF GitHub Bot commented on BEAM-3060: -- DariuszAniszewski opened a new pull request #4305: [BEAM-3060]

[jira] [Commented] (BEAM-3060) Add performance tests for commonly used file-based I/O PTransforms

[ https://issues.apache.org/jira/browse/BEAM-3060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318193#comment-16318193 ] ASF GitHub Bot commented on BEAM-3060: -- DariuszAniszewski closed pull request #4305: [BEAM-3060] Allow

Build failed in Jenkins: beam_PerformanceTests_FileBasedIO_IT #78

See -- [...truncated 21.62 KB...] [INFO] --- maven-compiler-plugin:3.6.2:testCompile (default-testCompile) @ beam-sdks-java-io-file-based-io-tests --- [INFO] Changes

Build failed in Jenkins: beam_PostCommit_Python_Verify #3910

See -- [...truncated 1.14 MB...] "@type": "OutputReference", "output_name": "out", "step_name": "s2" }, "serialized_fn":

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #607

See -- [...truncated 1.06 MB...] "namespace": "apache_beam.transforms.core.CallableWrapperDoFn", "type": "STRING",

[jira] [Created] (BEAM-3436) RetryHttpRequestInitializerTest takes 4min to complete

Ismaël Mejía created BEAM-3436: -- Summary: RetryHttpRequestInitializerTest takes 4min to complete Key: BEAM-3436 URL: https://issues.apache.org/jira/browse/BEAM-3436 Project: Beam Issue Type:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4678

See

[jira] [Commented] (BEAM-3422) The jar files uploaded to maven do not work with Java 9

[ https://issues.apache.org/jira/browse/BEAM-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16318029#comment-16318029 ] Ismaël Mejía commented on BEAM-3422: Thanks for reporting [~cheister] the fix is in time for the 2.3.0