[jira] [Work logged] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?focusedWorklogId=91420&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91420 ] ASF GitHub Bot logged work on BEAM-2732: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #1368

See Changes: [tgroh] Update Dataflow Development Container Version -- [...truncated 4.35 KB...] export PS1 fi basename "$VIRTUAL_ENV" #

Build failed in Jenkins: beam_PostCommit_Python_Verify #4703

See Changes: [tgroh] Update Dataflow Development Container Version -- Started by GitHub push by tgroh [EnvInject] - Loading node environment variables. Buildi

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex_Gradle #107

See Changes: [tgroh] Update Dataflow Development Container Version -- [...truncated 27.98 MB...] WARNING: Journal output stream is null.

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #83

See Changes: [github] Add region to dataflowOptions as well. [tgroh] Use Explicit PipelineOptions in Native Evaluators -- [...truncated 19.48 MB...] INF

[jira] [Work logged] (BEAM-4056) Identify Side Inputs by PTransform ID and local name

[ https://issues.apache.org/jira/browse/BEAM-4056?focusedWorklogId=91407&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91407 ] ASF GitHub Bot logged work on BEAM-4056: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?focusedWorklogId=91405&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91405 ] ASF GitHub Bot logged work on BEAM-3310: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2990) support data type MAP

[ https://issues.apache.org/jira/browse/BEAM-2990?focusedWorklogId=91401&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91401 ] ASF GitHub Bot logged work on BEAM-2990: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #106

See Changes: [tgroh] Update Dataflow Development Container Version -- [...truncated 1.24 MB...] at org.apache.spark.streaming.api.

[jira] [Commented] (BEAM-4089) Report Nexmark runs to BQ dashboard for anomoly detection

[ https://issues.apache.org/jira/browse/BEAM-4089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439706#comment-16439706 ] Kenneth Knowles commented on BEAM-4089: --- Assigned to you just because you already mad

[jira] [Created] (BEAM-4089) Report Nexmark runs to BQ dashboard for anomoly detection

Kenneth Knowles created BEAM-4089: - Summary: Report Nexmark runs to BQ dashboard for anomoly detection Key: BEAM-4089 URL: https://issues.apache.org/jira/browse/BEAM-4089 Project: Beam Issue

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex_Gradle #106

See Changes: [github] Add region to dataflowOptions as well. [tgroh] Use Explicit PipelineOptions in Native Evaluators -- [...truncated 23.

[jira] [Work logged] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?focusedWorklogId=91389&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91389 ] ASF GitHub Bot logged work on BEAM-2732: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?focusedWorklogId=91388&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91388 ] ASF GitHub Bot logged work on BEAM-2732: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #105

See Changes: [github] Add region to dataflowOptions as well. [tgroh] Use Explicit PipelineOptions in Native Evaluators -- [...truncated 1.

[beam] 01/01: Merge pull request #5085: Update Dataflow Development Container Version

This is an automated email from the ASF dual-hosted git repository. tgroh pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 96615a1c5dfc2e67c2d408cc4f589952036988e8 Merge: 0ccdd54 748f9e5 Author: Thomas Groh AuthorDate: Mon Apr 16 09:16:12 2018 -0

[beam] branch master updated (0ccdd54 -> 96615a1)

This is an automated email from the ASF dual-hosted git repository. tgroh pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0ccdd54 Merge pull request #5125: Use Explicit PipelineOptions in Native Evaluators add 748f9e5 Update Dataflow

[jira] [Work logged] (BEAM-3792) Python submits portable pipelines to the Flink-served endpoint.

[ https://issues.apache.org/jira/browse/BEAM-3792?focusedWorklogId=91381&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91381 ] ASF GitHub Bot logged work on BEAM-3792: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3914) 'Unzip' flattens before performing fusion

[ https://issues.apache.org/jira/browse/BEAM-3914?focusedWorklogId=91380&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91380 ] ASF GitHub Bot logged work on BEAM-3914: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3914) 'Unzip' flattens before performing fusion

[ https://issues.apache.org/jira/browse/BEAM-3914?focusedWorklogId=91379&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91379 ] ASF GitHub Bot logged work on BEAM-3914: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #1367

See -- [...truncated 4.30 KB...] PS1="(`basename \"$VIRTUAL_ENV\"`) $PS1" fi export PS1 fi basename "$VIRTUAL_ENV" # Make sure to unalias

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #1366

See Changes: [github] Add region to dataflowOptions as well. [tgroh] Use Explicit PipelineOptions in Native Evaluators -- [...truncated 4.3

Build failed in Jenkins: beam_PostCommit_Python_Verify #4702

See Changes: [github] Add region to dataflowOptions as well. [tgroh] Use Explicit PipelineOptions in Native Evaluators -- Started by GitHub push by tgroh Sta

[jira] [Work logged] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?focusedWorklogId=91375&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91375 ] ASF GitHub Bot logged work on BEAM-2732: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-2732) State tracking in Python is inefficient and has duplicated code

[ https://issues.apache.org/jira/browse/BEAM-2732?focusedWorklogId=91376&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91376 ] ASF GitHub Bot logged work on BEAM-2732: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91362&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91362 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #1365

See -- [...truncated 1.02 KB...] > git checkout -f 9e3e9c4d0a0dc1574c8956c7f8379b37ba262cb2 Commit message: "This closes #5028" > git rev-list --no-walk

Build failed in Jenkins: beam_PostCommit_Python_Verify #4701

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam1 (beam) in workspace

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91351&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91351 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3942) Update performance testing framework to use Gradle.

[ https://issues.apache.org/jira/browse/BEAM-3942?focusedWorklogId=91340&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91340 ] ASF GitHub Bot logged work on BEAM-3942: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-4016) Direct runner incorrect lifecycle, @SplitRestriction should execute after @Setup on SplittableDoFn

[ https://issues.apache.org/jira/browse/BEAM-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439429#comment-16439429 ] Ismaël Mejía commented on BEAM-4016: I tried that workaround but it ends up calling the

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91333&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91333 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91332&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91332 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-4049: -- Assignee: Alexander Dejanovski (was: Jean-Baptiste Onofré) > Improve write throughput of Cassan

[jira] [Assigned] (BEAM-3485) CassandraIO.read() splitting produces invalid queries

[ https://issues.apache.org/jira/browse/BEAM-3485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3485: -- Assignee: Alexander Dejanovski (was: Alexey Romanenko) > CassandraIO.read() splitting produces

[jira] [Assigned] (BEAM-3424) CassandraIO uses 1 split if can't estimate size

[ https://issues.apache.org/jira/browse/BEAM-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3424: -- Assignee: Alexander Dejanovski (was: Alexey Romanenko) > CassandraIO uses 1 split if can't esti

[jira] [Assigned] (BEAM-3425) CassandraIO fails to estimate size: Codec not found for requested operation: [varchar <-> java.lang.Long]

[ https://issues.apache.org/jira/browse/BEAM-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-3425: -- Assignee: Alexander Dejanovski (was: Alexey Romanenko) > CassandraIO fails to estimate size: Co

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91329&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91329 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91330&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91330 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Created] (BEAM-4088) ExecutorServiceParallelExecutorTest#ensureMetricsThreadDoesntLeak in PR #4965 does not pass in gradle

Etienne Chauchot created BEAM-4088: -- Summary: ExecutorServiceParallelExecutorTest#ensureMetricsThreadDoesntLeak in PR #4965 does not pass in gradle Key: BEAM-4088 URL: https://issues.apache.org/jira/browse/BEAM-

[jira] [Commented] (BEAM-4016) Direct runner incorrect lifecycle, @SplitRestriction should execute after @Setup on SplittableDoFn

[ https://issues.apache.org/jira/browse/BEAM-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439412#comment-16439412 ] Romain Manni-Bucau commented on BEAM-4016: -- PS: don't forget the teardown mapping

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex_Gradle #105

See -- [...truncated 27.96 MB...] WARNING: Journal output stream is null. Skipping write to the WAL. Apr 16, 2018 12:52:11 PM com.datatorrent.stram

Build failed in Jenkins: beam_PerformanceTests_Spark #1597

See -- [...truncated 91.98 KB...] 'apache-beam-testing:bqjob_r4541cdaff52f81a_0162ce6577ad_1': Invalid schema update. Field timestamp has changed type from TIMESTAMP to FL

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #104

See -- [...truncated 1.24 MB...] at org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)

Build failed in Jenkins: beam_PerformanceTests_MongoDBIO_IT #57

See -- [...truncated 55.79 KB...] at com.mongodb.operation.CommandOperationHelper.executeWrappedCommandProtocol(CommandOperationHelper.java:84) at com.m

Build failed in Jenkins: beam_PerformanceTests_AvroIOIT_HDFS #56

See -- [...truncated 269.23 KB...] at org.apache.beam.sdk.io.hdfs.HadoopFileSystem.create(HadoopFileSystem.java:68) at org.apache.beam.sdk.io.FileSystem

Build failed in Jenkins: beam_PerformanceTests_XmlIOIT #151

See -- [...truncated 28.45 KB...] [INFO] Excluding com.google.apis:google-api-services-storage:jar:v1-rev71-1.22.0 from the shaded jar. [INFO] Excluding com.google.auth:goo

Jenkins build is back to normal : beam_PerformanceTests_Compressed_TextIOIT_HDFS #56

See

Build failed in Jenkins: beam_PerformanceTests_Python #1155

See -- [...truncated 627.11 KB...] [INFO] Apache Beam :: SDKs :: Java :: Fn Execution SUCCESS [ 3.251 s] [INFO] Apache Beam :: SDKs :: Java :: Extensions ..

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91305&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91305 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91303&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91303 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PerformanceTests_TextIOIT_HDFS #62

See -- [...truncated 2.68 KB...] ++ kubectl config current-context + kubectl --kubeconfig=

Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat #148

See -- [...truncated 1.56 KB...] [beam_PerformanceTests_HadoopInputFormat] $ /bin/bash -xe /tmp/jenkins2494799303865109198.sh + gcloud container clusters get-crede

Build failed in Jenkins: beam_PerformanceTests_XmlIOIT_HDFS #55

See -- [...truncated 1.29 KB...] > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after

[jira] [Work logged] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?focusedWorklogId=91302&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91302 ] ASF GitHub Bot logged work on BEAM-3310: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #196

See -- [...truncated 2.87 MB...] [INFO] Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.8.2/plexus-compiler-m

[jira] [Commented] (BEAM-4086) KafkaIO is flaky with gradle build

[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439218#comment-16439218 ] Colm O hEigeartaigh commented on BEAM-4086: --- I've also noticed it hanging with ma

[jira] [Commented] (BEAM-4087) Gradle build does not allow to overwrite versions of provided dependencies

[ https://issues.apache.org/jira/browse/BEAM-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439214#comment-16439214 ] Ismaël Mejía commented on BEAM-4087: >From a previously discussion with [~lcwik] anothe

[jira] [Commented] (BEAM-4086) KafkaIO is flaky with gradle build

[ https://issues.apache.org/jira/browse/BEAM-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16439210#comment-16439210 ] Alexey Romanenko commented on BEAM-4086: It hangs with maven too sometimes: {code:

[jira] [Created] (BEAM-4087) Gradle build does not allow to overwrite versions of provided dependencies

Ismaël Mejía created BEAM-4087: -- Summary: Gradle build does not allow to overwrite versions of provided dependencies Key: BEAM-4087 URL: https://issues.apache.org/jira/browse/BEAM-4087 Project: Beam

[jira] [Created] (BEAM-4086) KafkaIO is flaky with gradle build

Ismaël Mejía created BEAM-4086: -- Summary: KafkaIO is flaky with gradle build Key: BEAM-4086 URL: https://issues.apache.org/jira/browse/BEAM-4086 Project: Beam Issue Type: Sub-task Comp

[jira] [Work logged] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?focusedWorklogId=91261&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91261 ] ASF GitHub Bot logged work on BEAM-3310: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3310) Push metrics to a backend in an runner agnostic way

[ https://issues.apache.org/jira/browse/BEAM-3310?focusedWorklogId=91251&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91251 ] ASF GitHub Bot logged work on BEAM-3310: Author: ASF GitHub Bot

Build failed in Jenkins: beam_PostCommit_Python_Verify #4700

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam1 (beam) in workspace

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #1364

See -- [...truncated 1.02 KB...] > git checkout -f 9e3e9c4d0a0dc1574c8956c7f8379b37ba262cb2 Commit message: "This closes #5028" > git rev-list --no-walk

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91231&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91231 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91223&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91223 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91193&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91193 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4049) Improve write throughput of CassandraIO

[ https://issues.apache.org/jira/browse/BEAM-4049?focusedWorklogId=91190&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91190 ] ASF GitHub Bot logged work on BEAM-4049: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3995) Launch Nexmark suites from gradle and update web page docs

[ https://issues.apache.org/jira/browse/BEAM-3995?focusedWorklogId=91189&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-91189 ] ASF GitHub Bot logged work on BEAM-3995: Author: ASF GitHub Bot

<    1   2   3