[jira] [Resolved] (BEAM-4825) Nexmark query3 is flaky on Direct runner. State and/or timer issue ?

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-4825. Fix Version/s: Not applicable Resolution: Fixed No flakiness observed (nexmark

[jira] [Resolved] (BEAM-5178) Gradle: Try to reduce the initialization time when running a UTest multiple times.

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-5178. Fix Version/s: Not applicable Resolution: Fixed with gradle changes in the build and

[jira] [Closed] (BEAM-5177) Integrate javadocs in the IDE with gradle

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-5177. -- Fix Version/s: Not applicable Resolution: Won't Fix Not related to Beam, IDE

[jira] [Closed] (BEAM-6344) :beam-sdks-java-io-elasticsearch-tests-2:test failed owing to get 503 from ES

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-6344. -- Fix Version/s: Not applicable Resolution: Fixed There were recent overload counter

[jira] [Resolved] (BEAM-7290) Upgrade hadoop-client

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-7290. Fix Version/s: Not applicable Resolution: Fixed this ticket was open for a CVE on

[jira] [Closed] (BEAM-7291) Upgrade hadoop-common

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-7291. -- Fix Version/s: Not applicable Resolution: Fixed this ticket was open for a CVE on

[jira] [Resolved] (BEAM-7292) Upgrade hadoop-mapreduce-client-core

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-7292. Fix Version/s: Not applicable Resolution: Fixed this ticket was open for a CVE on

[jira] [Closed] (BEAM-7295) Upgrade javax.mail

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-7295. -- Fix Version/s: Not applicable Resolution: Fixed No more in use in Beam so closing the

[jira] [Resolved] (BEAM-7298) Upgrade zookeeper

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-7298. Fix Version/s: Not applicable Resolution: Fixed Opened because of a CVE in

[jira] [Updated] (BEAM-7400) Authentication for ElasticsearchIO seems to be failing

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-7400: --- Description: It seem to be failing at least on elasticsearch cloud: {code:java} [WARNING]

[jira] [Closed] (BEAM-8859) Fix SplittableDoFnTest.testLifecycleMethodsBounded in new spark runner

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-8859. -- Fix Version/s: Not applicable Resolution: Duplicate Duplicate of 

[jira] [Resolved] (BEAM-4797) Allow the user to limit the number of result docs in ElasticsearchIO.read()

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-4797. Fix Version/s: Not applicable Resolution: Won't Fix A contributor offered to

[jira] [Resolved] (BEAM-5370) Set a cause exception in ElasticsearchIO#getBackendVersion

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-5370. Fix Version/s: 2.7.0 Resolution: Fixed Forgot to close that one, thanks for the

[jira] [Commented] (BEAM-5757) Elasticsearch IO provide delete function

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123561#comment-17123561 ] Etienne Chauchot commented on BEAM-5757: Delete an entire index does not make a lot of sense

[jira] [Assigned] (BEAM-5757) Elasticsearch IO provide delete function

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-5757: -- Assignee: (was: Etienne Chauchot) > Elasticsearch IO provide delete function >

[jira] [Resolved] (BEAM-6304) can ElasticsearchIO add a ExceptionHandlerFn

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-6304. Fix Version/s: Not applicable Resolution: Won't Fix As it received no update, I

[jira] [Assigned] (BEAM-8860) Implement combine with context in new spark runner

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-8860: -- Assignee: (was: Etienne Chauchot) > Implement combine with context in new spark

[jira] [Resolved] (BEAM-9032) Replace broadcast variables based side inputs with temp views

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-9032. Fix Version/s: Not applicable Resolution: Won't Fix Temp views need to be

[jira] [Commented] (BEAM-9032) Replace broadcast variables based side inputs with temp views

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123510#comment-17123510 ] Etienne Chauchot commented on BEAM-9032: Forgot to put the update. Thanks for the reminder Kenn !

[jira] [Assigned] (BEAM-9307) Put windows inside the key to avoid having all values for the same key in memory

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-9307: -- Assignee: (was: Etienne Chauchot) > Put windows inside the key to avoid having all

[jira] [Resolved] (BEAM-9436) Improve performance of GBK

2020-06-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-9436. Fix Version/s: 2.20.0 Resolution: Fixed Performance of GBK was improved by linked PR

[jira] [Commented] (BEAM-10017) Expose SocketOptions timeouts in CassandraIO

2020-05-19 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111273#comment-17111273 ] Etienne Chauchot commented on BEAM-10017: - there is a jar task in the cassandra gradle module.

[jira] [Commented] (BEAM-10017) Expose SocketOptions timeouts in CassandraIO

2020-05-19 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110950#comment-17110950 ] Etienne Chauchot commented on BEAM-10017: - Hi Nathan, thanks for moving the design discussion to

[jira] [Updated] (BEAM-10017) Expose SocketOptions timeouts in CassandraIO

2020-05-19 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-10017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-10017: Summary: Expose SocketOptions timeouts in CassandraIO (was: Expose SocketOptions timeouts

[jira] [Comment Edited] (BEAM-3926) Support MetricsPusher in Dataflow Runner

2020-05-15 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108082#comment-17108082 ] Etienne Chauchot edited comment on BEAM-3926 at 5/15/20, 8:47 AM: --

[jira] [Commented] (BEAM-3926) Support MetricsPusher in Dataflow Runner

2020-05-15 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17108082#comment-17108082 ] Etienne Chauchot commented on BEAM-3926: [~foegler], [~pabloem], I have a user who asks for this

[jira] [Resolved] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-05-14 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-8025. Fix Version/s: 2.21.0 Resolution: Fixed I took a look at the statistics since my fix

[jira] [Commented] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-05-04 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17098905#comment-17098905 ] Etienne Chauchot commented on BEAM-8025: My last fix was merged, I'm waiting for 2 weeks to see if

[jira] [Commented] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-04-30 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096405#comment-17096405 ] Etienne Chauchot commented on BEAM-8025: Just submitted a PR: 

[jira] [Comment Edited] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-04-30 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096391#comment-17096391 ] Etienne Chauchot edited comment on BEAM-8025 at 4/30/20, 10:17 AM: --- Hi

[jira] [Comment Edited] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-04-30 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096391#comment-17096391 ] Etienne Chauchot edited comment on BEAM-8025 at 4/30/20, 10:02 AM: --- Hi

[jira] [Commented] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-04-30 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096391#comment-17096391 ] Etienne Chauchot commented on BEAM-8025: Hi Kenn, no it is due to jenkins cluster load. I can give

[jira] [Updated] (BEAM-9436) Improve performance of GBK

2020-03-26 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-9436: --- Summary: Improve performance of GBK (was: Try to avoid elements list materialization in GBK)

[jira] [Resolved] (BEAM-9133) CassandraIOTest.classMethod test is still flaky

2020-03-25 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-9133. Fix Version/s: Not applicable Resolution: Duplicate [~aromanenko] thanks. I know it

[jira] [Updated] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-03-12 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-8025: --- Fix Version/s: (was: 2.19.0) > Cassandra IO classMethod test is flaky >

[jira] [Reopened] (BEAM-8025) Cassandra IO classMethod test is flaky

2020-03-12 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reopened BEAM-8025: Still flaky. Might be for another reason though:   {code:java} java.lang.RuntimeException:

[jira] [Created] (BEAM-9480) org.apache.beam.sdk.io.mongodb.MongoDbIOTest.testReadWithAggregate is flaky

2020-03-10 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9480: -- Summary: org.apache.beam.sdk.io.mongodb.MongoDbIOTest.testReadWithAggregate is flaky Key: BEAM-9480 URL: https://issues.apache.org/jira/browse/BEAM-9480 Project:

[jira] [Created] (BEAM-9470) :sdks:java:io:kinesis:test is flaky

2020-03-09 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9470: -- Summary: :sdks:java:io:kinesis:test is flaky Key: BEAM-9470 URL: https://issues.apache.org/jira/browse/BEAM-9470 Project: Beam Issue Type: Test

[jira] [Commented] (BEAM-9436) Try to avoid elements list materialization in GBK

2020-03-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17051980#comment-17051980 ] Etienne Chauchot commented on BEAM-9436: Could not avoid materialization because ReduceFnRunner

[jira] [Created] (BEAM-9436) Try to avoid elements list materialization in GBK

2020-03-04 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9436: -- Summary: Try to avoid elements list materialization in GBK Key: BEAM-9436 URL: https://issues.apache.org/jira/browse/BEAM-9436 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-9307) Put windows inside the key to avoid having all values for the same key in memory

2020-03-04 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-9307: -- Assignee: Etienne Chauchot > Put windows inside the key to avoid having all values for

[jira] [Updated] (BEAM-9307) Put windows inside the key to avoid having all values for the same key in memory

2020-03-04 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-9307: --- Description: On both group by key and combinePerKey. Like it was done for the current

[jira] [Resolved] (BEAM-9327) Avoid creating a new accumulator for each add input in Combine translation

2020-03-04 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-9327. Fix Version/s: Not applicable Resolution: Won't Fix recoding adding an input to an

[jira] [Assigned] (BEAM-9327) Avoid creating a new accumulator for each add input in Combine translation

2020-02-17 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-9327: -- Assignee: Etienne Chauchot > Avoid creating a new accumulator for each add input in

[jira] [Updated] (BEAM-9307) Put windows inside the key to avoid having all values for the same key in memory

2020-02-17 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-9307: --- Summary: Put windows inside the key to avoid having all values for the same key in memory

[jira] [Created] (BEAM-9327) Avoid creating a new accumulator for each add input in Combine translation

2020-02-17 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9327: -- Summary: Avoid creating a new accumulator for each add input in Combine translation Key: BEAM-9327 URL: https://issues.apache.org/jira/browse/BEAM-9327 Project:

[jira] [Created] (BEAM-9307) new spark runner: put windows inside the key to avoid having all values for the same key in memory

2020-02-13 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9307: -- Summary: new spark runner: put windows inside the key to avoid having all values for the same key in memory Key: BEAM-9307 URL:

[jira] [Commented] (BEAM-9270) Unable to use ElasticsearchIO for indexpatterns: index-*

2020-02-10 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033716#comment-17033716 ] Etienne Chauchot commented on BEAM-9270: I did some more testing: the problem is really restricted

[jira] [Commented] (BEAM-9270) Unable to use ElasticsearchIO for indexpatterns: index-*

2020-02-10 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033655#comment-17033655 ] Etienne Chauchot commented on BEAM-9270: Hi [~krisnaru], thannks for raising this ! I can indeed

[jira] [Commented] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2020-01-29 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025780#comment-17025780 ] Etienne Chauchot commented on BEAM-8470: [~udim] it was already, see there is a new column >

[jira] [Closed] (BEAM-9205) Regression in validates runner tests configuration in spark module

2020-01-28 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-9205. -- Fix Version/s: 2.20.0 Resolution: Fixed > Regression in validates runner tests

[jira] [Updated] (BEAM-9205) Regression in validates runner tests configuration in spark module

2020-01-28 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-9205: --- Parent: BEAM-3310 Issue Type: Sub-task (was: Test) > Regression in validates runner

[jira] [Created] (BEAM-9205) Regression in validates runner tests configuration in spark module

2020-01-28 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9205: -- Summary: Regression in validates runner tests configuration in spark module Key: BEAM-9205 URL: https://issues.apache.org/jira/browse/BEAM-9205 Project: Beam

[jira] [Created] (BEAM-9187) org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactoryTest.loadBalancesBundles is flaky

2020-01-24 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9187: -- Summary: org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactoryTest.loadBalancesBundles is flaky Key: BEAM-9187 URL:

[jira] [Comment Edited] (BEAM-9065) Spark runner accumulates metrics (incorrectly) between runs

2020-01-22 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020913#comment-17020913 ] Etienne Chauchot edited comment on BEAM-9065 at 1/22/20 9:53 AM: - Hey !

[jira] [Commented] (BEAM-9065) Spark runner accumulates metrics (incorrectly) between runs

2020-01-22 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020913#comment-17020913 ] Etienne Chauchot commented on BEAM-9065: Hey ! Yes, no problem, no hurry, we are still waiting to

[jira] [Commented] (BEAM-9065) Spark runner accumulates metrics (incorrectly) between runs

2020-01-09 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011875#comment-17011875 ] Etienne Chauchot commented on BEAM-9065: [~udim] If 2.18 is not released when the patch is ready I

[jira] [Updated] (BEAM-9065) metrics are not reset upon init

2020-01-08 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-9065: --- Fix Version/s: 2.18.0 > metrics are not reset upon init > --- > >

[jira] [Created] (BEAM-9065) metrics are not reset upon init

2020-01-08 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9065: -- Summary: metrics are not reset upon init Key: BEAM-9065 URL: https://issues.apache.org/jira/browse/BEAM-9065 Project: Beam Issue Type: Bug

[jira] [Work started] (BEAM-9032) Replace broadcast variables based side inputs with temp views

2020-01-06 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-9032 started by Etienne Chauchot. -- > Replace broadcast variables based side inputs with temp views >

[jira] [Created] (BEAM-9032) Replace broadcast variables based side inputs with temp views

2019-12-26 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9032: -- Summary: Replace broadcast variables based side inputs with temp views Key: BEAM-9032 URL: https://issues.apache.org/jira/browse/BEAM-9032 Project: Beam

[jira] [Closed] (BEAM-5192) Support Elasticsearch 7.x

2019-12-26 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-5192. -- Fix Version/s: (was: Not applicable) 2.19.0 Resolution: Fixed >

[jira] [Created] (BEAM-9019) Improve Spark Encoders (wrappers of beam coders)

2019-12-23 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-9019: -- Summary: Improve Spark Encoders (wrappers of beam coders) Key: BEAM-9019 URL: https://issues.apache.org/jira/browse/BEAM-9019 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-5690) Issue with GroupByKey in BeamSql using SparkRunner

2019-12-18 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-5690. Fix Version/s: 2.19.0 Resolution: Fixed > Issue with GroupByKey in BeamSql using

[jira] [Commented] (BEAM-5690) Issue with GroupByKey in BeamSql using SparkRunner

2019-12-18 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999012#comment-16999012 ] Etienne Chauchot commented on BEAM-5690: Yes, thanks for pointing out [~iemejia], I forgot to

[jira] [Resolved] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-12 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-8894. Fix Version/s: Not applicable Resolution: Not A Problem Lack of definition of the

[jira] [Closed] (BEAM-8338) Support ES 7.x for ElasticsearchIO

2019-12-12 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-8338. -- Fix Version/s: Not applicable Resolution: Duplicate > Support ES 7.x for ElasticsearchIO

[jira] [Reopened] (BEAM-5192) Support Elasticsearch 7.x

2019-12-12 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reopened BEAM-5192: Assignee: Etienne Chauchot (was: Chet Aldrich) reopening to resume [~zhongchen] (who has

[jira] [Work started] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8894 started by Etienne Chauchot. -- > Fix multiple coder bug in new spark runner >

[jira] [Work started] (BEAM-8025) Cassandra IO classMethod test is flaky

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8025 started by Etienne Chauchot. -- > Cassandra IO classMethod test is flaky >

[jira] [Resolved] (BEAM-8830) fix Flatten tests in Spark Structured Streaming runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-8830. Fix Version/s: 2.19.0 Resolution: Fixed > fix Flatten tests in Spark Structured

[jira] [Commented] (BEAM-3310) Push metrics to a backend in an runner agnostic way

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993587#comment-16993587 ] Etienne Chauchot commented on BEAM-3310: unassigned myself because remaining work is to support

[jira] [Assigned] (BEAM-3310) Push metrics to a backend in an runner agnostic way

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-3310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-3310: -- Assignee: (was: Etienne Chauchot) > Push metrics to a backend in an runner

[jira] [Comment Edited] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993581#comment-16993581 ] Etienne Chauchot edited comment on BEAM-8894 at 12/11/19 2:17 PM: --

[jira] [Assigned] (BEAM-4088) ExecutorServiceParallelExecutorTest#ensureMetricsThreadDoesntLeak in PR #4965 does not pass in gradle

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-4088: -- Assignee: (was: Etienne Chauchot) >

[jira] [Comment Edited] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993581#comment-16993581 ] Etienne Chauchot edited comment on BEAM-8894 at 12/11/19 2:17 PM: --

[jira] [Comment Edited] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993581#comment-16993581 ] Etienne Chauchot edited comment on BEAM-8894 at 12/11/19 2:16 PM: --

[jira] [Commented] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-11 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993581#comment-16993581 ] Etienne Chauchot commented on BEAM-8894:

[jira] [Created] (BEAM-8909) Implement Timer API translation in spark runner

2019-12-06 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8909: -- Summary: Implement Timer API translation in spark runner Key: BEAM-8909 URL: https://issues.apache.org/jira/browse/BEAM-8909 Project: Beam Issue Type:

[jira] [Created] (BEAM-8908) Implement State API translation in spark runner

2019-12-06 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8908: -- Summary: Implement State API translation in spark runner Key: BEAM-8908 URL: https://issues.apache.org/jira/browse/BEAM-8908 Project: Beam Issue Type:

[jira] [Created] (BEAM-8907) Implement SplittableDoFn translation in spark runner

2019-12-06 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8907: -- Summary: Implement SplittableDoFn translation in spark runner Key: BEAM-8907 URL: https://issues.apache.org/jira/browse/BEAM-8907 Project: Beam Issue

[jira] [Resolved] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-8470. Fix Version/s: 2.18.0 Resolution: Fixed > Create a new Spark runner based on Spark

[jira] [Commented] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16988666#comment-16988666 ] Etienne Chauchot commented on BEAM-8894: I hav split this tests because it might be unrelated to

[jira] [Resolved] (BEAM-6209) Remove Http Metrics Sink specific methods from PipelineOptions

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot resolved BEAM-6209. Fix Version/s: 2.10.0 Resolution: Fixed > Remove Http Metrics Sink specific methods

[jira] [Assigned] (BEAM-2499) Support Custom Windows in Spark runner

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2499: -- Assignee: (was: Etienne Chauchot) > Support Custom Windows in Spark runner >

[jira] [Assigned] (BEAM-2176) Support state API in Spark streaming mode.

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-2176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2176: -- Assignee: (was: Etienne Chauchot) > Support state API in Spark streaming mode. >

[jira] [Assigned] (BEAM-4226) Migrate hadoop dependency to 2.7.4 or upper to fix a CVE

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-4226: -- Assignee: (was: Etienne Chauchot) > Migrate hadoop dependency to 2.7.4 or upper to

[jira] [Assigned] (BEAM-5171) org.apache.beam.sdk.io.CountingSourceTest.test[Un]boundedSourceSplits tests are flaky in Spark runner

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-5171: -- Assignee: (was: Etienne Chauchot) >

[jira] [Created] (BEAM-8894) Fix multiple coder bug in new spark runner

2019-12-05 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8894: -- Summary: Fix multiple coder bug in new spark runner Key: BEAM-8894 URL: https://issues.apache.org/jira/browse/BEAM-8894 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-8830) fix Flatten tests in Spark Structured Streaming runner

2019-12-05 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-8830: --- Description: 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'

[jira] [Closed] (BEAM-8839) Failed ValidatesRunner tests for new Spark Runner

2019-12-02 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-8839. -- Fix Version/s: Not applicable Resolution: Duplicate split this failures into 3 tickets

[jira] [Created] (BEAM-8860) Implement combine with context in new spark runner

2019-12-02 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8860: -- Summary: Implement combine with context in new spark runner Key: BEAM-8860 URL: https://issues.apache.org/jira/browse/BEAM-8860 Project: Beam Issue

[jira] [Created] (BEAM-8859) Fix org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded in new spark runner

2019-12-02 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8859: -- Summary: Fix org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded in new spark runner Key: BEAM-8859 URL:

[jira] [Created] (BEAM-8830) fix Flatten tests in Spark Structured Streaming runner

2019-11-26 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8830: -- Summary: fix Flatten tests in Spark Structured Streaming runner Key: BEAM-8830 URL: https://issues.apache.org/jira/browse/BEAM-8830 Project: Beam Issue

[jira] [Closed] (BEAM-5192) Support Elasticsearch 7.x

2019-11-26 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-5192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-5192. -- Fix Version/s: Not applicable Resolution: Duplicate > Support Elasticsearch 7.x >

[jira] [Closed] (BEAM-198) Spark runner batch translator to work with Datasets instead of RDDs

2019-10-24 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-198. - Fix Version/s: Not applicable Resolution: Fixed > Spark runner batch translator to work

[jira] [Created] (BEAM-8470) Create a new Spark runner based on Spark Structured streaming framework

2019-10-24 Thread Etienne Chauchot (Jira)
Etienne Chauchot created BEAM-8470: -- Summary: Create a new Spark runner based on Spark Structured streaming framework Key: BEAM-8470 URL: https://issues.apache.org/jira/browse/BEAM-8470 Project:

[jira] [Closed] (BEAM-7184) Performance regression on spark-runner

2019-10-09 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot closed BEAM-7184. -- Fix Version/s: Not applicable Resolution: Cannot Reproduce > Performance regression on

[jira] [Commented] (BEAM-7184) Performance regression on spark-runner

2019-10-09 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16947644#comment-16947644 ] Etienne Chauchot commented on BEAM-7184: As it has not shown up since April, I guess we can close

[jira] [Commented] (BEAM-7184) Performance regression on spark-runner

2019-10-08 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16946820#comment-16946820 ] Etienne Chauchot commented on BEAM-7184: Do we know what was causing the perf drop ? >

  1   2   3   4   >