[jira] (FLINK-1526) Add Minimum Spanning Tree library method and example
Title: Message Title Vasia Kalavri commented on FLINK-1526 Re: Add Minimum Spanning Tree library method and example Hi Xingcan Cui, thank you for your interest in this issue. As you can see in the comments history, contributors have had problems completing this task without support for for-loop iterations. Are you planning to take a different approach? Could you describe how you're planning to proceed? Thanks! Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5598) Return jar name when jar is uploaded
Title: Message Title Bill Liu commented on FLINK-5598 Re: Return jar name when jar is uploaded I vote for this, the jar id is required to run the job via Rest API. So it's better to return it in the upload result. Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4988) Elasticsearch 5.x support
Title: Message Title ASF GitHub Bot commented on FLINK-4988 Re: Elasticsearch 5.x support Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3112 Thank you for your comments @mikedias, I will address them. Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink issue #3112: [FLINK-4988] [elasticsearch] Add Elasticsearch 5.x Connec...
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/3112 Thank you for your comments @mikedias, I will address them. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-2168) Add HBaseTableSource
Title: Message Title ASF GitHub Bot commented on FLINK-2168 Re: Add HBaseTableSource Github user ramkrish86 commented on the issue: https://github.com/apache/flink/pull/3149 Am not sure how we will manage this. But one thing that can be done is that if invalid family name is added to the scan - HBase internally throws FamilyNotFoundException - so that we can track and report back. But am not sure how to track the schema. So every time he wants to scan two families - the user has to call HBaseTableSchema#addColumns() twice (with the required qualifiers). @tonycox Can you help me understand - when you say ' so we can add more maps that generate after familyMap has set'? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink issue #3149: FLINK-2168 Add HBaseTableSource
Github user ramkrish86 commented on the issue: https://github.com/apache/flink/pull/3149 Am not sure how we will manage this. But one thing that can be done is that if invalid family name is added to the scan - HBase internally throws FamilyNotFoundException - so that we can track and report back. But am not sure how to track the schema. So every time he wants to scan two families - the user has to call HBaseTableSchema#addColumns() twice (with the required qualifiers). @tonycox Can you help me understand - when you say ' so we can add more maps that generate after familyMap has set'? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5517) Upgrade hbase version to 1.3.0
Title: Message Title ASF GitHub Bot commented on FLINK-5517 Re: Upgrade hbase version to 1.3.0 GitHub user tedyu opened a pull request: https://github.com/apache/flink/pull/3235 FLINK-5517 Upgrade hbase version to 1.3.0 In the thread 'Help using HBase with Flink 1.1.4', Giuliano reported seeing: ``` java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator ``` The above has been solved by HBASE-14963 Upgrading to hbase 1.3.0 release would give better user experience. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tedyu/flink master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3235.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3235 commit b11e691e379760fec9bad6376ee277b5ed4c1912 Author: tedyuDate: 2017-01-30T00:44:04Z FLINK-5517 Upgrade hbase version to 1.3.0 Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink pull request #3235: FLINK-5517 Upgrade hbase version to 1.3.0
GitHub user tedyu opened a pull request: https://github.com/apache/flink/pull/3235 FLINK-5517 Upgrade hbase version to 1.3.0 In the thread 'Help using HBase with Flink 1.1.4', Giuliano reported seeing: ``` java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.()V from class org.apache.hadoop.hbase.zookeeper.MetaTableLocator ``` The above has been solved by HBASE-14963 Upgrading to hbase 1.3.0 release would give better user experience. You can merge this pull request into a Git repository by running: $ git pull https://github.com/tedyu/flink master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3235.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3235 commit b11e691e379760fec9bad6376ee277b5ed4c1912 Author: tedyuDate: 2017-01-30T00:44:04Z FLINK-5517 Upgrade hbase version to 1.3.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-4521) Fix "Submit new Job" panel in development mode
Title: Message Title ASF GitHub Bot commented on FLINK-4521 Re: Fix "Submit new Job" panel in development mode Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2431 Hi @uce I tried the latest version in the `master` branch and it seems that submit does not work there. I rebased my PR on top and tested it and it seems to work fine. Are you sure that all issues with submit were fixed in current version? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink issue #2431: [FLINK-4521][web frontend] Fix "Submit new Job" panel in ...
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2431 Hi @uce I tried the latest version in the `master` branch and it seems that submit does not work there. https://cloud.githubusercontent.com/assets/592286/22408446/eefd13c0-e670-11e6-9831-0fc6d3c7aaef.png;> I rebased my PR on top and tested it and it seems to work fine. Are you sure that all issues with submit were fixed in current version? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-2568) Flink fat jar is missing org.w3c.dom.ElementTraversal in some environments.
Title: Message Title Robert Metzger resolved as Cannot Reproduce Since 2015, no other user reported the issue. I'm closing it. Flink / FLINK-2568 Flink fat jar is missing org.w3c.dom.ElementTraversal in some environments. Change By: Robert Metzger Resolution: Cannot Reproduce Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3924) Remove protobuf shading from Kinesis connector
Title: Message Title Robert Metzger assigned an issue to Unassigned Flink / FLINK-3924 Remove protobuf shading from Kinesis connector Change By: Robert Metzger Assignee: Robert Metzger Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3079) Add utility for measuring the raw read throughput from a Kafka topic
Title: Message Title Robert Metzger resolved as Fixed The metrics in Flink now provide statistics for bytes per second and records per second. Flink / FLINK-3079 Add utility for measuring the raw read throughput from a Kafka topic Change By: Robert Metzger Resolution: Fixed Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2491) Operators are not participating in state checkpointing in some cases
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2491 Operators are not participating in state checkpointing in some cases Change By: Robert Metzger While implementing a test case for the Kafka Consumer, I came across the following bug:Consider the following topology, with the operator parallelism in parentheses:Source (2) --> Sink (1).In this setup, the {{snapshotState()}} method is called on the source, but not on the Sink.The sink receives the generated data. The only one of the two sources is generating data.I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2408) Some maven properties are defined in build profiles only
Title: Message Title Robert Metzger resolved as Fixed Resolved in https://github.com/apache/flink/commit/79a7bb213afd942a4a69a5e3906b6bd1f89fc290 (in Flink 0.10) Flink / FLINK-2408 Some maven properties are defined in build profiles only Change By: Robert Metzger Resolution: Fixed Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3030) Enhance Dashboard to show Execution Attempts
Title: Message Title ASF GitHub Bot commented on FLINK-3030 Re: Enhance Dashboard to show Execution Attempts Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2448 Hi @uce, I've rebased changes and updated the UI according to your suggestion. Now it looks like: What do you think about this? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1288) YARN ApplicationMaster sometimes fails to allocate the specified number of workers
Title: Message Title Robert Metzger resolved as Fixed This issue doesn't appear anymore in the recent YARN implementations. Most likely it was caused by YARNs scheduler Flink / FLINK-1288 YARN ApplicationMaster sometimes fails to allocate the specified number of workers Change By: Robert Metzger Resolution: Fixed Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink issue #2448: [FLINK-3030][web frontend] Enhance dashboard to show exec...
Github user mushketyk commented on the issue: https://github.com/apache/flink/pull/2448 Hi @uce, I've rebased changes and updated the UI according to your suggestion. Now it looks like: https://cloud.githubusercontent.com/assets/592286/22408112/2165724a-e66b-11e6-8008-6042a97ea412.png;> What do you think about this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-2036) StreamExecutionEnvironment usage in KafkaITcase
Title: Message Title Robert Metzger resolved as Fixed Closing ... The tests are now reusing a remote exec env. Flink / FLINK-2036 StreamExecutionEnvironment usage in KafkaITcase Change By: Robert Metzger Resolution: Fixed Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1166) Add a QA bot to Flink that is testing pull requests
Title: Message Title Robert Metzger commented on FLINK-1166 Re: Add a QA bot to Flink that is testing pull requests Unassigning myself. Let me know if you are interested in picking up my work. Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1055) JM Webfrontend needs unit tests
Title: Message Title Robert Metzger resolved as Fixed Closing JIRA. There are unit tests for the REST calls by the frontend Flink / FLINK-1055 JM Webfrontend needs unit tests Change By: Robert Metzger Resolution: Fixed Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1166) Add a QA bot to Flink that is testing pull requests
Title: Message Title Robert Metzger assigned an issue to Unassigned Flink / FLINK-1166 Add a QA bot to Flink that is testing pull requests Change By: Robert Metzger Assignee: Robert Metzger Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-87) Extend collectors to specify target sink
Title: Message Title Robert Metzger resolved as Won't Fix Closing as won't fix. There's not much focus on the DataSet API anymore, and there are good workarounds. Flink / FLINK-87 Extend collectors to specify target sink Change By: Robert Metzger Resolution: Won't Fix Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5481) Cannot create Collection of Row
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5481 Cannot create Collection of Row Change By: Robert Metzger Component/s: Table API & SQL Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5659) FileBaseUtils#deleteFileOrDirectory not thread-safe on Windows
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5659 FileBaseUtils#deleteFileOrDirectory not thread-safe on Windows Change By: Robert Metzger Component/s: Local Runtime Component/s: Core Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1497) No documentation on MiniCluster
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1497 No documentation on MiniCluster Change By: Robert Metzger Component/s: Documentation Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3245) KMeans Data Generator writes not the same centroids as it was used for the dataset
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3245 KMeans Data Generator writes not the same centroids as it was used for the dataset Change By: Robert Metzger Component/s: Examples Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1521) Some Chained Drivers do not respect object-reuse/non-reuse flag
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1521 Some Chained Drivers do not respect object-reuse/non-reuse flag Change By: Robert Metzger Component/s: Local Runtime Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-766) Web interface progress monitoring for DataSources and DataSinks with splits
Title: Message Title Robert Metzger updated an issue Flink / FLINK-766 Web interface progress monitoring for DataSources and DataSinks with splits Change By: Robert Metzger Component/s: Metrics Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1398) A new DataSet function: extractElementFromTuple
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1398 A new DataSet function: extractElementFromTuple Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1538) GSoC project: Spatial Data Processing Library
Title: Message Title Robert Metzger commented on FLINK-1538 Re: GSoC project: Spatial Data Processing Library Fabian Hueske I assume we can close this JIRA? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-37) [GitHub] Enable visualization of custom iteration statistics
Title: Message Title Robert Metzger resolved as Invalid Flink / FLINK-37 [GitHub] Enable visualization of custom iteration statistics Change By: Robert Metzger Resolution: Invalid Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-37) [GitHub] Enable visualization of custom iteration statistics
Title: Message Title Robert Metzger updated an issue Flink / FLINK-37 [GitHub] Enable visualization of custom iteration statistics Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-805) Early check of output write permissions
Title: Message Title Robert Metzger updated an issue Flink / FLINK-805 Early check of output write permissions Change By: Robert Metzger Component/s: DataSet API Component/s: Batch Connectors and Input/Output Formats Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-879) Allow empty result in cross function call
Title: Message Title Robert Metzger updated an issue Flink / FLINK-879 Allow empty result in cross function call Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-685) Add support for semi-joins
Title: Message Title Robert Metzger updated an issue Flink / FLINK-685 Add support for semi-joins Change By: Robert Metzger Component/s: Java API Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-788) Enable combiner for Reduce with Broadcast Variable
Title: Message Title Robert Metzger updated an issue Flink / FLINK-788 Enable combiner for Reduce with Broadcast Variable Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1098) flatArray() operator that converts arrays to elements
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1098 flatArray() operator that converts arrays to elements Change By: Robert Metzger Component/s: DataStream API Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-650) Give user functions access to TypeSerializers for their input types?
Title: Message Title Robert Metzger updated an issue Flink / FLINK-650 Give user functions access to TypeSerializers for their input types? Change By: Robert Metzger Component/s: Type Serialization System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1541) GSoC project: Distributed profiling
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1541 GSoC project: Distributed profiling Change By: Robert Metzger Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1541) GSoC project: Distributed profiling
Title: Message Title Robert Metzger commented on FLINK-1541 Re: GSoC project: Distributed profiling Till Rohrmann I assume we can close this JIRA? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1541) GSoC project: Distributed profiling
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1541 GSoC project: Distributed profiling Change By: Robert Metzger Component/s: Local Runtime Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1513) Remove GlobalConfiguration Singleton
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1513 Remove GlobalConfiguration Singleton Change By: Robert Metzger Component/s: Local Runtime Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink pull request #2066: Updated ssh configuration in base Dockerfile
Github user techmaniack closed the pull request at: https://github.com/apache/flink/pull/2066 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] flink issue #2066: Updated ssh configuration in base Dockerfile
Github user techmaniack commented on the issue: https://github.com/apache/flink/pull/2066 @greghogan +1 to close --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5681) Make ReaperThread for SafetyNetCloseableRegistry a singleton
Title: Message Title ASF GitHub Bot commented on FLINK-5681 Re: Make ReaperThread for SafetyNetCloseableRegistry a singleton Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/3230#discussion_r98358866 — Diff: flink-core/src/main/java/org/apache/flink/core/fs/SafetyNetCloseableRegistry.java — @@ -99,42 +120,61 @@ protected void doUnRegister( implements Closeable { private final Closeable innerCloseable; + private final SafetyNetCloseableRegistry closeableRegistry; private final String debugString; public PhantomDelegatingCloseableRef( WrappingProxyCloseable referent, + SafetyNetCloseableRegistry closeableRegistry, ReferenceQueue> q) { super(referent, q); this.innerCloseable = Preconditions.checkNotNull(WrappingProxyUtil.stripProxy(referent)); + this.closeableRegistry = Preconditions.checkNotNull(closeableRegistry); this.debugString = referent.toString(); } public Closeable getInnerCloseable() { - return innerCloseable; - } - public String getDebugString() { return debugString; } @Override public void close() throws IOException { + synchronized (closeableRegistry.getSynchronizationLock()) { + closeableRegistry.closeableToRef.remove(innerCloseable); — End diff – Removal is done here now, because the reaper thread should not keep/locate right references for all registries Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink pull request #3230: [FLINK-5681] Make ReaperThread for SafetyNetClosea...
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/3230#discussion_r98358866 --- Diff: flink-core/src/main/java/org/apache/flink/core/fs/SafetyNetCloseableRegistry.java --- @@ -99,42 +120,61 @@ protected void doUnRegister( implements Closeable { private final Closeable innerCloseable; + private final SafetyNetCloseableRegistry closeableRegistry; private final String debugString; public PhantomDelegatingCloseableRef( WrappingProxyCloseable referent, + SafetyNetCloseableRegistry closeableRegistry, ReferenceQueue> q) { super(referent, q); this.innerCloseable = Preconditions.checkNotNull(WrappingProxyUtil.stripProxy(referent)); + this.closeableRegistry = Preconditions.checkNotNull(closeableRegistry); this.debugString = referent.toString(); } - public Closeable getInnerCloseable() { - return innerCloseable; - } - public String getDebugString() { return debugString; } @Override public void close() throws IOException { + synchronized (closeableRegistry.getSynchronizationLock()) { + closeableRegistry.closeableToRef.remove(innerCloseable); --- End diff -- Removal is done here now, because the reaper thread should not keep/locate right references for all registries --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5681) Make ReaperThread for SafetyNetCloseableRegistry a singleton
Title: Message Title ASF GitHub Bot commented on FLINK-5681 Re: Make ReaperThread for SafetyNetCloseableRegistry a singleton Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3230 Quick question about this change: The reaper thread now does not remove the closeables any more from the `closeableToRef` map. Isn't that a potential memory leak over time? Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink issue #3230: [FLINK-5681] Make ReaperThread for SafetyNetCloseableRegi...
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/3230 Quick question about this change: The *reaper thread* now does not remove the closeables any more from the `closeableToRef` map. Isn't that a potential memory leak over time? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5663) Checkpoint fails because of closed registry
Title: Message Title Stephan Ewen resolved as Fixed Fixed in 1.2.0 via 617ff50c6103aa5d5354b6339531dc38d62127ec 1.3.0 via 50b665677831529ee492ceda40a3c8fd750d62ff Flink / FLINK-5663 Checkpoint fails because of closed registry Change By: Stephan Ewen Resolution: Fixed Fix Version/s: 1.3.0 Fix Version/s: 1.2.0 Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5663) Checkpoint fails because of closed registry
Title: Message Title Stephan Ewen closed an issue as Fixed Flink / FLINK-5663 Checkpoint fails because of closed registry Change By: Stephan Ewen Status: Resolved Closed Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1447) Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1447 Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser Change By: Robert Metzger Component/s: Webfrontend Component/s: Web Client Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1447) Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser
Title: Message Title Robert Metzger resolved as Won't Fix The cleint has been removed from flink Flink / FLINK-1447 Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser Change By: Robert Metzger Resolution: Won't Fix Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1447) Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1447 Flink Web Submission Client does not work on Ubuntu 14.04 firefox browser Change By: Robert Metzger Component/s: Webfrontend Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5663) Checkpoint fails because of closed registry
Title: Message Title ASF GitHub Bot commented on FLINK-5663 Re: Checkpoint fails because of closed registry Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3229 Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[GitHub] flink pull request #3229: [FLINK-5663] Prevent leaking SafetyNetCloseableReg...
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/3229 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5684) Add MacOS section to flink-runtime-web README
Title: Message Title ASF GitHub Bot commented on FLINK-5684 Re: Add MacOS section to flink-runtime-web README GitHub user mushketyk opened a pull request: https://github.com/apache/flink/pull/3234 FLINK-5684[web frontend] Add MacOS section to README.md Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If your changes take all of the items into account, feel free to open your pull request. For more information and/or questions please refer to the [How To Contribute guide](http://flink.apache.org/how-to-contribute.html). In addition to going through the list, please provide a meaningful description of your changes. [x] General The pull request references the related JIRA issue ("[FLINK-XXX] Jira title text") The pull request addresses only one issue Each commit in the PR has a meaningful commit message (including the JIRA id) [x] Documentation Documentation has been added for new functionality Old documentation affected by the pull request has been updated JavaDoc for public methods has been added [x] Tests & Build Functionality added by the pull request is covered by tests `mvn clean verify` has been executed successfully locally or a Travis build has passed You can merge this pull request into a Git repository by running: $ git pull https://github.com/mushketyk/flink macos-readme Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3234.patch To close this pull request, make a commit to your master/trunk branch with (at least)
[GitHub] flink pull request #3234: [FLINK-5684][web frontend] Add MacOS section to RE...
GitHub user mushketyk opened a pull request: https://github.com/apache/flink/pull/3234 [FLINK-5684][web frontend] Add MacOS section to README.md Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check list into consideration. If your changes take all of the items into account, feel free to open your pull request. For more information and/or questions please refer to the [How To Contribute guide](http://flink.apache.org/how-to-contribute.html). In addition to going through the list, please provide a meaningful description of your changes. - [x] General - The pull request references the related JIRA issue ("[FLINK-XXX] Jira title text") - The pull request addresses only one issue - Each commit in the PR has a meaningful commit message (including the JIRA id) - [x] Documentation - Documentation has been added for new functionality - Old documentation affected by the pull request has been updated - JavaDoc for public methods has been added - [x] Tests & Build - Functionality added by the pull request is covered by tests - `mvn clean verify` has been executed successfully locally or a Travis build has passed You can merge this pull request into a Git repository by running: $ git pull https://github.com/mushketyk/flink macos-readme Alternatively you can review and apply these changes as the patch at: https://github.com/apache/flink/pull/3234.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3234 commit c326a71616486b1e570f609fc665abab51a66244 Author: Ivan MushketykDate: 2017-01-29T17:03:02Z [FLINK-5684][web frontend] Add MacOS section to README.md --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[jira] (FLINK-5684) Add MacOS section to flink-runtime-web README
Title: Message Title Ivan Mushketyk created an issue Flink / FLINK-5684 Add MacOS section to flink-runtime-web README Issue Type: Bug Assignee: Ivan Mushketyk Components: Documentation Created: 29/Jan/17 17:01 Priority: Major Reporter: Ivan Mushketyk Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1268) FileOutputFormat with overwrite does not clear local output directories
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1268 FileOutputFormat with overwrite does not clear local output directories Change By: Robert Metzger Component/s: Batch Connectors and Input/Output Formats Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1240) We cannot use sortGroup on a global reduce
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1240 We cannot use sortGroup on a global reduce Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1298) Consolidate Handling of User Code ClassLoader
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1298 Consolidate Handling of User Code ClassLoader Change By: Robert Metzger Component/s: Local Runtime Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1337) Create an Amazon EMR Bootstrap Action
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1337 Create an Amazon EMR Bootstrap Action Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1256) Use Kryo for user code object serialization
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1256 Use Kryo for user code object serialization Change By: Robert Metzger Component/s: DataStream API Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5431) time format for akka status
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5431 time format for akka status Change By: Robert Metzger Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5545) remove FlinkAggregateExpandDistinctAggregatesRule when we upgrade calcite
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5545 remove FlinkAggregateExpandDistinctAggregatesRule when we upgrade calcite Change By: Robert Metzger Component/s: Table API & SQL Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5541) Missing null check for localJar in FlinkSubmitter#submitTopology()
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5541 Missing null check for localJar in FlinkSubmitter#submitTopology() Change By: Robert Metzger Component/s: Storm Compatibility Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5629) Unclosed RandomAccessFile in StaticFileServerHandler#respondAsLeader()
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5629 Unclosed RandomAccessFile in StaticFileServerHandler#respondAsLeader() Change By: Robert Metzger Component/s: Webfrontend Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5376) Misleading log statements in UnorderedStreamElementQueue
Title: Message Title Robert Metzger updated an issue Flink / FLINK-5376 Misleading log statements in UnorderedStreamElementQueue Change By: Robert Metzger Component/s: DataStream API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-5391) Unprotected access to shutdown in AbstractNonHaServices#checkNotShutdown()
Title: Message Title Robert Metzger resolved as Invalid Flink / FLINK-5391 Unprotected access to shutdown in AbstractNonHaServices#checkNotShutdown() Change By: Robert Metzger Resolution: Invalid Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4880) FlinkML - Implement Feature hashing (Data pre-processing)
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4880 FlinkML - Implement Feature hashing (Data pre-processing) Change By: Robert Metzger Component/s: Machine Learning Library Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4508) Consolidate DummyEnvironment and MockEnvironment for Tests
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4508 Consolidate DummyEnvironment and MockEnvironment for Tests Change By: Robert Metzger Component/s: Tests Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4964) FlinkML - Add StringIndexer
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4964 FlinkML - Add StringIndexer Change By: Robert Metzger Component/s: Machine Learning Library Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4508) Consolidate DummyEnvironment and MockEnvironment for Tests
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4508 Consolidate DummyEnvironment and MockEnvironment for Tests Change By: Robert Metzger Component/s: Local Runtime Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4849) trustStorePassword should be checked against null in SSLUtils#createSSLClientContext
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4849 trustStorePassword should be checked against null in SSLUtils#createSSLClientContext Change By: Robert Metzger Component/s: Security Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4848) keystoreFilePath should be checked against null in SSLUtils#createSSLServerContext
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4848 keystoreFilePath should be checked against null in SSLUtils#createSSLServerContext Change By: Robert Metzger Component/s: Security Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4865) FlinkML - Add EvaluateDataSet operation for LabeledVector
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4865 FlinkML - Add EvaluateDataSet operation for LabeledVector Change By: Robert Metzger Component/s: Machine Learning Library Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4962) Improve exception information about operand type inference failure during UDF SQL validation
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4962 Improve exception information about operand type inference failure during UDF SQL validation Change By: Robert Metzger Component/s: Table API & SQL Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4721) Getting exception when using a key of type Option[String] in distinct operation
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4721 Getting exception when using a key of type Option[String] in distinct operation Change By: Robert Metzger Component/s: Scala API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4721) Getting exception when using a key of type Option[String] in distinct operation
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4721 Getting exception when using a key of type Option[String] in distinct operation Change By: Robert Metzger Component/s: Type Serialization System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3961) Possibility to write output to multiple locations based on partitions
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3961 Possibility to write output to multiple locations based on partitions Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4644) Deprecate "flink.base.dir.path" from ConfigConstants
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4644 Deprecate "flink.base.dir.path" from ConfigConstants Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4755) Create ContainerID; Rename ResourceID into ProcessID and InstanceID into RegistrationID
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4755 Create ContainerID; Rename ResourceID into ProcessID and InstanceID into RegistrationID Change By: Robert Metzger Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3875) Add a TableSink for Elasticsearch
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3875 Add a TableSink for Elasticsearch Change By: Robert Metzger Component/s: Table API & SQL Component/s: Streaming Connectors Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3801) Upgrade Joda-Time library to 2.9.3
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3801 Upgrade Joda-Time library to 2.9.3 Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4548) Refactor ContinuousFileMonitoringTest to use OneShotLatch
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4548 Refactor ContinuousFileMonitoringTest to use OneShotLatch Change By: Robert Metzger Component/s: DataStream API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3613) Add standard deviation, mean, variance to list of Aggregations
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3613 Add standard deviation, mean, variance to list of Aggregations Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3606) Expose Configuration from RichFunctions
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3606 Expose Configuration from RichFunctions Change By: Robert Metzger Component/s: DataStream API Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-4462) Add RUN_TIME retention policy for all the flink annotations
Title: Message Title Robert Metzger updated an issue Flink / FLINK-4462 Add RUN_TIME retention policy for all the flink annotations Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-1702) Authenticate via Kerberos from the client only
Title: Message Title Robert Metzger updated an issue Flink / FLINK-1702 Authenticate via Kerberos from the client only Change By: Robert Metzger Component/s: Security Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3839) Support wildcards in classpath parameters
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3839 Support wildcards in classpath parameters Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3119) Remove dependency on Tuple from HadoopOutputFormat
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3119 Remove dependency on Tuple from HadoopOutputFormat Change By: Robert Metzger Component/s: Batch Connectors and Input/Output Formats Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2334) IOException: Channel to path could not be opened
Title: Message Title Robert Metzger resolved as Cannot Reproduce Resolved as cannot reproduce Flink / FLINK-2334 IOException: Channel to path could not be opened Change By: Robert Metzger Resolution: Cannot Reproduce Status: Open Resolved Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-3094) FileStateBackend does not clean up job-id checkpoint directory
Title: Message Title Robert Metzger updated an issue Flink / FLINK-3094 FileStateBackend does not clean up job-id checkpoint directory Change By: Robert Metzger Component/s: State Backends, Checkpointing Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2539) More unified code style for Scala code
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2539 More unified code style for Scala code Change By: Robert Metzger Component/s: Scala API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2334) IOException: Channel to path could not be opened
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2334 IOException: Channel to path could not be opened Change By: Robert Metzger Component/s: Local Runtime Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2366) HA Without ZooKeeper
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2366 HA Without ZooKeeper Change By: Robert Metzger Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2592) Rework of FlinkMiniCluster
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2592 Rework of FlinkMiniCluster Change By: Robert Metzger Component/s: Distributed Coordination Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2593) Revisit Flink's shading policy
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2593 Revisit Flink's shading policy Change By: Robert Metzger Component/s: Build System Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)
[jira] (FLINK-2193) Partial shuffling
Title: Message Title Robert Metzger updated an issue Flink / FLINK-2193 Partial shuffling Change By: Robert Metzger Component/s: DataSet API Add Comment This message was sent by Atlassian JIRA (v6.3.15#6346-sha1:dbc023d)