[jira] [Commented] (FLINK-5125) ContinuousFileProcessingCheckpointITCase is Flaky

2018-07-07 Thread Congxian Qiu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535993#comment-16535993 ] Congxian Qiu commented on FLINK-5125: - I run into the same problem also while run the test in my

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535987#comment-16535987 ] ASF GitHub Bot commented on FLINK-9407: --- Github user hequn8128 commented on the issue:

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-07 Thread hequn8128
Github user hequn8128 commented on the issue: https://github.com/apache/flink/pull/6075 Hi @zhangminglei , The main reason to implement the `CheckpointedFuntion ` is you have kept a buffer in you Writer class. The buffer is a memory buffer which will suffer data loss during job

[jira] [Commented] (FLINK-9642) Reduce the count to deal with state during a CEP process

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535986#comment-16535986 ] ASF GitHub Bot commented on FLINK-9642: --- Github user zhangminglei commented on the issue:

[GitHub] flink issue #6205: [FLINK-9642]Reduce the count to deal with state during a ...

2018-07-07 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/6205 Hi, @Aitozi I think it has conflicts now. ---

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535973#comment-16535973 ] ASF GitHub Bot commented on FLINK-9407: --- Github user zhangminglei commented on the issue:

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-07 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/6075 Thanks @hequn8128. You are very correct! It is more reasonable to put the ORC related classes into there ~, like @StephanEwen said, at the very least. make them optional. As refers to implement

[jira] [Commented] (FLINK-9563) Migrate integration tests for CEP

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535969#comment-16535969 ] ASF GitHub Bot commented on FLINK-9563: --- Github user deepaks4077 commented on the issue:

[GitHub] flink issue #6170: [FLINK-9563]: Using a custom sink function for tests in C...

2018-07-07 Thread deepaks4077
Github user deepaks4077 commented on the issue: https://github.com/apache/flink/pull/6170 @zentol, thanks for reviewing. I've updated the PR, can you please take a look? ---

[jira] [Updated] (FLINK-9750) Create new StreamingFileSink that works on Flink's FileSystem abstraction

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9750: -- Labels: pull-request-available (was: ) > Create new StreamingFileSink that works on Flink's

[jira] [Commented] (FLINK-9750) Create new StreamingFileSink that works on Flink's FileSystem abstraction

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535932#comment-16535932 ] ASF GitHub Bot commented on FLINK-9750: --- GitHub user kl0u opened a pull request:

[GitHub] flink pull request #6281: [FLINK-9750] Add new StreamingFileSink with Resuma...

2018-07-07 Thread kl0u
GitHub user kl0u opened a pull request: https://github.com/apache/flink/pull/6281 [FLINK-9750] Add new StreamingFileSink with ResumableWriter. ## What is the purpose of the change This PR is the first step towards introducing a new Streaming Filesystem sink that works on

[jira] [Commented] (FLINK-9776) Interrupt TaskThread only while in User/Operator code

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535780#comment-16535780 ] ASF GitHub Bot commented on FLINK-9776: --- Github user StephanEwen commented on a diff in the pull

[GitHub] flink pull request #6275: [FLINK-9776] [runtime] Stop sending periodic inter...

2018-07-07 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/6275#discussion_r200814568 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/taskmanager/Task.java --- @@ -1563,7 +1573,7 @@ public void run() {

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535776#comment-16535776 ] ASF GitHub Bot commented on FLINK-9407: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-07 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/6075 The dependencies of the `flink-connector-filesystem` are not well set up already, having an Avro dependency and a Hadoop dependency. I agree that it would be good to not introduce yet more

[jira] [Updated] (FLINK-9733) Make location for job graph files configurable

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9733: -- Labels: pull-request-available (was: ) > Make location for job graph files configurable >

[jira] [Commented] (FLINK-9733) Make location for job graph files configurable

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535755#comment-16535755 ] ASF GitHub Bot commented on FLINK-9733: --- GitHub user yanghua opened a pull request:

[GitHub] flink pull request #6280: [FLINK-9733] Make location for job graph files con...

2018-07-07 Thread yanghua
GitHub user yanghua opened a pull request: https://github.com/apache/flink/pull/6280 [FLINK-9733] Make location for job graph files configurable ## What is the purpose of the change *This pull request make location for job graph files configurable* ## Brief

[jira] [Commented] (FLINK-9682) Add setDescription to execution environment and display it in the UI

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535753#comment-16535753 ] ASF GitHub Bot commented on FLINK-9682: --- Github user yanghua commented on the issue:

[GitHub] flink issue #6266: [FLINK-9682] Add setDescription to execution environment ...

2018-07-07 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6266 @hequn8128 thanks for your suggestion. Yes, cutting off the description is a choice. But currently, for the web UI, if the description does not show in a new line, there is only little zone can be

[jira] [Commented] (FLINK-9682) Add setDescription to execution environment and display it in the UI

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535749#comment-16535749 ] ASF GitHub Bot commented on FLINK-9682: --- Github user hequn8128 commented on the issue:

[GitHub] flink issue #6266: [FLINK-9682] Add setDescription to execution environment ...

2018-07-07 Thread hequn8128
Github user hequn8128 commented on the issue: https://github.com/apache/flink/pull/6266 Hi @yanghua , I think if the description is too long, we can simply cut off the description. It is safe and easy. ---

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535745#comment-16535745 ] ASF GitHub Bot commented on FLINK-9407: --- Github user hequn8128 commented on the issue:

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-07 Thread hequn8128
Github user hequn8128 commented on the issue: https://github.com/apache/flink/pull/6075 Hi @zhangminglei , thanks very much for your PR. As for dependencies, I think it is better to move ORC related classes into the module of `flink-orc`, so we don't need to add orc

[jira] [Commented] (FLINK-9682) Add setDescription to execution environment and display it in the UI

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535715#comment-16535715 ] ASF GitHub Bot commented on FLINK-9682: --- Github user yanghua commented on the issue:

[GitHub] flink issue #6266: [FLINK-9682] Add setDescription to execution environment ...

2018-07-07 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6266 hi @tillrohrmann what's your idea about the way of showing the description of the job, or split the issue into backend API and frontend presentation? ---

[jira] [Commented] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535697#comment-16535697 ] ASF GitHub Bot commented on FLINK-9352: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #6092: [FLINK-9352] In Standalone checkpoint recover mode...

2018-07-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/6092 ---

[jira] [Resolved] (FLINK-9352) In Standalone checkpoint recover mode many jobs with same checkpoint interval cause IO pressure

2018-07-07 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-9352. -- Resolution: Fixed Fix Version/s: 1.6.0 Fixed via

[jira] [Updated] (FLINK-9706) DispatcherTest#testSubmittedJobGraphListener fails on Travis

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-9706: -- Labels: pull-request-available test-stability (was: test-stability) >

[jira] [Commented] (FLINK-9706) DispatcherTest#testSubmittedJobGraphListener fails on Travis

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535694#comment-16535694 ] ASF GitHub Bot commented on FLINK-9706: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #6279: [FLINK-9706] Properly wait for termination of JobM...

2018-07-07 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/6279 [FLINK-9706] Properly wait for termination of JobManagerRunner before restarting jobs ## What is the purpose of the change In order to avoid race conditions between resource clean up,

[jira] [Updated] (FLINK-9706) DispatcherTest#testSubmittedJobGraphListener fails on Travis

2018-07-07 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-9706: - Fix Version/s: 1.6.0 1.5.2 > DispatcherTest#testSubmittedJobGraphListener

[jira] [Assigned] (FLINK-9706) DispatcherTest#testSubmittedJobGraphListener fails on Travis

2018-07-07 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-9706: Assignee: Till Rohrmann > DispatcherTest#testSubmittedJobGraphListener fails on Travis >

[jira] [Commented] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535682#comment-16535682 ] ASF GitHub Bot commented on FLINK-8866: --- Github user suez1224 commented on a diff in the pull

[GitHub] flink pull request #6201: [FLINK-8866][Table API & SQL] Add support for unif...

2018-07-07 Thread suez1224
Github user suez1224 commented on a diff in the pull request: https://github.com/apache/flink/pull/6201#discussion_r200806113 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/plan/nodes/PhysicalTableSourceScan.scala --- @@ -39,9 +39,12 @@ abstract class

[jira] [Commented] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535680#comment-16535680 ] ASF GitHub Bot commented on FLINK-8866: --- Github user suez1224 commented on a diff in the pull

[GitHub] flink pull request #6201: [FLINK-8866][Table API & SQL] Add support for unif...

2018-07-07 Thread suez1224
Github user suez1224 commented on a diff in the pull request: https://github.com/apache/flink/pull/6201#discussion_r200806045 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/table/descriptors/FileSystem.scala --- @@ -27,6 +28,8 @@ class FileSystem extends

[jira] [Commented] (FLINK-9772) Documentation of Hadoop API outdated

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535679#comment-16535679 ] ASF GitHub Bot commented on FLINK-9772: --- Github user yanghua commented on the issue:

[GitHub] flink issue #6278: [FLINK-9772] Documentation of Hadoop API outdated

2018-07-07 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/6278 cc @zentol @tillrohrmann can this PR be merged into 1.5.1? ---

[jira] [Commented] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535678#comment-16535678 ] ASF GitHub Bot commented on FLINK-8866: --- Github user suez1224 commented on a diff in the pull

[GitHub] flink pull request #6201: [FLINK-8866][Table API & SQL] Add support for unif...

2018-07-07 Thread suez1224
Github user suez1224 commented on a diff in the pull request: https://github.com/apache/flink/pull/6201#discussion_r200805902 --- Diff: flink-libraries/flink-sql-client/src/main/java/org/apache/flink/table/client/config/Environment.java --- @@ -56,23 +58,44 @@ public

[GitHub] flink pull request #6201: [FLINK-8866][Table API & SQL] Add support for unif...

2018-07-07 Thread suez1224
Github user suez1224 commented on a diff in the pull request: https://github.com/apache/flink/pull/6201#discussion_r200805881 --- Diff: flink-libraries/flink-sql-client/src/main/java/org/apache/flink/table/client/config/Environment.java --- @@ -56,23 +58,44 @@ public

[jira] [Commented] (FLINK-8866) Create unified interfaces to configure and instatiate TableSinks

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535676#comment-16535676 ] ASF GitHub Bot commented on FLINK-8866: --- Github user suez1224 commented on a diff in the pull

[jira] [Commented] (FLINK-9407) Support orc rolling sink writer

2018-07-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535655#comment-16535655 ] ASF GitHub Bot commented on FLINK-9407: --- Github user zhangminglei commented on the issue:

[GitHub] flink issue #6075: [FLINK-9407] [hdfs connector] Support orc rolling sink wr...

2018-07-07 Thread zhangminglei
Github user zhangminglei commented on the issue: https://github.com/apache/flink/pull/6075 Patch have been updated. ---