[jira] [Commented] (FLINK-10205) Batch Job: InputSplit Fault tolerant for DataSourceTask

2018-08-23 Thread JIN SUN (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591066#comment-16591066 ] JIN SUN commented on FLINK-10205: - I would like to work on this issue > Batch Job: InputSplit Fault

[jira] [Created] (FLINK-10205) Batch Job: InputSplit Fault tolerant for DataSourceTask

2018-08-23 Thread JIN SUN (JIRA)
JIN SUN created FLINK-10205: --- Summary: Batch Job: InputSplit Fault tolerant for DataSourceTask Key: FLINK-10205 URL: https://issues.apache.org/jira/browse/FLINK-10205 Project: Flink Issue Type:

[jira] [Updated] (FLINK-10204) Job is marked as FAILED after serialization exception

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-10204: --- Labels: pull-request-available (was: ) > Job is marked as FAILED after serialization

[GitHub] benlamonica opened a new pull request #6610: [FLINK-10204] - fix serialization/copy error for LatencyMarker records.

2018-08-23 Thread GitBox
benlamonica opened a new pull request #6610: [FLINK-10204] - fix serialization/copy error for LatencyMarker records. URL: https://github.com/apache/flink/pull/6610 *Thank you very much for contributing to Apache Flink - we are happy that you want to help us improve Flink. To help the

[jira] [Commented] (FLINK-10204) Job is marked as FAILED after serialization exception

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590863#comment-16590863 ] ASF GitHub Bot commented on FLINK-10204: benlamonica opened a new pull request #6610:

[jira] [Created] (FLINK-10204) Job is marked as FAILED after serialization exception

2018-08-23 Thread Ben La Monica (JIRA)
Ben La Monica created FLINK-10204: - Summary: Job is marked as FAILED after serialization exception Key: FLINK-10204 URL: https://issues.apache.org/jira/browse/FLINK-10204 Project: Flink

[jira] [Commented] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590701#comment-16590701 ] ASF GitHub Bot commented on FLINK-8532: --- Guibo-Pan edited a comment on issue #6544: [FLINK-8532]

[GitHub] Guibo-Pan edited a comment on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition

2018-08-23 Thread GitBox
Guibo-Pan edited a comment on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition URL: https://github.com/apache/flink/pull/6544#issuecomment-415499383 Hi @StephanEwen , your suggestion lead me to deep thinks, and the extreme

[jira] [Commented] (FLINK-10186) FindBugs warnings: Random object created and used only once

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590696#comment-16590696 ] ASF GitHub Bot commented on FLINK-10186: Guibo-Pan commented on a change in pull request #6591:

[GitHub] Guibo-Pan commented on a change in pull request #6591: [FLINK-10186] Fix FindBugs warnings: Random object created and used o…

2018-08-23 Thread GitBox
Guibo-Pan commented on a change in pull request #6591: [FLINK-10186] Fix FindBugs warnings: Random object created and used o… URL: https://github.com/apache/flink/pull/6591#discussion_r212410516 ## File path:

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590683#comment-16590683 ] Kostas Kloudas commented on FLINK-10203: No problem [~artsem.semianenka]! I assigned the issue

[jira] [Assigned] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas reassigned FLINK-10203: -- Assignee: Artsem Semianenka > Support truncate method for old Hadoop versions in >

[jira] [Commented] (FLINK-10186) FindBugs warnings: Random object created and used only once

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590646#comment-16590646 ] ASF GitHub Bot commented on FLINK-10186: Guibo-Pan commented on a change in pull request #6591:

[GitHub] Guibo-Pan commented on a change in pull request #6591: [FLINK-10186] Fix FindBugs warnings: Random object created and used o…

2018-08-23 Thread GitBox
Guibo-Pan commented on a change in pull request #6591: [FLINK-10186] Fix FindBugs warnings: Random object created and used o… URL: https://github.com/apache/flink/pull/6591#discussion_r212410516 ## File path:

[jira] [Comment Edited] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590627#comment-16590627 ] Artsem Semianenka edited comment on FLINK-10203 at 8/23/18 6:24 PM:

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590627#comment-16590627 ] Artsem Semianenka commented on FLINK-10203: --- I'm so sorry guys, this is my first time when I

[jira] [Commented] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590614#comment-16590614 ] ASF GitHub Bot commented on FLINK-8532: --- Guibo-Pan commented on issue #6544: [FLINK-8532]

[GitHub] Guibo-Pan commented on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition

2018-08-23 Thread GitBox
Guibo-Pan commented on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition URL: https://github.com/apache/flink/pull/6544#issuecomment-415513913 I updated the code like mentioned above just now.

[jira] [Commented] (FLINK-9626) Possible resource leak in FileSystem

2018-08-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590612#comment-16590612 ] Stephan Ewen commented on FLINK-9626: - Note, that this happens only if there is no other FS factory

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590607#comment-16590607 ] Kostas Kloudas commented on FLINK-10203: Hi [~artsem.semianenka]! Given that you are working

[jira] [Assigned] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas reassigned FLINK-10203: -- Assignee: (was: Kostas Kloudas) > Support truncate method for old Hadoop

[jira] [Assigned] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Kostas Kloudas (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kostas Kloudas reassigned FLINK-10203: -- Assignee: Kostas Kloudas > Support truncate method for old Hadoop versions in >

[jira] [Commented] (FLINK-10195) RabbitMQ Source With Checkpointing Doesn't Backpressure Correctly

2018-08-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590591#comment-16590591 ] Stephan Ewen commented on FLINK-10195: -- Is that something that can be configured on RabbitMQ, for

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590588#comment-16590588 ] ASF GitHub Bot commented on FLINK-10203: StephanEwen commented on issue #6608:

[GitHub] StephanEwen commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread GitBox
StephanEwen commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608#issuecomment-415507439 I see, that is a fair reason. There are parallel efforts to add Parquet support

[jira] [Commented] (FLINK-10202) Enable configuration for state.checkpoint.dir in StreamExecutionEnvironment

2018-08-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590577#comment-16590577 ] Stephan Ewen commented on FLINK-10202: -- You can do that by calling {{env.setStateBackend(new

[GitHub] alpinegizmo opened a new pull request #6609: [hotfix][docs] missing breaking metrics page

2018-08-23 Thread GitBox
alpinegizmo opened a new pull request #6609: [hotfix][docs] missing breaking metrics page URL: https://github.com/apache/flink/pull/6609 Adding a missing `` to metrics.md. In both

[jira] [Commented] (FLINK-8532) RebalancePartitioner should use Random value for its first partition

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590561#comment-16590561 ] ASF GitHub Bot commented on FLINK-8532: --- Guibo-Pan commented on issue #6544: [FLINK-8532]

[GitHub] Guibo-Pan commented on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition

2018-08-23 Thread GitBox
Guibo-Pan commented on issue #6544: [FLINK-8532] [Streaming] modify RebalancePartitioner to use a random partition as its first partition URL: https://github.com/apache/flink/pull/6544#issuecomment-415499383 Hi @StephanEwen , your suggestion lead me to deep thinks, and the extreme

[jira] [Commented] (FLINK-10201) The batchTestUtil was mistakenly used in some stream sql tests

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590544#comment-16590544 ] ASF GitHub Bot commented on FLINK-10201: fhueske commented on issue #6605: [FLINK-10201] [table]

[GitHub] fhueske commented on issue #6605: [FLINK-10201] [table] [test] The batchTestUtil was mistakenly used in some stream sql tests

2018-08-23 Thread GitBox
fhueske commented on issue #6605: [FLINK-10201] [table] [test] The batchTestUtil was mistakenly used in some stream sql tests URL: https://github.com/apache/flink/pull/6605#issuecomment-415496307 Thanks for the PR @xccui. +1 to merge

[jira] [Commented] (FLINK-10011) Old job resurrected during HA failover

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590520#comment-16590520 ] ASF GitHub Bot commented on FLINK-10011: azagrebin commented on a change in pull request #6587:

[jira] [Commented] (FLINK-10011) Old job resurrected during HA failover

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590519#comment-16590519 ] ASF GitHub Bot commented on FLINK-10011: azagrebin commented on a change in pull request #6587:

[GitHub] azagrebin commented on a change in pull request #6587: [FLINK-10011] Release JobGraph from SubmittedJobGraphStore

2018-08-23 Thread GitBox
azagrebin commented on a change in pull request #6587: [FLINK-10011] Release JobGraph from SubmittedJobGraphStore URL: https://github.com/apache/flink/pull/6587#discussion_r212379451 ## File path:

[GitHub] azagrebin commented on a change in pull request #6587: [FLINK-10011] Release JobGraph from SubmittedJobGraphStore

2018-08-23 Thread GitBox
azagrebin commented on a change in pull request #6587: [FLINK-10011] Release JobGraph from SubmittedJobGraphStore URL: https://github.com/apache/flink/pull/6587#discussion_r212321052 ## File path:

[jira] [Commented] (FLINK-10136) Add REPEAT supported in Table API and SQL

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590453#comment-16590453 ] ASF GitHub Bot commented on FLINK-10136: yanghua commented on issue #6597: [FLINK-10136] [table]

[GitHub] yanghua commented on issue #6597: [FLINK-10136] [table] Add REPEAT supported in Table API and SQL

2018-08-23 Thread GitBox
yanghua commented on issue #6597: [FLINK-10136] [table] Add REPEAT supported in Table API and SQL URL: https://github.com/apache/flink/pull/6597#issuecomment-415478057 cc @xccui This is an automated message from the Apache

[GitHub] StefanRRichter commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability

2018-08-23 Thread GitBox
StefanRRichter commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability URL: https://github.com/apache/flink/pull/6604#issuecomment-415476287 Modulo some test failures from NPEs.

[jira] [Commented] (FLINK-9061) add entropy to s3 path for better scalability

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590443#comment-16590443 ] ASF GitHub Bot commented on FLINK-9061: --- StefanRRichter commented on issue #6604: [FLINK-9061]

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590401#comment-16590401 ] ASF GitHub Bot commented on FLINK-10203: art4ul commented on issue #6608: [FLINK-10203]Support

[GitHub] art4ul commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread GitBox
art4ul commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608#issuecomment-415465746 @StephanEwen I try to explain you our case: the new Streaming FileSink ideally

[jira] [Commented] (FLINK-9559) The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590380#comment-16590380 ] ASF GitHub Bot commented on FLINK-9559: --- hequn8128 commented on issue #6519: [FLINK-9559] [table]

[GitHub] hequn8128 commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread GitBox
hequn8128 commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR URL: https://github.com/apache/flink/pull/6519#issuecomment-415459642 @pnowojski Hi, thanks for your review. Yes, support VARCHAR(N) can solve the

[jira] [Commented] (FLINK-9061) add entropy to s3 path for better scalability

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590366#comment-16590366 ] ASF GitHub Bot commented on FLINK-9061: --- StephanEwen commented on issue #6604: [FLINK-9061]

[GitHub] StephanEwen commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability

2018-08-23 Thread GitBox
StephanEwen commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability URL: https://github.com/apache/flink/pull/6604#issuecomment-415454197 Okay, updated the implementation. Moved the entropy injection code tho the FS implementation, which is

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590362#comment-16590362 ] ASF GitHub Bot commented on FLINK-10203: art4ul commented on issue #6608: [FLINK-10203]Support

[GitHub] art4ul commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread GitBox
art4ul commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608#issuecomment-415453555 @StephanEwen Yes it's critical because we need to write Parquet files .

[jira] [Updated] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artsem Semianenka updated FLINK-10203: -- Description: New StreamingFileSink ( introduced in 1.6 Flink version ) use

[jira] [Updated] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artsem Semianenka updated FLINK-10203: -- Description: New StreamingFileSink ( introduced in 1.6 Flink version ) use

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590352#comment-16590352 ] ASF GitHub Bot commented on FLINK-10203: StephanEwen commented on issue #6608:

[GitHub] StephanEwen commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread GitBox
StephanEwen commented on issue #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608#issuecomment-415451715 @art4ul Initially, we wanted to keep the new StreamingFileSink code simple and

[jira] [Commented] (FLINK-10198) Set Env object in DBOptions for RocksDB

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590340#comment-16590340 ] ASF GitHub Bot commented on FLINK-10198: StephanEwen commented on issue #6603:

[GitHub] StephanEwen commented on issue #6603: [FLINK-10198][state] Set Env object in DBOptions for RocksDB

2018-08-23 Thread GitBox
StephanEwen commented on issue #6603: [FLINK-10198][state] Set Env object in DBOptions for RocksDB URL: https://github.com/apache/flink/pull/6603#issuecomment-415448851 This has big implication on how users configure their memory. Previously, there was one buffer pool per state, now there

[jira] [Commented] (FLINK-9559) The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590334#comment-16590334 ] ASF GitHub Bot commented on FLINK-9559: --- pnowojski edited a comment on issue #6519: [FLINK-9559]

[GitHub] pnowojski edited a comment on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread GitBox
pnowojski edited a comment on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR URL: https://github.com/apache/flink/pull/6519#issuecomment-415443589 At least according to draft of 2008 SQL Standard (paragraph 9.3, section 3) iii)

[jira] [Commented] (FLINK-9559) The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590333#comment-16590333 ] ASF GitHub Bot commented on FLINK-9559: --- pnowojski commented on issue #6519: [FLINK-9559] [table]

[GitHub] pnowojski commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread GitBox
pnowojski commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR URL: https://github.com/apache/flink/pull/6519#issuecomment-415443589 At least according to draft of 2008 SQL Standard, this PR violates it (paragraph 9.3,

[jira] [Updated] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-10203: --- Labels: pull-request-available (was: ) > Support truncate method for old Hadoop versions

[jira] [Commented] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590284#comment-16590284 ] ASF GitHub Bot commented on FLINK-10203: art4ul opened a new pull request #6608:

[GitHub] art4ul opened a new pull request #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread GitBox
art4ul opened a new pull request #6608: [FLINK-10203]Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream URL: https://github.com/apache/flink/pull/6608 ## What is the purpose of the change New StreamingFileSink ( introduced in 1.6 Flink version )

[jira] [Commented] (FLINK-10050) Support 'allowedLateness' in CoGroupedStreams

2018-08-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590245#comment-16590245 ] Aljoscha Krettek commented on FLINK-10050: -- I think {{DataStream.join()}} and

[jira] [Commented] (FLINK-9559) The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590230#comment-16590230 ] ASF GitHub Bot commented on FLINK-9559: --- pnowojski commented on issue #6519: [FLINK-9559] [table]

[GitHub] pnowojski commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR

2018-08-23 Thread GitBox
pnowojski commented on issue #6519: [FLINK-9559] [table] The type of a union of CHAR columns of different lengths should be VARCHAR URL: https://github.com/apache/flink/pull/6519#issuecomment-415420332 What does the SQL standard have to say about this? MySQL is not the most standard

[jira] [Updated] (FLINK-10203) Support truncate method for old Hadoop versions in HadoopRecoverableFsDataOutputStream

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artsem Semianenka updated FLINK-10203: -- Summary: Support truncate method for old Hadoop versions in

[jira] [Updated] (FLINK-10203) HadoopRecoverableFsDataOutputStream does not support Hadoop 2.6

2018-08-23 Thread Artsem Semianenka (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Artsem Semianenka updated FLINK-10203: -- Summary: HadoopRecoverableFsDataOutputStream does not support Hadoop 2.6 (was:

[jira] [Created] (FLINK-10203) HadoopRecoverableWriter does not support Hadoop

2018-08-23 Thread Artsem Semianenka (JIRA)
Artsem Semianenka created FLINK-10203: - Summary: HadoopRecoverableWriter does not support Hadoop Key: FLINK-10203 URL: https://issues.apache.org/jira/browse/FLINK-10203 Project: Flink

[GitHub] FredTing commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer

2018-08-23 Thread GitBox
FredTing commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer URL: https://github.com/apache/flink/pull/6105#discussion_r212309444 ## File path:

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590215#comment-16590215 ] ASF GitHub Bot commented on FLINK-8500: --- FredTing commented on a change in pull request #6105:

[jira] [Commented] (FLINK-10198) Set Env object in DBOptions for RocksDB

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590108#comment-16590108 ] ASF GitHub Bot commented on FLINK-10198: NicoK commented on issue #6603: [FLINK-10198][state]

[GitHub] NicoK commented on issue #6603: [FLINK-10198][state] Set Env object in DBOptions for RocksDB

2018-08-23 Thread GitBox
NicoK commented on issue #6603: [FLINK-10198][state] Set Env object in DBOptions for RocksDB URL: https://github.com/apache/flink/pull/6603#issuecomment-415383492 In general, I like this idea, because before we would potentially end up with a log of additional RocksDB threads that might

[jira] [Commented] (FLINK-9391) Support UNNEST in Table API

2018-08-23 Thread Mikhail (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590055#comment-16590055 ] Mikhail commented on FLINK-9391: Hello [~twalthr], As I know, [~ipatina] is on another project. So I'd

[GitHub] zentol closed pull request #6607: [docs] Remove the redundant tag

2018-08-23 Thread GitBox
zentol closed pull request #6607: [docs] Remove the redundant tag URL: https://github.com/apache/flink/pull/6607 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign pull request

[jira] [Commented] (FLINK-9713) Support versioned joins in planning phase

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590035#comment-16590035 ] ASF GitHub Bot commented on FLINK-9713: --- pnowojski commented on a change in pull request #6299:

[GitHub] pnowojski commented on a change in pull request #6299: [FLINK-9713][table][sql] Support processing time versioned joins

2018-08-23 Thread GitBox
pnowojski commented on a change in pull request #6299: [FLINK-9713][table][sql] Support processing time versioned joins URL: https://github.com/apache/flink/pull/6299#discussion_r212257550 ## File path:

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590017#comment-16590017 ] ASF GitHub Bot commented on FLINK-8500: --- tzulitai commented on a change in pull request #6105:

[GitHub] tzulitai commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer

2018-08-23 Thread GitBox
tzulitai commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer URL: https://github.com/apache/flink/pull/6105#discussion_r212252904 ## File path:

[jira] [Commented] (FLINK-9061) add entropy to s3 path for better scalability

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590003#comment-16590003 ] ASF GitHub Bot commented on FLINK-9061: --- StephanEwen commented on issue #6604: [FLINK-9061]

[GitHub] StephanEwen commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability

2018-08-23 Thread GitBox
StephanEwen commented on issue #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability URL: https://github.com/apache/flink/pull/6604#issuecomment-415362329 Good points - these were actually problems in the original PR as well... Will try to come up with a

[GitHub] kisimple opened a new pull request #6607: [docs] Remove the redundant tag

2018-08-23 Thread GitBox
kisimple opened a new pull request #6607: [docs] Remove the redundant tag URL: https://github.com/apache/flink/pull/6607 Remove the redundant `` tag in https://ci.apache.org/projects/flink/flink-docs-stable/monitoring/metrics.html#io

[jira] [Commented] (FLINK-8500) Get the timestamp of the Kafka message from kafka consumer(Kafka010Fetcher)

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589904#comment-16589904 ] ASF GitHub Bot commented on FLINK-8500: --- aljoscha commented on a change in pull request #6105:

[GitHub] aljoscha commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer

2018-08-23 Thread GitBox
aljoscha commented on a change in pull request #6105: [FLINK-8500] Get the timestamp of the Kafka message from kafka consumer URL: https://github.com/apache/flink/pull/6105#discussion_r21385 ## File path:

[jira] [Updated] (FLINK-10202) Enable configuration for state.checkpoint.dir in StreamExecutionEnvironment

2018-08-23 Thread buptljy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] buptljy updated FLINK-10202: Description: Usually we can set state.checkpoint.dir in flink-conf.yaml, but sometimes we run a flink

[jira] [Updated] (FLINK-10202) Enable configuration for state.checkpoint.dir in StreamExecutionEnvironment

2018-08-23 Thread buptljy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] buptljy updated FLINK-10202: Summary: Enable configuration for state.checkpoint.dir in StreamExecutionEnvironment (was: Enable

[jira] [Updated] (FLINK-10202) Enable configuration for state.checkpoint.dir with environment

2018-08-23 Thread buptljy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] buptljy updated FLINK-10202: Description: Usually we can set state.checkpoint.dir in flink-conf.yaml, but sometimes we run a flink

[jira] [Updated] (FLINK-10202) Enable configuration for state.checkpoint.dir in environment

2018-08-23 Thread buptljy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] buptljy updated FLINK-10202: Summary: Enable configuration for state.checkpoint.dir in environment (was: Enable configuration for

[jira] [Created] (FLINK-10202) Enable configuration for state.checkpoint.dir with environment

2018-08-23 Thread buptljy (JIRA)
buptljy created FLINK-10202: --- Summary: Enable configuration for state.checkpoint.dir with environment Key: FLINK-10202 URL: https://issues.apache.org/jira/browse/FLINK-10202 Project: Flink Issue

[jira] [Commented] (FLINK-9693) Possible memory leak in jobmanager retaining archived checkpoints

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589897#comment-16589897 ] ASF GitHub Bot commented on FLINK-9693: --- TisonKun commented on issue #6251: [FLINK-9693] Set

[GitHub] TisonKun commented on issue #6251: [FLINK-9693] Set Execution#taskRestore to null after deployment

2018-08-23 Thread GitBox
TisonKun commented on issue #6251: [FLINK-9693] Set Execution#taskRestore to null after deployment URL: https://github.com/apache/flink/pull/6251#issuecomment-415333090 Thanks till, this saves my weekend :-) This is an

[jira] [Commented] (FLINK-7551) Add VERSION to the REST urls.

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589893#comment-16589893 ] ASF GitHub Bot commented on FLINK-7551: --- zentol commented on a change in pull request #6602:

[GitHub] zentol commented on a change in pull request #6602: [FLINK-7551][rest] Add versioning to REST API

2018-08-23 Thread GitBox
zentol commented on a change in pull request #6602: [FLINK-7551][rest] Add versioning to REST API URL: https://github.com/apache/flink/pull/6602#discussion_r212220053 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/rest/RestServerEndpoint.java ## @@

[jira] [Commented] (FLINK-9061) add entropy to s3 path for better scalability

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589873#comment-16589873 ] ASF GitHub Bot commented on FLINK-9061: --- StefanRRichter commented on a change in pull request

[jira] [Commented] (FLINK-10172) Inconsistentcy in ExpressionParser and ExpressionDsl for order by asc/desc

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-10172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589876#comment-16589876 ] ASF GitHub Bot commented on FLINK-10172: twalthr commented on issue #6585:

[GitHub] twalthr commented on issue #6585: [FLINK-10172][table]re-adding asc & desc suffix expression to expressionParser

2018-08-23 Thread GitBox
twalthr commented on issue #6585: [FLINK-10172][table]re-adding asc & desc suffix expression to expressionParser URL: https://github.com/apache/flink/pull/6585#issuecomment-415329206 Thank you @walterddr. I would open an issue for this minor thing to at least track it.

[GitHub] StefanRRichter commented on a change in pull request #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability

2018-08-23 Thread GitBox
StefanRRichter commented on a change in pull request #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability URL: https://github.com/apache/flink/pull/6604#discussion_r212216578 ## File path:

[jira] [Updated] (FLINK-9928) Add LOG2 function for table/sql API

2018-08-23 Thread vinoyang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vinoyang updated FLINK-9928: Issue Type: Sub-task (was: New Feature) Parent: FLINK-6810 > Add LOG2 function for table/sql API

[jira] [Commented] (FLINK-8868) Support Table Function as Table for Stream Sql

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589862#comment-16589862 ] ASF GitHub Bot commented on FLINK-8868: --- pnowojski commented on a change in pull request #6574:

[GitHub] pnowojski commented on a change in pull request #6574: [FLINK-8868] [table] Support Table Function as Table Source for Stream Sql

2018-08-23 Thread GitBox
pnowojski commented on a change in pull request #6574: [FLINK-8868] [table] Support Table Function as Table Source for Stream Sql URL: https://github.com/apache/flink/pull/6574#discussion_r212213682 ## File path:

[jira] [Commented] (FLINK-9061) add entropy to s3 path for better scalability

2018-08-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589854#comment-16589854 ] ASF GitHub Bot commented on FLINK-9061: --- StefanRRichter commented on a change in pull request

[GitHub] StefanRRichter commented on a change in pull request #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability

2018-08-23 Thread GitBox
StefanRRichter commented on a change in pull request #6604: [FLINK-9061] Optionally add entropy to checkpoint paths better S3 scalability URL: https://github.com/apache/flink/pull/6604#discussion_r212211288 ## File path:

[GitHub] yanghua commented on issue #6567: [FLINK-10074] Allowable number of checkpoint failures

2018-08-23 Thread GitBox
yanghua commented on issue #6567: [FLINK-10074] Allowable number of checkpoint failures URL: https://github.com/apache/flink/pull/6567#issuecomment-415303507 @tillrohrmann When you have free time, please review this PR. thanks.

  1   2   >