[jira] [Commented] (FLINK-7936) Lack of synchronization w.r.t. taskManagers in MetricStore#add()

2017-10-30 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226280#comment-16226280 ] Bowen Li commented on FLINK-7936: - Hi [~pnowojski], does this still hold after your refactor of

[jira] [Commented] (FLINK-7153) Eager Scheduling can't allocate source for ExecutionGraph correctly

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226215#comment-16226215 ] ASF GitHub Bot commented on FLINK-7153: --- Github user summerleafs commented on a diff in the pull

[GitHub] flink pull request #4916: [FLINK-7153] Re-introduce preferred locations for ...

2017-10-30 Thread summerleafs
Github user summerleafs commented on a diff in the pull request: https://github.com/apache/flink/pull/4916#discussion_r147891494 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/Execution.java --- @@ -1065,6 +1177,46 @@ private void

[jira] [Commented] (FLINK-7153) Eager Scheduling can't allocate source for ExecutionGraph correctly

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226198#comment-16226198 ] ASF GitHub Bot commented on FLINK-7153: --- Github user summerleafs commented on a diff in the pull

[GitHub] flink pull request #4916: [FLINK-7153] Re-introduce preferred locations for ...

2017-10-30 Thread summerleafs
Github user summerleafs commented on a diff in the pull request: https://github.com/apache/flink/pull/4916#discussion_r147889602 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/ExecutionGraph.java --- @@ -878,113 +880,70 @@ private void

[jira] [Updated] (FLINK-7588) Document RocksDB tuning for spinning disks

2017-10-30 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-7588: -- Description: In docs/ops/state/large_state_tuning.md , it was mentioned that: bq. the default configuration is

[jira] [Updated] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

2017-10-30 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-7873: -- Description: Why i introduce this: Current recover strategy will always read checkpoint data from

[jira] [Updated] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

2017-10-30 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou updated FLINK-7873: -- Summary: Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

[jira] [Commented] (FLINK-7947) Let ParameterTool return a dedicated GlobalJobParameters object

2017-10-30 Thread Hai Zhou UTC+8 (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226117#comment-16226117 ] Hai Zhou UTC+8 commented on FLINK-7947: --- +1 > Let ParameterTool return a dedicated

[jira] [Assigned] (FLINK-7947) Let ParameterTool return a dedicated GlobalJobParameters object

2017-10-30 Thread Bowen Li (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bowen Li reassigned FLINK-7947: --- Assignee: Bowen Li > Let ParameterTool return a dedicated GlobalJobParameters object >

[jira] [Commented] (FLINK-7940) Add timeout for futures

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225946#comment-16225946 ] ASF GitHub Bot commented on FLINK-7940: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #4918: [FLINK-7940] Add FutureUtils.orTimeout

2017-10-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4918 ---

[jira] [Closed] (FLINK-7940) Add timeout for futures

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-7940. Resolution: Done Fix Version/s: 1.4.0 Added via c568aed1ecb7675a2776e15f120e45ad576eeb37 >

[jira] [Resolved] (FLINK-6495) Migrate Akka configuration options

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-6495. -- Resolution: Fixed Fixed via ae50c30ac3a7ce62df62120eda85b273a6aea7f7 > Migrate Akka

[jira] [Commented] (FLINK-7739) Improve Kafka*ITCase tests stability

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225933#comment-16225933 ] ASF GitHub Bot commented on FLINK-7739: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-7739) Improve Kafka*ITCase tests stability

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225934#comment-16225934 ] ASF GitHub Bot commented on FLINK-7739: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-6495) Migrate Akka configuration options

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225932#comment-16225932 ] ASF GitHub Bot commented on FLINK-6495: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #4749: [FLINK-7739][tests] Properly shutdown resources in...

2017-10-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4749 ---

[GitHub] flink pull request #4774: [FLINK-6495] Fix Akka's default value for heartbea...

2017-10-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4774 ---

[jira] [Comment Edited] (FLINK-7739) Improve Kafka*ITCase tests stability

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225927#comment-16225927 ] Till Rohrmann edited comment on FLINK-7739 at 10/30/17 11:06 PM: - Fixed

[GitHub] flink pull request #4751: [FLINK-7739][kafka-tests] Throttle down data produ...

2017-10-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4751 ---

[jira] [Resolved] (FLINK-7739) Improve Kafka*ITCase tests stability

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-7739. -- Resolution: Fixed Fix Version/s: 1.4.0 Fixed via

[jira] [Commented] (FLINK-7951) YarnApplicationMaster does not load HDFSConfiguration

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225922#comment-16225922 ] ASF GitHub Bot commented on FLINK-7951: --- GitHub user tillrohrmann opened a pull request:

[GitHub] flink pull request #4926: [FLINK-7951] Load YarnConfiguration with default H...

2017-10-30 Thread tillrohrmann
GitHub user tillrohrmann opened a pull request: https://github.com/apache/flink/pull/4926 [FLINK-7951] Load YarnConfiguration with default Hadoop configuration ## What is the purpose of the change This PR loads the default Hadoop configuration via HadoopUtils.

[jira] [Created] (FLINK-7951) YarnApplicationMaster does not load HDFSConfiguration

2017-10-30 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7951: Summary: YarnApplicationMaster does not load HDFSConfiguration Key: FLINK-7951 URL: https://issues.apache.org/jira/browse/FLINK-7951 Project: Flink Issue

[jira] [Assigned] (FLINK-7951) YarnApplicationMaster does not load HDFSConfiguration

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann reassigned FLINK-7951: Assignee: Till Rohrmann > YarnApplicationMaster does not load HDFSConfiguration >

[jira] [Updated] (FLINK-7936) Lack of synchronization w.r.t. taskManagers in MetricStore#add()

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7936: -- Component/s: Metrics > Lack of synchronization w.r.t. taskManagers in MetricStore#add() >

[jira] [Updated] (FLINK-7777) Bump japicmp to 0.10.0

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-: -- Component/s: Build System > Bump japicmp to 0.10.0 > -- > >

[jira] [Updated] (FLINK-7871) SlotPool should release its unused slot to RM

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7871: -- Component/s: Distributed Coordination > SlotPool should release its unused slot to RM >

[jira] [Updated] (FLINK-7795) Utilize error-prone to discover common coding mistakes

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7795: -- Component/s: Build System > Utilize error-prone to discover common coding mistakes >

[jira] [Updated] (FLINK-7782) Flink CEP not recognizing pattern

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7782: -- Component/s: CEP > Flink CEP not recognizing pattern > - > >

[jira] [Updated] (FLINK-7913) Add support for Kafka default partitioner

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7913: -- Component/s: Kafka Connector > Add support for Kafka default partitioner >

[jira] [Updated] (FLINK-7935) Metrics with user supplied scope variables

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7935: -- Component/s: Metrics > Metrics with user supplied scope variables >

[jira] [Updated] (FLINK-7927) Different Netty Versions in dependencies of flink-runtime make it impossible to use 3rd party libraries using netty

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7927: -- Component/s: Build System > Different Netty Versions in dependencies of flink-runtime make it

[jira] [Updated] (FLINK-7877) Fix compilation against the Hadoop 3 beta1 release

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7877: -- Component/s: Build System > Fix compilation against the Hadoop 3 beta1 release >

[jira] [Updated] (FLINK-7787) Remove guava dependency in the cassandra connector

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7787: -- Component/s: Build System > Remove guava dependency in the cassandra connector >

[jira] [Updated] (FLINK-7881) flink can't deployed on yarn with ha

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7881: -- Component/s: YARN > flink can't deployed on yarn with ha >

[jira] [Updated] (FLINK-7934) Upgrade Calcite dependency to 1.15

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7934: -- Component/s: Table API & SQL > Upgrade Calcite dependency to 1.15 >

[jira] [Updated] (FLINK-7894) Improve metrics around fine-grained recovery and associated checkpointing behaviors

2017-10-30 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-7894: -- Component/s: Metrics > Improve metrics around fine-grained recovery and associated

[jira] [Commented] (FLINK-4228) YARN artifact upload does not work with S3AFileSystem

2017-10-30 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225408#comment-16225408 ] Nico Kruber commented on FLINK-4228: [~aljoscha]: I successfully reproduced the error with a current

[jira] [Commented] (FLINK-7950) flink-queryable-state-runtime not a dependency in flink-dist

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225364#comment-16225364 ] ASF GitHub Bot commented on FLINK-7950: --- GitHub user NicoK opened a pull request:

[GitHub] flink pull request #4925: [FLINK-7950][build] add flink-queryable-state-runt...

2017-10-30 Thread NicoK
GitHub user NicoK opened a pull request: https://github.com/apache/flink/pull/4925 [FLINK-7950][build] add flink-queryable-state-runtime as a dependency to flink-dist ## What is the purpose of the change Since #4906, `flink-queryable-state-runtime`'s jar file was put into

[jira] [Created] (FLINK-7950) flink-queryable-state-runtime not a dependency in flink-dist

2017-10-30 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-7950: -- Summary: flink-queryable-state-runtime not a dependency in flink-dist Key: FLINK-7950 URL: https://issues.apache.org/jira/browse/FLINK-7950 Project: Flink

[jira] [Updated] (FLINK-4228) YARN artifact upload does not work with S3AFileSystem

2017-10-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-4228: Description: The issue now is exclusive to running on YARN with s3a:// as your configured

[jira] [Commented] (FLINK-7838) Kafka011ProducerExactlyOnceITCase do not finish

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225241#comment-16225241 ] ASF GitHub Bot commented on FLINK-7838: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #4915: [FLINK-7838] Bunch of hotfixes and fix missing syn...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4915#discussion_r147754468 --- Diff: flink-connectors/flink-connector-kafka-0.11/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer011Test.java --- @@ -61,7

[jira] [Commented] (FLINK-7838) Kafka011ProducerExactlyOnceITCase do not finish

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225238#comment-16225238 ] ASF GitHub Bot commented on FLINK-7838: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #4915: [FLINK-7838] Bunch of hotfixes and fix missing syn...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4915#discussion_r147754127 --- Diff: flink-connectors/flink-connector-kafka-0.11/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/FlinkKafkaProducer.java --- @@ -226,13

[jira] [Commented] (FLINK-6495) Migrate Akka configuration options

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225173#comment-16225173 ] ASF GitHub Bot commented on FLINK-6495: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #4774: [FLINK-6495] Fix Akka's default value for heartbea...

2017-10-30 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/4774#discussion_r147743853 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/akka/AkkaUtils.scala --- @@ -257,6 +257,20 @@ object AkkaUtils {

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225160#comment-16225160 ] ASF GitHub Bot commented on FLINK-7784: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147741136 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunctionTest.java --- @@ -35,60 +42,101 @@

[jira] [Commented] (FLINK-7418) Replace all uses of jackson with flink-shaded-jackson

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225151#comment-16225151 ] ASF GitHub Bot commented on FLINK-7418: --- Github user aljoscha commented on the issue:

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225146#comment-16225146 ] ASF GitHub Bot commented on FLINK-7784: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink issue #4923: [FLINK-7418][build] Integrate flink-shaded-jackson2

2017-10-30 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/4923 Ok for me. ---

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147739898 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunction.java --- @@ -58,18 +61,37 @@

[jira] [Commented] (FLINK-7418) Replace all uses of jackson with flink-shaded-jackson

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225139#comment-16225139 ] ASF GitHub Bot commented on FLINK-7418: --- Github user zentol commented on the issue:

[GitHub] flink issue #4923: [FLINK-7418][build] Integrate flink-shaded-jackson2

2017-10-30 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/4923 It's more of an assumption tbh, i haven't tried it out. I've looked through the fenzo source code to search for APIs that expose jackson but couldn't find any. They annotate a number of POJOs but

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147736898 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunction.java --- @@ -58,18 +61,37 @@

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225119#comment-16225119 ] ASF GitHub Bot commented on FLINK-7784: --- Github user GJL commented on a diff in the pull request:

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225114#comment-16225114 ] ASF GitHub Bot commented on FLINK-7784: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147735664 --- Diff: flink-connectors/flink-connector-kafka-0.11/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer011Tests.java --- @@ -83,49

[jira] [Closed] (FLINK-6916) FLIP-19: Improved BLOB storage architecture

2017-10-30 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber closed FLINK-6916. -- Resolution: Done Fix Version/s: 1.4.0 > FLIP-19: Improved BLOB storage architecture >

[jira] [Commented] (FLINK-7949) AsyncWaitOperator is not restarting when queue is full

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225085#comment-16225085 ] ASF GitHub Bot commented on FLINK-7949: --- GitHub user bartektartanus opened a pull request:

[GitHub] flink pull request #4924: [FLINK-7949] AsyncWaitOperator is not restarting w...

2017-10-30 Thread bartektartanus
GitHub user bartektartanus opened a pull request: https://github.com/apache/flink/pull/4924 [FLINK-7949] AsyncWaitOperator is not restarting when queue is full Change: Emitter thread is started BEFORE filling up the queue of recovered elements Issue description: During

[jira] [Commented] (FLINK-7418) Replace all uses of jackson with flink-shaded-jackson

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225082#comment-16225082 ] ASF GitHub Bot commented on FLINK-7418: --- Github user aljoscha commented on the issue:

[GitHub] flink issue #4923: [FLINK-7418][build] Integrate flink-shaded-jackson2

2017-10-30 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/4923 Changes look good. :+1: How do we know that our Mesos support still works when Jackson is shaded there? ---

[jira] [Commented] (FLINK-7400) off-heap limits set to conservatively in cluster environments

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225080#comment-16225080 ] ASF GitHub Bot commented on FLINK-7400: --- Github user NicoK commented on the issue:

[GitHub] flink issue #4506: [FLINK-7400][cluster] fix off-heap limits set to conserva...

2017-10-30 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/4506 I just tested this on a real yarn cluster with `./bin/flink run -m yarn-cluster -yn 1 -ys 2 -yjm 768 -ytm 1024 -yD taskmanager.memory.off-heap=true -yD taskmanager.memory.size=260 -yD

[jira] [Created] (FLINK-7949) AsyncWaitOperator is not restarting when queue is full

2017-10-30 Thread JIRA
Bartłomiej Tartanus created FLINK-7949: -- Summary: AsyncWaitOperator is not restarting when queue is full Key: FLINK-7949 URL: https://issues.apache.org/jira/browse/FLINK-7949 Project: Flink

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225068#comment-16225068 ] ASF GitHub Bot commented on FLINK-7784: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147727170 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunction.java --- @@ -58,18 +61,37 @@

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225064#comment-16225064 ] ASF GitHub Bot commented on FLINK-7784: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147654876 --- Diff: flink-connectors/flink-connector-kafka-0.11/src/test/java/org/apache/flink/streaming/connectors/kafka/FlinkKafkaProducer011Tests.java --- @@

[jira] [Commented] (FLINK-7418) Replace all uses of jackson with flink-shaded-jackson

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225054#comment-16225054 ] ASF GitHub Bot commented on FLINK-7418: --- GitHub user zentol opened a pull request:

[GitHub] flink pull request #4923: [FLINK-7418][build] Integrate flink-shaded-jackson...

2017-10-30 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/4923 [FLINK-7418][build] Integrate flink-shaded-jackson2 ## What is the purpose of the change This PR replaces all usages of com.fasterxml.jackson with flink-shaded-jackson. One change

[jira] [Commented] (FLINK-7947) Let ParameterTool return a dedicated GlobalJobParameters object

2017-10-30 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225051#comment-16225051 ] Aljoscha Krettek commented on FLINK-7947: - +1 I think most code around {{ParemeterTool}} would

[GitHub] flink pull request #4922: [hotfix][metrics] Cleanup ScopeFormats

2017-10-30 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/4922#discussion_r147719227 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/metrics/scope/ScopeFormats.java --- @@ -38,30 +36,9 @@ //

[GitHub] flink issue #4794: [build][minor] Add missing licenses

2017-10-30 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/4794 Adding the license to `browserconfig.xml` looks fine, but why change the user configurations `masters`, `slaves`, and `zoo.cfg`? Are these even copyrightable? ---

[jira] [Commented] (FLINK-7784) Don't fail TwoPhaseCommitSinkFunction when failing to commit

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225030#comment-16225030 ] ASF GitHub Bot commented on FLINK-7784: --- Github user GJL commented on a diff in the pull request:

[GitHub] flink pull request #4910: [FLINK-7784] [kafka-producer] Don't fail TwoPhaseC...

2017-10-30 Thread GJL
Github user GJL commented on a diff in the pull request: https://github.com/apache/flink/pull/4910#discussion_r147717560 --- Diff: flink-streaming-java/src/test/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunctionTest.java --- @@ -35,60 +42,101 @@

[GitHub] flink pull request #4922: [hotfix][metrics] Cleanup ScopeFormats

2017-10-30 Thread zentol
GitHub user zentol opened a pull request: https://github.com/apache/flink/pull/4922 [hotfix][metrics] Cleanup ScopeFormats ## What is the purpose of the change This PR cleans up a few things related to `ScopeFormats`. ## Brief change log * remove unused

[jira] [Assigned] (FLINK-7732) Test instability in Kafka end-to-end test (invalid Kafka offset)

2017-10-30 Thread Piotr Nowojski (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-7732: - Assignee: Piotr Nowojski > Test instability in Kafka end-to-end test (invalid Kafka

[jira] [Commented] (FLINK-7902) TwoPhaseCommitSinkFunctions should use custom TypeSerializer

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225008#comment-16225008 ] ASF GitHub Bot commented on FLINK-7902: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #4919: [FLINK-7902] Use TypeSerializer in TwoPhaseCommitS...

2017-10-30 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/4919#discussion_r147711564 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunction.java --- @@ -361,5 +376,247 @@

[jira] [Updated] (FLINK-7948) YarnApplicationMaster should also load hdfs-site.xml

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-7948: - Summary: YarnApplicationMaster should also load hdfs-site.xml (was: YarnApplicationMaster should

[jira] [Commented] (FLINK-7902) TwoPhaseCommitSinkFunctions should use custom TypeSerializer

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224984#comment-16224984 ] ASF GitHub Bot commented on FLINK-7902: --- Github user kl0u commented on a diff in the pull request:

[GitHub] flink pull request #4919: [FLINK-7902] Use TypeSerializer in TwoPhaseCommitS...

2017-10-30 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/4919#discussion_r147704985 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/TwoPhaseCommitSinkFunction.java --- @@ -361,5 +376,247 @@ public

[jira] [Created] (FLINK-7948) YarnApplicationMaster should also load the hdfs-site.xml

2017-10-30 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7948: Summary: YarnApplicationMaster should also load the hdfs-site.xml Key: FLINK-7948 URL: https://issues.apache.org/jira/browse/FLINK-7948 Project: Flink Issue

[jira] [Commented] (FLINK-7765) Enable dependency convergence

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224978#comment-16224978 ] ASF GitHub Bot commented on FLINK-7765: --- Github user pnowojski commented on the issue:

[GitHub] flink issue #4777: [FLINK-7765] Enable dependency convergence

2017-10-30 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/4777 I'm not sure if you can easily disable convergence in child pom. I think that shading happens after resolving dependency versions. So first you would need to fix dependency convergence for

[jira] [Closed] (FLINK-7696) Add projection push-down support for TableSources with time attributes

2017-10-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-7696. Resolution: Implemented Fix Version/s: 1.4.0 Implemented for 1.4.0 with

[jira] [Closed] (FLINK-6870) Combined batch and stream TableSource can not produce same time attributes

2017-10-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-6870. Resolution: Fixed Fix Version/s: 1.4.0 Fixed for 1.4.0 with

[jira] [Closed] (FLINK-7179) ProjectableTableSource interface doesn't compatible with BoundedOutOfOrdernessTimestampExtractor

2017-10-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-7179. Resolution: Fixed Fix Version/s: 1.4.0 Fixed for 1.4.0 with

[jira] [Closed] (FLINK-7548) Support watermark generation for TableSource

2017-10-30 Thread Fabian Hueske (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Hueske closed FLINK-7548. Resolution: Implemented Implemented for 1.4.0 with 9a2ba6e058e907aef65e0af8731ca5ec8733712e >

[jira] [Updated] (FLINK-7947) Let ParameterTool return a dedicated GlobalJobParameters object

2017-10-30 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-7947: - Description: The {{ParameterTool}} directly implements the {{GlobalJobParameters}} interface.

[jira] [Created] (FLINK-7947) Let ParameterTool return a dedicated GlobalJobParameters object

2017-10-30 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-7947: Summary: Let ParameterTool return a dedicated GlobalJobParameters object Key: FLINK-7947 URL: https://issues.apache.org/jira/browse/FLINK-7947 Project: Flink

[GitHub] flink pull request #4894: [FLINK-7548] [table] Improve rowtime support of Ta...

2017-10-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/4894 ---

[jira] [Commented] (FLINK-7548) Support watermark generation for TableSource

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224913#comment-16224913 ] ASF GitHub Bot commented on FLINK-7548: --- Github user asfgit closed the pull request at:

[jira] [Commented] (FLINK-7943) OptionalDataException when launching Flink jobs concurrently

2017-10-30 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16224909#comment-16224909 ] ASF GitHub Bot commented on FLINK-7943: --- GitHub user tillrohrmann opened a pull request:

  1   2   3   4   >