[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-06-30 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @tzulitai ,ok,Thanks a lot! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-06-20 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @tzulitai ,When I have fixed the problem, I want to write a IT case. But, in the Yarn IT case: 1、 It uses the yarn mini cluster, which is for testing.I do not know whether it is using

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-06-08 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen ,@tzulitai , please review the code ,if it is ok. Please help me to merge the PR. Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-26 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @EronWright ,thank you very much . yes you are right. But about solutin 1. We need only add the HDFS delegation token in yarn container context , yarn client not need refresh the token, yarn

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-25 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @tzulitai , you are right. There are two problems in yarn cluster mode: 1、when we use the keytab,we do not set the HDFS delegation token to yarn container context, but yarn need

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-19 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , we resolve this problem. We only add the HDFS delegation token in JM、TM yarn container context. And when we configuration the keytab, the JM、TM use the keytab

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-08 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , yes, when configuration keytab, the hadoop code automatically renew delegation tokens .But when token and keytab are available, the hadoop use the token first, but the keytab

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-07 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 After resolving this problem, we find another problem, when we configure the keytab 、principal, and add the HDFS delegation token, the JM 、TM also use this token, but not keytab when

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-04 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , I can run the yarn IT case! Thanks very much. But, in the Yarn IT case: 1、 It uses the yarn mini cluster, which is for testing.I do not know whether it is using HDFS

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-03 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , you mean the reason of this problem is the version of hadoop? The version of 2.7.2 is ok? Thanks! --- If your project is set up for it, you can reply to this email and have your

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-05-03 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , when I run the YARNHighAvailabilityITCase, occur the following error. I set the flie /etc/hosts as following: 9.96.101.32 9-96-101-32 127.0.0.1 localhost

[GitHub] flink issue #3776: [FLINK-6376]when deploy flink cluster on the yarn, it is ...

2017-04-28 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3776 @StephanEwen , yes, i agree with you! I will see how to add the Yarn IT case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[GitHub] flink pull request #3776: [FLINK-6376]when deploy flink cluster on the yarn,...

2017-04-25 Thread Rucongzhang
GitHub user Rucongzhang opened a pull request: https://github.com/apache/flink/pull/3776 [FLINK-6376]when deploy flink cluster on the yarn, it is lack of hdfs delegation. Thanks for contributing to Apache Flink. Before you open your pull request, please take the following check

[GitHub] flink issue #3600: [FLINK-6117]Make setting of 'zookeeper.sasl.disable' work...

2017-03-28 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3600 @StephanEwen , yes, now if you want to use kerberos , you need additionally to set zookeeper.sasl.disable to false. And I agree with you, the default value of zookeeper.sasl.disable can set

[GitHub] flink issue #3600: [FLINK-6117]Make setting of 'zookeeper.sasl.disable' work...

2017-03-27 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/3600 @zhengcanbin ,@StephanEwen ,@shijinkui. After push this issue, we must illustrate in flink configuration. If we want to use kerberos authentication with ZK server, we must set

[GitHub] flink issue #2425: FLINK-3930 Added shared secret based authorization for Fl...

2017-03-12 Thread Rucongzhang
Github user Rucongzhang commented on the issue: https://github.com/apache/flink/pull/2425 @vijikarthi ,when you will push this issue to the master? I can help you, if you need any help. Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink pull request: [flink-2532]fix the function name and the vari...

2015-08-17 Thread Rucongzhang
Github user Rucongzhang commented on the pull request: https://github.com/apache/flink/pull/1025#issuecomment-131697201 @mbalassi , OK, I will modify it and name it splitsList.Thank you. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] flink pull request: [FLINK-2531]combining the if branch to improve...

2015-08-17 Thread Rucongzhang
Github user Rucongzhang closed the pull request at: https://github.com/apache/flink/pull/1023 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] flink pull request: [flink-2532]fix the function name and the vari...

2015-08-16 Thread Rucongzhang
GitHub user Rucongzhang opened a pull request: https://github.com/apache/flink/pull/1025 [flink-2532]fix the function name and the variable name are the same In class StreamWindow, in function split, there is a list variable also called split. Two split are confusing

[GitHub] flink pull request: [FLINK-2478]fix the array may have out of boun...

2015-08-16 Thread Rucongzhang
Github user Rucongzhang commented on the pull request: https://github.com/apache/flink/pull/1021#issuecomment-131493503 Yes,stephan it should throw an exception.I will modify .Thank you very much! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] flink pull request: [FLINK-2531]combining the if branch to improve...

2015-08-16 Thread Rucongzhang
GitHub user Rucongzhang opened a pull request: https://github.com/apache/flink/pull/1023 [FLINK-2531]combining the if branch to improve the judge logic In function receiveAcknowledgeMessage, the if branch checkpoint.isFullyAcknowledged() can combine with the if branch

[GitHub] flink pull request: [FLINK-2531]combining the if branch to improve...

2015-08-16 Thread Rucongzhang
Github user Rucongzhang commented on the pull request: https://github.com/apache/flink/pull/1023#issuecomment-131504171 @chiwanpark , you are right. isFullyAcknowledged() must be called after calling function acknowledgeTask. --- If your project is set up for it, you can reply

[GitHub] flink pull request: [FLINK-2478]fix the array may have out of boun...

2015-08-15 Thread Rucongzhang
GitHub user Rucongzhang opened a pull request: https://github.com/apache/flink/pull/1021 [FLINK-2478]fix the array may have out of bounds In getNestedDelta function, the array length of oldDatapoint and the array length of newDatapoint are notbeen ensured same.So add