答复: [DISCUSS] Development of SQL OVER / Table API Row Windows for streaming tables

2017-02-05 Thread shijinkui
hi,Fabian, sunjincheng Today is the first workday of 2017 in China. When we come back, I found the SQL issues had been assigned between New Year... Yuhong Hong is interest in FLINK-5657. She had implemented it before. Can we reconsider to assign FLINK-5657 to her? Thanks Jinkui Shi [1]

[discuss] merge module flink-yarn and flink-yarn-test

2016-09-21 Thread shijinkui
Hi, All There too much module in the root. There are no necessary to separate the test code from sub-module. I never see such design: two modules, one is main code, the other is test code. Is there some special reason? >From Jinkui Shi

答复: [discuss] merge module flink-yarn and flink-yarn-test

2016-09-21 Thread shijinkui
there was a reason to have different modules, which had again something to do with the Maven Shade Plugin Dependencies and shading really seem the trickiest thing in bigger Java/Scala projects ;-) On Wed, Sep 21, 2016 at 11:04 AM, shijinkui <shijin...@huawei.com> wrote: > Hi, All > > There

答复: 答复: [DISCUSS] add netty tcp/restful pushed source support

2016-09-27 Thread shijinkui
@flink.apache.org 主题: Re: 答复: [DISCUSS] add netty tcp/restful pushed source support Apache Bahir's website only suggests support for additional frameworks, but there is a Flink repository at https://github.com/apache/bahir-flink On Tue, Sep 27, 2016 at 8:38 AM, shijinkui <shijin...@huawei.

答复: [DISCUSS] add netty tcp/restful pushed source support

2016-09-27 Thread shijinkui
Bahir as a project dedicated to streaming connectors. Would that be a good target for the connector? - What are your thoughts on fault tolerance for that connector? On Mon, Sep 26, 2016 at 3:01 PM, shijinkui <shijin...@huawei.com> wrote: > Hi, all > > 1.In order to sup

scala api createLocalEnvironment() function add default Configuration parameter

2016-09-27 Thread shijinkui
Hi,all scala program can't direct use createLocalEnvironment with custom Configure object. such as I want to start web server in local mode with Flink UI, I will do such as: ``` // set up execution environment val conf = new Configuration conf.setBoolean(ConfigConstants.LOCAL_START_WEBSERVER,

[DISCUSS] add netty tcp/restful pushed source support

2016-09-26 Thread shijinkui
Hi, all 1.In order to support end-to-end pushed source, I create FLINK-4630. I want to know whether is this idea worth? --- When source stream get start, listen a provided tcp port, receive stream data from user data

答复: 答复: [discuss] merge module flink-yarn and flink-yarn-test

2016-09-26 Thread shijinkui
Constantly accusing the community of creating bad structures before > even trying to understand the reasoning behind that does not come > across as very friendly. Constantly accusing the community of sloppy > work just because your laptop settings are incompatible with the > default conf

[Discuss] State Backend use external HBase storage

2016-11-15 Thread shijinkui
Hi, All At present flink have three state backend: memory, file system, rocksdb. MemoryStateBackend will tansform the snapshot to jobManager, 5MB limited default. Even setting it bigger, that not suitable for very big state storage. HDFS can meet the reliability guarantee, but It's slow. File

答复: [DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate)

2017-01-10 Thread shijinkui
Do we have a probable time of 1.2 release? This month or Next month? -邮件原件- 发件人: Robert Metzger [mailto:rmetz...@apache.org] 发送时间: 2017年1月3日 20:44 收件人: dev@flink.apache.org 抄送: u...@flink.apache.org 主题: [DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate) Hi, First

Re: Java library for Flink-Kudu integration

2017-03-28 Thread shijinkui
Hi, Fabian Do we have plan to replace Flink connectors with bahir-flink[1]? [1] https://github.com/apache/Bahir-flink 在 2017/3/28 上午12:15, "Fabian Hueske" 写入: >Hi Ruben, > >thanks for sharing this! >A Flink Kudu connector is a great contribution and Bahir seems to be the

[DISCUSS] Flink dist directory management

2017-03-25 Thread shijinkui
Hi, all The Flink distribution’s directory have no very clear responsibility about what type of files should be in which directory. The "bin","conf","lib" directories are clear for their responsibility. But the “opt" directories are mixed with library jars and example jars. I think we can

Re: [DISCUSS] Flink dist directory management

2017-03-27 Thread shijinkui
mples >> and belly-examples into "examples/“ to keep “opt” clean. >> >> Best, >> Jark Wu >> >> > 在 2017年3月25日,下午3:46,shijinkui <shijin...@huawei.com> 写道: >> > >> > Hi, all >> > >> > The Flink distributionĄ¯s directo

Re: Flink as a Service (FaaS)

2017-03-14 Thread shijinkui
Hi, Chen Qin We also met your end-to-end use case. A RPC Source and Sink such as netty source sink can fit such requirements. I’ve submit a natty module in bahir-flink project which only a demo. If use connector source instead of Kafka, how do we make the data persistent? One choice is

[jira] [Created] (FLINK-5705) webmonitor's request/response use UTF-8 explicitly

2017-02-03 Thread shijinkui (JIRA)
shijinkui created FLINK-5705: Summary: webmonitor's request/response use UTF-8 explicitly Key: FLINK-5705 URL: https://issues.apache.org/jira/browse/FLINK-5705 Project: Flink Issue Type

[jira] [Created] (FLINK-5640) configure the explicit Unit Test file suffix

2017-01-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5640: Summary: configure the explicit Unit Test file suffix Key: FLINK-5640 URL: https://issues.apache.org/jira/browse/FLINK-5640 Project: Flink Issue Type: Test

[jira] [Created] (FLINK-5650) flink-python unit test costs more than half hour

2017-01-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5650: Summary: flink-python unit test costs more than half hour Key: FLINK-5650 URL: https://issues.apache.org/jira/browse/FLINK-5650 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5860) Replace all the file creating from java.io.tmpdir with TemporaryFolder

2017-02-20 Thread shijinkui (JIRA)
shijinkui created FLINK-5860: Summary: Replace all the file creating from java.io.tmpdir with TemporaryFolder Key: FLINK-5860 URL: https://issues.apache.org/jira/browse/FLINK-5860 Project: Flink

[jira] [Created] (FLINK-5839) Flink Security in Huawei's use case

2017-02-17 Thread shijinkui (JIRA)
shijinkui created FLINK-5839: Summary: Flink Security in Huawei's use case Key: FLINK-5839 URL: https://issues.apache.org/jira/browse/FLINK-5839 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5806) TaskExecutionState toString format have wrong key

2017-02-15 Thread shijinkui (JIRA)
shijinkui created FLINK-5806: Summary: TaskExecutionState toString format have wrong key Key: FLINK-5806 URL: https://issues.apache.org/jira/browse/FLINK-5806 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5754) released tag missing .gitigonore .travis.yml .gitattributes

2017-02-09 Thread shijinkui (JIRA)
shijinkui created FLINK-5754: Summary: released tag missing .gitigonore .travis.yml .gitattributes Key: FLINK-5754 URL: https://issues.apache.org/jira/browse/FLINK-5754 Project: Flink Issue

[jira] [Created] (FLINK-5543) customCommandLine tips in CliFrontend

2017-01-17 Thread shijinkui (JIRA)
shijinkui created FLINK-5543: Summary: customCommandLine tips in CliFrontend Key: FLINK-5543 URL: https://issues.apache.org/jira/browse/FLINK-5543 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5519) scala-maven-plugin version all change to 3.2.2

2017-01-16 Thread shijinkui (JIRA)
shijinkui created FLINK-5519: Summary: scala-maven-plugin version all change to 3.2.2 Key: FLINK-5519 URL: https://issues.apache.org/jira/browse/FLINK-5519 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4560) enforcer java version as 1.7

2016-09-01 Thread shijinkui (JIRA)
shijinkui created FLINK-4560: Summary: enforcer java version as 1.7 Key: FLINK-4560 URL: https://issues.apache.org/jira/browse/FLINK-4560 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4561) replace all the scala version as a property

2016-09-01 Thread shijinkui (JIRA)
shijinkui created FLINK-4561: Summary: replace all the scala version as a property Key: FLINK-4561 URL: https://issues.apache.org/jira/browse/FLINK-4561 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4562) table example make an divided module in flink-examples

2016-09-02 Thread shijinkui (JIRA)
shijinkui created FLINK-4562: Summary: table example make an divided module in flink-examples Key: FLINK-4562 URL: https://issues.apache.org/jira/browse/FLINK-4562 Project: Flink Issue Type

[jira] [Created] (FLINK-4630) add netty tcp source support

2016-09-18 Thread shijinkui (JIRA)
shijinkui created FLINK-4630: Summary: add netty tcp source support Key: FLINK-4630 URL: https://issues.apache.org/jira/browse/FLINK-4630 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-4669) scala api createLocalEnvironment() function add default Configuration parameter

2016-09-23 Thread shijinkui (JIRA)
shijinkui created FLINK-4669: Summary: scala api createLocalEnvironment() function add default Configuration parameter Key: FLINK-4669 URL: https://issues.apache.org/jira/browse/FLINK-4669 Project: Flink

[jira] [Created] (FLINK-4661) Failure to find org.apache.flink:flink-runtime_2.10:jar:tests

2016-09-22 Thread shijinkui (JIRA)
shijinkui created FLINK-4661: Summary: Failure to find org.apache.flink:flink-runtime_2.10:jar:tests Key: FLINK-4661 URL: https://issues.apache.org/jira/browse/FLINK-4661 Project: Flink Issue

[jira] [Created] (FLINK-4518) maxLineLength change to 120

2016-08-27 Thread shijinkui (JIRA)
shijinkui created FLINK-4518: Summary: maxLineLength change to 120 Key: FLINK-4518 URL: https://issues.apache.org/jira/browse/FLINK-4518 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-4517) scala code refactoring

2016-08-27 Thread shijinkui (JIRA)
shijinkui created FLINK-4517: Summary: scala code refactoring Key: FLINK-4517 URL: https://issues.apache.org/jira/browse/FLINK-4517 Project: Flink Issue Type: Improvement Reporter

[jira] [Created] (FLINK-4519) scala maxLineLength increased to 120

2016-08-27 Thread shijinkui (JIRA)
shijinkui created FLINK-4519: Summary: scala maxLineLength increased to 120 Key: FLINK-4519 URL: https://issues.apache.org/jira/browse/FLINK-4519 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5167) StreamExecutionEnvironment's set function return `this` instead of void

2016-11-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5167: Summary: StreamExecutionEnvironment's set function return `this` instead of void Key: FLINK-5167 URL: https://issues.apache.org/jira/browse/FLINK-5167 Project: Flink

[jira] [Created] (FLINK-5166) TextInputFormatTest.testNestedFileRead

2016-11-25 Thread shijinkui (JIRA)
shijinkui created FLINK-5166: Summary: TextInputFormatTest.testNestedFileRead Key: FLINK-5166 URL: https://issues.apache.org/jira/browse/FLINK-5166 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-5168) Scaladoc annotation link use [[]] instead of {@link}

2016-11-26 Thread shijinkui (JIRA)
shijinkui created FLINK-5168: Summary: Scaladoc annotation link use [[]] instead of {@link} Key: FLINK-5168 URL: https://issues.apache.org/jira/browse/FLINK-5168 Project: Flink Issue Type

[jira] [Created] (FLINK-5217) Deprecated interface Checkpointed make clear suggestion

2016-12-01 Thread shijinkui (JIRA)
shijinkui created FLINK-5217: Summary: Deprecated interface Checkpointed make clear suggestion Key: FLINK-5217 URL: https://issues.apache.org/jira/browse/FLINK-5217 Project: Flink Issue Type

[jira] [Created] (FLINK-5399) Add more information to checkpoint result of TriggerSavepointSuccess

2016-12-28 Thread shijinkui (JIRA)
shijinkui created FLINK-5399: Summary: Add more information to checkpoint result of TriggerSavepointSuccess Key: FLINK-5399 URL: https://issues.apache.org/jira/browse/FLINK-5399 Project: Flink

[jira] [Created] (FLINK-5370) build failure for unit test of FileInputFormatTest and GlobFilePathFilterTest

2016-12-19 Thread shijinkui (JIRA)
shijinkui created FLINK-5370: Summary: build failure for unit test of FileInputFormatTest and GlobFilePathFilterTest Key: FLINK-5370 URL: https://issues.apache.org/jira/browse/FLINK-5370 Project: Flink

[jira] [Created] (FLINK-5395) support locally build distribution by script create_release_files.sh

2016-12-27 Thread shijinkui (JIRA)
shijinkui created FLINK-5395: Summary: support locally build distribution by script create_release_files.sh Key: FLINK-5395 URL: https://issues.apache.org/jira/browse/FLINK-5395 Project: Flink

[jira] [Created] (FLINK-5396) flink-dist replace scala version in opt.xml by change-scala-version.sh

2016-12-27 Thread shijinkui (JIRA)
shijinkui created FLINK-5396: Summary: flink-dist replace scala version in opt.xml by change-scala-version.sh Key: FLINK-5396 URL: https://issues.apache.org/jira/browse/FLINK-5396 Project: Flink

[jira] [Created] (FLINK-6193) Flink dist directory normalize

2017-03-27 Thread shijinkui (JIRA)
shijinkui created FLINK-6193: Summary: Flink dist directory normalize Key: FLINK-6193 URL: https://issues.apache.org/jira/browse/FLINK-6193 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6201) move python example files to the examples dir

2017-03-27 Thread shijinkui (JIRA)
shijinkui created FLINK-6201: Summary: move python example files to the examples dir Key: FLINK-6201 URL: https://issues.apache.org/jira/browse/FLINK-6201 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-6387) Flink UI support access log

2017-04-26 Thread shijinkui (JIRA)
shijinkui created FLINK-6387: Summary: Flink UI support access log Key: FLINK-6387 URL: https://issues.apache.org/jira/browse/FLINK-6387 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-6367) support custom header settings of allow origin

2017-04-24 Thread shijinkui (JIRA)
shijinkui created FLINK-6367: Summary: support custom header settings of allow origin Key: FLINK-6367 URL: https://issues.apache.org/jira/browse/FLINK-6367 Project: Flink Issue Type: Sub-task