[jira] [Created] (FLINK-9651) Add a Kafka table source factory with Protobuf format support
mingleizhang created FLINK-9651: --- Summary: Add a Kafka table source factory with Protobuf format support Key: FLINK-9651 URL: https://issues.apache.org/jira/browse/FLINK-9651 Project: Flink Issue Type: Sub-task Components: Table API SQL Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9650) Support Protocol Buffers formats
mingleizhang created FLINK-9650: --- Summary: Support Protocol Buffers formats Key: FLINK-9650 URL: https://issues.apache.org/jira/browse/FLINK-9650 Project: Flink Issue Type: Sub-task Components: Streaming Connectors Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9625) Enrich the error information to user
mingleizhang created FLINK-9625:
---
Summary: Enrich the error information to user
Key: FLINK-9625
URL: https://issues.apache.org/jira/browse/FLINK-9625
Project: Flink
Issue Type: Improvement
Reporter: mingleizhang
Assignee: mingleizhang
When the fields too many, and the types do not match with it would cause the
below error. I think we should tell the users which field type does not match.
{code:java}
Exception in thread "main" org.apache.flink.table.api.TableException: Result
field does not match requested type. Requested: String; Actual: Integer
at
org.apache.flink.table.api.TableEnvironment$$anonfun$generateRowConverterFunction$1.apply(TableEnvironment.scala:953)
at
org.apache.flink.table.api.TableEnvironment$$anonfun$generateRowConverterFunction$1.apply(TableEnvironment.scala:944)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at
org.apache.flink.table.api.TableEnvironment.generateRowConverterFunction(TableEnvironment.scala:944)
at
org.apache.flink.table.api.StreamTableEnvironment.getConversionMapperWithChanges(StreamTableEnvironment.scala:358)
at
org.apache.flink.table.api.StreamTableEnvironment.translate(StreamTableEnvironment.scala:794)
at
org.apache.flink.table.api.StreamTableEnvironment.translate(StreamTableEnvironment.scala:734)
at
org.apache.flink.table.api.java.StreamTableEnvironment.toRetractStream(StreamTableEnvironment.scala:414)
at
org.apache.flink.table.api.java.StreamTableEnvironment.toRetractStream(StreamTableEnvironment.scala:357)
at router.StreamRouterRunning.main(StreamRouterRunning.java:76)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-9614) Improve the error message for Compiler#compile
mingleizhang created FLINK-9614: --- Summary: Improve the error message for Compiler#compile Key: FLINK-9614 URL: https://issues.apache.org/jira/browse/FLINK-9614 Project: Flink Issue Type: Improvement Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9609) Add bucket ready notification mechanism for BucketingSink when checkpoint complete
mingleizhang created FLINK-9609: --- Summary: Add bucket ready notification mechanism for BucketingSink when checkpoint complete Key: FLINK-9609 URL: https://issues.apache.org/jira/browse/FLINK-9609 Project: Flink Issue Type: Improvement Components: filesystem-connector, State Backends, Checkpointing Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9607) Support ParquetTableSink
mingleizhang created FLINK-9607: --- Summary: Support ParquetTableSink Key: FLINK-9607 URL: https://issues.apache.org/jira/browse/FLINK-9607 Project: Flink Issue Type: New Feature Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9606) Support ParquetTableSource
mingleizhang created FLINK-9606: --- Summary: Support ParquetTableSource Key: FLINK-9606 URL: https://issues.apache.org/jira/browse/FLINK-9606 Project: Flink Issue Type: New Feature Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9605) Support KafkaProtoBufTableSink
mingleizhang created FLINK-9605: --- Summary: Support KafkaProtoBufTableSink Key: FLINK-9605 URL: https://issues.apache.org/jira/browse/FLINK-9605 Project: Flink Issue Type: New Feature Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9604) Support KafkaProtoBufTableSource
mingleizhang created FLINK-9604: --- Summary: Support KafkaProtoBufTableSource Key: FLINK-9604 URL: https://issues.apache.org/jira/browse/FLINK-9604 Project: Flink Issue Type: New Feature Components: Table API SQL Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9411) Support parquet rolling sink writer
mingleizhang created FLINK-9411: --- Summary: Support parquet rolling sink writer Key: FLINK-9411 URL: https://issues.apache.org/jira/browse/FLINK-9411 Project: Flink Issue Type: New Feature Reporter: mingleizhang Assignee: Triones Deng Like support orc rolling sink writer in FLINK-9407 , we should also support parquet rolling sink writer. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-9230) WebFrontendITCase.testStopYarn is unstable
mingleizhang created FLINK-9230:
---
Summary: WebFrontendITCase.testStopYarn is unstable
Key: FLINK-9230
URL: https://issues.apache.org/jira/browse/FLINK-9230
Project: Flink
Issue Type: Improvement
Components: Tests
Environment: The latest commit :
7d0bfd51e967eb1eb2c2869d79cb7cd13b8366dd on master branch.
Reporter: mingleizhang
{code:java}
Running org.apache.flink.runtime.webmonitor.WebFrontendITCase
Running org.apache.flink.runtime.webmonitor.WebRuntimeMonitorITCase
Tests run: 9, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 8.348 sec <<<
FAILURE! - in org.apache.flink.runtime.webmonitor.WebFrontendITCase
testStopYarn(org.apache.flink.runtime.webmonitor.WebFrontendITCase) Time
elapsed: 1.365 sec <<< FAILURE!
java.lang.AssertionError: expected:<202 Accepted> but was:<404 Not Found>
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.failNotEquals(Assert.java:834)
at org.junit.Assert.assertEquals(Assert.java:118)
at org.junit.Assert.assertEquals(Assert.java:144)
at
org.apache.flink.runtime.webmonitor.WebFrontendITCase.testStopYarn(WebFrontendITCase.java:359)
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.805 sec - in
org.apache.flink.runtime.webmonitor.WebRuntimeMonitorITCase
Results :
Failed tests:
WebFrontendITCase.testStopYarn:359 expected:<202 Accepted> but was:<404 Not
Found>
Tests run: 14, Failures: 1, Errors: 0, Skipped: 0
02:17:10.224 [INFO]
02:17:10.224 [INFO] Reactor Summary:
02:17:10.224 [INFO]
02:17:10.224 [INFO] flink-core .
SUCCESS [ 58.759 s]
02:17:10.224 [INFO] flink-java .
SUCCESS [ 30.613 s]
02:17:10.224 [INFO] flink-runtime ..
SUCCESS [22:26 min]
02:17:10.224 [INFO] flink-optimizer
SUCCESS [ 5.508 s]
02:17:10.224 [INFO] flink-clients ..
SUCCESS [ 12.354 s]
02:17:10.224 [INFO] flink-streaming-java ...
SUCCESS [02:53 min]
02:17:10.224 [INFO] flink-scala
SUCCESS [ 18.968 s]
02:17:10.225 [INFO] flink-test-utils ...
SUCCESS [ 4.826 s]
02:17:10.225 [INFO] flink-statebackend-rocksdb .
SUCCESS [ 13.644 s]
02:17:10.225 [INFO] flink-runtime-web ..
FAILURE [ 15.095 s]
02:17:10.225 [INFO] flink-streaming-scala .. SKIPPED
02:17:10.225 [INFO] flink-scala-shell .. SKIPPED
02:17:10.225 [INFO]
02:17:10.225 [INFO] BUILD FAILURE
02:17:10.225 [INFO]
02:17:10.225 [INFO] Total time: 28:03 min
02:17:10.225 [INFO] Finished at: 2018-04-21T02:17:10+00:00
02:17:10.837 [INFO] Final Memory: 87M/711M
02:17:10.837 [INFO]
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-9226) Add Bucketing e2e test script to run-nightly-tests.sh
mingleizhang created FLINK-9226:
---
Summary: Add Bucketing e2e test script to run-nightly-tests.sh
Key: FLINK-9226
URL: https://issues.apache.org/jira/browse/FLINK-9226
Project: Flink
Issue Type: Improvement
Reporter: mingleizhang
Assignee: mingleizhang
The {{test_streaming_bucketing.sh}} does not add to {{run-nightly-tests.sh}}
now, the latter will be executed by manually verifying a release or making sure
that the tests pass.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-9224) Add Bucketing e2e test script to run-pre-commit-tests.sh
mingleizhang created FLINK-9224:
---
Summary: Add Bucketing e2e test script to run-pre-commit-tests.sh
Key: FLINK-9224
URL: https://issues.apache.org/jira/browse/FLINK-9224
Project: Flink
Issue Type: Improvement
Reporter: mingleizhang
Assignee: mingleizhang
The {{test_streaming_bucketing.sh}} does not add to {{run-pre-commit-tests.sh}}
now, the latter will be executed by Travis that would verify e2e test whether
correct or incorrect. So, we should add it and make Travis execute it for every
git commits.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-9092) End to end test for elasticsearch2.x
mingleizhang created FLINK-9092: --- Summary: End to end test for elasticsearch2.x Key: FLINK-9092 URL: https://issues.apache.org/jira/browse/FLINK-9092 Project: Flink Issue Type: Task Components: ElasticSearch Connector, Tests Reporter: mingleizhang Assignee: mingleizhang To prevent a patch from being too big, I separated these tasks into two jira. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-8907) Unable to start the process by start-cluster.sh
mingleizhang created FLINK-8907: --- Summary: Unable to start the process by start-cluster.sh Key: FLINK-8907 URL: https://issues.apache.org/jira/browse/FLINK-8907 Project: Flink Issue Type: Bug Components: Startup Shell Scripts Reporter: mingleizhang Fix For: 1.5.0 -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-8276) Annotation for Kafka connector
mingleizhang created FLINK-8276: --- Summary: Annotation for Kafka connector Key: FLINK-8276 URL: https://issues.apache.org/jira/browse/FLINK-8276 Project: Flink Issue Type: Sub-task Reporter: mingleizhang Assignee: mingleizhang Fix For: 1.5.0 See parent issue. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-8199) Annotation for Elasticsearch connector
mingleizhang created FLINK-8199: --- Summary: Annotation for Elasticsearch connector Key: FLINK-8199 URL: https://issues.apache.org/jira/browse/FLINK-8199 Project: Flink Issue Type: Sub-task Components: ElasticSearch Connector Affects Versions: 1.5.0 Reporter: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7573) Introduce Http protocol connector for Elasticsearch2
mingleizhang created FLINK-7573: --- Summary: Introduce Http protocol connector for Elasticsearch2 Key: FLINK-7573 URL: https://issues.apache.org/jira/browse/FLINK-7573 Project: Flink Issue Type: Improvement Components: ElasticSearch Connector Reporter: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7302) Failed to run CorrelateITCase class under windows environment
mingleizhang created FLINK-7302:
---
Summary: Failed to run CorrelateITCase class under windows
environment
Key: FLINK-7302
URL: https://issues.apache.org/jira/browse/FLINK-7302
Project: Flink
Issue Type: Bug
Components: Table API & SQL
Environment: Windows 7
Reporter: mingleizhang
Assignee: mingleizhang
Error:(220, 5) reference to UserDefinedFunctionTestUtils is ambiguous;
it is imported twice in the same scope by
import org.apache.flink.table.utils._
and import org.apache.flink.table.runtime.utils._
UserDefinedFunctionTestUtils.setJobParameters(env, Map("word_separator" ->
"#"))
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (FLINK-7162) Tests should not write outside 'target' directory.
mingleizhang created FLINK-7162: --- Summary: Tests should not write outside 'target' directory. Key: FLINK-7162 URL: https://issues.apache.org/jira/browse/FLINK-7162 Project: Flink Issue Type: Bug Components: Local Runtime Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7139) Refine currentTimeMillis to nanoTime
mingleizhang created FLINK-7139:
---
Summary: Refine currentTimeMillis to nanoTime
Key: FLINK-7139
URL: https://issues.apache.org/jira/browse/FLINK-7139
Project: Flink
Issue Type: Improvement
Components: Local Runtime
Reporter: mingleizhang
Assignee: mingleizhang
Priority: Minor
When measuring intervals of time it's much better & safer to use
{{System.nanoTime()}} than {{System.currentTimeMillis()}}. The latter is
affected by system clock drift and adjustments (like by system time daemon) and
the former is much more precise and stable.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (FLINK-7134) Remove hadoop1.x code in mapreduce.utils.HadoopUtils
mingleizhang created FLINK-7134: --- Summary: Remove hadoop1.x code in mapreduce.utils.HadoopUtils Key: FLINK-7134 URL: https://issues.apache.org/jira/browse/FLINK-7134 Project: Flink Issue Type: Improvement Components: Java API Reporter: mingleizhang Assignee: mingleizhang This jira is similar to FLINK-7118. And for a clearer format and a review, I separated the two jira. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7121) Remove the hardcoded way in core
mingleizhang created FLINK-7121: --- Summary: Remove the hardcoded way in core Key: FLINK-7121 URL: https://issues.apache.org/jira/browse/FLINK-7121 Project: Flink Issue Type: Bug Components: Core Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7120) Remove the hardcoded way in Utils
mingleizhang created FLINK-7120: --- Summary: Remove the hardcoded way in Utils Key: FLINK-7120 URL: https://issues.apache.org/jira/browse/FLINK-7120 Project: Flink Issue Type: Bug Components: YARN Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7119) Remove the hardcoded way in HadoopUtils
mingleizhang created FLINK-7119:
---
Summary: Remove the hardcoded way in HadoopUtils
Key: FLINK-7119
URL: https://issues.apache.org/jira/browse/FLINK-7119
Project: Flink
Issue Type: Bug
Components: Java API
Reporter: mingleizhang
Assignee: mingleizhang
I can see this kind of hardcoded way in {{HadoopUtils}}.
{code:java}
clazz = Class.forName("org.apache.hadoop.mapred.JobContextImpl", true,
Thread.currentThread().getContextClassLoader());
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (FLINK-7118) Remove hadoop1.x code in HadoopUtils
mingleizhang created FLINK-7118: --- Summary: Remove hadoop1.x code in HadoopUtils Key: FLINK-7118 URL: https://issues.apache.org/jira/browse/FLINK-7118 Project: Flink Issue Type: Bug Components: Java API Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7114) Remove the hardcoded way in flink
mingleizhang created FLINK-7114: --- Summary: Remove the hardcoded way in flink Key: FLINK-7114 URL: https://issues.apache.org/jira/browse/FLINK-7114 Project: Flink Issue Type: Bug Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7104) AccessDeniedException get when FileUtilsTest#testDeleteDirectoryConcurrently call
mingleizhang created FLINK-7104: --- Summary: AccessDeniedException get when FileUtilsTest#testDeleteDirectoryConcurrently call Key: FLINK-7104 URL: https://issues.apache.org/jira/browse/FLINK-7104 Project: Flink Issue Type: Bug Components: Core Reporter: mingleizhang Priority: Critical -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-7094) Update outdated doc release 1.2 to latest stable release 1.3
mingleizhang created FLINK-7094: --- Summary: Update outdated doc release 1.2 to latest stable release 1.3 Key: FLINK-7094 URL: https://issues.apache.org/jira/browse/FLINK-7094 Project: Flink Issue Type: Bug Reporter: mingleizhang Assignee: mingleizhang -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-6991) Inaccessible link under Gelly document
mingleizhang created FLINK-6991: --- Summary: Inaccessible link under Gelly document Key: FLINK-6991 URL: https://issues.apache.org/jira/browse/FLINK-6991 Project: Flink Issue Type: Bug Reporter: mingleizhang Assignee: mingleizhang When I visited the web http://flink.apache.org/news/2015/08/24/introducing-flink-gelly.html#top, then at the bottom of the page there is a Gelly Documentation link. It belongs to a non-existent resources. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-6934) Consider moving LRUCache class
mingleizhang created FLINK-6934: --- Summary: Consider moving LRUCache class Key: FLINK-6934 URL: https://issues.apache.org/jira/browse/FLINK-6934 Project: Flink Issue Type: Improvement Components: Local Runtime Reporter: mingleizhang Assignee: mingleizhang LRUCache class is not used any more. So, I would suggest remove it. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-6932) Update the inaccessible Dataflow Model paper link
mingleizhang created FLINK-6932: --- Summary: Update the inaccessible Dataflow Model paper link Key: FLINK-6932 URL: https://issues.apache.org/jira/browse/FLINK-6932 Project: Flink Issue Type: Bug Components: Documentation Reporter: mingleizhang Assignee: mingleizhang I tried to access the [#Dataflow Model paper] link which under [https://ci.apache.org/projects/flink/flink-docs-release-1.2/dev/event_time.html], then it gives me an error [ 404 ] instead. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (FLINK-6381) Unnecessary synchronizing object in BucketingSink
mingleizhang created FLINK-6381: --- Summary: Unnecessary synchronizing object in BucketingSink Key: FLINK-6381 URL: https://issues.apache.org/jira/browse/FLINK-6381 Project: Flink Issue Type: Bug Components: filesystem-connector Reporter: mingleizhang -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6351) Refactoring YarnFlinkApplicationMasterRunner by combining AbstractYarnFlinkApplicationMasterRunner in one class
mingleizhang created FLINK-6351: --- Summary: Refactoring YarnFlinkApplicationMasterRunner by combining AbstractYarnFlinkApplicationMasterRunner in one class Key: FLINK-6351 URL: https://issues.apache.org/jira/browse/FLINK-6351 Project: Flink Issue Type: Improvement Components: YARN Reporter: mingleizhang Assignee: mingleizhang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Created] (FLINK-6313) Some words was spelled wrong and incorrect LOG.error without print
mingleizhang created FLINK-6313: --- Summary: Some words was spelled wrong and incorrect LOG.error without print Key: FLINK-6313 URL: https://issues.apache.org/jira/browse/FLINK-6313 Project: Flink Issue Type: Bug Components: Queryable State Reporter: mingleizhang Assignee: mingleizhang Priority: Trivial I find some words are spelled wrong and log.error without print information. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
