[jira] [Created] (FLINK-12940) Translate "Apache Cassandra Connector" page into Chinese
Jark Wu created FLINK-12940: --- Summary: Translate "Apache Cassandra Connector" page into Chinese Key: FLINK-12940 URL: https://issues.apache.org/jira/browse/FLINK-12940 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/cassandra.html; into Chinese. The doc located in "flink/docs/dev/connectors/cassandra.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12941) Translate "Amazon AWS Kinesis Streams Connector" page into Chinese
Jark Wu created FLINK-12941: --- Summary: Translate "Amazon AWS Kinesis Streams Connector" page into Chinese Key: FLINK-12941 URL: https://issues.apache.org/jira/browse/FLINK-12941 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/kinesis.html; into Chinese. The doc located in "flink/docs/dev/connectors/kinesis.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12945) Translate "RabbitMQ Connector" page into Chinese
Jark Wu created FLINK-12945: --- Summary: Translate "RabbitMQ Connector" page into Chinese Key: FLINK-12945 URL: https://issues.apache.org/jira/browse/FLINK-12945 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/rabbitmq.html; into Chinese. The doc located in "flink/docs/dev/connectors/rabbitmq.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12944) Translate "Streaming File Sink" page into Chinese
Jark Wu created FLINK-12944: --- Summary: Translate "Streaming File Sink" page into Chinese Key: FLINK-12944 URL: https://issues.apache.org/jira/browse/FLINK-12944 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/streamfile_sink.html; into Chinese. The doc located in "flink/docs/dev/connectors/streamfile_sink.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12947) Translate "Twitter Connector" page into Chinese
Jark Wu created FLINK-12947: --- Summary: Translate "Twitter Connector" page into Chinese Key: FLINK-12947 URL: https://issues.apache.org/jira/browse/FLINK-12947 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/twitter.html; into Chinese. The doc located in "flink/docs/dev/connectors/twitter.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12946) Translate "Apache NiFi Connector" page into Chinese
Jark Wu created FLINK-12946: --- Summary: Translate "Apache NiFi Connector" page into Chinese Key: FLINK-12946 URL: https://issues.apache.org/jira/browse/FLINK-12946 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/nifi.htmll; into Chinese. The doc located in "flink/docs/dev/connectors/nifi.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12943) Translate "HDFS Connector" page into Chinese
Jark Wu created FLINK-12943: --- Summary: Translate "HDFS Connector" page into Chinese Key: FLINK-12943 URL: https://issues.apache.org/jira/browse/FLINK-12943 Project: Flink Issue Type: Sub-task Components: chinese-translation, Documentation Reporter: Jark Wu Translate the internal page "https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/filesystem_sink.html; into Chinese. The doc located in "flink/docs/dev/connectors/filesystem_sink.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11622) Translate the "Command-Line Interface" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870018#comment-16870018 ] Jark Wu commented on FLINK-11622: - Hi [~nicholasjiang], I think if you have done this, we can continue to work on your translation. > Translate the "Command-Line Interface" page into Chinese > > > Key: FLINK-11622 > URL: https://issues.apache.org/jira/browse/FLINK-11622 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Hui Zhao >Assignee: Jasper Yue >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/ops/cli.html > The markdown file is located in > https://github.com/apache/flink/blob/master/docs/ops/cli.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/ops/cli.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12743) Introduce unbounded streaming anti/semi join operator
[ https://issues.apache.org/jira/browse/FLINK-12743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12743. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 16818dad7e04fac8f862771a23a702f72e605e72 > Introduce unbounded streaming anti/semi join operator > - > > Key: FLINK-12743 > URL: https://issues.apache.org/jira/browse/FLINK-12743 > Project: Flink > Issue Type: New Feature > Components: Table SQL / Runtime >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > This operator is responsible for unbounded streaming semi/anti join, and will > be optimized in following cases: > 1. If the join keys (with equality condition) are also primary key, we will > have a more efficient state layout > 2. If the inputs have primary keys, but join keys are not primary key, we can > also come up with an efficient state layout > 3. Inputs don't have primary keys, this will go to default implementation -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12834) Support CharType and BinaryType in blink runner
[ https://issues.apache.org/jira/browse/FLINK-12834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12834. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 1ee24d6c626e8d361354721ad3de41d18e33bb70 > Support CharType and BinaryType in blink runner > --- > > Key: FLINK-12834 > URL: https://issues.apache.org/jira/browse/FLINK-12834 > Project: Flink > Issue Type: New Feature > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > 1.Now we use LogicalType VarcharType to support calcite char type. > 2.Subsequent TableApi also generates LogicalType's CharType. > We need real support CharType in internal code gen and computation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-11560) Translate "Flink Applications" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11560. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in flink-web: 7e6322b301dd8eb7344cd315354d76df28cc9eb8 > Translate "Flink Applications" page into Chinese > > > Key: FLINK-11560 > URL: https://issues.apache.org/jira/browse/FLINK-11560 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: Zhou Yumin >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 0.5h > Remaining Estimate: 0h > > Translate "Flink Applications" page into Chinese. > The markdown file is located in: flink-web/flink-applications.zh.md > The url link is: https://flink.apache.org/zh/flink-applications.html > Please adjust the links in the page to Chinese pages when translating. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12930) Update Chinese "how to contribute" pages
[ https://issues.apache.org/jira/browse/FLINK-12930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12930: Issue Type: Sub-task (was: Task) Parent: FLINK-11526 > Update Chinese "how to contribute" pages > > > Key: FLINK-12930 > URL: https://issues.apache.org/jira/browse/FLINK-12930 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Robert Metzger >Priority: Major > > FLINK-12605 updated the "How to contribute" pages. Thus, we need to update > the Chinese translation of those pages. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12833) Add Klaviyo to Chinese PoweredBy page
[ https://issues.apache.org/jira/browse/FLINK-12833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12833: Issue Type: Sub-task (was: Task) Parent: FLINK-11526 > Add Klaviyo to Chinese PoweredBy page > - > > Key: FLINK-12833 > URL: https://issues.apache.org/jira/browse/FLINK-12833 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Fabian Hueske >Priority: Major > > Commit b54ecfa930653bcfecd60df3414deca5291c6cb3 added Klaviyo to the English > PoweredBy page. > It should be added to the Chinese page as well. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-11606) Translate the "Distributed Runtime Environment" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11606. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 058fabedf355f532b9ceb76e9ea7345e0677d71f > Translate the "Distributed Runtime Environment" page into Chinese > - > > Key: FLINK-11606 > URL: https://issues.apache.org/jira/browse/FLINK-11606 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Kevin Liu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/concepts/runtime.html > The markdown file is located in flink/docs/concepts/runtime.zh.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/concepts/runtime.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12955) Add HBase LookupableTableSource
[ https://issues.apache.org/jira/browse/FLINK-12955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870853#comment-16870853 ] Jark Wu commented on FLINK-12955: - We should also support an HBase AsyncLookupableTableSource. Maybe in this issue or another issue. > Add HBase LookupableTableSource > --- > > Key: FLINK-12955 > URL: https://issues.apache.org/jira/browse/FLINK-12955 > Project: Flink > Issue Type: New Feature >Reporter: Chance Li >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12708) Introduce new Interfaces for source and sink to make Blink runner work
[
https://issues.apache.org/jira/browse/FLINK-12708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-12708:
Description:
In order to support Blink batch and temporal table join, we need some new
source interfaces and changes about TableSchema.
- {{AsyncTableFunction}}: used as async lookup function, to support async
temporal table join (i.e. dimension table join.).
- {{LookupableTableSource}}: The {{LookupableTableSource}} interface adds
support for the table to be accessed via key column(s) in a lookup fashion in
order to support temporal table join.
- {{BoundedTableSource}}: used for batch table source, returns a bounded
DataStream, not a {{InputFormat}}, because we also want to reuse existing
streaming source implementation to support bounded source, for example: bounded
Kafka source.
- {{BoundedTableSink}}: used for batch table sink, emit a bounded DataStream,
not a {{OutputFormat}}. The reason is the same as above.
was:
In order to support Blink batch and temporal table join, we need some new
source interfaces and changes about TableSchema.
- {{AsyncTableFunction}}: used as async lookup function, to support async
temporal table join (i.e. dimension table join.).
- {{LookupableTableSource}}: The {{LookupableTableSource}} interface adds
support for the table to be accessed via key column(s) in a lookup fashion in
order to support temporal table join.
- {{BoundedTableSource}}: used for batch table source, returns a bounded
DataStream, not a {{InputFormat}}, because we also want to reuse existing
streaming source implementation to support bounded source, for example: bounded
Kafka source.
- {{BoundedTableSink}}: used for batch table sink, emit a bounded DataStream,
not a {{OutputFormat}}. The reason is the same as above.
- {{TableSchema}}: The {{TableSchema}} is extended to carry more information
about primary key and unique keys. The key information will be used in
optimization.
> Introduce new Interfaces for source and sink to make Blink runner work
> --
>
> Key: FLINK-12708
> URL: https://issues.apache.org/jira/browse/FLINK-12708
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / API
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
>
> In order to support Blink batch and temporal table join, we need some new
> source interfaces and changes about TableSchema.
> - {{AsyncTableFunction}}: used as async lookup function, to support async
> temporal table join (i.e. dimension table join.).
> - {{LookupableTableSource}}: The {{LookupableTableSource}} interface adds
> support for the table to be accessed via key column(s) in a lookup fashion in
> order to support temporal table join.
> - {{BoundedTableSource}}: used for batch table source, returns a bounded
> DataStream, not a {{InputFormat}}, because we also want to reuse existing
> streaming source implementation to support bounded source, for example:
> bounded Kafka source.
> - {{BoundedTableSink}}: used for batch table sink, emit a bounded
> DataStream, not a {{OutputFormat}}. The reason is the same as above.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (FLINK-12801) Set parallelism for batch SQL
[ https://issues.apache.org/jira/browse/FLINK-12801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12801. --- Resolution: Fixed Assignee: xupingyong Fix Version/s: 1.9.0 Fixed in 1.9.0: 6f5425fc9798510fef33ccd7bb81d4b9f59bffa5 > Set parallelism for batch SQL > - > > Key: FLINK-12801 > URL: https://issues.apache.org/jira/browse/FLINK-12801 > Project: Flink > Issue Type: Task > Components: Table SQL / Planner >Reporter: XuPingyong >Assignee: xupingyong >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > DataStream user can set parallelism by > SingleOutputStreamOperator#setParallelism and DataStreamSink#setParallelism. > But SQL users cannot set parallelism to operators while compiled jobGraphs > from SQL are usally complex. > Now we first set parallelism for batch SQL by config. We introduce two > resourceSetting mode: > InferMode.NONE: User can set parallelism to source, sink and other > nodes separately. > InferMode.ONLY_SOURCE： Relative to InferMode.NONE, source paralelism > can be inferred by source row count. > We also introduce ShuffleStage to make adjacent operatos parallelism > same that there is no data shuffle between them. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12392) FlinkRelMetadataQuery does not compile with Scala 2.12
[
https://issues.apache.org/jira/browse/FLINK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu closed FLINK-12392.
---
Resolution: Fixed
Fixed in 1.9.0: ca8d9cab87fa082a0939ce51b8369b75691df3a4
> FlinkRelMetadataQuery does not compile with Scala 2.12
> --
>
> Key: FLINK-12392
> URL: https://issues.apache.org/jira/browse/FLINK-12392
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.9.0
>Reporter: Chesnay Schepler
>Assignee: godfrey he
>Priority: Blocker
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> {code}
> 10:57:51.770 [ERROR]
> /home/travis/build/apache/flink/flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/plan/metadata/FlinkRelMetadataQuery.scala:52:
> error: value EMPTY in class RelMetadataQuery cannot be accessed in object
> org.apache.calcite.rel.metadata.RelMetadataQuery
> 10:57:51.770 [ERROR] Access to protected value EMPTY not permitted because
> 10:57:51.770 [ERROR] enclosing package metadata in package plan is not a
> subclass of
> 10:57:51.770 [ERROR] class RelMetadataQuery in package metadata where target
> is defined
> 10:57:51.770 [ERROR] this(RelMetadataQuery.THREAD_PROVIDERS.get,
> RelMetadataQuery.EMPTY)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-12453) Simplify constructor of AggsHandlerCodeGenerator to explicitly tell which methods need to be generated
[ https://issues.apache.org/jira/browse/FLINK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12453: Summary: Simplify constructor of AggsHandlerCodeGenerator to explicitly tell which methods need to be generated (was: StreamExecGlobalGroupAggregate construct wrong args for AggsHandlerCodeGenerator) > Simplify constructor of AggsHandlerCodeGenerator to explicitly tell which > methods need to be generated > -- > > Key: FLINK-12453 > URL: https://issues.apache.org/jira/browse/FLINK-12453 > Project: Flink > Issue Type: Bug > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > In generateAggsHandler: > val generator = new AggsHandlerCodeGenerator( > CodeGeneratorContext(config), > relBuilder, > FlinkTypeFactory.toInternalRowType(inputRowType).getFieldTypes, > needRetract = false, > config.getNullCheck, > inputFieldCopy) > but AggsHandlerCodeGenerator args is: > class AggsHandlerCodeGenerator( > ctx: CodeGeneratorContext, > relBuilder: RelBuilder, > inputFieldTypes: Seq[InternalType], > needRetract: Boolean, > copyInputField: Boolean, > needAccumulate: Boolean = true) > Same issue to StreamExecIncrementalGroupAggregate -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12453) StreamExecGlobalGroupAggregate construct wrong args for AggsHandlerCodeGenerator
[ https://issues.apache.org/jira/browse/FLINK-12453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12453. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 504e7be7dcb2cad4184f9ffd1ef20d8b13f64f40 > StreamExecGlobalGroupAggregate construct wrong args for > AggsHandlerCodeGenerator > > > Key: FLINK-12453 > URL: https://issues.apache.org/jira/browse/FLINK-12453 > Project: Flink > Issue Type: Bug > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > In generateAggsHandler: > val generator = new AggsHandlerCodeGenerator( > CodeGeneratorContext(config), > relBuilder, > FlinkTypeFactory.toInternalRowType(inputRowType).getFieldTypes, > needRetract = false, > config.getNullCheck, > inputFieldCopy) > but AggsHandlerCodeGenerator args is: > class AggsHandlerCodeGenerator( > ctx: CodeGeneratorContext, > relBuilder: RelBuilder, > inputFieldTypes: Seq[InternalType], > needRetract: Boolean, > copyInputField: Boolean, > needAccumulate: Boolean = true) > Same issue to StreamExecIncrementalGroupAggregate -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12421) Synchronize the latest documentation changes into Chinese documents
[ https://issues.apache.org/jira/browse/FLINK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12421. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 3f532e18b96b83abdde189c4304f66c60b285d5c > Synchronize the latest documentation changes into Chinese documents > --- > > Key: FLINK-12421 > URL: https://issues.apache.org/jira/browse/FLINK-12421 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Minor > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > There are several commits to documentations have not been synchronized to > Chinese documents, i.e. `xx.zh.md`. This pull request will synchronize the > latest changes into Chinese documents. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12269) Support Temporal Table Join in blink planner
[
https://issues.apache.org/jira/browse/FLINK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu closed FLINK-12269.
---
Resolution: Fixed
Fix Version/s: 1.9.0
Fixed in 1.9.0: 03ba66352b93844e60e9cc022eb645b823deed69
> Support Temporal Table Join in blink planner
>
>
> Key: FLINK-12269
> URL: https://issues.apache.org/jira/browse/FLINK-12269
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / Planner
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Support translate following "FOR SYSTEM_TIME AS OF" query into
> {{StreamExecTemporalTableJoin}}.
> {code:sql}
> SELECT
> o.amout, o.currency, r.rate, o.amount * r.rate
> FROM
> Orders AS o
> JOIN LatestRates FOR SYSTEM_TIME AS OF o.proctime AS r
> ON r.currency = o.currency
> {code}
> This is an extension to current temporal join (FLINK-9738) using a standard
> syntax introduced in Calcite 1.19.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-12507) Fix AsyncLookupJoin doesn't close all generated ResultFutures
Jark Wu created FLINK-12507:
---
Summary: Fix AsyncLookupJoin doesn't close all generated
ResultFutures
Key: FLINK-12507
URL: https://issues.apache.org/jira/browse/FLINK-12507
Project: Flink
Issue Type: Bug
Components: Table SQL / Runtime
Reporter: Jark Wu
Assignee: Jark Wu
There is a fragile test in AsyncLookupJoinITCase, that not all the udfs are
closed at the end.
{code:java}
02:40:48.787 [ERROR] Tests run: 22, Failures: 2, Errors: 0, Skipped: 0, Time
elapsed: 47.098 s <<< FAILURE! - in
org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase
02:40:48.791 [ERROR]
testAsyncJoinTemporalTableWithUdfFilter[StateBackend=HEAP](org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase)
Time elapsed: 1.266 s <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<2>
at
org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase.testAsyncJoinTemporalTableWithUdfFilter(AsyncLookupJoinITCase.scala:268)
02:40:48.794 [ERROR]
testAsyncJoinTemporalTableWithUdfFilter[StateBackend=ROCKSDB](org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase)
Time elapsed: 1.033 s <<< FAILURE!
java.lang.AssertionError: expected:<0> but was:<2>
at
org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase.testAsyncJoinTemporalTableWithUdfFilter(AsyncLookupJoinITCase.scala:268)
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (FLINK-12507) Fix AsyncLookupJoin doesn't close all generated ResultFutures
[
https://issues.apache.org/jira/browse/FLINK-12507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu closed FLINK-12507.
---
Resolution: Fixed
Fix Version/s: 1.9.0
Fixed in 1.9.0: a42b65c1ea8850ebc16dcd8d9913651e0837cb36
> Fix AsyncLookupJoin doesn't close all generated ResultFutures
> -
>
> Key: FLINK-12507
> URL: https://issues.apache.org/jira/browse/FLINK-12507
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> There is a fragile test in AsyncLookupJoinITCase, that not all the udfs are
> closed at the end.
> {code:java}
> 02:40:48.787 [ERROR] Tests run: 22, Failures: 2, Errors: 0, Skipped: 0, Time
> elapsed: 47.098 s <<< FAILURE! - in
> org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase
> 02:40:48.791 [ERROR]
> testAsyncJoinTemporalTableWithUdfFilter[StateBackend=HEAP](org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase)
> Time elapsed: 1.266 s <<< FAILURE!
> java.lang.AssertionError: expected:<0> but was:<2>
> at
> org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase.testAsyncJoinTemporalTableWithUdfFilter(AsyncLookupJoinITCase.scala:268)
> 02:40:48.794 [ERROR]
> testAsyncJoinTemporalTableWithUdfFilter[StateBackend=ROCKSDB](org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase)
> Time elapsed: 1.033 s <<< FAILURE!
> java.lang.AssertionError: expected:<0> but was:<2>
> at
> org.apache.flink.table.runtime.stream.sql.AsyncLookupJoinITCase.testAsyncJoinTemporalTableWithUdfFilter(AsyncLookupJoinITCase.scala:268)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (FLINK-11610) Translate the "Examples" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11610. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: c6c3197961019800670060748881e537b33e42d4 > Translate the "Examples" page into Chinese > -- > > Key: FLINK-11610 > URL: https://issues.apache.org/jira/browse/FLINK-11610 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: shenlei >Priority: Major > Fix For: 1.9.0 > > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/examples/ > The markdown file is located in flink/docs/examples/index.zh.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12401) Support incremental emit for non-window streaming FlatAggregate on Table API
[ https://issues.apache.org/jira/browse/FLINK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846359#comment-16846359 ] Jark Wu commented on FLINK-12401: - Do you have a design about incremental emit [~hequn8128] ? For example, what's the API looks like, when will be invoked, what is it used for? > Support incremental emit for non-window streaming FlatAggregate on Table API > > > Key: FLINK-12401 > URL: https://issues.apache.org/jira/browse/FLINK-12401 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / API >Reporter: Hequn Cheng >Assignee: Hequn Cheng >Priority: Major > > As described in > [Flip-29|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97552739], > there are two output modes for non-window streaming flatAggregate. One is > emitting with full values, the other is emitting with incremental values. > [FLINK-10977|https://issues.apache.org/jira/browse/FLINK-10977] supports the > former one, this jira is going to support the latter one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12335) Improvement the code and performance of class SegmentsUtil
[ https://issues.apache.org/jira/browse/FLINK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12335: Summary: Improvement the code and performance of class SegmentsUtil (was: Remove useless code in SegmentsUtil) > Improvement the code and performance of class SegmentsUtil > -- > > Key: FLINK-12335 > URL: https://issues.apache.org/jira/browse/FLINK-12335 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Runtime >Reporter: Liya Fan >Assignee: Liya Fan >Priority: Minor > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Improve the performance of class SegmentsUtil: > To evaluate the offset, an integer is bitand with a mask to clear to low > bits, and then shift right. The bitand is useless: > ((index & BIT_BYTE_POSITION_MASK) >>> 3) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12335) Remove useless code in SegmentsUtil
[ https://issues.apache.org/jira/browse/FLINK-12335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12335. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 11a96fdf213467595dad73cffd9b05134a4d0d75 > Remove useless code in SegmentsUtil > --- > > Key: FLINK-12335 > URL: https://issues.apache.org/jira/browse/FLINK-12335 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Runtime >Reporter: Liya Fan >Assignee: Liya Fan >Priority: Minor > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Improve the performance of class SegmentsUtil: > To evaluate the offset, an integer is bitand with a mask to clear to low > bits, and then shift right. The bitand is useless: > ((index & BIT_BYTE_POSITION_MASK) >>> 3) -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (FLINK-12593) Revise the document for CEP
[ https://issues.apache.org/jira/browse/FLINK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-12593: --- Assignee: Jark Wu > Revise the document for CEP > --- > > Key: FLINK-12593 > URL: https://issues.apache.org/jira/browse/FLINK-12593 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Liya Fan >Assignee: Jark Wu >Priority: Minor > > The document for CEP (flink/docs/dev/libs/cep.md) can be difficult to > understand and follow, especially for beginners. > I suggest revising from the following aspects: > 1. Give more detailed descriptions of existing examples. > 2. More examples are required to illustrate the features. > 3. More explanations are required for some concepts, like contiguity. > 4. We can add more references to better understand the concepts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (FLINK-12593) Revise the document for CEP
[ https://issues.apache.org/jira/browse/FLINK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu reassigned FLINK-12593: --- Assignee: (was: Jark Wu) > Revise the document for CEP > --- > > Key: FLINK-12593 > URL: https://issues.apache.org/jira/browse/FLINK-12593 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Liya Fan >Priority: Minor > > The document for CEP (flink/docs/dev/libs/cep.md) can be difficult to > understand and follow, especially for beginners. > I suggest revising from the following aspects: > 1. Give more detailed descriptions of existing examples. > 2. More examples are required to illustrate the features. > 3. More explanations are required for some concepts, like contiguity. > 4. We can add more references to better understand the concepts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12593) Revise the document for CEP
[ https://issues.apache.org/jira/browse/FLINK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846393#comment-16846393 ] Jark Wu commented on FLINK-12593: - Hi [~fan_li_ya] thanks a lot for the ideas. The community is also working on improve documentation and started a discussion[1] about this two days ago. It would be great if you can leave some thoughts and comments regarding to the CEP restructure in the design doc[2] there. So that we can work together to improve documentation. [1]. http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-to-Restructure-Update-amp-Rework-Apache-Flink-s-Documentation-tt29014.html [2]. https://docs.google.com/document/d/1pPM4vTWUUiJb73pd8OqHA1EWVl9cv6kXoCB5F7_J6gM/edit > Revise the document for CEP > --- > > Key: FLINK-12593 > URL: https://issues.apache.org/jira/browse/FLINK-12593 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Liya Fan >Priority: Minor > > The document for CEP (flink/docs/dev/libs/cep.md) can be difficult to > understand and follow, especially for beginners. > I suggest revising from the following aspects: > 1. Give more detailed descriptions of existing examples. > 2. More examples are required to illustrate the features. > 3. More explanations are required for some concepts, like contiguity. > 4. We can add more references to better understand the concepts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (FLINK-12593) Revise the document for CEP
[ https://issues.apache.org/jira/browse/FLINK-12593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846393#comment-16846393 ] Jark Wu edited comment on FLINK-12593 at 5/23/19 3:02 AM: -- Hi [~fan_li_ya] thanks a lot for the ideas. The community is also working on improving documentation and started a discussion[1] about this two days ago. It would be great if you can leave some thoughts and comments regarding to the CEP restructure in the design doc[2] there. So that we can work together to improve documentation. [1]. http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-to-Restructure-Update-amp-Rework-Apache-Flink-s-Documentation-tt29014.html [2]. https://docs.google.com/document/d/1pPM4vTWUUiJb73pd8OqHA1EWVl9cv6kXoCB5F7_J6gM/edit was (Author: jark): Hi [~fan_li_ya] thanks a lot for the ideas. The community is also working on improve documentation and started a discussion[1] about this two days ago. It would be great if you can leave some thoughts and comments regarding to the CEP restructure in the design doc[2] there. So that we can work together to improve documentation. [1]. http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-to-Restructure-Update-amp-Rework-Apache-Flink-s-Documentation-tt29014.html [2]. https://docs.google.com/document/d/1pPM4vTWUUiJb73pd8OqHA1EWVl9cv6kXoCB5F7_J6gM/edit > Revise the document for CEP > --- > > Key: FLINK-12593 > URL: https://issues.apache.org/jira/browse/FLINK-12593 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Liya Fan >Priority: Minor > > The document for CEP (flink/docs/dev/libs/cep.md) can be difficult to > understand and follow, especially for beginners. > I suggest revising from the following aspects: > 1. Give more detailed descriptions of existing examples. > 2. More examples are required to illustrate the features. > 3. More explanations are required for some concepts, like contiguity. > 4. We can add more references to better understand the concepts. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12606) Move SourceFunction to flink-core
[
https://issues.apache.org/jira/browse/FLINK-12606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847160#comment-16847160
]
Jark Wu commented on FLINK-12606:
-
I think we should do the same thing for SinkFunction. For {{OutputFormat}}, it
is already there.
> Move SourceFunction to flink-core
> -
>
> Key: FLINK-12606
> URL: https://issues.apache.org/jira/browse/FLINK-12606
> Project: Flink
> Issue Type: Improvement
> Components: API / DataStream
>Reporter: Aljoscha Krettek
>Assignee: Aljoscha Krettek
>Priority: Major
>
> As part of the efforts to merge the new Blink-based Table API runner
> (FLINK-11439) we need to make {{TableSource}}/{{TableSink}} interfaces
> available in {{flink-table-common}}. This requires, among other things, that
> the "physical" source interfaces are available in {{flink-core}}, independent
> of DataSet/DataStream dependencies. For {{InputFormat}} this is already the
> case, we need to do the same for {{SourceFunction}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (FLINK-12611) Make time indicator nullable in blink
[
https://issues.apache.org/jira/browse/FLINK-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847335#comment-16847335
]
Jark Wu edited comment on FLINK-12611 at 5/24/19 8:12 AM:
--
Is it the problem of time indicator? If we have a field {{x BIGINT NOT NULL}} ,
will the following query work?
{code:sql}
select max(x) from T
{code}
was (Author: jark):
Is it the problem of time indicator? If we the field {{x}} is BIGINT NOT NULL,
will the following query work?
{code:sql}
select max(x) from T
{code}
> Make time indicator nullable in blink
> -
>
> Key: FLINK-12611
> URL: https://issues.apache.org/jira/browse/FLINK-12611
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner
>Reporter: Jingsong Lee
>Assignee: Jingsong Lee
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> SQL: select max(rowtime), count(a) from T
> There will be a AssertionError: type mismatch:
> aggCall type:
> TIMESTAMP(3) NOT NULL
> inferred type:
> TIMESTAMP(3)
> Agg type checking is done before TimeIndicator materializes. So there is a
> exception.
> And before introducing nullable of LogicalType, we should modify this to
> avoid more potential TypeCheck problems.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12611) Make time indicator nullable in blink
[ https://issues.apache.org/jira/browse/FLINK-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847365#comment-16847365 ] Jark Wu commented on FLINK-12611: - Get it. We don't have a nullable time indicator type. However, I think max(rowtime) is a materialize operation, which shouldn't return a time indicator type but a timestmap. Will that solve the problem? > Make time indicator nullable in blink > - > > Key: FLINK-12611 > URL: https://issues.apache.org/jira/browse/FLINK-12611 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > SQL: select max(rowtime), count(a) from T > There will be a AssertionError: type mismatch: > aggCall type: > TIMESTAMP(3) NOT NULL > inferred type: > TIMESTAMP(3) > Agg type checking is done before TimeIndicator materializes. So there is a > exception. > And before introducing nullable of LogicalType, we should modify this to > avoid more potential TypeCheck problems. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12613) Move SinkFunction to flink-core
[
https://issues.apache.org/jira/browse/FLINK-12613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-12613:
Description: As part of the efforts to merge the new Blink-based Table API
runner (FLINK-11439) we need to make TableSource/TableSink interfaces available
in {{flink-table-common}}. This requires, among other things, that the
"physical" source interfaces are available in flink-core, independent of
DataSet/DataStream dependencies. For {{OutputFormat}} this is already the case,
we need to do the same for {{SinkFunction}}. (was: As part of the efforts to
merge the new Blink-based Table API runner (FLINK-11439) we need to make
TableSource/TableSink interfaces available in {{flink-table-common}}. This
requires, among other things, that the "physical" source interfaces are
available in flink-core, independent of DataSet/DataStream dependencies. For
{{InputFormat}} this is already the case, we need to do the same for
{{SinkFunction}}.)
> Move SinkFunction to flink-core
> ---
>
> Key: FLINK-12613
> URL: https://issues.apache.org/jira/browse/FLINK-12613
> Project: Flink
> Issue Type: Improvement
> Components: API / DataStream
>Reporter: Aljoscha Krettek
>Assignee: Aljoscha Krettek
>Priority: Major
>
> As part of the efforts to merge the new Blink-based Table API runner
> (FLINK-11439) we need to make TableSource/TableSink interfaces available in
> {{flink-table-common}}. This requires, among other things, that the
> "physical" source interfaces are available in flink-core, independent of
> DataSet/DataStream dependencies. For {{OutputFormat}} this is already the
> case, we need to do the same for {{SinkFunction}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12611) Make time indicator nullable in blink
[
https://issues.apache.org/jira/browse/FLINK-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847335#comment-16847335
]
Jark Wu commented on FLINK-12611:
-
Is it the problem of time indicator? If we the field {{x}} is BIGINT NOT NULL,
will the following query work?
select max(x) from T
> Make time indicator nullable in blink
> -
>
> Key: FLINK-12611
> URL: https://issues.apache.org/jira/browse/FLINK-12611
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner
>Reporter: Jingsong Lee
>Assignee: Jingsong Lee
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> SQL: select max(rowtime), count(a) from T
> There will be a AssertionError: type mismatch:
> aggCall type:
> TIMESTAMP(3) NOT NULL
> inferred type:
> TIMESTAMP(3)
> Agg type checking is done before TimeIndicator materializes. So there is a
> exception.
> And before introducing nullable of LogicalType, we should modify this to
> avoid more potential TypeCheck problems.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (FLINK-12611) Make time indicator nullable in blink
[
https://issues.apache.org/jira/browse/FLINK-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847335#comment-16847335
]
Jark Wu edited comment on FLINK-12611 at 5/24/19 8:11 AM:
--
Is it the problem of time indicator? If we the field {{x}} is BIGINT NOT NULL,
will the following query work?
{code:sql}
select max(x) from T
{code}
was (Author: jark):
Is it the problem of time indicator? If we the field {{x}} is BIGINT NOT NULL,
will the following query work?
select max(x) from T
> Make time indicator nullable in blink
> -
>
> Key: FLINK-12611
> URL: https://issues.apache.org/jira/browse/FLINK-12611
> Project: Flink
> Issue Type: Improvement
> Components: Table SQL / Planner
>Reporter: Jingsong Lee
>Assignee: Jingsong Lee
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> SQL: select max(rowtime), count(a) from T
> There will be a AssertionError: type mismatch:
> aggCall type:
> TIMESTAMP(3) NOT NULL
> inferred type:
> TIMESTAMP(3)
> Agg type checking is done before TimeIndicator materializes. So there is a
> exception.
> And before introducing nullable of LogicalType, we should modify this to
> avoid more potential TypeCheck problems.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (FLINK-12611) Make time indicator nullable in blink
[ https://issues.apache.org/jira/browse/FLINK-12611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847365#comment-16847365 ] Jark Wu edited comment on FLINK-12611 at 5/24/19 9:02 AM: -- Get it. We don't have a nullable time indicator type. was (Author: jark): Get it. We don't have a nullable time indicator type. However, I think max(rowtime) is a materialize operation, which shouldn't return a time indicator type but a timestmap. Will that solve the problem? > Make time indicator nullable in blink > - > > Key: FLINK-12611 > URL: https://issues.apache.org/jira/browse/FLINK-12611 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Reporter: Jingsong Lee >Assignee: Jingsong Lee >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > SQL: select max(rowtime), count(a) from T > There will be a AssertionError: type mismatch: > aggCall type: > TIMESTAMP(3) NOT NULL > inferred type: > TIMESTAMP(3) > Agg type checking is done before TimeIndicator materializes. So there is a > exception. > And before introducing nullable of LogicalType, we should modify this to > avoid more potential TypeCheck problems. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12471) Fix broken links in documentation to make CRON travis job work
Jark Wu created FLINK-12471:
---
Summary: Fix broken links in documentation to make CRON travis job
work
Key: FLINK-12471
URL: https://issues.apache.org/jira/browse/FLINK-12471
Project: Flink
Issue Type: Bug
Components: Documentation
Reporter: Jark Wu
Assignee: Jark Wu
The CRON travis job is failing because of documentation link checks.
Following are the broken links:
{code:java}
[2019-05-09 14:05:44] ERROR `/zh/dev/stream/side_output.html' not found.
[2019-05-09 14:05:45] ERROR `/dev/table/(/dev/table/sourceSinks.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.8.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.7.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.6.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.5.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/levels_of_abstraction.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table_api.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/program_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/parallel_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/windows.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/event_ingestion_processing_time.svg' not
found.
[2019-05-09 14:05:48] ERROR `/zh/fig/state_partitioning.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_chains.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/processes.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_slots.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/slot_sharing.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/checkpoints.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking_with_flink.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamps_watermarks.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamp_extractors.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/apis/streaming/event_time.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table/(/dev/table/sourceSinks.html' not
found.
[2019-05-09 14:05:49] ERROR `/zh/fig/checkpoint_tuning.svg' not found.
[2019-05-09 14:05:49] ERROR `/zh/fig/local_recovery.png' not found.
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-12471) Fix broken links in documentation to make CRON travis job work
[
https://issues.apache.org/jira/browse/FLINK-12471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-12471:
Description:
The CRON travis job is failing because of documentation link checks.
https://travis-ci.org/apache/flink/jobs/530213609
Following are the broken links:
{code:java}
[2019-05-09 14:05:44] ERROR `/zh/dev/stream/side_output.html' not found.
[2019-05-09 14:05:45] ERROR `/dev/table/(/dev/table/sourceSinks.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.8.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.7.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.6.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.5.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/levels_of_abstraction.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table_api.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/program_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/parallel_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/windows.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/event_ingestion_processing_time.svg' not
found.
[2019-05-09 14:05:48] ERROR `/zh/fig/state_partitioning.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_chains.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/processes.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_slots.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/slot_sharing.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/checkpoints.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking_with_flink.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamps_watermarks.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamp_extractors.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/apis/streaming/event_time.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table/(/dev/table/sourceSinks.html' not
found.
[2019-05-09 14:05:49] ERROR `/zh/fig/checkpoint_tuning.svg' not found.
[2019-05-09 14:05:49] ERROR `/zh/fig/local_recovery.png' not found.
{code}
was:
The CRON travis job is failing because of documentation link checks.
Following are the broken links:
{code:java}
[2019-05-09 14:05:44] ERROR `/zh/dev/stream/side_output.html' not found.
[2019-05-09 14:05:45] ERROR `/dev/table/(/dev/table/sourceSinks.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.8.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.7.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.6.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/release-notes/flink-1.5.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/levels_of_abstraction.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table_api.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/program_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/parallel_dataflow.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/windows.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/event_ingestion_processing_time.svg' not
found.
[2019-05-09 14:05:48] ERROR `/zh/fig/state_partitioning.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_chains.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/processes.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/tasks_slots.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/slot_sharing.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/fig/checkpoints.svg' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking_with_flink.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/linking.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamps_watermarks.html' not found.
[2019-05-09 14:05:48] ERROR
`/zh/apis/streaming/event_timestamp_extractors.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/apis/streaming/event_time.html' not found.
[2019-05-09 14:05:48] ERROR `/zh/dev/table/(/dev/table/sourceSinks.html' not
found.
[2019-05-09 14:05:49] ERROR `/zh/fig/checkpoint_tuning.svg' not found.
[2019-05-09 14:05:49] ERROR `/zh/fig/local_recovery.png' not found.
{code}
> Fix broken links in documentation to make CRON travis job work
> --
>
> Key: FLINK-12471
> URL: https://issues.apache.org/jira/browse/FLINK-12471
> Project: Flink
> Issue Type: Bug
> Components: Documentation
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
>
> The CRON travis job is failing because of documentation link checks.
> https://travis-ci.org/apache/flink/jobs/530213609
> Following are the broken links:
> {code:java}
> [2019-05-09 14:05:44] ERROR `/zh/dev/stream/side_output.html' not found.
> [2019-05-09
[jira] [Closed] (FLINK-12496) Support translation from StreamExecGroupWindowAggregate to StreamTransformation.
[ https://issues.apache.org/jira/browse/FLINK-12496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12496. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 3801252b076d82176e9d6f3c190361ae8077e3aa > Support translation from StreamExecGroupWindowAggregate to > StreamTransformation. > > > Key: FLINK-12496 > URL: https://issues.apache.org/jira/browse/FLINK-12496 > Project: Flink > Issue Type: Task > Components: Table SQL / Runtime >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12537) Improve Documentation Build Time
[ https://issues.apache.org/jira/browse/FLINK-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841422#comment-16841422 ] Jark Wu commented on FLINK-12537: - a big +1 Do you have some thoughts about this already? > Improve Documentation Build Time > > > Key: FLINK-12537 > URL: https://issues.apache.org/jira/browse/FLINK-12537 > Project: Flink > Issue Type: Improvement > Components: Documentation >Reporter: Seth Wiesman >Assignee: Seth Wiesman >Priority: Major > > Flink documentation today uses Jekyll and heavy use of liquid tags, the time > to build the docs from scratch is > 3min and incremental updates to a single > page can still take 5 - 10 seconds. > This is an umbrella issue to profile the documentation build and improve the > render times. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12392) FlinkRelMetadataQuery does not compile with Scala 2.12
[
https://issues.apache.org/jira/browse/FLINK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836018#comment-16836018
]
Jark Wu commented on FLINK-12392:
-
Sure [~twalthr], we will figure it out today.
> FlinkRelMetadataQuery does not compile with Scala 2.12
> --
>
> Key: FLINK-12392
> URL: https://issues.apache.org/jira/browse/FLINK-12392
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.9.0
>Reporter: Chesnay Schepler
>Priority: Blocker
> Fix For: 1.9.0
>
>
> {code}
> 10:57:51.770 [ERROR]
> /home/travis/build/apache/flink/flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/plan/metadata/FlinkRelMetadataQuery.scala:52:
> error: value EMPTY in class RelMetadataQuery cannot be accessed in object
> org.apache.calcite.rel.metadata.RelMetadataQuery
> 10:57:51.770 [ERROR] Access to protected value EMPTY not permitted because
> 10:57:51.770 [ERROR] enclosing package metadata in package plan is not a
> subclass of
> 10:57:51.770 [ERROR] class RelMetadataQuery in package metadata where target
> is defined
> 10:57:51.770 [ERROR] this(RelMetadataQuery.THREAD_PROVIDERS.get,
> RelMetadataQuery.EMPTY)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (FLINK-12560) Documentation language build flags
[ https://issues.apache.org/jira/browse/FLINK-12560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12560. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: 5c5342e0499e08ebe4fa5b3b57818939ed75b84b > Documentation language build flags > -- > > Key: FLINK-12560 > URL: https://issues.apache.org/jira/browse/FLINK-12560 > Project: Flink > Issue Type: Sub-task > Components: Documentation >Reporter: Seth Wiesman >Assignee: Seth Wiesman >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Most documentation writers are only ever focused on one language at a time. > Adding language-specific build flags can dramatically reduce render time > during local development. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11560) Translate "Flink Applications" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844455#comment-16844455 ] Jark Wu commented on FLINK-11560: - Thanks a lot for push the progress of Flink website translation [~Brian Zhou]. However, I'm quite busy these days, may have time to review on Friday. [~klion26] [~yangfei] do you have time to review it? > Translate "Flink Applications" page into Chinese > > > Key: FLINK-11560 > URL: https://issues.apache.org/jira/browse/FLINK-11560 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: Zhou Yumin >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Translate "Flink Applications" page into Chinese. > The markdown file is located in: flink-web/flink-applications.zh.md > The url link is: https://flink.apache.org/zh/flink-applications.html > Please adjust the links in the page to Chinese pages when translating. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Comment Edited] (FLINK-11560) Translate "Flink Applications" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844455#comment-16844455 ] Jark Wu edited comment on FLINK-11560 at 5/21/19 2:38 AM: -- Thanks a lot for pushing the progress of Flink website translation [~Brian Zhou]. However, I'm quite busy these days, may have time to review on Friday. [~klion26] [~yangfei] do you have time to review it? was (Author: jark): Thanks a lot for push the progress of Flink website translation [~Brian Zhou]. However, I'm quite busy these days, may have time to review on Friday. [~klion26] [~yangfei] do you have time to review it? > Translate "Flink Applications" page into Chinese > > > Key: FLINK-11560 > URL: https://issues.apache.org/jira/browse/FLINK-11560 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: Zhou Yumin >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Translate "Flink Applications" page into Chinese. > The markdown file is located in: flink-web/flink-applications.zh.md > The url link is: https://flink.apache.org/zh/flink-applications.html > Please adjust the links in the page to Chinese pages when translating. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12553) Fix a bug in SqlDateTimeUtils#parseToTimeMillis
[ https://issues.apache.org/jira/browse/FLINK-12553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12553. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: a86bce5a176144e06d0120b804f3af986c325ebf > Fix a bug in SqlDateTimeUtils#parseToTimeMillis > --- > > Key: FLINK-12553 > URL: https://issues.apache.org/jira/browse/FLINK-12553 > Project: Flink > Issue Type: Bug > Components: Table SQL / Runtime >Reporter: Liya Fan >Assignee: Liya Fan >Priority: Trivial > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > If parameter "1999-12-31 12:34:56.123" is used, it should return 123. But it > returns 1230 now. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12351) AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
[
https://issues.apache.org/jira/browse/FLINK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829298#comment-16829298
]
Jark Wu commented on FLINK-12351:
-
[~rmetzger] Thanks for the reminder.
> AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
> -
>
> Key: FLINK-12351
> URL: https://issues.apache.org/jira/browse/FLINK-12351
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
>Reporter: Jark Wu
>Priority: Major
> Fix For: 1.9.0
>
>
> Currently, AsyncWaitOperator directly put the input StreamElement into
> {{StreamElementQueue}}. But when object reuse is enabled, the StreamElement
> is reused, which means the element in {{StreamElementQueue}} will be
> modified. As a result, the output of AsyncWaitOperator might be wrong.
> An easy way to fix this might be deep copy the input StreamElement when
> object reuse is enabled, like this:
> https://github.com/apache/flink/blob/blink/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/async/AsyncWaitOperator.java#L209
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Closed] (FLINK-11754) Translate the "Roadmap" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11754. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in flink-web: 7f603e6b557bf14a933ec741282fc25a4c26daf5 > Translate the "Roadmap" page into Chinese > - > > Key: FLINK-11754 > URL: https://issues.apache.org/jira/browse/FLINK-11754 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: hanfei >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 1h > Remaining Estimate: 0h > > The markdown file will be located in: flink-web/roadmap.zh.md > The url link is: https://flink.apache.org/zh/roadmap.html > Please start to work after the prior PR > https://github.com/apache/flink-web/pull/178 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12421) Synchronize the latest documentation changes into Chinese documents
[ https://issues.apache.org/jira/browse/FLINK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12421: Issue Type: Task (was: Sub-task) Parent: (was: FLINK-11525) > Synchronize the latest documentation changes into Chinese documents > --- > > Key: FLINK-12421 > URL: https://issues.apache.org/jira/browse/FLINK-12421 > Project: Flink > Issue Type: Task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > There are several commits to documentations have not been synchronized to > Chinese documents, i.e. `xx.zh.md`. This pull request will synchronize the > latest changes into Chinese documents. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12421) Synchronize the latest documentation changes into Chinese documents
[ https://issues.apache.org/jira/browse/FLINK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12421: Issue Type: Sub-task (was: Improvement) Parent: FLINK-11525 > Synchronize the latest documentation changes into Chinese documents > --- > > Key: FLINK-12421 > URL: https://issues.apache.org/jira/browse/FLINK-12421 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > There are several commits to documentations have not been synchronized to > Chinese documents, i.e. `xx.zh.md`. This pull request will synchronize the > latest changes into Chinese documents. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12421) Synchronize the latest documentation changes into Chinese documents
[ https://issues.apache.org/jira/browse/FLINK-12421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12421: Issue Type: Sub-task (was: Task) Parent: FLINK-11529 > Synchronize the latest documentation changes into Chinese documents > --- > > Key: FLINK-12421 > URL: https://issues.apache.org/jira/browse/FLINK-12421 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Minor > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > There are several commits to documentations have not been synchronized to > Chinese documents, i.e. `xx.zh.md`. This pull request will synchronize the > latest changes into Chinese documents. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12421) Synchronize the latest documentation changes into Chinese documents
Jark Wu created FLINK-12421: --- Summary: Synchronize the latest documentation changes into Chinese documents Key: FLINK-12421 URL: https://issues.apache.org/jira/browse/FLINK-12421 Project: Flink Issue Type: Improvement Components: chinese-translation, Documentation Reporter: Jark Wu Assignee: Jark Wu There are several commits to documentations have not been synchronized to Chinese documents, i.e. `xx.zh.md`. This pull request will synchronize the latest changes into Chinese documents. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11561) Translate "Flink Architecture" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834334#comment-16834334 ] Jark Wu commented on FLINK-11561: - [~Tom Goong] Yes, it is in flink-web project. What do you mean "merged together"? > Translate "Flink Architecture" page into Chinese > > > Key: FLINK-11561 > URL: https://issues.apache.org/jira/browse/FLINK-11561 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: Tom Goong >Priority: Major > > Translate "Flink Architecture" page into Chinese. > The markdown file is located in: flink-web/flink-architecture.zh.md > The url link is: https://flink.apache.org/zh/flink-architecture.html > Please adjust the links in the page to Chinese pages when translating. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-11530) Support multiple languages for the framework of flink docs
[ https://issues.apache.org/jira/browse/FLINK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11530. --- > Support multiple languages for the framework of flink docs > -- > > Key: FLINK-11530 > URL: https://issues.apache.org/jira/browse/FLINK-11530 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 40m > Remaining Estimate: 0h > > A more detailed description can be found in the proposed doc: > https://docs.google.com/document/d/1R1-uDq-KawLB8afQYrczfcoQHjjIhq6tvUksxrfhBl0/edit# > This step aims to integrate the mulitple-language-plugin for flink docs to > support Chinese. All the $pagename.zh.md should be created first in this JIRA > but keep the original English contents. A link between English version and > Chinese version should also be considered. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Resolved] (FLINK-11530) Support multiple languages for the framework of flink docs
[ https://issues.apache.org/jira/browse/FLINK-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu resolved FLINK-11530. - Resolution: Fixed Fix Version/s: 1.9.0 Resolved in 1.9 with commits: 182456f2ed0c9345990d8d25cac26d22e828bb46 63c7bd2697187c52ca062bb8512ce8e9744bb95f > Support multiple languages for the framework of flink docs > -- > > Key: FLINK-11530 > URL: https://issues.apache.org/jira/browse/FLINK-11530 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 40m > Remaining Estimate: 0h > > A more detailed description can be found in the proposed doc: > https://docs.google.com/document/d/1R1-uDq-KawLB8afQYrczfcoQHjjIhq6tvUksxrfhBl0/edit# > This step aims to integrate the mulitple-language-plugin for flink docs to > support Chinese. All the $pagename.zh.md should be created first in this JIRA > but keep the original English contents. A link between English version and > Chinese version should also be considered. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12263) Remove SINGLE_VALUE aggregate function from physical plan
Jark Wu created FLINK-12263:
---
Summary: Remove SINGLE_VALUE aggregate function from physical plan
Key: FLINK-12263
URL: https://issues.apache.org/jira/browse/FLINK-12263
Project: Flink
Issue Type: New Feature
Components: Table SQL / Planner
Reporter: Jark Wu
SINGLE_VALUE is an aggregate function which only accepts one row, and throws
exception when received more than one row.
For example:
{code:sql}
SELECT a2, SUM(a1) FROM A GROUP BY a2 HAVING SUM(a1) > (SELECT SUM(a1) * 0.1
FROM A)
{code}
will get a physical plan contains SINGLE_VALUE:
{code:sql}
+- NestedLoopJoin(joinType=[InnerJoin], where=[>(EXPR$1, $f0)], select=[a2,
EXPR$1, $f0], build=[right], singleRowJoin=[true])
:- HashAggregate(isMerge=[true], groupBy=[a2], select=[a2, Final_SUM(sum$0)
AS EXPR$1])
: +- Exchange(distribution=[hash[a2]])
: +- LocalHashAggregate(groupBy=[a2], select=[a2, Partial_SUM(a1) AS
sum$0])
:+- TableSourceScan(table=[[A, source: [TestTableSource(a1, a2)]]],
fields=[a1, a2])
+- Exchange(distribution=[broadcast])
+- HashAggregate(isMerge=[true], select=[Final_SINGLE_VALUE(value$0,
count$1) AS $f0])
+- Exchange(distribution=[single])
+- LocalHashAggregate(select=[Partial_SINGLE_VALUE(EXPR$0) AS
(value$0, count$1)])
+- Calc(select=[*($f0, 0.1) AS EXPR$0])
+- HashAggregate(isMerge=[true], select=[Final_SUM(sum$0) AS
$f0])
+- Exchange(distribution=[single])
+- LocalHashAggregate(select=[Partial_SUM(a1) AS sum$0])
+- Calc(select=[a1])
+- TableSourceScan(table=[[A, source:
[TestTableSource(a1, a2)]]], fields=[a1, a2])
{code}
But SINGLE_VALUE is a bit wired in physical plan because the logical plan can
make sure there is only one input row. Moreover it it also introduces
additional overhead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-11633) Translate "Working with State" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822490#comment-16822490 ] Jark Wu commented on FLINK-11633: - Hi [~klion26], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate "Working with State" into Chinese > --- > > Key: FLINK-11633 > URL: https://issues.apache.org/jira/browse/FLINK-11633 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Priority: Major > > Doc locates in flink/doc/dev/state/state.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11635) Translate "Checkpointing" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822492#comment-16822492 ] Jark Wu commented on FLINK-11635: - Hi [~klion26], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate "Checkpointing" page into Chinese > --- > > Key: FLINK-11635 > URL: https://issues.apache.org/jira/browse/FLINK-11635 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Priority: Major > > doc locates in flink/docs/dev/stream/state/checkpointing.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11634) Translate "State Backends" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822491#comment-16822491 ] Jark Wu commented on FLINK-11634: - Hi [~klion26], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate "State Backends" page into Chinese > > > Key: FLINK-11634 > URL: https://issues.apache.org/jira/browse/FLINK-11634 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Priority: Major > > doc locates in flink/docs/dev/stream/state/state_backens.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11623) Translate the "Configuration" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822487#comment-16822487 ] Jark Wu commented on FLINK-11623: - Hi [~hanfeio], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Configuration" page into Chinese > --- > > Key: FLINK-11623 > URL: https://issues.apache.org/jira/browse/FLINK-11623 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Hui Zhao >Assignee: hanfei >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > The page url is > https:https://ci.apache.org/projects/flink/flink-docs-master/ops/config.html > The markdown file is located in > https://github.com/apache/flink/blob/master/docs/ops/config.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11624) Translate the "File Systems" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822488#comment-16822488 ] Jark Wu commented on FLINK-11624: - Hi [~nicholasjiang], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "File Systems" page into Chinese > -- > > Key: FLINK-11624 > URL: https://issues.apache.org/jira/browse/FLINK-11624 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Hui Zhao >Assignee: Nicholas Jiang >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/ops/filesystems.html > The markdown file is located in > https://github.com/apache/flink/blob/master/docs/ops/filesystems.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11627) Translate the "JobManager High Availability (HA)" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822489#comment-16822489 ] Jark Wu commented on FLINK-11627: - Hi [~wangfengchao], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "JobManager High Availability (HA)" page into Chinese > --- > > Key: FLINK-11627 > URL: https://issues.apache.org/jira/browse/FLINK-11627 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Hui Zhao >Assignee: Fengchao Wang >Priority: Major > Time Spent: 3h 20m > Remaining Estimate: 0h > > The page url > ishttps://ci.apache.org/projects/flink/flink-docs-master/ops/jobmanager_high_availability.html > The markdown file is located in > https://github.com/apache/flink/blob/master/docs/ops/jobmanager_high_availability.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/ops/jobmanager_high_availability.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11622) Translate the "Command-Line Interface" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822486#comment-16822486 ] Jark Wu commented on FLINK-11622: - Hi [~nicholasjiang], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Command-Line Interface" page into Chinese > > > Key: FLINK-11622 > URL: https://issues.apache.org/jira/browse/FLINK-11622 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Hui Zhao >Assignee: Nicholas Jiang >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/ops/cli.html > The markdown file is located in > https://github.com/apache/flink/blob/master/docs/ops/cli.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/ops/cli.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11636) Translate "State Schema Evolution" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822493#comment-16822493 ] Jark Wu commented on FLINK-11636: - Hi [~klion26], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate "State Schema Evolution" into Chinese > --- > > Key: FLINK-11636 > URL: https://issues.apache.org/jira/browse/FLINK-11636 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Priority: Major > > doc locates in flink/docs/dev/stream/state/schema_evolution.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11614) Translate the "Configuring Dependencies" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822485#comment-16822485 ] Jark Wu commented on FLINK-11614: - Hi [~yangfei], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Configuring Dependencies" page into Chinese > -- > > Key: FLINK-11614 > URL: https://issues.apache.org/jira/browse/FLINK-11614 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: YangFei >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/dev/projectsetup/dependencies.html > The markdown file is located in flink/docs/dev/projectsetup/dependencies.zh.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11612) Translate the "Project Template for Java" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822483#comment-16822483 ] Jark Wu commented on FLINK-11612: - Hi [~xleesf], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Project Template for Java" page into Chinese > --- > > Key: FLINK-11612 > URL: https://issues.apache.org/jira/browse/FLINK-11612 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: leesf >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/dev/projectsetup/java_api_quickstart.html > The markdown file is located in > flink/docs/dev/projectsetup/java_api_quickstart.zh.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/quickstart/java_api_quickstart.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11613) Translate the "Project Template for Scala" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822484#comment-16822484 ] Jark Wu commented on FLINK-11613: - Hi [~Tom Goong] , FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Project Template for Scala" page into Chinese > > > Key: FLINK-11613 > URL: https://issues.apache.org/jira/browse/FLINK-11613 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Tom Goong >Priority: Major > Labels: pull-request-available > Time Spent: 0.5h > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/dev/projectsetup/scala_api_quickstart.html > The markdown file is located in > flink/docs/dev/projectsetup/scala_api_quickstart.zh.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/quickstart/scala_api_quickstart.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (FLINK-12269) Support Temporal Table Join in blink planner
[
https://issues.apache.org/jira/browse/FLINK-12269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu reassigned FLINK-12269:
---
Assignee: Jark Wu
> Support Temporal Table Join in blink planner
>
>
> Key: FLINK-12269
> URL: https://issues.apache.org/jira/browse/FLINK-12269
> Project: Flink
> Issue Type: New Feature
> Components: Table SQL / Planner
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
>
> Support translate following "FOR SYSTEM_TIME AS OF" query into
> {{StreamExecTemporalTableJoin}}.
> {code:sql}
> SELECT
> o.amout, o.currency, r.rate, o.amount * r.rate
> FROM
> Orders AS o
> JOIN LatestRates FOR SYSTEM_TIME AS OF o.proctime AS r
> ON r.currency = o.currency
> {code}
> This is an extension to current temporal join (FLINK-9738) using a standard
> syntax introduced in Calcite 1.19.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (FLINK-12269) Support Temporal Table Join in blink planner
Jark Wu created FLINK-12269:
---
Summary: Support Temporal Table Join in blink planner
Key: FLINK-12269
URL: https://issues.apache.org/jira/browse/FLINK-12269
Project: Flink
Issue Type: New Feature
Components: Table SQL / Planner
Reporter: Jark Wu
Support translate following "FOR SYSTEM_TIME AS OF" query into
{{StreamExecTemporalTableJoin}}.
{code:sql}
SELECT
o.amout, o.currency, r.rate, o.amount * r.rate
FROM
Orders AS o
JOIN LatestRates FOR SYSTEM_TIME AS OF o.proctime AS r
ON r.currency = o.currency
{code}
This is an extension to current temporal join (FLINK-9738) using a standard
syntax introduced in Calcite 1.19.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-12270) SortDistinctAggregateITCase fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu updated FLINK-12270:
Component/s: (was: Runtime / Operators)
Table SQL / Runtime
> SortDistinctAggregateITCase fails on Travis
> ---
>
> Key: FLINK-12270
> URL: https://issues.apache.org/jira/browse/FLINK-12270
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Runtime
>Affects Versions: 1.9.0
>Reporter: Chesnay Schepler
>Priority: Major
>
> https://travis-ci.org/apache/flink/jobs/522247106
> {code}
> 20:47:38.852 [ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 2, Time
> elapsed: 75.246 s <<< FAILURE! - in
> org.apache.flink.table.runtime.batch.sql.agg.SortDistinctAggregateITCase
> 20:47:38.857 [ERROR]
> testSomeColumnsBothInDistinctAggAndGroupBy(org.apache.flink.table.runtime.batch.sql.agg.SortDistinctAggregateITCase)
> Time elapsed: 5.705 s <<< ERROR!
> org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
> Caused by: java.lang.RuntimeException:
> org.apache.flink.runtime.memory.MemoryAllocationException: Could not allocate
> 64 pages. Only 0 pages are remaining.
> Caused by: org.apache.flink.runtime.memory.MemoryAllocationException: Could
> not allocate 64 pages. Only 0 pages are remaining.
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12270) SortDistinctAggregateITCase fails on Travis
[
https://issues.apache.org/jira/browse/FLINK-12270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822431#comment-16822431
]
Jark Wu commented on FLINK-12270:
-
I have also encountered this issue in pre-commit of FLINK-12133. After
discussed with [~godfreyhe] offline, the reason might be the default
SQL_RESOURCE_HASH_AGG_TABLE_MEM is too big. So I decrease this value to 4M in
test base class in the [latest merged
commit|https://github.com/apache/flink/commit/fefdd08b849d486234cb38ff0c0a12359eae24d2#diff-cb1826ace95100e2eacf8989309e076c].
But it might be other reasons.
> SortDistinctAggregateITCase fails on Travis
> ---
>
> Key: FLINK-12270
> URL: https://issues.apache.org/jira/browse/FLINK-12270
> Project: Flink
> Issue Type: Bug
> Components: Runtime / Operators
>Affects Versions: 1.9.0
>Reporter: Chesnay Schepler
>Priority: Major
>
> https://travis-ci.org/apache/flink/jobs/522247106
> {code}
> 20:47:38.852 [ERROR] Tests run: 23, Failures: 0, Errors: 1, Skipped: 2, Time
> elapsed: 75.246 s <<< FAILURE! - in
> org.apache.flink.table.runtime.batch.sql.agg.SortDistinctAggregateITCase
> 20:47:38.857 [ERROR]
> testSomeColumnsBothInDistinctAggAndGroupBy(org.apache.flink.table.runtime.batch.sql.agg.SortDistinctAggregateITCase)
> Time elapsed: 5.705 s <<< ERROR!
> org.apache.flink.runtime.client.JobExecutionException: Job execution failed.
> Caused by: java.lang.RuntimeException:
> org.apache.flink.runtime.memory.MemoryAllocationException: Could not allocate
> 64 pages. Only 0 pages are remaining.
> Caused by: org.apache.flink.runtime.memory.MemoryAllocationException: Could
> not allocate 64 pages. Only 0 pages are remaining.
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-11531) Translate the Home Page of flink docs into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822471#comment-16822471 ] Jark Wu commented on FLINK-11531: - Hi [~klion26], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the Home Page of flink docs into Chinese > -- > > Key: FLINK-11531 > URL: https://issues.apache.org/jira/browse/FLINK-11531 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Congxian Qiu(klion26) >Priority: Major > > The home page url is https://ci.apache.org/projects/flink/flink-docs-master/ . > The markdown file is located in flink/docs/index.zh.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11605) Translate the "Dataflow Programming Model" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822472#comment-16822472 ] Jark Wu commented on FLINK-11605: - Hi [~xueyu], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Dataflow Programming Model" page into Chinese > > > Key: FLINK-11605 > URL: https://issues.apache.org/jira/browse/FLINK-11605 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: xueyu >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/concepts/programming-model.html > The markdown file is located in flink/docs/concepts/programming-model.zh.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11609) Translate the "Running Flink on Windows" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822478#comment-16822478 ] Jark Wu commented on FLINK-11609: - Hi [~linjie], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Running Flink on Windows" page into Chinese > -- > > Key: FLINK-11609 > URL: https://issues.apache.org/jira/browse/FLINK-11609 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: xulinjie >Priority: Major > Labels: pull-request-available > Time Spent: 20m > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/tutorials/flink_on_windows.html > The markdown file is located in flink/docs/tutorials/flink_on_windows.zh.md > The markdown file will be created once FLINK-11530 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/start/flink_on_windows.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12133) Support unbounded aggregate in streaming table runtime
[ https://issues.apache.org/jira/browse/FLINK-12133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12133. --- Resolution: Fixed Fix Version/s: 1.9.0 Resolved in 1.9: fefdd08b849d486234cb38ff0c0a12359eae24d2 > Support unbounded aggregate in streaming table runtime > -- > > Key: FLINK-12133 > URL: https://issues.apache.org/jira/browse/FLINK-12133 > Project: Flink > Issue Type: New Feature > Components: Table SQL / Runtime >Reporter: Jark Wu >Assignee: Jark Wu >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > This ticket is aiming to support unbounded aggregate in streaming runtime. > This should includes: > 1. GroupAggFunction: function that support unbounded aggregate without > optimizations > 2. MiniBatchGroupAggFunction: function that support unbounded aggregate with > minibatch optimization > 3. MiniBatchLocalGroupAggFunction & MiniBatchGlobalGroupAggFunction: > function that support unbounded aggregate with local combine optimization -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-7391) Normalize release entries
[ https://issues.apache.org/jira/browse/FLINK-7391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-7391. -- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in flink-web: 8730f9495fdb4d8a076a0cc3f8163f2c6079cd89 > Normalize release entries > - > > Key: FLINK-7391 > URL: https://issues.apache.org/jira/browse/FLINK-7391 > Project: Flink > Issue Type: Improvement > Components: Project Website >Reporter: Chesnay Schepler >Assignee: Wang Geng >Priority: Major > Labels: pull-request-available, starter > Fix For: 1.9.0 > > Time Spent: 40m > Remaining Estimate: 0h > > The release list at http://flink.apache.org/downloads.html is inconsistent in > regards to the java/scala docs links. For 1.1.3 and below we only include a > docs link for the latest version (i.e 1.1.3, but not for 1.1.2), for higher > versions we have a docs link for every release. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11561) Translate "Flink Architecture" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822467#comment-16822467 ] Jark Wu commented on FLINK-11561: - Hi [~klion26], I want to push it a bit forward. Do you still have time to translate this page? > Translate "Flink Architecture" page into Chinese > > > Key: FLINK-11561 > URL: https://issues.apache.org/jira/browse/FLINK-11561 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Project Website >Reporter: Jark Wu >Assignee: Congxian Qiu(klion26) >Priority: Major > > Translate "Flink Architecture" page into Chinese. > The markdown file is located in: flink-web/flink-architecture.zh.md > The url link is: https://flink.apache.org/zh/flink-architecture.html > Please adjust the links in the page to Chinese pages when translating. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11607) Translate the "DataStream API Tutorial" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822473#comment-16822473 ] Jark Wu commented on FLINK-11607: - Hi [~libenchao], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "DataStream API Tutorial" page into Chinese > - > > Key: FLINK-11607 > URL: https://issues.apache.org/jira/browse/FLINK-11607 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Benchao Li >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/tutorials/datastream_api.html > The markdown file is located in flink/docs/tutorials/datastream_api.zh.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11608) Translate the "Local Setup Tutorial" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822474#comment-16822474 ] Jark Wu commented on FLINK-11608: - Hi [~shengjk1], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Local Setup Tutorial" page into Chinese > -- > > Key: FLINK-11608 > URL: https://issues.apache.org/jira/browse/FLINK-11608 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: shengjk1 >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/tutorials/local_setup.html > The markdown file is located in flink/docs/tutorials/local_setup.zh.md > The markdown file will be created once FLINK-11530 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11606) Translate the "Distributed Runtime Environment" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822480#comment-16822480 ] Jark Wu commented on FLINK-11606: - Hi [~Sunnyd], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Distributed Runtime Environment" page into Chinese > - > > Key: FLINK-11606 > URL: https://issues.apache.org/jira/browse/FLINK-11606 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Huadong Sun >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/concepts/runtime.html > The markdown file is located in flink/docs/concepts/runtime.zh.md > The markdown file will be created once FLINK-11529 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/concepts/runtime.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11611) Translate the "Batch Examples" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822482#comment-16822482 ] Jark Wu commented on FLINK-11611: - Hi [~iluvex], FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Batch Examples" page into Chinese > > > Key: FLINK-11611 > URL: https://issues.apache.org/jira/browse/FLINK-11611 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: Xin Ma >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/dev/batch/examples.html > The markdown file is located in flink/docs/dev/batch/examples.zh.md > The markdown file will be created once FLINK-11530 is merged. > You can reference the translation from : > https://github.com/flink-china/1.6.0/blob/master/dev/batch/examples.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-11610) Translate the "Examples" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16822481#comment-16822481 ] Jark Wu commented on FLINK-11610: - Hi [~shenlang] , FLINK-11530 has been merged. I think we can start to work on this issue. Before starting work, please make sure you have read [“Flink Translation Specifications”|https://cwiki.apache.org/confluence/display/FLINK/Flink+Translation+Specifications]. > Translate the "Examples" page into Chinese > -- > > Key: FLINK-11610 > URL: https://issues.apache.org/jira/browse/FLINK-11610 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Jark Wu >Assignee: shenlei >Priority: Major > > The page url is > https://ci.apache.org/projects/flink/flink-docs-master/examples/ > The markdown file is located in flink/docs/examples/index.zh.md > The markdown file will be created once FLINK-11529 is merged. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (FLINK-12351) AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
[
https://issues.apache.org/jira/browse/FLINK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jark Wu reassigned FLINK-12351:
---
Assignee: Jark Wu
> AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
> -
>
> Key: FLINK-12351
> URL: https://issues.apache.org/jira/browse/FLINK-12351
> Project: Flink
> Issue Type: Bug
> Components: API / DataStream
>Reporter: Jark Wu
>Assignee: Jark Wu
>Priority: Major
> Labels: pull-request-available
> Fix For: 1.9.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently, AsyncWaitOperator directly put the input StreamElement into
> {{StreamElementQueue}}. But when object reuse is enabled, the StreamElement
> is reused, which means the element in {{StreamElementQueue}} will be
> modified. As a result, the output of AsyncWaitOperator might be wrong.
> An easy way to fix this might be deep copy the input StreamElement when
> object reuse is enabled, like this:
> https://github.com/apache/flink/blob/blink/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/async/AsyncWaitOperator.java#L209
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12392) FlinkRelMetadataQuery does not compile with Scala 2.12
[
https://issues.apache.org/jira/browse/FLINK-12392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833022#comment-16833022
]
Jark Wu commented on FLINK-12392:
-
cc [~godfreyhe]
> FlinkRelMetadataQuery does not compile with Scala 2.12
> --
>
> Key: FLINK-12392
> URL: https://issues.apache.org/jira/browse/FLINK-12392
> Project: Flink
> Issue Type: Bug
> Components: Table SQL / Planner
>Affects Versions: 1.9.0
>Reporter: Chesnay Schepler
>Priority: Major
> Fix For: 1.9.0
>
>
> {code}
> 10:57:51.770 [ERROR]
> /home/travis/build/apache/flink/flink-table/flink-table-planner-blink/src/main/scala/org/apache/flink/table/plan/metadata/FlinkRelMetadataQuery.scala:52:
> error: value EMPTY in class RelMetadataQuery cannot be accessed in object
> org.apache.calcite.rel.metadata.RelMetadataQuery
> 10:57:51.770 [ERROR] Access to protected value EMPTY not permitted because
> 10:57:51.770 [ERROR] enclosing package metadata in package plan is not a
> subclass of
> 10:57:51.770 [ERROR] class RelMetadataQuery in package metadata where target
> is defined
> 10:57:51.770 [ERROR] this(RelMetadataQuery.THREAD_PROVIDERS.get,
> RelMetadataQuery.EMPTY)
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12348) Use TableConfig in api module to replace TableConfig in blink-planner module.
[ https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833528#comment-16833528 ] Jark Wu commented on FLINK-12348: - Yes, I totally agree with your points [~hequn8128] > Use TableConfig in api module to replace TableConfig in blink-planner module. > - > > Key: FLINK-12348 > URL: https://issues.apache.org/jira/browse/FLINK-12348 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Since TableConfig already moved to API module in > [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig > in blink-planner-module should not exist anymore. The issue aims to remove > the TableConfig in blink-planner-module, use TableConfig in API module > instead. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-11633) Translate "Working with State" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11633. --- Resolution: Fixed Fix Version/s: 1.9.0 Resolved in 1.9.0: 906d593ae21c98e335e0a078fe37d6d295e6f993 > Translate "Working with State" into Chinese > --- > > Key: FLINK-11633 > URL: https://issues.apache.org/jira/browse/FLINK-11633 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Assignee: Congxian Qiu(klion26) >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 20m > Remaining Estimate: 0h > > Doc locates in flink/doc/dev/state/state.md -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-11636) Translate "State Schema Evolution" into Chinese
[ https://issues.apache.org/jira/browse/FLINK-11636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-11636. --- Resolution: Fixed Fix Version/s: 1.9.0 Resolved in 1.9.0: d9f9037b1508b81396d83aee72a90e89a9b1c6ad > Translate "State Schema Evolution" into Chinese > --- > > Key: FLINK-11636 > URL: https://issues.apache.org/jira/browse/FLINK-11636 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Congxian Qiu(klion26) >Assignee: YangFei >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > doc locates in flink/docs/dev/stream/state/schema_evolution.md > [https://ci.apache.org/projects/flink/flink-docs-stable/dev/stream/state/schema_evolution.html] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12348) Make TableConfig configurable from string-string map
[ https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833800#comment-16833800 ] Jark Wu commented on FLINK-12348: - Btw, I renamed the title of this JIRA to make it more clear about what we want to do. > Make TableConfig configurable from string-string map > > > Key: FLINK-12348 > URL: https://issues.apache.org/jira/browse/FLINK-12348 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Since TableConfig already moved to API module in > [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig > in blink-planner-module should not exist anymore. The issue aims to remove > the TableConfig in blink-planner-module, use TableConfig in API module > instead. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (FLINK-12415) Translate "History Server" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-12415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12415: Summary: Translate "History Server" page into Chinese (was: Translate "History Server" doc into Chinese) > Translate "History Server" page into Chinese > > > Key: FLINK-12415 > URL: https://issues.apache.org/jira/browse/FLINK-12415 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Armstrong Nova >Assignee: Armstrong Nova >Priority: Major > > Translate > "[https://ci.apache.org/projects/flink/flink-docs-master/monitoring/historyserver.html]; > page into Chinese. > This doc located in "flink/docs/monitoring/historyserver.zh.md" -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12404) Translate the "Register a custom serializer for your Flink program" page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-12404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12404. --- Resolution: Fixed Resolved in 1.9.0: 96c6be0e5b5bd144b0cc1a545133cc3853fd2a4c > Translate the "Register a custom serializer for your Flink program" page into > Chinese > - > > Key: FLINK-12404 > URL: https://issues.apache.org/jira/browse/FLINK-12404 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: YangFei >Assignee: YangFei >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > doc locates in flink/docs/dev/custom_serializers.zh.md > the url is > [https://ci.apache.org/projects/flink/flink-docs-release-1.8/dev/custom_serializers.html] -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (FLINK-12348) Use TableConfig in api module to replace TableConfig in blink-planner module.
[
https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833789#comment-16833789
]
Jark Wu commented on FLINK-12348:
-
+1 provide methods for frequently used properties.
Regarding to the naming of properties, I think you raised a good point, this is
what I want to discuss next. I think it's nice to follow descriptor properties,
actually we also use this pattern in Blink properties.
Regarding to the hierarchy of properties, we split the options into following
in Blink:
* {{sql.exec.xxx}} for runtime
* {{sql.optimizer.xxx}} for optimizer
* {{sql.resource.xxx}} for resource, e.g. memory, parallelism, cpu
* {{sql.codegen.xxx}} for codegen
I'm not sure there should be a planner hierarchy. IMO, planner is a little
broad for users, it seems that it includes optimizer, codegen, resource, etc..
Maybe we should draft a google doc to list all the properties will be added in
the near future (mostly from Blink planner, shall we go through every property
name from Blink?). So that we can have an overview of properties to have a
better hierarchy.
> Use TableConfig in api module to replace TableConfig in blink-planner module.
> -
>
> Key: FLINK-12348
> URL: https://issues.apache.org/jira/browse/FLINK-12348
> Project: Flink
> Issue Type: Task
> Components: Table SQL / API
>Reporter: Jing Zhang
>Assignee: Jing Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Since TableConfig already moved to API module in
> [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig
> in blink-planner-module should not exist anymore. The issue aims to remove
> the TableConfig in blink-planner-module, use TableConfig in API module
> instead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (FLINK-12348) Use TableConfig in api module to replace TableConfig in blink-planner module.
[
https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833789#comment-16833789
]
Jark Wu edited comment on FLINK-12348 at 5/6/19 12:50 PM:
--
+1 provide methods for frequently used properties.
Regarding to the naming of properties, I think you raised a good point, this is
what I want to discuss next. I think it's nice to follow descriptor properties,
actually we also use this pattern in Blink properties.
Regarding to the hierarchy of properties, we split the options into following
in Blink:
* {{sql.exec.xxx}} for runtime
* {{sql.optimizer.xxx}} for optimizer
* {{sql.resource.xxx}} for resource, e.g. memory, parallelism, cpu
* {{sql.codegen.xxx}} for codegen
I'm not sure there should be a planner hierarchy. IMO, planner is a little
broad for users, it seems that it includes optimizer, codegen, resource, etc..
Maybe we should draft a google doc to list all the properties will be added in
the near future (mostly from Blink planner, shall we go through every property
name from Blink?). So that we can have an overview of properties to have a
better hierarchy. And we can continue the discussion in the doc.
was (Author: jark):
+1 provide methods for frequently used properties.
Regarding to the naming of properties, I think you raised a good point, this is
what I want to discuss next. I think it's nice to follow descriptor properties,
actually we also use this pattern in Blink properties.
Regarding to the hierarchy of properties, we split the options into following
in Blink:
* {{sql.exec.xxx}} for runtime
* {{sql.optimizer.xxx}} for optimizer
* {{sql.resource.xxx}} for resource, e.g. memory, parallelism, cpu
* {{sql.codegen.xxx}} for codegen
I'm not sure there should be a planner hierarchy. IMO, planner is a little
broad for users, it seems that it includes optimizer, codegen, resource, etc..
Maybe we should draft a google doc to list all the properties will be added in
the near future (mostly from Blink planner, shall we go through every property
name from Blink?). So that we can have an overview of properties to have a
better hierarchy.
> Use TableConfig in api module to replace TableConfig in blink-planner module.
> -
>
> Key: FLINK-12348
> URL: https://issues.apache.org/jira/browse/FLINK-12348
> Project: Flink
> Issue Type: Task
> Components: Table SQL / API
>Reporter: Jing Zhang
>Assignee: Jing Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Since TableConfig already moved to API module in
> [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig
> in blink-planner-module should not exist anymore. The issue aims to remove
> the TableConfig in blink-planner-module, use TableConfig in API module
> instead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-12348) Make TableConfig configurable from string-string map
[ https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-12348: Summary: Make TableConfig configurable from string-string map (was: Use TableConfig in api module to replace TableConfig in blink-planner module.) > Make TableConfig configurable from string-string map > > > Key: FLINK-12348 > URL: https://issues.apache.org/jira/browse/FLINK-12348 > Project: Flink > Issue Type: Task > Components: Table SQL / API >Reporter: Jing Zhang >Assignee: Jing Zhang >Priority: Major > Labels: pull-request-available > Time Spent: 10m > Remaining Estimate: 0h > > Since TableConfig already moved to API module in > [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig > in blink-planner-module should not exist anymore. The issue aims to remove > the TableConfig in blink-planner-module, use TableConfig in API module > instead. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (FLINK-12351) AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
Jark Wu created FLINK-12351:
---
Summary: AsyncWaitOperator should deep copy StreamElement when
object reuse is enabled
Key: FLINK-12351
URL: https://issues.apache.org/jira/browse/FLINK-12351
Project: Flink
Issue Type: Bug
Reporter: Jark Wu
Fix For: 1.9.0
Currently, AsyncWaitOperator directly put the input StreamElement into
{{StreamElementQueue}}. But when object reuse is enabled, the StreamElement is
reused, which means the element in {{StreamElementQueue}} will be modified. As
a result, the output of AsyncWaitOperator might be wrong.
An easy way to fix this might be deep copy the input StreamElement when object
reuse is enabled, like this:
https://github.com/apache/flink/blob/blink/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/async/AsyncWaitOperator.java#L209
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12351) AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
[
https://issues.apache.org/jira/browse/FLINK-12351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16828869#comment-16828869
]
Jark Wu commented on FLINK-12351:
-
Hi [~aitozi], I think fix the bug in AsyncWaitOperator and enable objectReuse
on operator level are two orthogonal problems. We can create another JIRA to
discuss the operator level object reuse problem.
Currently, I only find the AsyncWaitOperator is affected, because it doesn't
deep copy input record before put it into heap buffer (Java ArrayDeque).
IMO, no matter object reuse is enabled or not, the AsyncWaitOperator should
output the same result, because it's the framework code not user code.
Hi [~till.rohrmann], what do you think about this? If you don't object, I can
create a PR for this.
> AsyncWaitOperator should deep copy StreamElement when object reuse is enabled
> -
>
> Key: FLINK-12351
> URL: https://issues.apache.org/jira/browse/FLINK-12351
> Project: Flink
> Issue Type: Bug
>Reporter: Jark Wu
>Priority: Major
> Fix For: 1.9.0
>
>
> Currently, AsyncWaitOperator directly put the input StreamElement into
> {{StreamElementQueue}}. But when object reuse is enabled, the StreamElement
> is reused, which means the element in {{StreamElementQueue}} will be
> modified. As a result, the output of AsyncWaitOperator might be wrong.
> An easy way to fix this might be deep copy the input StreamElement when
> object reuse is enabled, like this:
> https://github.com/apache/flink/blob/blink/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/async/AsyncWaitOperator.java#L209
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12348) Use TableConfig in api module to replace TableConfig in blink-planner module.
[
https://issues.apache.org/jira/browse/FLINK-12348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833212#comment-16833212
]
Jark Wu commented on FLINK-12348:
-
Hi [~twalthr], I find that the updates to TableConfig mentioned in FLIP-32 is
mainly for a builder pattern. But the most important change Blink introduced is
making TableConfig configurable using plain key-value pairs (similar to runtime
options in {{flink-conf.yaml}}). So that we can setup a cluster or a job using
yaml files, for example:
{code:java}
sql.timeZone: UTC
sql.codegen.length.max: 64000
{code}
In order to support this feature, we need a member
{{org.apache.flink.configuration.Configuration}} in {{TableConfig}}. And move
{{TableConfigOptions}} into api module. What do you think? [~twalthr]
[~hequn8128] [~dawidwys]
> Use TableConfig in api module to replace TableConfig in blink-planner module.
> -
>
> Key: FLINK-12348
> URL: https://issues.apache.org/jira/browse/FLINK-12348
> Project: Flink
> Issue Type: Task
> Components: Table SQL / API
>Reporter: Jing Zhang
>Assignee: Jing Zhang
>Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Since TableConfig already moved to API module in
> [FLINK-11067|https://issues.apache.org/jira/browse/FLINK-11067], TableConfig
> in blink-planner-module should not exist anymore. The issue aims to remove
> the TableConfig in blink-planner-module, use TableConfig in API module
> instead.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-12401) Support incremental emit for non-window streaming FlatAggregate on Table API
[ https://issues.apache.org/jira/browse/FLINK-12401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16833186#comment-16833186 ] Jark Wu commented on FLINK-12401: - Incremental value is ACC? Is this issue going to support local-combine + global optimization for flatAggregate? > Support incremental emit for non-window streaming FlatAggregate on Table API > > > Key: FLINK-12401 > URL: https://issues.apache.org/jira/browse/FLINK-12401 > Project: Flink > Issue Type: Sub-task > Components: Table SQL / API >Reporter: Hequn Cheng >Assignee: Hequn Cheng >Priority: Major > > As described in > [Flip-29|https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97552739], > there are two output modes for non-window streaming flatAggregate. One is > emitting with full values, the other is emitting with incremental values. > [FLINK-10977|https://issues.apache.org/jira/browse/FLINK-10977] supports the > former one, this jira is going to support the latter one. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Closed] (FLINK-12360) Translate "Jobs and Scheduling" Page into Chinese
[ https://issues.apache.org/jira/browse/FLINK-12360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-12360. --- Resolution: Fixed Fix Version/s: 1.9.0 Fixed in 1.9.0: cc651895375e901f49773b693d594b047e3c0f9c > Translate "Jobs and Scheduling" Page into Chinese > - > > Key: FLINK-12360 > URL: https://issues.apache.org/jira/browse/FLINK-12360 > Project: Flink > Issue Type: Sub-task > Components: chinese-translation, Documentation >Reporter: Armstrong Nova >Assignee: Armstrong Nova >Priority: Major > Labels: pull-request-available > Fix For: 1.9.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Translate the internal page > "[https://ci.apache.org/projects/flink/flink-docs-master/internals/job_scheduling.html]; > to Chinese > the doc locates in "flink/docs/internals/job_scheduling.md", the translated > doc in "flink/docs/internals/job_scheduling.zh.md" > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
