Hi Etienne,
ParquetColumnarRowInputFormat is not fully functional yet, it has a good
performance, but it is hard to support complex types, like array and map...
So I think a migrated ParquetInputFormat version is required.
Best,
Jingsong
On Wed, Feb 24, 2021 at 3:43 PM Etienne Chauchot
wrote:
Hi all, thanks for driving this and especially Piotr for re-active this
thread.
First, for `notifyCheckpointComplete`, I have strong preference towards
"shut down the dataflow
pipeline with one checkpoint in total", so I tend to option dropping "send
records" from
`notifyCheckpointComplete` for
Zhengqi Zhang created FLINK-21499:
-
Summary: maven package hang when using multithread on jdk 11
Key: FLINK-21499
URL: https://issues.apache.org/jira/browse/FLINK-21499
Project: Flink
Issue
Tzu-Li (Gordon) Tai created FLINK-21498:
---
Summary: Avoid copying when converting byte[] to ByteString in
StateFun
Key: FLINK-21498
URL: https://issues.apache.org/jira/browse/FLINK-21498
Guowei Ma created FLINK-21497:
-
Summary:
FileSourceTextLinesITCase.testBoundedTextFileSourceWithJobManagerFailover fail
Key: FLINK-21497
URL: https://issues.apache.org/jira/browse/FLINK-21497
Project:
Tzu-Li (Gordon) Tai created FLINK-21496:
---
Summary: Upgrade Testcontainers to 1.15.1 in Stateful Functions
Key: FLINK-21496
URL: https://issues.apache.org/jira/browse/FLINK-21496
Project: Flink
jiayue.yu created FLINK-21495:
-
Summary: Flink 1.12.0 execute hive sql GeneratedExpression ERROR
Key: FLINK-21495
URL: https://issues.apache.org/jira/browse/FLINK-21495
Project: Flink
Issue
Zheng Hu created FLINK-21494:
Summary: Could not execute statement 'USE `default`' in Flink SQL
client
Key: FLINK-21494
URL: https://issues.apache.org/jira/browse/FLINK-21494
Project: Flink
zhisheng created FLINK-21493:
Summary: Flink Command Line Interface Document can add command
usage
Key: FLINK-21493
URL: https://issues.apache.org/jira/browse/FLINK-21493
Project: Flink
Issue
Till Rohrmann created FLINK-21492:
-
Summary: ActiveResourceManager swallows exception stack trace
Key: FLINK-21492
URL: https://issues.apache.org/jira/browse/FLINK-21492
Project: Flink
Issue
Tzu-Li (Gordon) Tai created FLINK-21491:
---
Summary: Properly shade Protobuf in statefun-sdk-java
Key: FLINK-21491
URL: https://issues.apache.org/jira/browse/FLINK-21491
Project: Flink
Dawid Wysakowicz created FLINK-21490:
Summary: UnalignedCheckpointITCase fails on azure
Key: FLINK-21490
URL: https://issues.apache.org/jira/browse/FLINK-21490
Project: Flink
Issue Type:
Thanks for the reponses Guowei and Yun,
Could you elaborate more/remind me, what does it mean to replace emitting
results from the `notifyCheckpointComplete` with `OperatorCoordinator`
approach?
About the discussion in FLINK-21133 and how it relates to FLIP-147. You are
right Yun gao, that in
Seth Wiesman created FLINK-21489:
Summary: Hugo docs add two anchor links to headers
Key: FLINK-21489
URL: https://issues.apache.org/jira/browse/FLINK-21489
Project: Flink
Issue Type: Bug
Maciej Obuchowski created FLINK-21488:
-
Summary: Jdbc XA sink - XID generation conflicts between jobs
Key: FLINK-21488
URL: https://issues.apache.org/jira/browse/FLINK-21488
Project: Flink
Till Rohrmann created FLINK-21487:
-
Summary: Replace TaskExecutor with TaskManager in ConfigOption
description
Key: FLINK-21487
URL: https://issues.apache.org/jira/browse/FLINK-21487
Project: Flink
Dawid Wysakowicz created FLINK-21486:
Summary: Add sanity check when switching from Rocks to Heap timers
Key: FLINK-21486
URL: https://issues.apache.org/jira/browse/FLINK-21486
Project: Flink
Shengkai Fang created FLINK-21485:
-
Summary: Simplify the ExecutionContext
Key: FLINK-21485
URL: https://issues.apache.org/jira/browse/FLINK-21485
Project: Flink
Issue Type: Sub-task
Piotr Nowojski created FLINK-21484:
--
Summary: Internal enum CheckpointType is exposed via REST API,
making it part of Public API
Key: FLINK-21484
URL: https://issues.apache.org/jira/browse/FLINK-21484
Igal Shilman created FLINK-21483:
Summary: Disable the spot bugs plugin.
Key: FLINK-21483
URL: https://issues.apache.org/jira/browse/FLINK-21483
Project: Flink
Issue Type: Task
Hi Till, Guowei,
Very thanks for initiating the disucssion and the deep thoughts!
For the notifyCheckpointComplete, I also agree we could try to avoid
emitting new records in notifyCheckpointComplete via using OperatorCoordinator
for new sink API. Besides, the hive sink might also need some
Hey Roman,
I've created Jira task and already provided PR.
https://issues.apache.org/jira/browse/FLINK-21442
I see that "tickets need to be assigned before starting with the
implementation work" but we already had the implementation in our fork.
Can you assign me to this task and provide code
Andy created FLINK-21482:
Summary: Support grouping set syntax for WindowAggregate
Key: FLINK-21482
URL: https://issues.apache.org/jira/browse/FLINK-21482
Project: Flink
Issue Type: New Feature
Hi all,
The agreed date of a feature freeze is due in about a month. Therefore
we thought it would be a good time to give an update of the current
progress.
From the information we gathered there are currently no known obstacles
or foreseeable delays. We are still aiming for the end of March as
Xintong Song created FLINK-21480:
Summary: Respect external resources from resource requirements
Key: FLINK-21480
URL: https://issues.apache.org/jira/browse/FLINK-21480
Project: Flink
Issue
Chesnay Schepler created FLINK-21481:
Summary: Move git-commit-id-plugin execution to flink-runtime
Key: FLINK-21481
URL: https://issues.apache.org/jira/browse/FLINK-21481
Project: Flink
Hi, Till
Thank you very much for your careful consideration
*1. Emit records in `NotifyCheckpointComplete`.*
Sorry for making you misunderstanding because of my expression. I just
want to say the current interface does not prevent users from doing it.
>From the perspective of the new sink
Xintong Song created FLINK-21479:
Summary: Provide read-only interface of TaskManagerTracker to
ResourceAllocationStrategy
Key: FLINK-21479
URL: https://issues.apache.org/jira/browse/FLINK-21479
Caizhi Weng created FLINK-21478:
---
Summary: Lookup joins should deal with any intermediate table
scans correctly
Key: FLINK-21478
URL: https://issues.apache.org/jira/browse/FLINK-21478
Project: Flink
Caizhi Weng created FLINK-21477:
---
Summary: Lookup joins should deal with intermediate table scans
containing just the table source correctly
Key: FLINK-21477
URL: https://issues.apache.org/jira/browse/FLINK-21477
30 matches
Mail list logo
