sco,
>
> Do you have a use case for "Future>"?
> When do users need this?
>
> Best,
> Jark
>
> On Mon, 11 Oct 2021 at 21:27, Francesco Guardiani >
> wrote:
>
> > Hi all,
> > Looking at the TableResult type I was wondering, given the interface
ult to Future/CompletableFuture.
WDYT?
FG
--
Francesco Guardiani | Software Engineer
france...@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Processing | Event Dri
, for example to convert an input stream of JSON from Kafka to a Row
instance.
Do you have any opinions about deprecating these classes in 1.15 and then
drop them in 1.16? Or are you using them? If yes, can you describe your use
case?
Thank you,
FG
--
Francesco Guardiani | Software Engineer
mentioned formats. Users can either
> > use Table API or implement a custom
> > SerializationSchema/DeserializationSchema according to their needs. It
> > is actually not that complicated to add Jackson and configure the
> > ObjectMapper for reading JSON/CSV.
> >
> >
Hi Jing,
Thanks for the FLIP. I'm not very knowledgeable about the topic, but going
through both the FLIP and the discussion here, I wonder, does it makes
sense for a lookup join to use hash distribution whenever is possible by
default?
The point you're explaining here:
> Many Lookup table
gt; flink-training
> >> to use assertj, removing a mixture of junit4 assertions and hamcrest in
> >> the
> >> process. I chose assertj because I found it to be more expressive and
> made
> >> the tests more readable.
> >>
> >> +1 from me
&
Hi all,
tl;dr:
I think Timo pretty much said it all. As described in the issue, my
proposal is:
* Let's switch the default behavior of CAST to fail
* Let's add TRY_CAST to have the old behavior
* Let's add a rule (disabled by default) that wraps every CAST in a TRY, in
order to keep the old
e the idea of using assertj to
implement such policy?
FG
[1] A library for assertions https://assertj.github.io, already used by the
pulsar connector
[2] https://assertj.github.io/doc/#assertj-core-custom-assertions-creation
--
Francesco Guardiani | Software Engineer
france...@ververica.co
+1 with Ingo proposal, the goal of the template should be to help developer
to do a self check of his/her PR quality, not to define whether something
is done or not. It's up to the committer to check that the "definition of
done" is fulfilled.
> The Definition of Done as suggested:
This
Francesco Guardiani wrote:
> Hi all,
>
> Given I see generally consensus around having a convention and using
> assertj, I propose to merge these 2 PRs:
>
> * Add the explanation of this convention in our code quality guide:
> https://github.com/apache/flink-web/pull/482
> * A
+1 with what both Ingo and Matthias sad, personally, I cannot wait to start
using some of
the APIs introduced in Java 9. And I'm pretty sure that's the same for our
users as well.
On Tuesday, 23 November 2021 13:35:07 CET Ingo Bürk wrote:
> Hi everyone,
>
> continued support for Java 8 can
;
> But still, I'm ok to change the behavior, but just not now. It will really
> create a big mess after
> users upgrade their SQL jobs. I'm either fine to do it in some really big
> version change like
> Flink 2.0, or we can do it after we have some universal error records
> handling
gt; > Best,
>> > D.
>> >
>> > On Tue, Nov 16, 2021 at 9:37 AM Till Rohrmann
>> > wrote:
>> >
>> > > Using JUnit5 with assertJ is fine with me if the community agrees.
>> Having
>> > > guides for best practices would definitely
Congratulations Fabian!
On Mon, Nov 15, 2021 at 2:29 PM Yun Gao
wrote:
> Congratulations Fabian!
>
> Best,
> Yun
> --Original Mail --
> Sender:Ingo Bürk
> Send Date:Mon Nov 15 21:27:36 2021
> Recipients:dev
> CC: ,
> Subject:Re: [ANNOUNCE] New Apache Flink
write it back in
the original
plan file, perhaps doing a backup of the previous one? Can you please clarify
this aspect?
Except these considerations, the proposal looks good to me and I'm eagerly
waiting to see
it in play.
Thanks,
FG
--
Francesco Guardiani | Software Engineer
france...@
Hi Sergey,
Thank you for your FLIP, the autocompletion looks stunning and really
useful!
FG
On Tue, Nov 2, 2021 at 4:25 AM Jark Wu wrote:
> Awesome demo, looking forward to these features!
>
> I only have a minor comment: could we provide a config to enable/disable
> the prompt values?
> We
Created https://issues.apache.org/jira/browse/FLINK-24673
On Mon, Oct 25, 2021 at 9:57 AM Francesco Guardiani
wrote:
> Last remainder: unless there are any objections, I will proceed with
> deprecating these by the end of the week.
>
> On Thu, Oct 21, 2021 at 4:28 PM Konstantin Kn
Congrats Matthias!
On Thu, Dec 2, 2021 at 4:53 PM Nicolaus Weidner <
nicolaus.weid...@ververica.com> wrote:
> Congrats Matthias, well deserved!
>
> Best,
> Nico
>
> On Thu, Dec 2, 2021 at 4:48 PM Fabian Paul wrote:
>
> > Congrats and well deserved.
> >
> > Best,
> > Fabian
> >
> > On Thu, Dec
Congrats Ingo!
On Thu, Dec 2, 2021 at 4:58 PM Nicolaus Weidner <
nicolaus.weid...@ververica.com> wrote:
> Congrats Ingo!
> The PMC probably realized that it's simply too much work to review and
> merge all your PRs, so now you can/have to do part of that work yourself
> ;-)
>
> Best,
> Nico
>
>
tps://github.com/apache/flink/pull/17897> to
flink-parquet and flink-orc.
Thanks,
FG
--
Francesco Guardiani | Software Engineer
france...@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
gt;>> a group of people managing some streaming platform, which will provide
> >>>> Flink as an execution engine
> >>>> to their users. Alibaba has more than 40K online streaming SQL jobs,
> and
> >>>> ByteDance also has a similar
>
Hi Till,
Thanks for starting this discussion, I think it's very beneficial for the
community to have stable APIs, in particular to develop connectors and
formats.
A couple of comments:
> I would suggest that we document these guarantees prominently under
/docs/dev/api_stability.
I think it
n for the legacy
> type system yet?
>
> Cheers,
>
> Konstantin
>
> On Wed, Dec 8, 2021 at 6:02 PM Francesco Guardiani <
> france...@ververica.com>
> wrote:
>
> > Hi all,
> > In case you haven't seen, last week I published in the issue comments
> this
+1 with a separate repo and +1 with the flink-storage name
On Fri, Jan 7, 2022 at 8:40 AM Jingsong Li wrote:
> Hi everyone,
>
> Vote for create a separate sub project for FLIP-188 thread is here:
> https://lists.apache.org/thread/wzzhr27cvrh6w107bn464m1m1ycfll1z
>
> Best,
> Jingsong
>
>
> On
> > It's not really a bugfix. But it might help developers with their
> > > > backports.
> > > >
> > > > Matthias
> > > >
> > > > [1] https://github.com/apache/flink/pull/17871
> > > >
> > > > On Thu, No
Congratulations, Yuan!
On Mon, Mar 14, 2022 at 3:51 PM yanfei lei wrote:
> Congratulations, Yuan!
>
>
>
> Zhilong Hong 于2022年3月14日周一 19:31写道：
>
> > Congratulations, Yuan!
> >
> > Best,
> > Zhilong
> >
> > On Mon, Mar 14, 2022 at 7:22 PM Konstantin Knauf
> > wrote:
> >
> > > Congratulations,
ld system.
> >
> > Seth
> >
> > On Wed, Mar 9, 2022 at 9:45 AM Francesco Guardiani <
> > france...@ververica.com>
> > wrote:
> >
> > > Hi all,
> > > I've been spending some time prototyping a scalafmt conf, which doesn't
> >
confusing for new users. Last but
> not
> > >> least, I believe the impact on existing users will be minimal (since
> it
> > can
> > >> be changed by changing one flag).
> > >>
> > >> Best regards,
> > >>
> > >> Martijn
>
nable scala formatting check
> > >
> > >
> > >
> > > +1 I've never written any Scala in Flink, but this makes a lot of sense
> > to
> > > me. Converging on a smaller set of tools and simplifying the build is
> > > always a good idea and the
> In the theory aspect, incremental data should be carefully considered for
streaming data. In this situation, the data flow from target_table to
target_table
will be a loop, and the incremental data with one key will keep going
through
the loop. It looks very strange.
This is the same concern I
Hi all,
I'm +1 with what everything you said Marios.
I'm gonna add another argument on top of that: the "legacy-cast-behavior"
has also a broken type inference, leading to incorrect results or further
errors down in the pipeline[1]. For example, take this:
SELECT COALESCE(CAST('a' AS INT), 0)
mvn spotless:check will check both java and scala
* mvn spotless:apply will format both java and scala
WDYT?
FG
--
Francesco Guardiani | Software Engineer
france...@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/&g
Congratulations Martjin!
On Fri, Mar 4, 2022 at 8:38 AM Ingo Bürk wrote:
> Congrats, Martijn!
>
> On 03.03.22 16:49, Robert Metzger wrote:
> > Hi everyone,
> >
> > On behalf of the PMC, I'm very happy to announce Martijn Visser as a new
> > Flink committer.
> >
> > Martijn is a very active
Sorry I replied on the wrong thread, i repost my answer here :)
As there was already a discussion in the doc, I'll just summarize my
opinions here on the proposed execution of this FLIP.
I think we should rather avoid exposing internal details, which I consider
Calcite to be part of, but rather
As there was already a discussion in the doc, I'll just summarize my
opinions here on the proposed execution of this FLIP.
I think we should rather avoid exposing internal details, which I consider
Calcite to be part of, but rather reuse what we already have to define an
AST from Table API, which
Thanks Chesnay for this!
FG
On Mon, Jan 24, 2022 at 11:20 AM David Morávek wrote:
> That's a great news Chesnay, thanks for driving this! This should unblock
> some ongoing Flink efforts +1
>
> Best,
> D.
>
> On Mon, Jan 24, 2022 at 10:58 AM Chesnay Schepler
> wrote:
>
> > Hello everyone,
> >
>>>
>>> Fully agree on the template part, what's good to know is that a
>>> connector template/archetype is part of the goals for the external
>>> connector repository.
>>>
>>> Best regards,
>>>
>>> Martijn
>>>
>
Hi,
I agree with the concern about having this connector in the main repo. But
I think in general it doesn't harm to have a sample connector to show how
to develop a custom connector, and I think that the Twitter connector can
be a good candidate for such a template. It needs rework for sure, as
ur branch to update the PR
Sorry for this noise!
Thank you,
FG
--
Francesco Guardiani | Software Engineer
france...@ververica.com
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Proc
Francesco Guardiani created FLINK-17611:
---
Summary: Support unix domain sockets for sidecar communication in
Stateful Functions
Key: FLINK-17611
URL: https://issues.apache.org/jira/browse/FLINK-17611
Francesco Guardiani created FLINK-18810:
---
Summary: Golang remote functions SDK
Key: FLINK-18810
URL: https://issues.apache.org/jira/browse/FLINK-18810
Project: Flink
Issue Type: New
Francesco Guardiani created FLINK-24225:
---
Summary: Define and implement UPSERT INTO semantics
Key: FLINK-24225
URL: https://issues.apache.org/jira/browse/FLINK-24225
Project: Flink
Francesco Guardiani created FLINK-24170:
---
Summary: Building a fresh clone with latest Maven fails
Key: FLINK-24170
URL: https://issues.apache.org/jira/browse/FLINK-24170
Project: Flink
Francesco Guardiani created FLINK-24214:
---
Summary: A submit job failure crashes the sql client
Key: FLINK-24214
URL: https://issues.apache.org/jira/browse/FLINK-24214
Project: Flink
Francesco Guardiani created FLINK-24363:
---
Summary: java.io.FileNotFoundException crashes the standalone
session manager
Key: FLINK-24363
URL: https://issues.apache.org/jira/browse/FLINK-24363
Francesco Guardiani created FLINK-24359:
---
Summary: Migrate FileSystem connector to ResolvedSchema
Key: FLINK-24359
URL: https://issues.apache.org/jira/browse/FLINK-24359
Project: Flink
Francesco Guardiani created FLINK-24544:
---
Summary: Failure when using Kafka connector in Table API with Avro
and Confluent schema registry
Key: FLINK-24544
URL: https://issues.apache.org/jira/browse/FLINK
Francesco Guardiani created FLINK-24565:
---
Summary: Port Avro FileSystemFormatFactory to StreamFormat
Key: FLINK-24565
URL: https://issues.apache.org/jira/browse/FLINK-24565
Project: Flink
Francesco Guardiani created FLINK-24566:
---
Summary: Remove CsvFileSystemFormatFactory
Key: FLINK-24566
URL: https://issues.apache.org/jira/browse/FLINK-24566
Project: Flink
Issue Type
Francesco Guardiani created FLINK-24500:
---
Summary: Move SqlDateTimeUtils to table-common
Key: FLINK-24500
URL: https://issues.apache.org/jira/browse/FLINK-24500
Project: Flink
Issue
Francesco Guardiani created FLINK-24499:
---
Summary: OVER IGNORE NULLS support
Key: FLINK-24499
URL: https://issues.apache.org/jira/browse/FLINK-24499
Project: Flink
Issue Type: New
Francesco Guardiani created FLINK-24507:
---
Summary: Cleanup all the various date/time/timestamp utils
Key: FLINK-24507
URL: https://issues.apache.org/jira/browse/FLINK-24507
Project: Flink
Francesco Guardiani created FLINK-24575:
---
Summary: Port TestCsvFileSystemFormatFactory to
DeserializationSchema
Key: FLINK-24575
URL: https://issues.apache.org/jira/browse/FLINK-24575
Project
Francesco Guardiani created FLINK-24462:
---
Summary: Refactor casting rules in a similar fashion to
DataStructureConverter
Key: FLINK-24462
URL: https://issues.apache.org/jira/browse/FLINK-24462
Francesco Guardiani created FLINK-24461:
---
Summary: TableResult#print() should use internal data types
Key: FLINK-24461
URL: https://issues.apache.org/jira/browse/FLINK-24461
Project: Flink
Francesco Guardiani created FLINK-24466:
---
Summary: Interval Join late events handling behaviour is not
consistent
Key: FLINK-24466
URL: https://issues.apache.org/jira/browse/FLINK-24466
Project
Francesco Guardiani created FLINK-24617:
---
Summary: Support partition keys through metadata
Key: FLINK-24617
URL: https://issues.apache.org/jira/browse/FLINK-24617
Project: Flink
Issue
Francesco Guardiani created FLINK-24616:
---
Summary: Expose all metadata in FileStatus
Key: FLINK-24616
URL: https://issues.apache.org/jira/browse/FLINK-24616
Project: Flink
Issue Type
Francesco Guardiani created FLINK-24615:
---
Summary: Add infrastructure to support metadata in filesystem
connector
Key: FLINK-24615
URL: https://issues.apache.org/jira/browse/FLINK-24615
Project
Francesco Guardiani created FLINK-25131:
---
Summary: Update sql client to ship flink-table-planner-loader
instead of flink-table-planner
Key: FLINK-25131
URL: https://issues.apache.org/jira/browse/FLINK-25131
Francesco Guardiani created FLINK-25129:
---
Summary: Update docs and examples to use
flink-table-planner-loader instead of flink-table-planner
Key: FLINK-25129
URL: https://issues.apache.org/jira/browse/FLINK
Francesco Guardiani created FLINK-25128:
---
Summary: Introduce flink-table-planner-loader
Key: FLINK-25128
URL: https://issues.apache.org/jira/browse/FLINK-25128
Project: Flink
Issue
Francesco Guardiani created FLINK-25130:
---
Summary: Update flink-table-uber to ship
flink-table-planner-loader instead of flink-table-planner
Key: FLINK-25130
URL: https://issues.apache.org/jira/browse/FLINK
Francesco Guardiani created FLINK-25526:
---
Summary: Deprecate TableSinkFactory, TableSourceFactory and
TableFormatFactory
Key: FLINK-25526
URL: https://issues.apache.org/jira/browse/FLINK-25526
Francesco Guardiani created FLINK-25428:
---
Summary: Expose complex types CAST to String
Key: FLINK-25428
URL: https://issues.apache.org/jira/browse/FLINK-25428
Project: Flink
Issue Type
Francesco Guardiani created FLINK-24924:
---
Summary: TO_TIMESTAMP and TO_DATE should fail
Key: FLINK-24924
URL: https://issues.apache.org/jira/browse/FLINK-24924
Project: Flink
Issue
Francesco Guardiani created FLINK-25090:
---
Summary: Run the assertj conversion script to convert assertions
Key: FLINK-25090
URL: https://issues.apache.org/jira/browse/FLINK-25090
Project: Flink
Francesco Guardiani created FLINK-25079:
---
Summary: Add assertj assertions for table types
Key: FLINK-25079
URL: https://issues.apache.org/jira/browse/FLINK-25079
Project: Flink
Issue
Francesco Guardiani created FLINK-25075:
---
Summary: Remove reflection to instantiate PlannerExpressionParser
Key: FLINK-25075
URL: https://issues.apache.org/jira/browse/FLINK-25075
Project: Flink
Francesco Guardiani created FLINK-25052:
---
Summary: Port row to row cast logic to CastRule
Key: FLINK-25052
URL: https://issues.apache.org/jira/browse/FLINK-25052
Project: Flink
Issue
Francesco Guardiani created FLINK-25051:
---
Summary: Port raw <-> binary logic to CastRule
Key: FLINK-25051
URL: https://issues.apache.org/jira/browse/FLINK-25051
Project: Flink
Francesco Guardiani created FLINK-25060:
---
Summary: Replace DataType.projectFields with Projection type
Key: FLINK-25060
URL: https://issues.apache.org/jira/browse/FLINK-25060
Project: Flink
Francesco Guardiani created FLINK-25061:
---
Summary: Add assertj as dependency in flink-parent
Key: FLINK-25061
URL: https://issues.apache.org/jira/browse/FLINK-25061
Project: Flink
Francesco Guardiani created FLINK-24902:
---
Summary: Port boolean <-> numeric casting logic to CastRule
Key: FLINK-24902
URL: https://issues.apache.org/jira/browse/FLINK-24902
Project:
Francesco Guardiani created FLINK-24673:
---
Summary: Deprecate old Row
SerializationSchema/DeserializationSchema
Key: FLINK-24673
URL: https://issues.apache.org/jira/browse/FLINK-24673
Project
Francesco Guardiani created FLINK-24685:
---
Summary: Use the new casting rules in TableResult#print
Key: FLINK-24685
URL: https://issues.apache.org/jira/browse/FLINK-24685
Project: Flink
Francesco Guardiani created FLINK-24684:
---
Summary: Port to string casting rules to the new CastRule interface
Key: FLINK-24684
URL: https://issues.apache.org/jira/browse/FLINK-24684
Project
Francesco Guardiani created FLINK-24843:
---
Summary:
DynamicTableFactory.Context.getCatalogTable().getPartitionKeys() should return
indexes
Key: FLINK-24843
URL: https://issues.apache.org/jira/browse/FLINK
Francesco Guardiani created FLINK-24847:
---
Summary: Decide the overflows behaviour
Key: FLINK-24847
URL: https://issues.apache.org/jira/browse/FLINK-24847
Project: Flink
Issue Type: Sub
Francesco Guardiani created FLINK-24778:
---
Summary: Add DataTypes#ROW(List)
Key: FLINK-24778
URL: https://issues.apache.org/jira/browse/FLINK-24778
Project: Flink
Issue Type: Bug
Francesco Guardiani created FLINK-24779:
---
Summary: Port Numeric casting logic to CastRule
Key: FLINK-24779
URL: https://issues.apache.org/jira/browse/FLINK-24779
Project: Flink
Issue
Francesco Guardiani created FLINK-24780:
---
Summary: Port time to time casting logic to CastRule
Key: FLINK-24780
URL: https://issues.apache.org/jira/browse/FLINK-24780
Project: Flink
Francesco Guardiani created FLINK-24781:
---
Summary: Port from string casting logic to CastRule
Key: FLINK-24781
URL: https://issues.apache.org/jira/browse/FLINK-24781
Project: Flink
Francesco Guardiani created FLINK-24752:
---
Summary: Cleanup ScalarOperatorGens#generateCast
Key: FLINK-24752
URL: https://issues.apache.org/jira/browse/FLINK-24752
Project: Flink
Issue
Francesco Guardiani created FLINK-24747:
---
Summary: Add producedDataType to
SupportsProjectionPushDown.applyProjection
Key: FLINK-24747
URL: https://issues.apache.org/jira/browse/FLINK-24747
Francesco Guardiani created FLINK-24776:
---
Summary: Clarify DecodingFormat
Key: FLINK-24776
URL: https://issues.apache.org/jira/browse/FLINK-24776
Project: Flink
Issue Type: Bug
Francesco Guardiani created FLINK-25113:
---
Summary: Cleanup from Parquet and Orc the partition key handling
logic
Key: FLINK-25113
URL: https://issues.apache.org/jira/browse/FLINK-25113
Project
Francesco Guardiani created FLINK-25282:
---
Summary: Move runtime dependencies from table-planner to
table-runtime
Key: FLINK-25282
URL: https://issues.apache.org/jira/browse/FLINK-25282
Project
Francesco Guardiani created FLINK-25300:
---
Summary: Remove CEIL and FLOOR call with one argument for integral
values
Key: FLINK-25300
URL: https://issues.apache.org/jira/browse/FLINK-25300
Francesco Guardiani created FLINK-25299:
---
Summary: Improve LIKE operator efficiency
Key: FLINK-25299
URL: https://issues.apache.org/jira/browse/FLINK-25299
Project: Flink
Issue Type
Francesco Guardiani created FLINK-25156:
---
Summary: DISTINCT is not handled correctly by CastRules
Key: FLINK-25156
URL: https://issues.apache.org/jira/browse/FLINK-25156
Project: Flink
Francesco Guardiani created FLINK-25158:
---
Summary: Fix formatting for true, false and null to uppercase
Key: FLINK-25158
URL: https://issues.apache.org/jira/browse/FLINK-25158
Project: Flink
Francesco Guardiani created FLINK-25157:
---
Summary: Introduce NULL type to string cast rule
Key: FLINK-25157
URL: https://issues.apache.org/jira/browse/FLINK-25157
Project: Flink
Issue
Francesco Guardiani created FLINK-25228:
---
Summary: Introduce flink-table-test-utils
Key: FLINK-25228
URL: https://issues.apache.org/jira/browse/FLINK-25228
Project: Flink
Issue Type
Francesco Guardiani created FLINK-25229:
---
Summary: Introduce flink-table-api-bridge-common
Key: FLINK-25229
URL: https://issues.apache.org/jira/browse/FLINK-25229
Project: Flink
Issue
Francesco Guardiani created FLINK-25114:
---
Summary: Remove flink-scala dependency from flink-table-runtime
Key: FLINK-25114
URL: https://issues.apache.org/jira/browse/FLINK-25114
Project: Flink
Francesco Guardiani created FLINK-25518:
---
Summary: Harden JSON Serialization utilities
Key: FLINK-25518
URL: https://issues.apache.org/jira/browse/FLINK-25518
Project: Flink
Issue Type
Francesco Guardiani created FLINK-25588:
---
Summary: Add jdk8 and datetime module to jackson shaded
Key: FLINK-25588
URL: https://issues.apache.org/jira/browse/FLINK-25588
Project: Flink
Francesco Guardiani created FLINK-26071:
---
Summary: TableEnvironment#compilePlan should fail
Key: FLINK-26071
URL: https://issues.apache.org/jira/browse/FLINK-26071
Project: Flink
Issue
Francesco Guardiani created FLINK-26519:
---
Summary: Remove FlinkTypeFactory.INSTANCE singleton
Key: FLINK-26519
URL: https://issues.apache.org/jira/browse/FLINK-26519
Project: Flink
1 - 100 of 141 matches
Mail list logo
