Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4522
yeah, we ran our job with this change on Flink 1.3.0 on EMR and didn't have
issues.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4547
[FLINK-7454][docs] update 'Monitoring Current Event Time' section of Flink
doc
**(The sections below can be removed for hotfixes of typos)**
## What is the purpose of
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4473
@tzulitai done!
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4547
any feedback?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4522
@tzulitai any more feedbacks? We have a ticket on my company for this task,
and I'd like to mark it as finished if possible :)
---
If your project is set up for it, you can reply to this
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4522
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
GitHub user bowenli86 reopened a pull request:
https://github.com/apache/flink/pull/4522
[FLINK-7366][kinesis connector] Upgrade kinesis producer library in
flink-connector-kinesis
## What is the purpose of the change
We need to upgrade KPL and KCL to pick up the enhanced
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4473
@tzulitai any more feedbacks? We have a ticket on my company for this task,
and I'd like to mark it as finished if possible :)
---
If your project is set up for it, you can reply to this
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4522
can anyone from data artisan take a look at this PR please?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4473
can anyone from data artisan take a look at this PR please?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4547
@zentol does it look good to you?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4522
Great! I can start FLINK-7508 then
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4522
@aljoscha No worries. Dropping compatibility with Flink 1.2 Kinesis
consumer is great news! I reopened
(Flink-7422)[https://issues.apache.org/jira/browse/FLINK-7422] to upgrade KCL
---
If your
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4627
[FLINK-7422][kinesis] Upgrade Kinesis Client Library (KCL) and AWS SDK in
flink-connector-kinesis
## What is the purpose of the change
Upgrade KCL from 1.6.2 to 1.8.1
(https
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4627
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4639#discussion_r136877433
--- Diff:
flink-core/src/main/java/org/apache/flink/util/AbstractCloseableRegistry.java
---
@@ -61,13 +75,14 @@ public final void registerClosable(C
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4639#discussion_r136879648
--- Diff:
flink-core/src/main/java/org/apache/flink/util/AbstractCloseableRegistry.java
---
@@ -61,13 +75,14 @@ public final void registerClosable(C
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4473
@tzulitai or other Flink committers, can you please merge this so I can
submit more PRs depend on this? Thanks!
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4473
@tzulitai Thank you, Gordon!
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4656
[FLINK-7508][kinesis] switch FlinkKinesisProducer to use KPL's
ThreadingMode to ThreadedPool mode rather than Per_Request mode
## What is the purpose of the change
KinesisProducerLi
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4657
[FLINK-7600][kinesis] shorten delay of
KinesisProducerConfiguration.setCredentialsRefreshDelay() to avoid
updateCredentials Exception
## What is the purpose of the change
we saw the
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4662
[FLINK-7609][examples] WindowWordCount example doesn't print countWindow
output with default configs
## What is the purpose of the change
When running WindowWordCount example wi
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4663
[FLINK-6549] [DataStream API] Improve error message for type mismatches
with side outputs
## What is the purpose of the change
A type mismatch when using side outputs causes a
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4662
There's no output with 100/50 either, because the default text we use at
WordCountData.WORDS is not very long and cannot satisfy the count window size.
There's only 11 window ouputs even
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4881
Flink 7864
## What is the purpose of the change
Support side-outputs in CoProcessFunction
## Brief change log
- Support side-outputs in CoProcessFunction
- Added
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4757
Hi @tillrohrmann , I'm spending time on issues of 1.4.0. This handler is
not on my top priority right now. Please feel free to continue working on this
if you'd like to :)
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4786
Hi @aljoscha @fhueske , please let me know if you have any more comments
---
GitHub user bowenli86 reopened a pull request:
https://github.com/apache/flink/pull/4881
[FLINK-7864] [DataStream API] Support side-outputs in CoProcessFunction
## What is the purpose of the change
Support side-outputs in CoProcessFunction
## Brief change log
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4881
---
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4833#discussion_r146134235
--- Diff: docs/dev/stream/operators/windows.md ---
@@ -427,6 +427,93 @@ input
The above example sums up the second fields of the tuples for all
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4833#discussion_r146134312
--- Diff: docs/dev/stream/operators/windows.md ---
@@ -721,6 +808,111 @@ input
+ Incremental Window Aggregation with
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4833#discussion_r146134311
--- Diff: docs/dev/stream/operators/windows.md ---
@@ -721,6 +808,111 @@ input
+ Incremental Window Aggregation with
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4833#discussion_r146134163
--- Diff: docs/dev/stream/operators/windows.md ---
@@ -427,6 +427,93 @@ input
The above example sums up the second fields of the tuples for all
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4833#discussion_r146134241
--- Diff: docs/dev/stream/operators/windows.md ---
@@ -427,6 +427,93 @@ input
The above example sums up the second fields of the tuples for all
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4833
I just saw this PR, and sorry for submitting my feedbacks late...
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4798
Hi @StephanEwen @StefanRRichter , please let me know if you have any more
feedbacks
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4882
[FLINK-6245] Fix late side output documentation in Window documents.
## What is the purpose of the change
There are two things that need to be done:
1) in the syntax description
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4798#discussion_r146165655
--- Diff:
flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java
---
@@ -313,10
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4798#discussion_r146165645
--- Diff:
flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java
---
@@ -235,6
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4798#discussion_r146167573
--- Diff:
flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java
---
@@ -235,26
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4882
---
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4871#discussion_r146440154
--- Diff:
flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/FlinkKinesisProducer.java
---
@@ -265,19
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4786
---
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4881
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4881
Those are actually intentional to reorder the methods so they conform to
the order in the interface. Well, it's fine to not merge those
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4871
LGTM :+1:
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4899
[FLINK-5967][DataStream API][Doc] Add RuntimeContext#getAggregatingState()
and document AggregatingState
## What is the purpose of the change
Add `RuntimeContext#getAggregatingState
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4881
Sounds good. Thanks!
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4904
[hotfix] reorder the methods so they conform to their order in the interface
## What is the purpose of the change
As discussed with @aljoscha in https://github.com/apache/flink/pull/4881
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4907#discussion_r147031787
--- Diff: flink-core/src/main/java/org/apache/flink/util/FileUtils.java ---
@@ -243,11 +245,19 @@ else if (directory.exists()) {
* @throws
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4899
@StephanEwen @aljoscha Hi guys, I'm not sure if this is counted as a
feature or not (I guess so, because this PR adds a few new public APIs). If so,
it would be necessary to get this into m
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4907#discussion_r147121427
--- Diff: flink-core/src/main/java/org/apache/flink/util/FileUtils.java ---
@@ -243,11 +245,19 @@ else if (directory.exists()) {
* @throws
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4899
---
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4904
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4757
Once this PR is merged, I'll migrate other metrics handlers and abstract
the common code away.
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4932
I would suggest another solution - rather than adding another interface
'DelimiterProvider', add `getDelimiter()` which returns '.' as an interface
default method to `MetricRep
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4944
[hotfix] add space bewteen error message lines
## What is the purpose of the change
add space bewteen error message lines
## Brief change log
add space bewteen error
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4945
[FLINK-7977][build] bump version of compatibility check for Flink 1.4
## What is the purpose of the change
Since Flink maintains backward compatibility check for 2 versions, Flink
1.4
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4960
ð
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4963
[FLINK-7475] [core][state backend] support update() in ListState
## What is the purpose of the change
If users want to update the list, they have to do two steps:
```java
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4798
Hi @StefanRRichter , do you have more feedbacks?
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4963
Hi @yunfan123 Thanks for the feedback, and I agree with you.
Well, here's the problem: Flink seems to be using the
StringAppendTestOperator as merge operator from RocksDB, which ad
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4963
@yunfan123 sorry I can't find where `PredefinedOptions` defines it. Isn't
Flink using RocksDB's `StringAppendTESTOperator` in `RocksDBKeyedStateBackend`?
Hi @aljosch
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4963
@yunfan123 @aljoscha @StefanRRichter I chose the "shallow" simulation.
What do you guys think?
The build failure seems to be because one build profile timed out.
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/5017
[FLINK-8076] Upgrade KinesisProducer to 0.10.6 to set properties
approperiately
## What is the purpose of the change
https://github.com/awslabs/amazon-kinesis-producer/issues/124 has
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4921
LGTM +1
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4945
Sounds good. Thanks @zentol ! ð
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/5017
cc @tzulitai
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/5032
Can you please add a unit test for this?
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/5032
sounds good
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4945
Sounds good. Thanks, @zentol !
---
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4945
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4798
@StefanRRichter @aljoscha is it still possible to get this into 1.4?
---
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/5032#discussion_r152348905
--- Diff:
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/StreamingRuntimeContextTest.java
---
@@ -270,6 +271,20 @@ public
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/5032#discussion_r152475532
--- Diff:
flink-streaming-java/src/test/java/org/apache/flink/streaming/api/operators/StreamingRuntimeContextTest.java
---
@@ -270,6 +271,20 @@ public
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4798
---
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4757
Hi @GJL , you can take over this PR
---
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/5112
[FLINK-8175] remove flink-streaming-contrib and migrate its classes to
flink-streaming-java/scala
## What is the purpose of the change
This is the first step to clean up flink-contrib
Github user bowenli86 closed the pull request at:
https://github.com/apache/flink/pull/4757
---
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/6319#discussion_r202197686
--- Diff: flink-container/docker/README.md ---
@@ -0,0 +1,44 @@
+# Apache Flink cluster deployment on docker using docker-compose
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/6319#discussion_r202198679
--- Diff: flink-container/docker/README.md ---
@@ -0,0 +1,44 @@
+# Apache Flink cluster deployment on docker using docker-compose
--- End diff
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/6300#discussion_r202201507
--- Diff:
flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/internals/ShardConsumer.java
---
@@ -330,4
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/6300#discussion_r202199865
--- Diff:
flink-connectors/flink-connector-kinesis/src/main/java/org/apache/flink/streaming/connectors/kinesis/config/ConsumerConfigConstants.java
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/6373
Ran into this bug too.
+1 for the fix
---
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4136#discussion_r126240877
--- Diff: docs/ops/state_backends.md ---
@@ -124,7 +124,7 @@ RocksDBStateBackend is currently the only backend that
offers incremental checkp
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
@tzulitai I shaded httpcomponents. Does it look good?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4136#discussion_r126503269
--- Diff: docs/ops/state_backends.md ---
@@ -123,8 +123,7 @@ RocksDBStateBackend is currently the only backend that
offers incremental checkp
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4150#discussion_r126509865
--- Diff: docs/setup/aws.md ---
@@ -224,8 +224,6 @@ Depending on which file system you use, please add the
following dependencies. Y
- `S3AFileSystem
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
@tzulitai @tedyu
Hi guys, I'm also wondering how much percentage of Flink users are using
Flink with Kinesis? Kinesis has so many limitations that we are considering to
move from Ki
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4150#discussion_r126511039
--- Diff: flink-connectors/flink-connector-kinesis/pom.xml ---
@@ -36,6 +36,8 @@ under the License.
1.10.71
1.6.2
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
I added http components to dependencies because Hadoop-aws 2.7 depends on
http components 4.2.
```
$ jar -tf flink-connector-kinesis_2.11-1.4-SNAPSHOT.jar | grep apache/http
org
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4150#discussion_r127138994
--- Diff: flink-connectors/flink-connector-kinesis/pom.xml ---
@@ -56,6 +58,18 @@ under the License
Github user bowenli86 commented on a diff in the pull request:
https://github.com/apache/flink/pull/4150#discussion_r127139879
--- Diff: flink-connectors/flink-connector-kinesis/pom.xml ---
@@ -56,6 +58,18 @@ under the License
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
ok, I kind of figured out what `promoteTransitiveDependencies` means.
I removed explicit dependencies of httpclient and httpcore from `pom.xml`,
and made sure http-components are shaded
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4309
I ran into this too. Thanks for the PR!
Shall we also create a ticket to move generated files out of `src`?
---
If your project is set up for it, you can reply to this email and have your
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
During testing, I saw the following exception:
```java
java.lang.IllegalStateException: Socket not created by this factory
at
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4136
@zentol @alpinegizmo Let me know your thoughts on it
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have
GitHub user bowenli86 opened a pull request:
https://github.com/apache/flink/pull/4375
[Flink 6365][kinesis-connector] Adapt default values of the Kinesis
connector
Thanks for contributing to Apache Flink. Before you open your pull request,
please take the following check list
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4150
My Flink job checkpoints to S3, I'm configuring S3AFileSystem shown in
https://ci.apache.org/projects/flink/flink-docs-release-1.3/setup/aws.html#flink-for-hadoop-27.
I doubt if this
Github user bowenli86 commented on the issue:
https://github.com/apache/flink/pull/4136
@zentol @alpinegizmo Guys, please let me know your thoughts :)
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does
201 - 300 of 498 matches
Mail list logo
