Hi Leo,
I think run job with external jars is important too.
Have you took a look to PipelineOptions.JARS in configuration?
I think this is a way to set external jars. And SQL-CLI need it too.
Best,
Jingsong Lee
On Wed, Dec 11, 2019 at 9:18 AM 50man wrote:
> Hi everyone,
>
>
> I propose an
Thanks Yu & Gary for your great work.
1.10 is a very important version for batch sql (also streaming sql).
It enables many features to be put into production.
Looking forward to the 1.10 release.
Let's "beat" it by tests.
Best,
Jingsong Lee
On Wed, Dec 11, 2019 at 2:55 PM Wei Zhong wrote:
>
Bowen Li created FLINK-15192:
Summary: consider split 'SQL' page into multiple sub pages for
better clarity
Key: FLINK-15192
URL: https://issues.apache.org/jira/browse/FLINK-15192
Project: Flink
Jark Wu created FLINK-15191:
---
Summary: Fix can't create table source for Kafka if watermark or
computed column is defined
Key: FLINK-15191
URL: https://issues.apache.org/jira/browse/FLINK-15191
Project:
Hi Yu & Gary,
Great work! Looking forward to the 1.10 release. :)
Best,
Wei
> 在 2019年12月11日，14:20，Dian Fu 写道：
>
> Hi Yu & Gary,
>
> Thanks for your great work. Looking forward to the 1.10 release.
>
> Regards,
> Dian
>
>> 在 2019年12月11日，上午10:29，Danny Chan 写道：
>>
>> Hi Yu & Gary,
>>
>>
Hi Ouyang,
If you are focused on kubernetes standalone per-job cluster, i think you
could use the initContainer
to download user jars from remote storage and then copy them to flink
classpath. When the
JobManager and TaskManger container launched, they could use the jars
locally.
If you want to
Bowen Li created FLINK-15190:
Summary: add documentation for DDL in FLIP-69
Key: FLINK-15190
URL: https://issues.apache.org/jira/browse/FLINK-15190
Project: Flink
Issue Type: Task
Bowen Li created FLINK-15189:
Summary: add documentation for catalog view and hive view
Key: FLINK-15189
URL: https://issues.apache.org/jira/browse/FLINK-15189
Project: Flink
Issue Type: Task
Hi Yu & Gary,
Thanks for your great work. Looking forward to the 1.10 release.
Regards,
Dian
> 在 2019年12月11日，上午10:29，Danny Chan 写道：
>
> Hi Yu & Gary,
>
> Thanks for your nice job ~
>
> Best,
> Danny Chan
> 在 2019年11月19日 +0800 PM11:44，dev@flink.apache.org，写道：
>>
>> Hi Yu & Gary,
>>
>>
Bowen Li created FLINK-15188:
Summary: add builder for catalog objects
Key: FLINK-15188
URL: https://issues.apache.org/jira/browse/FLINK-15188
Project: Flink
Issue Type: Task
zhijiang created FLINK-15187:
Summary: Reuse LocalBufferPool for FileBufferReader in blocking
partition
Key: FLINK-15187
URL: https://issues.apache.org/jira/browse/FLINK-15187
Project: Flink
Rui Li created FLINK-15186:
--
Summary: Column names and nullability mismatch when querying
CatalogViews
Key: FLINK-15186
URL: https://issues.apache.org/jira/browse/FLINK-15186
Project: Flink
Issue
Jingsong Lee created FLINK-15185:
Summary: Hive sink can not run in standalone mode
Key: FLINK-15185
URL: https://issues.apache.org/jira/browse/FLINK-15185
Project: Flink
Issue Type: Bug
Bowen Li created FLINK-15184:
Summary: write guest post for Flink-Hive integration for AWS and
Cloudera
Key: FLINK-15184
URL: https://issues.apache.org/jira/browse/FLINK-15184
Project: Flink
Thanks, Yangtze.
+1 for building the image locally.
The time consumption for both building image locally and pulling it from
DockerHub sounds reasonable and affordable. Therefore, I'm also in favor of
avoiding the cost maintaining a custom image.
Thank you~
Xintong Song
On Wed, Dec 11, 2019
Jingsong Lee created FLINK-15183:
Summary: Use SQL-CLI to TPC-DS E2E test
Key: FLINK-15183
URL: https://issues.apache.org/jira/browse/FLINK-15183
Project: Flink
Issue Type: Test
Hi everyone,
I'm happy to announce that we have unanimously approved this release.
There are 10 approving votes, 3 of which are binding:
* Jincheng (binding)
* Ufuk (binding)
* Till (binding)
* Jingsong
* Fabian
* Danny
* Yang Wang
* Dian
* Wei
* Hequn
There are no disapproving votes.
Thanks
Hi Yu & Gary,
Thanks for your nice job ~
Best,
Danny Chan
在 2019年11月19日 +0800 PM11:44，dev@flink.apache.org，写道：
>
> Hi Yu & Gary,
>
> Thanks a lot for your work and looking forward to the 1.10 release. :)
+1 (non-binding)
- verified signatures and checksums
- built from sources with Scala 2.11 and Scala 2.12
- ran examples on a yarn cluster in attached mode and detached mode
> 在 2019年12月11日，10:20，Hequn Cheng 写道：
>
> +1 (non-binding)
>
> - check release note
> - check signatures and hashes
> -
ShenDa created FLINK-15182:
--
Summary: Add FileTableSink based on StreamingFileSink
Key: FLINK-15182
URL: https://issues.apache.org/jira/browse/FLINK-15182
Project: Flink
Issue Type: Improvement
+1 (non-binding)
- check release note
- check signatures and hashes
- run e2e test on Travis
- built from source, without Hadoop and using Scala 2.11,2.12
- checked that all POM files point to the same version
- ran examples on a standalone cluster.
Best,
Hequn
On Wed, Dec 11, 2019 at 10:02 AM
Thanks for the feedback, Yang.
Some updates I want to share in this thread.
I have built a PoC version of Meos e2e test with WordCount
workflow.[1] Then, I ran it in the testing environment. As the result
shown here[2]:
- For pulling image from DockerHub, it took 1 minute and 21 seconds
- For
+1 (non-binding)
- verified signatures and checksums
- build from source without tests with Scala 2.11 and Scala 2.12
- start standalone cluster and web ui is accessible
- submit word count example of both batch and stream, there is no suspicious
log output
- run a couple of tests in IDE
-
Hi everyone,
I propose an important API feature to register user jar files in
{Stream}ExecutionEnvironment.
The proposal is here,
https://issues.apache.org/jira/browse/FLINK-14319
Let's discuss it and I hope we can acquire a consent ASAP cause this
feature is potentially helpful for some
Mans Singh created FLINK-15181:
--
Summary: Minor doc correction
Key: FLINK-15181
URL: https://issues.apache.org/jira/browse/FLINK-15181
Project: Flink
Issue Type: Improvement
+1 to drop vendor related docs. Links to vendors’ webpages should be enough
On Tue, Dec 10, 2019 at 08:15 Seth Wiesman wrote:
> @uce Agreed. The discussion here seems to have died down. Since I assume
> most people following this thread have gone home for the day, I'll leave
> this for one more
Patrick Fletcher created FLINK-15180:
Summary: Docs say to use Kinesis profile which no longer exists
Key: FLINK-15180
URL: https://issues.apache.org/jira/browse/FLINK-15180
Project: Flink
Thanks a lot Seth!
I propose to merge this PR if there's no more feedback within the next 24
hours.
On Mon, Dec 9, 2019 at 6:41 PM Seth Wiesman wrote:
> Hi All!
>
> A while back, Marta opened a PR to create a documentation style guide as
> part of FLIP-42[1][2]. Unfortunately, the review
Hi folks,
Thanks for the discussion, great feedback. Also thanks Dawid for the
explanation, it is much clearer now.
One thing that is indeed missing from the FLIP is how the boundedness is
passed to the Source implementation. So the API should be
Source#createEnumerator(Boundedness boundedness,
@uce Agreed. The discussion here seems to have died down. Since I assume
most people following this thread have gone home for the day, I'll leave
this for one more day and then remove the pages tomorrow.
Seth
On Tue, Dec 10, 2019 at 9:38 AM Ufuk Celebi wrote:
> Answers inline...
>
> On Thu,
Answers inline...
On Thu, Dec 5, 2019 at 6:28 PM Seth Wiesman wrote:
> One option would be to do exactly that, but then I feel like we are
> committing to tracking changes on those systems and I just don't know how
> feasible that is.
>
I don't think that's feasible. It's bound to get out of
Hi everyone,
+1 (binding)
- verified that e2e tests pass on Travis
- verified checksums and signatures
- built Flink from sources with Scala 2.12
- ran examples on standalone cluster
Cheers,
Till
On Tue, Dec 10, 2019 at 12:23 PM Yang Wang wrote:
> Hi Hequn,
>
> +1 (non-binding)
>
> -
+1 (binding)
* verified checksums and hashes
* ran stateful example job in Kubernetes environment
* build (custom) Docker image from sources for Scala 2.11, 2.12
* used jackson new 2.10.1 profile and verified that the jackson databind
version is updated
* verified versions match 1.8.3 in pom.xml
Kostas Kloudas created FLINK-15179:
--
Summary: Kubernetes should not have a CustomCommandLine.
Key: FLINK-15179
URL: https://issues.apache.org/jira/browse/FLINK-15179
Project: Flink
Issue
Zhu Zhu created FLINK-15178:
---
Summary: Task crash due to mmap allocation failure for BLOCKING
shuffle
Key: FLINK-15178
URL: https://issues.apache.org/jira/browse/FLINK-15178
Project: Flink
Issue
Stephan Ewen created FLINK-15177:
Summary: Migrate RocksDB Configurable Options to new type safe
config options
Key: FLINK-15177
URL: https://issues.apache.org/jira/browse/FLINK-15177
Project: Flink
ouyangwulin created FLINK-15176:
---
Summary: Add '--job-classname' to flink-container
'job-cluster-job.yaml.template'
Key: FLINK-15176
URL: https://issues.apache.org/jira/browse/FLINK-15176
Project:
Hi Hequn,
+1 (non-binding)
- verified checksums and hashes
- built from sources (Scala 2.11 and Scala 2.12)
- running flink per-job/session cluster on Yarn with more that 1000
containers, good
Danny Chan 于2019年12月10日周二 上午9:39写道：
> Hi Hequn,
>
> +1 (non-binding)
>
> - verified checksums and
liupengcheng created FLINK-15175:
Summary: syntax not supported in SQLClient for TPCDS queries
Key: FLINK-15175
URL: https://issues.apache.org/jira/browse/FLINK-15175
Project: Flink
Issue
Bhagavan created FLINK-15174:
Summary: FLINK security using PKI mutual auth needs certificate
pinning or Private CA
Key: FLINK-15174
URL: https://issues.apache.org/jira/browse/FLINK-15174
Project: Flink
xiaodao created FLINK-15173:
---
Summary: perjob on yarn appcluster shutdown depend on CliFrontend
Key: FLINK-15173
URL: https://issues.apache.org/jira/browse/FLINK-15173
Project: Flink
Issue Type:
Hi everyone,
thanks for drafting this FLIP. It reads very well.
Concerning Dawid's proposal, I tend to agree. The boundedness could come
from the source and tell the system how to treat the operator (scheduling
wise). From a user's perspective it should be fine to get back a DataStream
when
Jingsong Lee created FLINK-15172:
Summary: optimize the operator algorithm to lazily allocate memory
Key: FLINK-15172
URL: https://issues.apache.org/jira/browse/FLINK-15172
Project: Flink
Piotr Nowojski created FLINK-15171:
--
Summary: Performance regression in serialisation benchmarks
Key: FLINK-15171
URL: https://issues.apache.org/jira/browse/FLINK-15171
Project: Flink
Issue
Dawid Wysakowicz created FLINK-15170:
Summary: WebFrontendITCase.testCancelYarn fails on travis
Key: FLINK-15170
URL: https://issues.apache.org/jira/browse/FLINK-15170
Project: Flink
45 matches
Mail list logo
