[jira] [Commented] (FLINK-24937) "kubernetes application HA test" hangs on azure

2021-11-17 Thread Yang Wang (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445107#comment-17445107
 ] 

Yang Wang commented on FLINK-24937:
---

I think the root cause is that building the image failed without retrying and 
had a zero return code. Currently, the {{build_image}} function in 
{{common_docker.sh}} does not handle the return code correctly.

 

https://github.com/apache/flink/blob/master/flink-end-to-end-tests/test-scripts/common_docker.sh#L36

 
{code:java}
2021-11-17T02:14:36.0714817Z Nov 17 02:14:36  ---> Running in e99d4d069cea
2021-11-17T02:14:36.1943135Z Nov 17 02:14:36 + dpkg --print-architecture
2021-11-17T02:14:36.1989940Z Nov 17 02:14:36 + wget -nv -O 
/usr/local/bin/gosu 
https://github.com/tianon/gosu/releases/download/1.11/gosu-amd64
2021-11-17T02:14:36.8405227Z Nov 17 02:14:36 
https://objects.githubusercontent.com/github-production-release-asset-2e65be/19708981/82e9dd00-d091-11e8-8734-a1caffcee352?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F2027%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=2027T021304Z&X-Amz-Expires=300&X-Amz-Signature=d60d553d399e9738cfd987bdc7877eae11a3a16e654c9462e31bc3c10b54e73d&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=19708981&response-content-disposition=attachment%3B%20filename%3Dgosu-amd64&response-content-type=application%2Foctet-stream:
2021-11-17T02:14:36.8408478Z Nov 17 02:14:36 2021-11-17 02:14:36 ERROR 503: 
Egress is over the account limit..
2021-11-17T02:14:36.8798098Z The command '/bin/sh -c set -ex;   wget -nv -O 
/usr/local/bin/gosu 
"https://github.com/tianon/gosu/releases/download/$GOSU_VERSION/gosu-$(dpkg 
--print-architecture)";   wget -nv -O /usr/local/bin/gosu.asc 
"https://github.com/tianon/gosu/releases/download/$GOSU_VERSION/gosu-$(dpkg 
--print-architecture).asc";   export GNUPGHOME="$(mktemp -d)";   for server in 
ha.pool.sks-keyservers.net $(shuf -e   
hkp://p80.pool.sks-keyservers.net:80   
keyserver.ubuntu.com   hkp://keyserver.ubuntu.com:80
   pgp.mit.edu) ; do   gpg --batch --keyserver 
"$server" --recv-keys B42F6819007F00F88E364FD4036A9C25BF357DD4 && break || : ;  
 done &&   gpg --batch --verify /usr/local/bin/gosu.asc /usr/local/bin/gosu;   
gpgconf --kill all;   rm -rf "$GNUPGHOME" /usr/local/bin/gosu.asc;   chmod +x 
/usr/local/bin/gosu;   gosu nobody true' returned a non-zero code: 8 {code}

> "kubernetes application HA test" hangs on azure
> ---
>
> Key: FLINK-24937
> URL: https://issues.apache.org/jira/browse/FLINK-24937
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.14.1
>Reporter: Yun Gao
>Priority: Major
>  Labels: test-stability
>
> {code:java}
> 2021-11-17T02:15:23.4319085Z Nov 17 02:15:23 ##[endgroup]
> 2021-11-17T02:15:23.4319779Z Nov 17 02:15:23 Searching for .dump, .dumpstream 
> and related files in '/home/vsts/work/1/s'
> 2021-11-17T02:15:24.7906640Z dmesg: read kernel buffer failed: Operation not 
> permitted
> 2021-11-17T02:15:25.1156830Z Nov 17 02:15:25 No taskexecutor daemon to stop 
> on host fv-az123-364.
> 2021-11-17T02:15:25.3229454Z Nov 17 02:15:25 No standalonesession daemon to 
> stop on host fv-az123-364.
> 2021-11-17T06:09:57.2488148Z 
> ==
> 2021-11-17T06:09:57.2489380Z === WARNING: This task took already 95% of the 
> available time budget of 281 minutes ===
> 2021-11-17T06:09:57.2490646Z 
> ==
>  {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26628&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=2562



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot commented on pull request #17820: [FLINK-24931][flink-scala] Remove deprecated/unused class files in flink-scala module.

2021-11-17 Thread GitBox


flinkbot commented on pull request #17820:
URL: https://github.com/apache/flink/pull/17820#issuecomment-971490716


   
   ## CI report:
   
   * c6b5780096468663e8b40c0112bcc50709c2adf5 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-24940) Docs about create Hive catalog via SQL CLI is out of date

2021-11-17 Thread luoyuxia (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

luoyuxia updated FLINK-24940:
-
Component/s: Connectors / Hive
 Documentation

> Docs about create Hive catalog via SQL CLI is out of date
> -
>
> Key: FLINK-24940
> URL: https://issues.apache.org/jira/browse/FLINK-24940
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / Hive, Documentation
>Reporter: luoyuxia
>Priority: Major
>
> As it's not supported to use yaml in SQL CLI, the documatation about how to 
> create hive catalog in SQL CLI is out of date.
> [https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/table/hive/hive_catalog/#step-2-configure-flink-cluster-and-sql-cli]
> To avoid misleading users, we need to upadte the docs.
>  
> I would like to update the document.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (FLINK-24940) Docs about create Hive catalog via SQL CLI is out of date

2021-11-17 Thread luoyuxia (Jira)
luoyuxia created FLINK-24940:


 Summary: Docs about create Hive catalog via SQL CLI is out of date
 Key: FLINK-24940
 URL: https://issues.apache.org/jira/browse/FLINK-24940
 Project: Flink
  Issue Type: Improvement
Reporter: luoyuxia


As it's not supported to use yaml in SQL CLI, the documatation about how to 
create hive catalog in SQL CLI is out of date.

[https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/connectors/table/hive/hive_catalog/#step-2-configure-flink-cluster-and-sql-cli]

To avoid misleading users, we need to upadte the docs.

 

I would like to update the document.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-24931) Remove deprecated/unused class files in flink-scala module.

2021-11-17 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated FLINK-24931:
---
Labels: pull-request-available  (was: )

> Remove deprecated/unused class files in flink-scala module.
> ---
>
> Key: FLINK-24931
> URL: https://issues.apache.org/jira/browse/FLINK-24931
> Project: Flink
>  Issue Type: Improvement
>  Components: API / Scala
>Reporter: Yuepeng Pan
>Priority: Minor
>  Labels: pull-request-available
>
> Remove deprecated/unused class files in flink-scala module. 
> org.apache.flink.api.scala.typeutils.ScalaOptionSerializerConfigSnapshot
> org.apache.flink.api.scala.typeutils.ScalaTrySerializerConfigSnapshot
> org.apache.flink.api.scala.typeutils.TraversableSerializerConfigSnapshot
>  
> These class files were tagged with 'Deprecated' in beginning of the year 2019.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] RocMarshal opened a new pull request #17820: [FLINK-24931][flink-scala] Remove deprecated/unused class files in flink-scala module.

2021-11-17 Thread GitBox


RocMarshal opened a new pull request #17820:
URL: https://github.com/apache/flink/pull/17820


   
   
   
   ## What is the purpose of the change
   
   Remove deprecated/unused class files in flink-scala module.
   
   ## Brief change log
   
   org.apache.flink.api.scala.typeutils.ScalaOptionSerializerConfigSnapshot
   org.apache.flink.api.scala.typeutils.ScalaTrySerializerConfigSnapshot
   org.apache.flink.api.scala.typeutils.TraversableSerializerConfigSnapshot
   

   These class files were tagged with 'Deprecated' in beginning of the year 
2019 and were not referenced by other class files.
   
   
   ## Verifying this change
   
   
   This change is a trivial rework / code cleanup without any test coverage.
   
   
   
   ## Does this pull request potentially affect one of the following parts:
   
 - Dependencies (does it add or upgrade a dependency): (yes / **no**)
 - The public API, i.e., is any changed class annotated with 
`@Public(Evolving)`: (yes / **no**)
 - The serializers: (yes / **no** / don't know)
 - The runtime per-record code paths (performance sensitive): (yes / **no** 
/ don't know)
 - Anything that affects deployment or recovery: JobManager (and its 
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't 
know)
 - The S3 file system connector: (yes / no / don't know)
   
   ## Documentation
   
 - Does this pull request introduce a new feature? (yes / **no**)
 - If yes, how is the feature documented? (**not applicable** / docs / 
JavaDocs / not documented)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26656)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26656)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (FLINK-24851) KafkaSourceBuilder: auto.offset.reset is ignored

2021-11-17 Thread liwei li (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445105#comment-17445105
 ] 

liwei li commented on FLINK-24851:
--

Then, I will revise the PR according to the opinions of both of above. After it 
is finished, please help to review the code, thank you.

> KafkaSourceBuilder: auto.offset.reset is ignored
> 
>
> Key: FLINK-24851
> URL: https://issues.apache.org/jira/browse/FLINK-24851
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Kafka
>Affects Versions: 1.14.0
>Reporter: Arseniy Tashoyan
>Assignee: liwei li
>Priority: Major
>  Labels: pull-request-available
>
> Creating KafkaSource like this:
> {code:scala}
> val props = new Properties()
> props.put("bootstrap.servers", "localhost:9092")
> props.put("group.id", "group1")
> props.put("auto.offset.reset", "latest")
> val kafkaSource = KafkaSource.builder[String]()
>   .setProperties(props)
>   .build()
> {code}
> The actually used value for _"auto.offset.reset"_ is *"earliest"* instead of 
> configured *"latest"*.
> This occurs because _"auto.offset.reset"_ gets overridden by 
> _startingOffsetsInitializer.getAutoOffsetResetStrategy().name().toLowerCase()_.
>  The default value for _startingOffsetsInitializer_ is _"earliest"_.
> This behavior is misleading.
> This behavior imposes an inconvenience on configuring the Kafka connector. We 
> cannot use the Kafka setting _"auto.offset.reset"_ as-is. Instead we must 
> extract this particular setting from other settings and propagate to 
> _KafkaSourceBuilder.setStartingOffsets()_:
> {code:scala}
> val kafkaSource = KafkaSource.builder[String]()
>   .setProperties(props)
>   .setStartingOffsets(
> OffsetsInitializer.committedOffsets(
>   OffsetResetStrategy.valueOf(
> props.get(ConsumerConfig.AUTO_OFFSET_RESET_CONFIG)
>   .asInstanceOf[String]
>   .toUpperCase(Locale.ROOT)
>   )
> )
>   )
>   .build()
> {code}
> The expected behavior is to use the value of _"auto.offset.reset"_ provided 
> by _KafkaSourceBuilder.setProperties()_ - unless overridden via 
> _KafkaSourceBuilder. setStartingOffsets()_.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17815: [FLINK-22702][tests] Add test data supplier which provide null timestamp field to kafka connector tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17815:
URL: https://github.com/apache/flink/pull/17815#issuecomment-971312244


   
   ## CI report:
   
   * c654feccc34582ec2f2c6c22513c7a67bcd3de65 Azure: 
[CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26639)
 
   * 167488b16e036f8e3db30e4758d5ba14e2fea337 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26648)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17537: [FLINK-19722][table-planner]Pushdown Watermark to SourceProvider (new Source)

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17537:
URL: https://github.com/apache/flink/pull/17537#issuecomment-948566240


   
   ## CI report:
   
   * 218b458b34cb587f0f9c75d951539638e6c4ca6c Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26640)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-24939) Support 'SHOW CREATE CATALOG' syntax

2021-11-17 Thread Yubin Li (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yubin Li updated FLINK-24939:
-
Description: 
SHOW CREATE CATALOG ;

 

`Catalog` is playing a more import role in flink, it would be great to get 
existing catalog detail information

  was:
SHOW CREATE CATALOG ;

 

`Catalog` is playing a more import role in flink, it would be great to get 
existing catalogdetail  information


> Support 'SHOW CREATE CATALOG' syntax
> 
>
> Key: FLINK-24939
> URL: https://issues.apache.org/jira/browse/FLINK-24939
> Project: Flink
>  Issue Type: Improvement
>Affects Versions: 1.14.0
>Reporter: Yubin Li
>Priority: Major
>
> SHOW CREATE CATALOG ;
>  
> `Catalog` is playing a more import role in flink, it would be great to get 
> existing catalog detail information



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-24939) Support 'SHOW CREATE CATALOG' syntax

2021-11-17 Thread Yubin Li (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yubin Li updated FLINK-24939:
-
Description: 
SHOW CREATE CATALOG ;

 

`Catalog` is playing a more import role in flink, it would be great to get 
existing catalogdetail  information

  was:
SHOW CREATE CATALOG ;

 

`Catalog` is playing a more import role in flink, it would be greate to get 
existing catalogdetail  information


> Support 'SHOW CREATE CATALOG' syntax
> 
>
> Key: FLINK-24939
> URL: https://issues.apache.org/jira/browse/FLINK-24939
> Project: Flink
>  Issue Type: Improvement
>Affects Versions: 1.14.0
>Reporter: Yubin Li
>Priority: Major
>
> SHOW CREATE CATALOG ;
>  
> `Catalog` is playing a more import role in flink, it would be great to get 
> existing catalogdetail  information



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Created] (FLINK-24939) Support 'SHOW CREATE CATALOG' syntax

2021-11-17 Thread Yubin Li (Jira)
Yubin Li created FLINK-24939:


 Summary: Support 'SHOW CREATE CATALOG' syntax
 Key: FLINK-24939
 URL: https://issues.apache.org/jira/browse/FLINK-24939
 Project: Flink
  Issue Type: Improvement
Affects Versions: 1.14.0
Reporter: Yubin Li


SHOW CREATE CATALOG ;

 

`Catalog` is playing a more import role in flink, it would be greate to get 
existing catalogdetail  information



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17774: [FLINK-24611] Prevent JM from discarding state on checkpoint abortion

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17774:
URL: https://github.com/apache/flink/pull/17774#issuecomment-966933536


   
   ## CI report:
   
   * 825a694250c558dacb5751a12e53f83af018c739 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26632)
 
   * 6731722ca4886ba8c584d541219a7d6b980b3028 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26655)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17774: [FLINK-24611] Prevent JM from discarding state on checkpoint abortion

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17774:
URL: https://github.com/apache/flink/pull/17774#issuecomment-966933536


   
   ## CI report:
   
   * 825a694250c558dacb5751a12e53f83af018c739 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26632)
 
   * 6731722ca4886ba8c584d541219a7d6b980b3028 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-21001) Flink job is blocked while using tableEnvironment with tableFunction and join

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-21001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-21001:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Flink job is blocked while using tableEnvironment with tableFunction and join
> -
>
> Key: FLINK-21001
> URL: https://issues.apache.org/jira/browse/FLINK-21001
> Project: Flink
>  Issue Type: Bug
>  Components: Table SQL / API
>Affects Versions: 1.11.2
> Environment: flink-11.2
>Reporter: Wu
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
> Attachments: client_log.txt
>
>
> The code is as follow.
> {code:java}
> //代码占位符
> package com.oppo.recdata.datapipe;
> import com.oppo.recdata.datapipe.flink.transform.ExplodeDataTypeEnum;
> import com.oppo.recdata.datapipe.flink.transform.ExplodeModify;
> import com.oppo.recdata.datapipe.flink.transform.TableExplode;
> import 
> com.oppo.recdata.datapipe.flink.transform.function.CollectMapAggregateFunction;
> import org.apache.flink.table.api.*;
> import static org.apache.flink.table.api.Expressions.row;
> /**
>  * @author wujianz...@oppo.com
>  */
> public class BatchTable {
> public static void main(String[] args) {
> EnvironmentSettings settings = 
> EnvironmentSettings.newInstance().useBlinkPlanner().inBatchMode().build();
> TableEnvironment tableEnv = TableEnvironment.create(settings);
> ExplodeModify modify = new ExplodeModify(ExplodeDataTypeEnum.string, 
> null, "&");
> tableEnv.createTemporarySystemFunction("explode", new 
> TableExplode(modify));
> tableEnv.createFunction("collect_map", 
> CollectMapAggregateFunction.class);
> Table table = tableEnv.fromValues(
> DataTypes.ROW(
> DataTypes.FIELD("buuid", DataTypes.STRING()),
> DataTypes.FIELD("docType", DataTypes.INT()),
> DataTypes.FIELD("viewTime", DataTypes.INT()),
> DataTypes.FIELD("subCategory", DataTypes.STRING())
> ),
> row("John", "1", "36", "NBA&football")
> );
> tableEnv.createTemporaryView("feeds_expose_click_profile", table);
> Table add_profile = tableEnv.sqlQuery("select buuid, cast(docType as 
> varchar) as docType, viewTime, subCategory from feeds_expose_click_profile 
> where buuid is not null and docType is not null and viewTime > 0");
> tableEnv.createTemporaryView("add_profile", add_profile);
> Table cate2Click = tableEnv.sqlQuery("select buuid, docType, 
> viewTime, cate2 from add_profile, LATERAL TABLE(explode(subCategory)) as 
> t(cate2) where subCategory is not null");
> tableEnv.createTemporaryView("cate2_click", cate2Click);
> Table cate2_detail = tableEnv.sqlQuery("select cate2, sum(viewTime) 
> as viewTimeSum, buuid, docType from cate2_click GROUP BY buuid, cate2, 
> docType");
> tableEnv.createTemporaryView("user_cate2_detail", cate2_detail);
> Table user_global_cate2 = tableEnv.sqlQuery("select 
> 'gcate2_24h_click_sumtime' as fieldName, sum(viewTime) as fieldValue,  buuid 
> as keyName, docType from cate2_click group by buuid, docType");
> tableEnv.createTemporaryView("user_global_cate2", user_global_cate2);
> Table global_user_cate2 = tableEnv.sqlQuery("select cate2 as 
> fieldName, sum(viewTime) as fieldValue, 'guser_cate2_24h_click_sumtime' as 
> keyName, docType from cate2_click group by cate2, docType ");
> tableEnv.createTemporaryView("global_user_cate2",global_user_cate2);
> Table global_user_global_cate2 = tableEnv.sqlQuery("select 
> 'guser_gcate2_24h_click_sumtime' as fieldName, sum(viewTime) as fieldValue, 
> 'global_feature' as keyName, docType from cate2_click group by docType");
> tableEnv.createTemporaryView("global_user_global_cate2", 
> global_user_global_cate2);
> Table cate2_cs_detail = tableEnv.sqlQuery("select a.cate2 as 
> fieldName, (a.viewTimeSum + 0.2) / (b.fieldValue * c.fieldValue / 
> d.fieldValue + 0.2) as fieldValue, a.buuid as keyName, a.docType from 
> user_cate2_detail a join user_global_cate2 b on a.buuid = b.keyName and 
> a.docType = b.docType join global_user_cate2 c on a.cate2 = c.fieldName and 
> a.docType = c.docType join global_u

[jira] [Updated] (FLINK-16679) Investigate more efficient outer join plans

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16679:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Investigate more efficient outer join plans
> ---
>
> Key: FLINK-16679
> URL: https://issues.apache.org/jira/browse/FLINK-16679
> Project: Flink
>  Issue Type: Improvement
>  Components: Table SQL / Planner
>Reporter: Timo Walther
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> FLINK-16344 avoids errors due to incompatible types during planning by 
> preserving the nullability attributes of nested types. It added an additional 
> check for {{rt.getStructKind == StructKind.PEEK_FIELDS_NO_EXPAND}} to only 
> cover nested rows. Not top-level rows. But it seems that a couple of 
> execution plans would look nicer if the nullability property is preserved for 
> top-level rows as well. However, a lot of join tests fail we should 
> investigate this issue if we would like to have more efficient execution 
> plans.
> The comment in {{RelDataTypeFactoryImpl#createTypeWithNullability}} says:
> {code}
> According to the SQL standard, nullability for struct types can be defined 
> only for columns, which translates to top level structs. Nested struct 
> attributes are always nullable, so in principle we could always set the 
> nested attributes to be nullable.
> {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-11864) Let compressed channel reader/writer reuse the logic of AsynchronousFileIOChannel

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-11864:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Let compressed channel reader/writer reuse the logic of 
> AsynchronousFileIOChannel
> -
>
> Key: FLINK-11864
> URL: https://issues.apache.org/jira/browse/FLINK-11864
> Project: Flink
>  Issue Type: Improvement
>  Components: Table SQL / Runtime
>Reporter: Kurt Young
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> This is a follow up issue of 
> [Flink-11863|https://issues.apache.org/jira/browse/FLINK-11863]. The 
> introduced `CompressedBlockChannelReader` and `CompressedBlockChannelWriter` 
> should reuse the logic of `AsynchronousFileIOChannel` by extending from it. 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-24135) Add support for metric group tags in StatsDReporter

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-24135:
---
  Labels: Metrics auto-deprioritized-major  (was: Metrics stale-major)
Priority: Minor  (was: Major)

This issue was labeled "stale-major" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Major, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Add support for metric group tags in StatsDReporter
> ---
>
> Key: FLINK-24135
> URL: https://issues.apache.org/jira/browse/FLINK-24135
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Metrics
>Reporter: Prakhar Mathur
>Priority: Minor
>  Labels: Metrics, auto-deprioritized-major
>
> The current StatsDReporter in Flink does not support adding tags via Metric 
> Group, which is currently being followed in Influx and Datadog reporter. 
> Support for blacklisting tags and metrics will also be added as part of this 
> in order to filter out metrics/tags which are not required by the user.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-21803) Tumbling / Sliding windows are unaware of daylight savings time

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-21803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-21803:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Tumbling / Sliding windows are unaware of daylight savings time
> ---
>
> Key: FLINK-21803
> URL: https://issues.apache.org/jira/browse/FLINK-21803
> Project: Flink
>  Issue Type: Improvement
>  Components: API / DataStream
>Affects Versions: 1.12.2
>Reporter: Craig Smoothey
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> It is currently possible to specify an "offset" for tumbling / sliding 
> windows. The offset is however immutable. This creates a problem for 
> aggregations that have to be performed in a timezone which utilises daylight 
> savings time for half of the year. For example. If one is aggregating data by 
> day in the New York time zone, then for half of the year, the offset is 5 
> hours (relative UTC) and for the other half of the year, the offset is 4 
> hours (relative UTC). There is no way to construct tumbling / sliding windows 
> to specify daylight savings time behaviour. It would be helpful if there was 
> a constructor for tumbling / sliding windows to specify the timezone that the 
> aggregation must be performed in (default = UTC). The tumbling / sliding 
> window would then be required to automatically change the offset depending on 
> whether daylight savings time is active or not for the specified time zone. 
> My application is using the DataStream API.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-20743) Print ContainerId For RemoteTransportException

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-20743:
---
Labels: auto-unassigned stale-minor  (was: auto-unassigned)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Print ContainerId For RemoteTransportException
> --
>
> Key: FLINK-20743
> URL: https://issues.apache.org/jira/browse/FLINK-20743
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Network
>Affects Versions: 1.10.0, 1.11.1, 1.12.1
>Reporter: yang gang
>Priority: Minor
>  Labels: auto-unassigned, stale-minor
> Attachments: image-2020-12-23-15-13-21-226.png
>
>
> !image-2020-12-23-15-13-21-226.png|width=970,height=291!
>  RemoteTransportException, this exception reminds the user which service has 
> a problem by means of Ip/Port.
>  When we troubleshoot the problem, the information is not accurate enough. 
> Usually at this time we need to look at the running log of the container that 
> has the problem, but when we see this log, it also shows that the container 
> has died, so pass Ip/ The port method can no longer quickly locate a specific 
> container.
>  So I hope that when such an exception occurs, I hope to print the 
> containerId。
> E.g:
>  Connection unexpectedly closed by remote task manager 
> 'hostName/ip:port/containerId'. This might indicate that the remote task 
> manager was lost.
>   
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-11906) Getting error while submitting job

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-11906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-11906:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Getting error while submitting job 
> ---
>
> Key: FLINK-11906
> URL: https://issues.apache.org/jira/browse/FLINK-11906
> Project: Flink
>  Issue Type: Bug
>  Components: Command Line Client
>Affects Versions: 1.7.2
> Environment: Production
>Reporter: Ramesh Srinivasalu
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> Getting below error while submitting java program to flink runner. Any help 
> would be greatly appreciated.
>  
>  
> [INFO] --- exec-maven-plugin:1.4.0:java (default-cli) @ cap_scoring ---
> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
> SLF4J: Defaulting to no-operation (NOP) logger implementation
> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further 
> details.
> Submitting job with JobID: ae56656f79644d4c181395b9322d9dc0. Waiting for job 
> completion.
> [WARNING]
> java.lang.reflect.InvocationTargetException
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:293)
>  at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.RuntimeException: Pipeline execution failed
>  at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:121)
>  at org.apache.beam.sdk.Pipeline.run(Pipeline.java:297)
>  at org.apache.beam.sdk.Pipeline.run(Pipeline.java:283)
>  at 
> com.att.streams.tdata.cap_scoring.CapInjestAndScore.main(CapInjestAndScore.java:410)
>  ... 6 more
> Caused by: org.apache.flink.client.program.ProgramInvocationException: The 
> program execution failed: Couldn't retrieve the JobExecutionResult from the 
> JobManager.
>  at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:478)
>  at 
> org.apache.flink.client.program.StandaloneClusterClient.submitJob(StandaloneClusterClient.java:105)
>  at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:442)
>  at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:429)
>  at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:404)
>  at 
> org.apache.flink.client.RemoteExecutor.executePlanWithJars(RemoteExecutor.java:211)
>  at 
> org.apache.flink.client.RemoteExecutor.executePlan(RemoteExecutor.java:188)
>  at 
> org.apache.flink.api.java.RemoteEnvironment.execute(RemoteEnvironment.java:172)
>  at 
> org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.executePipeline(FlinkPipelineExecutionEnvironment.java:114)
>  at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:118)
>  ... 9 more
> Caused by: org.apache.flink.runtime.client.JobExecutionException: Couldn't 
> retrieve the JobExecutionResult from the JobManager.
>  at 
> org.apache.flink.runtime.client.JobClient.awaitJobResult(JobClient.java:309)
>  at 
> org.apache.flink.runtime.client.JobClient.submitJobAndWait(JobClient.java:396)
>  at org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:467)
>  ... 18 more
> Caused by: 
> org.apache.flink.runtime.client.JobClientActorConnectionTimeoutException: 
> Lost connection to the JobManager.
>  at 
> org.apache.flink.runtime.client.JobClientActor.handleMessage(JobClientActor.java:219)
>  at 
> org.apache.flink.runtime.akka.FlinkUntypedActor.handleLeaderSessionID(FlinkUntypedActor.java:101)
>  at 
> org.apache.flink.runtime.akka.FlinkUntypedActor.onReceive(FlinkUntypedActor.java:68)
>  at 
> akka.actor.UntypedActor$$anonfun$receive$1.applyOrElse(UntypedActor.scala:167)
>  at akka.actor.Actor$class.aroundReceive(Actor.scala:467)
>  at akka.actor.UntypedActor.aroundReceive(UntypedActor.scala:97)
>  at akka.actor.ActorCell.receiveMessage(ActorCell.scala:516)
>  at akka.actor.ActorCell.invoke(ActorCell.scala:487)
>  at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:238)
>  at akka.dispatch.Mailbox.run(Mailbox.scala:220)
>  at 

[jira] [Updated] (FLINK-20945) flink hive insert heap out of memory

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-20945:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> flink hive insert heap out of memory
> 
>
> Key: FLINK-20945
> URL: https://issues.apache.org/jira/browse/FLINK-20945
> Project: Flink
>  Issue Type: Improvement
>  Components: Table SQL / Ecosystem
> Environment: flink 1.12.0 
> hive-exec 2.3.5
>Reporter: Bruce GAO
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> when using flink sql to insert into hive from kafka, heap out of memory 
> occrus randomly.
> Hive table using year/month/day/hour as partition,  it seems the max heap 
> space needed is corresponded to active partition number(according to kafka 
> message disordered and delay). which means if partition number increases, the 
> heap space needed also increase, may cause the heap out of memory.
> when write record, is it possible to take the whole heap space usage into 
> account in checkBlockSizeReached, or some other method to avoid OOM?



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-21467) Document possible recommended usage of Bounded{One/Multi}Input.endInput and emphasize that they could be called multiple times

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-21467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-21467:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Document possible recommended usage of Bounded{One/Multi}Input.endInput and 
> emphasize that they could be called multiple times
> --
>
> Key: FLINK-21467
> URL: https://issues.apache.org/jira/browse/FLINK-21467
> Project: Flink
>  Issue Type: Improvement
>  Components: API / DataStream
>Affects Versions: 1.13.0
>Reporter: Kezhu Wang
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> It is too tempting to use these api, especially {{BoundedOneInput.endInput}}, 
> to commit final result before FLIP-147 delivered. And this will cause 
> re-commit after failover as [~gaoyunhaii] has pointed out in FLINK-21132.
> I have 
> [pointed|https://github.com/apache/iceberg/issues/2033#issuecomment-784153620]
>  this out in 
> [apache/iceberg#2033|https://github.com/apache/iceberg/issues/2033], please 
> correct me if I was wrong.
> cc [~aljoscha] [~pnowojski] [~roman_khachatryan]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-21205) Maybe remove Locality enum

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-21205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-21205:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Maybe remove Locality enum
> --
>
> Key: FLINK-21205
> URL: https://issues.apache.org/jira/browse/FLINK-21205
> Project: Flink
>  Issue Type: Improvement
>  Components: Runtime / Coordination
>Reporter: Chesnay Schepler
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> The {{Locality}} enum does appear to be used in any meaningful way; we could 
> think about removing it.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-20867) Support ship files from local/remote path to k8s pod

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-20867:
---
Labels: auto-deprioritized-major pull-requests-available stale-minor  (was: 
auto-deprioritized-major pull-requests-available)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Support ship files from local/remote path to k8s pod
> 
>
> Key: FLINK-20867
> URL: https://issues.apache.org/jira/browse/FLINK-20867
> Project: Flink
>  Issue Type: New Feature
>  Components: Deployment / Kubernetes
>Affects Versions: 1.12.0
>Reporter: Ruguo Yu
>Priority: Minor
>  Labels: auto-deprioritized-major, pull-requests-available, 
> stale-minor
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-20985) end the stream-job in docker container will remain some zombie processes in 1.11, these useless processes not be maked as zombie but still exist in 1.12

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-20985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-20985:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> end the stream-job in docker container will remain some zombie processes in 
> 1.11, these useless  processes not be maked as zombie but still exist in 1.12
> -
>
> Key: FLINK-20985
> URL: https://issues.apache.org/jira/browse/FLINK-20985
> Project: Flink
>  Issue Type: Improvement
>  Components: flink-docker
>Reporter: he jie
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> when i use pyflink in docker , end the stream-job will remain some process. 
> these process used for endpoint  and tmp python logs . In flink-1.11 ,these 
> process will be marked as zombie; in flink-1.12, these process wont be marked 
> but still exit 。



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-21083) Streaming write partitioned table needs to handle null partition value

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-21083:
---
Labels: auto-deprioritized-major stale-minor  (was: 
auto-deprioritized-major)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issues has been marked as 
Minor but is unassigned and neither itself nor its Sub-Tasks have been updated 
for 180 days. I have gone ahead and marked it "stale-minor". If this ticket is 
still Minor, please either assign yourself or give an update. Afterwards, 
please remove the label or in 7 days the issue will be deprioritized.


> Streaming write partitioned table needs to handle null partition value
> --
>
> Key: FLINK-21083
> URL: https://issues.apache.org/jira/browse/FLINK-21083
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / FileSystem, Connectors / Hive
>Reporter: Rui Li
>Priority: Minor
>  Labels: auto-deprioritized-major, stale-minor
>
> When user configs to extract time attribute from partition values, we need to 
> decide how to handle null partition values.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17813: [FLINK-24802][Table SQL/Planner] Improve cast ROW to STRING

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17813:
URL: https://github.com/apache/flink/pull/17813#issuecomment-970956527


   
   ## CI report:
   
   * c7e634de45cb1f4c024e196c1b4c0d1c37ee9021 Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26638)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-16784) Support KeyedBroadcastProcessFunction state bootstrapping.

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16784:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Support KeyedBroadcastProcessFunction state bootstrapping. 
> ---
>
> Key: FLINK-16784
> URL: https://issues.apache.org/jira/browse/FLINK-16784
> Project: Flink
>  Issue Type: Improvement
>  Components: API / State Processor
>Reporter: Seth Wiesman
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>




--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16792) flink-s3-fs-hadoop cannot access s3

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16792:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> flink-s3-fs-hadoop cannot access s3
> ---
>
> Key: FLINK-16792
> URL: https://issues.apache.org/jira/browse/FLINK-16792
> Project: Flink
>  Issue Type: Bug
>  Components: FileSystems
>Affects Versions: 1.10.0
>Reporter: yanxiaobin
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> When flink-s3-fs-hadoop-1.10.0.jar is placed in the lib directory of Flink 
> distribution and flink accesses aws s3, the following exception occurs:
>  
> Caused by: java.util.concurrent.ExecutionException: 
> java.lang.NoSuchMethodError: 
> org.apache.hadoop.util.SemaphoredDelegatingExecutor.(Lcom/google/common/util/concurrent/ListeningExecutorService;IZ)V
>  at java.util.concurrent.FutureTask.report(FutureTask.java:122) at 
> java.util.concurrent.FutureTask.get(FutureTask.java:192) at 
> org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:461)
>  at 
> org.apache.flink.streaming.api.operators.OperatorSnapshotFinalizer.(OperatorSnapshotFinalizer.java:53)
>  at 
> org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:1143)
>  ... 3 more Caused by: java.lang.NoSuchMethodError: 
> org.apache.hadoop.util.SemaphoredDelegatingExecutor.(Lcom/google/common/util/concurrent/ListeningExecutorService;IZ)V
>  at org.apache.hadoop.fs.s3a.S3AFileSystem.create(S3AFileSystem.java:769) at 
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1169) at 
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1149) at 
> org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1038) at 
> org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.create(HadoopFileSystem.java:141)
>  at 
> org.apache.flink.fs.s3hadoop.common.HadoopFileSystem.create(HadoopFileSystem.java:37)
>  at 
> org.apache.flink.core.fs.SafetyNetWrapperFileSystem.create(SafetyNetWrapperFileSystem.java:126)
>  at 
> org.apache.flink.core.fs.EntropyInjector.createEntropyAware(EntropyInjector.java:61)
>  at 
> org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.createStream(FsCheckpointStreamFactory.java:356)
>  at 
> org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.flush(FsCheckpointStreamFactory.java:234)
>  at 
> org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactory$FsCheckpointStateOutputStream.closeAndGetHandle(FsCheckpointStreamFactory.java:309)
>  at 
> org.apache.flink.runtime.state.DefaultOperatorStateBackendSnapshotStrategy$1.callInternal(DefaultOperatorStateBackendSnapshotStrategy.java:179)
>  at 
> org.apache.flink.runtime.state.DefaultOperatorStateBackendSnapshotStrategy$1.callInternal(DefaultOperatorStateBackendSnapshotStrategy.java:108)
>  at 
> org.apache.flink.runtime.state.AsyncSnapshotCallable.call(AsyncSnapshotCallable.java:75)
>  at java.util.concurrent.FutureTask.run(FutureTask.java:266) at 
> org.apache.flink.runtime.concurrent.FutureUtils.runIfNotDoneAndGet(FutureUtils.java:458)



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16729) Offer an out-of-the-box Set serializer

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16729:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Offer an out-of-the-box Set serializer
> --
>
> Key: FLINK-16729
> URL: https://issues.apache.org/jira/browse/FLINK-16729
> Project: Flink
>  Issue Type: New Feature
>  Components: API / Type Serialization System
>Affects Versions: 1.11.0
>Reporter: Nico Kruber
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Currently, Set types are serialized by Kryo by default, since Flink does not 
> come with an own SetSerializer (only one for maps). While the MapSerializer 
> can be easily adapted to cover sets instead, I think, this should be 
> available by default to get the maximum performance out of Flink (kryo is 
> slow!)
>  
> When this is added, however, we need to provide a migration path for old 
> state (or not use the new SetSerializer by default but offer to opt-in). This 
> may need further investigation as to whether it is possible to migrate from 
> kryo automatically and whether we can check potential changes to the 
> encapsulated entry class.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16846) Add python docker images

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16846:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Add python docker images
> 
>
> Key: FLINK-16846
> URL: https://issues.apache.org/jira/browse/FLINK-16846
> Project: Flink
>  Issue Type: Improvement
>  Components: API / Python, flink-docker
>Reporter: Ismaël Mejía
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> We do not include python currently in the docker images. This issue is to 
> include it or create derived python specific images.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16760) Support the yaml file submission for native Kubernetes integration

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16760:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Support the yaml file submission for native Kubernetes integration
> --
>
> Key: FLINK-16760
> URL: https://issues.apache.org/jira/browse/FLINK-16760
> Project: Flink
>  Issue Type: New Feature
>  Components: Deployment / Kubernetes, Deployment / Scripts
>Reporter: Yang Wang
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> Currently, the native K8s integration is friendly and convenient to the Flink 
> users, especially they have some experience of YARN deployment. The 
> submission command and process are very similar and could be integrated into 
> their existing deployer(i.e. job lifecycle management system).
> However, if you are a K8s user and prefer the K8s way to start the Flink 
> cluster(regarding it as a application). Then yaml way is more appropriate.
>  
> What's the difference between standalone on K8s[1] and this ticket?
>  # Dynamic resource allocation
>  # Do not need to create taskmanager deployment yaml. Since the taskmanagers 
> will be allocated by Flink ResourceManager dynamically on demand. The 
> configmap, jobmanager deployment, service still need to be created manually.
>  # Service account needs to be prepared beforehand[2].
>  # Some scripts(flink-console.sh, jobmanager.sh, etc.) needs to be updated to 
> use native K8s entrypoint 
> {{org.apache.flink.kubernetes.entrypoint.KubernetesSessionClusterEntrypoint}}
>  
> Do we have the alternative option?
> A possible way is using a K8s job(yaml file) to run the 
> {{kubernetes-session.sh}} to start the Flink cluster. This is just moving the 
> submission from local machine to K8s cluster.
>  
> [1]. 
> [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/kubernetes.html]
> [2]. 
> [https://ci.apache.org/projects/flink/flink-docs-master/ops/deployment/native_kubernetes.html#rbac]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16755) Savepoint docs should be updated

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16755:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Savepoint docs should be updated
> 
>
> Key: FLINK-16755
> URL: https://issues.apache.org/jira/browse/FLINK-16755
> Project: Flink
>  Issue Type: Improvement
>  Components: API / State Processor, Documentation
>Affects Versions: 1.10.0
>Reporter: Jiayi Liao
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> We should update this 
> [paragraph|https://ci.apache.org/projects/flink/flink-docs-stable/ops/state/savepoints.html#can-i-move-the-savepoint-files-on-stable-storage]
>  after state processor api. 
> cc [~sjwiesman]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16764) Allow custom Kafka topic discovery logic

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16764:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Allow custom Kafka topic discovery logic
> 
>
> Key: FLINK-16764
> URL: https://issues.apache.org/jira/browse/FLINK-16764
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / Kafka
>Affects Versions: 1.10.0
>Reporter: pine zhao
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
>  Flink Kafka Consumer is also capable of discovering topics, based on pattern 
> matching on the topic names using regular expressions。but i need customize 
> discovering strategy,now it's not work,so i have to download the source code 
> of  connectors and change them 。We need customize KafkaTopicsDescriptor



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-24534) Set async based transport for remote functions default

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-24534:
---
Labels: pull-request-available stale-assigned  (was: pull-request-available)

I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help 
the community manage its development. I see this issue is assigned but has not 
received an update in 30 days, so it has been labeled "stale-assigned".
If you are still working on the issue, please remove the label and add a 
comment updating the community on your progress.  If this issue is waiting on 
feedback, please consider this a reminder to the committer/reviewer. Flink is a 
very active project, and so we appreciate your patience.
If you are no longer working on the issue, please unassign yourself so someone 
else may work on it.


> Set async based transport for remote functions default 
> ---
>
> Key: FLINK-24534
> URL: https://issues.apache.org/jira/browse/FLINK-24534
> Project: Flink
>  Issue Type: Improvement
>  Components: Stateful Functions
>Reporter: Igal Shilman
>Assignee: Igal Shilman
>Priority: Major
>  Labels: pull-request-available, stale-assigned
>
> Currently, in an endpoint definition, if a transport field is not specified 
> we assume that the transport is the synchronous one 
> (io.statefun.transports.v1/okhttp), we should make the asynchronous transport 
> (io.statefun.transports.v1/async) to be the default one.
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16861) Adding delegation token to the AM container Failed

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16861:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> Adding delegation token to the AM container Failed
> --
>
> Key: FLINK-16861
> URL: https://issues.apache.org/jira/browse/FLINK-16861
> Project: Flink
>  Issue Type: Bug
>  Components: Connectors / Hive
>Affects Versions: 1.9.1, 1.10.0
>Reporter: Xianxun Ye
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> This EXP happended When I use hive connector with kerberos auth.
> Althrough modify the 'yarn-site.xml' yarn.resourcemanager.principal value to 
> the special principal, I can fix this. But I have to change this value every 
> times by modify yarn-site.xml file, when submit a hive conncetor job. This is 
> not very convenient for dev.
>  
> {code:java}
> //代码占位符
> 2020-03-06 22:58:01,778 INFO  
> org.apache.flink.yarn.AbstractYarnClusterDescriptor   - Adding 
> delegation token to the AM container..
> 2020-03-06 22:58:01,781 ERROR org.apache.flink.client.cli.CliFrontend 
>   - Error while running the command.
> org.apache.flink.client.deployment.ClusterDeploymentException: Could not 
> deploy Yarn job cluster.
> at 
> org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:82)
> at 
> org.apache.flink.client.cli.CliFrontend.runProgram(CliFrontend.java:230)
> at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:205)
> at 
> org.apache.flink.client.cli.CliFrontend.parseParameters(CliFrontend.java:1010)
> at 
> org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1083)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at 
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1754)
> at 
> org.apache.flink.runtime.security.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
> at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1083)
> Caused by: java.io.IOException: Can't get Master Kerberos principal for use 
> as renewer
> at 
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:116)
> at 
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodesInternal(TokenCache.java:100)
> at 
> org.apache.hadoop.mapreduce.security.TokenCache.obtainTokensForNamenodes(TokenCache.java:80)
> at org.apache.flink.yarn.Utils.setTokensFor(Utils.java:269)
> at 
> org.apache.flink.yarn.AbstractYarnClusterDescriptor.startAppMaster(AbstractYarnClusterDescriptor.java:929)
> at 
> org.apache.flink.yarn.AbstractYarnClusterDescriptor.deployInternal(AbstractYarnClusterDescriptor.java:507)
> at 
> org.apache.flink.yarn.YarnClusterDescriptor.deployJobCluster(YarnClusterDescriptor.java:75)
> ... 9 more
> {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Updated] (FLINK-16794) ClassNotFoundException caused by ClassLoader.getSystemClassLoader using impertinently

2021-11-17 Thread Flink Jira Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-16794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Flink Jira Bot updated FLINK-16794:
---
  Labels: auto-deprioritized-major auto-deprioritized-minor  (was: 
auto-deprioritized-major stale-minor)
Priority: Not a Priority  (was: Minor)

This issue was labeled "stale-minor" 7 days ago and has not received any 
updates so it is being deprioritized. If this ticket is actually Minor, please 
raise the priority and ask a committer to assign you the issue or revive the 
public discussion.


> ClassNotFoundException caused by ClassLoader.getSystemClassLoader using 
> impertinently  
> ---
>
> Key: FLINK-16794
> URL: https://issues.apache.org/jira/browse/FLINK-16794
> Project: Flink
>  Issue Type: Improvement
>  Components: Client / Job Submission, Runtime / REST
>Affects Versions: 1.8.0
>Reporter: victor.jiang
>Priority: Not a Priority
>  Labels: auto-deprioritized-major, auto-deprioritized-minor
>
> In some containerization environment,the context classloader is not the 
> SystemClassLoader,it uses the customized classloader usually for the classes 
> isolation ,so the ClassNotFoundException may be caused。recommends using 
> getClass/Caller/ThreadCurrentContext 's ClassLoader。
> The related sources below:
>  # 
> [ClusterClient.java:113|https://github.com/apache/flink/blob/c6997c97c575d334679915c328792b8a3067cfb5/flink-clients/src/main/java/org/apache/flink/client/program/ClusterClient.java#L113]:
>  {{return getAccumulators(jobID, ClassLoader.getSystemClassLoader());}}
>  # 
> [BlobUtils.java:290|https://github.com/apache/flink/blob/c6997c97c575d334679915c328792b8a3067cfb5/flink-runtime/src/main/java/org/apache/flink/runtime/blob/BlobUtils.java#L290]:
>  {{return (Throwable) InstantiationUtil.deserializeObject(bytes, 
> ClassLoader.getSystemClassLoader());}}
>  # 
> [SerializedThrowableDeserializer.java:50|https://github.com/apache/flink/blob/c6997c97c575d334679915c328792b8a3067cfb5/flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/json/SerializedThrowableDeserializer.java#L50]:
>  {{return InstantiationUtil.deserializeObject(serializedException, 
> ClassLoader.getSystemClassLoader());}}
>  # 
> [RemoteRpcInvocation.java:121|https://github.com/apache/flink/blob/c6997c97c575d334679915c328792b8a3067cfb5/flink-runtime/src/main/java/org/apache/flink/runtime/rpc/messages/RemoteRpcInvocation.java#L121]:
>  {{methodInvocation = 
> serializedMethodInvocation.deserializeValue(ClassLoader.getSystemClassLoader());}}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   * c6ec114588077e7db35ec0ece0dee799e06bfc94 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17819: [FLINK-15816][k8s] Limit kubernetes.cluster-id to a maximum of 40 characters

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17819:
URL: https://github.com/apache/flink/pull/17819#issuecomment-971446182


   
   ## CI report:
   
   * 7f0824c6027e9fdd23acd9c6f742614662e2fba2 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26654)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot commented on pull request #17819: [FLINK-15816][k8s] Limit kubernetes.cluster-id to a maximum of 40 characters

2021-11-17 Thread GitBox


flinkbot commented on pull request #17819:
URL: https://github.com/apache/flink/pull/17819#issuecomment-971446182


   
   ## CI report:
   
   * 7f0824c6027e9fdd23acd9c6f742614662e2fba2 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot commented on pull request #17819: [FLINK-15816][k8s] Limit kubernetes.cluster-id to a maximum of 40 characters

2021-11-17 Thread GitBox


flinkbot commented on pull request #17819:
URL: https://github.com/apache/flink/pull/17819#issuecomment-971446006


   Thanks a lot for your contribution to the Apache Flink project. I'm the 
@flinkbot. I help the community
   to review your pull request. We will use this comment to track the progress 
of the review.
   
   
   ## Automated Checks
   Last check on commit 7f0824c6027e9fdd23acd9c6f742614662e2fba2 (Wed Nov 17 
10:33:28 UTC 2021)
   
   **Warnings:**
* No documentation files were touched! Remember to keep the Flink docs up 
to date!
   
   
   Mention the bot in a comment to re-run the automated checks.
   ## Review Progress
   
   * ❓ 1. The [description] looks good.
   * ❓ 2. There is [consensus] that the contribution should go into to Flink.
   * ❓ 3. Needs [attention] from.
   * ❓ 4. The change fits into the overall [architecture].
   * ❓ 5. Overall code [quality] is good.
   
   Please see the [Pull Request Review 
Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full 
explanation of the review process.
The Bot is tracking the review progress through labels. Labels are applied 
according to the order of the review items. For consensus, approval by a Flink 
committer of PMC member is required Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot approve description` to approve one or more aspects (aspects: 
`description`, `consensus`, `architecture` and `quality`)
- `@flinkbot approve all` to approve all aspects
- `@flinkbot approve-until architecture` to approve everything until 
`architecture`
- `@flinkbot attention @username1 [@username2 ..]` to require somebody's 
attention
- `@flinkbot disapprove architecture` to remove an approval you gave earlier
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink-ml] zhipeng93 commented on pull request #34: [hotfix] fix nullpointer exception when broadcast variables are cleaned

2021-11-17 Thread GitBox


zhipeng93 commented on pull request #34:
URL: https://github.com/apache/flink-ml/pull/34#issuecomment-971445800


   Hi @gaoyunhaii and @lindong28 ,
   
   Thanks for the review. I have added a unit test. Please check out for 
`BroadcastVariableReceiverOperatorTest`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Comment Edited] (FLINK-24921) FileSourceSplit should not be visible in the user API in ParquetColumnarRowInputFormat

2021-11-17 Thread Etienne Chauchot (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17444592#comment-17444592
 ] 

Etienne Chauchot edited comment on FLINK-24921 at 11/17/21, 10:31 AM:
--

I took a deeper look at the code, [~arvid] you're right (thanks) Parquet Format 
is used to support hive format hence the parametrized type. And indeed, it can 
difficultly be removed. But the factory I see in the parquet format package 
(ParquetFileFormatFactory) is for the table API. So _FileSourceSplit_ will 
surface in the parquet API when using DataStream API unless I'm missing 
something.

While documenting the DataStream connectors from the user point of view, I 
searched how to use _ParquetColumnarRowInputFormat_ by taking a look at the 
tests and they refer either explicitly _FileSourceSplit_ or do a raw use of the 
parametrized _ParquetColumnarRowInputFormat_ class so I though we could improve 
the API.

For now, I'll document as is.


was (Author: echauchot):
I took a deeper look at the code, [~arvid] you're right (thanks) Parquet Format 
is used to support hive format hence the parametrized type. And indeed, it can 
difficultly be removed. But the factory I see in the parquet format package 
(ParquetFileFormatFactory) is for the table API.

While documenting the DataStream connectors from the user point of view, I 
searched how to use _ParquetColumnarRowInputFormat_ by taking a look at the 
tests and they refer either explicitly _FileSourceSplit_ or do a raw use of the 
parametrized _ParquetColumnarRowInputFormat_ class so I though we could improve 
the API.

For now, I'll document as is.

> FileSourceSplit should not be visible in the user API in 
> ParquetColumnarRowInputFormat
> --
>
> Key: FLINK-24921
> URL: https://issues.apache.org/jira/browse/FLINK-24921
> Project: Flink
>  Issue Type: Improvement
>  Components: Connectors / FileSystem
>Reporter: Etienne Chauchot
>Assignee: Etienne Chauchot
>Priority: Major
>
> _FileSourceSplit_ is an internal class that should not be visible in the user 
> API like 
> [here|https://github.com/apache/flink/blob/6f2d8fe3007464343c5312e27612be448b415148/flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/ParquetColumnarRowInputFormatTest.java#L235].
>  The fact that _FileSourceSplit_ surfaces in the API also influences the user 
> to do a raw use of the parametrized class like 
> [here|https://github.com/apache/flink/blob/6f2d8fe3007464343c5312e27612be448b415148/flink-formats/flink-parquet/src/test/java/org/apache/flink/formats/parquet/ParquetColumnarRowInputFormatTest.java#L407]
> It could be better to make parquet format a not parametrized class as it is 
> done for hive connector
> _class_  HiveBulkFormatAdapter
> _implements BulkFormat_
> rather than
> _class ParquetColumnarRowInputFormat_
> _extends ParquetVectorizedInputFormat_
>  



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] alpreu opened a new pull request #17819: [FLINK-15816][k8s] Limit kubernetes.cluster-id to a maximum of 40 characters

2021-11-17 Thread GitBox


alpreu opened a new pull request #17819:
URL: https://github.com/apache/flink/pull/17819


   ## What is the purpose of the change
   
   Kubernetes labels have a maximum length of 63 characters. The longest 
created label is {cluster-id}-resourcemanager-leader, therefore the cluster-id 
has to be limited to 40 characters to not create failures on deployment.
   
   
   ## Brief change log
   
 - Updated MAXIMUM_CHARACTERS_OF_CLUSTER_ID to 40
 - Updated docs
   
   ## Verifying this change
   
   
   This change is already covered by existing tests, such as *(please describe 
tests)*.
   
- AbstractKubernetesParametersTest#testClusterIdLengthLimitation
   
   
   ## Does this pull request potentially affect one of the following parts:
   
 - Dependencies (does it add or upgrade a dependency): (no)
 - The public API, i.e., is any changed class annotated with 
`@Public(Evolving)`: (no)
 - The serializers: (no)
 - The runtime per-record code paths (performance sensitive): (no)
 - Anything that affects deployment or recovery: JobManager (and its 
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes - kubernetes)
 - The S3 file system connector: (no)
   
   ## Documentation
   
 - Does this pull request introduce a new feature? (no)
 - If yes, how is the feature documented? (docs + JavaDocs)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26653)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (FLINK-24936) Python test_data_stream.py hangs on azure

2021-11-17 Thread Huang Xingbo (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445063#comment-17445063
 ] 

Huang Xingbo commented on FLINK-24936:
--

[~gaoyunhaii] Thanks for the reporting this issue. The error reasons for the  
these hanging tests are the same. When the Azure machine creates multiple 
python processes, some of them cannot be started. The concurrency of udf tests 
adjusted to 1 can solve this problem. I'm still thinking about whether there is 
a better solution.

> Python test_data_stream.py hangs on azure
> -
>
> Key: FLINK-24936
> URL: https://issues.apache.org/jira/browse/FLINK-24936
> Project: Flink
>  Issue Type: Bug
>  Components: API / Python
>Affects Versions: 1.14.0
>Reporter: Yun Gao
>Priority: Major
>  Labels: test-stability
>
> {code:java}
> Nov 17 04:36:57 pyflink/datastream/tests/test_data_stream.py 
> ... [ 33%]
> Nov 17 04:52:58 
> ==
> Nov 17 04:52:58 Process produced no output for 900 seconds.
> Nov 17 04:52:58 
> ==
> Nov 17 04:52:58 
> ==
>  {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26627&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Assigned] (FLINK-24936) Python test_data_stream.py hangs on azure

2021-11-17 Thread Huang Xingbo (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Huang Xingbo reassigned FLINK-24936:


Assignee: Huang Xingbo

> Python test_data_stream.py hangs on azure
> -
>
> Key: FLINK-24936
> URL: https://issues.apache.org/jira/browse/FLINK-24936
> Project: Flink
>  Issue Type: Bug
>  Components: API / Python
>Affects Versions: 1.14.0
>Reporter: Yun Gao
>Assignee: Huang Xingbo
>Priority: Major
>  Labels: test-stability
>
> {code:java}
> Nov 17 04:36:57 pyflink/datastream/tests/test_data_stream.py 
> ... [ 33%]
> Nov 17 04:52:58 
> ==
> Nov 17 04:52:58 Process produced no output for 900 seconds.
> Nov 17 04:52:58 
> ==
> Nov 17 04:52:58 
> ==
>  {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26627&view=logs&j=821b528f-1eed-5598-a3b4-7f748b13f261&t=6bb545dd-772d-5d8c-f258-f5085fba3295



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17799: [FLINK-24409][kafka] Fix collection of KafkaSourceReaderMetrics for topics containing periods

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17799:
URL: https://github.com/apache/flink/pull/17799#issuecomment-969089865


   
   ## CI report:
   
   * 075ae2263d7cc68a9bcd4d6e336494c104d670a9 Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26556)
 
   * 8e7cbb60cd774d89cfde15ac5062b9ebb44d2c3a Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26652)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17799: [FLINK-24409][kafka] Fix collection of KafkaSourceReaderMetrics for topics containing periods

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17799:
URL: https://github.com/apache/flink/pull/17799#issuecomment-969089865


   
   ## CI report:
   
   * 075ae2263d7cc68a9bcd4d6e336494c104d670a9 Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26556)
 
   * 8e7cbb60cd774d89cfde15ac5062b9ebb44d2c3a UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17685: [FLINK-24631][Kubernetes]Use minimal selector to select jobManager and taskManager pod

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17685:
URL: https://github.com/apache/flink/pull/17685#issuecomment-961148655


   
   ## CI report:
   
   * 2471d36bd4c3a7a91c9651e32a836f3b045dbb7f Azure: 
[CANCELED](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26637)
 
   * 164b09750d797e4686133ca89af9f84895eab8a2 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26644)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17816: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17816:
URL: https://github.com/apache/flink/pull/17816#issuecomment-971338462


   
   ## CI report:
   
   * 251f55c950101b10454bfb031469e8cd643ea512 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26641)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17773: [FLINK-24409][kafka] Fix collection of KafkaSourceReaderMetrics for t…

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17773:
URL: https://github.com/apache/flink/pull/17773#issuecomment-966918976


   
   ## CI report:
   
   * d2e43591620e4cbef556a60ef82694351381099f Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26523)
 
   * f6c57afdafb62ad077745dea97effbcc942a689a Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26651)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17773: [FLINK-24409][kafka] Fix collection of KafkaSourceReaderMetrics for t…

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17773:
URL: https://github.com/apache/flink/pull/17773#issuecomment-966918976


   
   ## CI report:
   
   * d2e43591620e4cbef556a60ef82694351381099f Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26523)
 
   * f6c57afdafb62ad077745dea97effbcc942a689a UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * c0f52636331adf1db6268b504e674f1f41e3f07d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17817: [FLINK-24922][docs] Backport fix spelling errors in the word "parallism"

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17817:
URL: https://github.com/apache/flink/pull/17817#issuecomment-971344993


   
   ## CI report:
   
   * 999fa42b698ec2d652d9e9b7c7db32b946231797 Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26642)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * 971b874f8e0fd6483924dac21fbade6d31558f0d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (FLINK-24433) "No space left on device" in Azure e2e tests

2021-11-17 Thread Roman Khachatryan (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445048#comment-17445048
 ] 

Roman Khachatryan commented on FLINK-24433:
---

Probably caused by FLINK-24938.

> "No space left on device" in Azure e2e tests
> 
>
> Key: FLINK-24433
> URL: https://issues.apache.org/jira/browse/FLINK-24433
> Project: Flink
>  Issue Type: Bug
>  Components: Build System / Azure Pipelines
>Affects Versions: 1.15.0
>Reporter: Dawid Wysakowicz
>Priority: Major
>  Labels: test-stability
> Fix For: 1.15.0
>
>
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=24668&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=19772
> {code}
> Sep 30 17:08:42 Job has been submitted with JobID 
> 5594c18e128a328ede39cfa59cb3cb07
> Sep 30 17:08:56 2021-09-30 17:08:56,809 main ERROR Recovering from 
> StringBuilderEncoder.encode('2021-09-30 17:08:56,807 WARN  
> org.apache.flink.streaming.api.operators.collect.CollectResultFetcher [] - An 
> exception occurred when fetching query results
> Sep 30 17:08:56 java.util.concurrent.ExecutionException: 
> org.apache.flink.runtime.rest.util.RestClientException: [Internal server 
> error.,  Sep 30 17:08:56 org.apache.flink.runtime.messages.FlinkJobNotFoundException: 
> Could not find Flink job (5594c18e128a328ede39cfa59cb3cb07)
> Sep 30 17:08:56   at 
> org.apache.flink.runtime.dispatcher.Dispatcher.getJobMasterGateway(Dispatcher.java:923)
> Sep 30 17:08:56   at 
> org.apache.flink.runtime.dispatcher.Dispatcher.performOperationOnJobMasterGateway(Dispatcher.java:937)
> Sep 30 17:08:56   at 
> org.apache.flink.runtime.dispatcher.Dispatcher.deliverCoordinationRequestToCoordina2021-09-30T17:08:57.1584224Z
>  ##[error]No space left on device
> {code}



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Updated] (FLINK-24938) Checkpoint cleaner is closed before checkpoints are discarded

2021-11-17 Thread Roman Khachatryan (Jira)


 [ 
https://issues.apache.org/jira/browse/FLINK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Roman Khachatryan updated FLINK-24938:
--
Priority: Critical  (was: Major)

> Checkpoint cleaner is closed before checkpoints are discarded
> -
>
> Key: FLINK-24938
> URL: https://issues.apache.org/jira/browse/FLINK-24938
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0, 1.15.0
>Reporter: Roman Khachatryan
>Priority: Critical
> Fix For: 1.15.0, 1.14.1
>
>
> When CompletedCheckpointStore shuts down it tries to discard some checkpoints 
> using CheckpointCleaner. The latter is closed asynchronously since 
> FLINK-23647 and before the Store.
> Visible as warning when running 
> ResumeCheckpointManuallyITCase.testExternalizedIncrementalRocksDBCheckpointsZookeeper:
> {code}
> 2021-11-17 10:47:10,599 Fail to remove checkpoint during shutdown. 
> [DefaultCompletedCheckpointStore flink-akka.actor.default-dispatcher-5]
>  java.lang.IllegalStateException: CheckpointsCleaner has already been closed
>  at 
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) 
> ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.incrementNumberOfCheckpointsToClean(CheckpointsCleaner.java:105)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanup(CheckpointsCleaner.java:87)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanCheckpoint(CheckpointsCleaner.java:62)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.tryRemoveCompletedCheckpoint(DefaultCompletedCheckpointStore.java:2
>  at 
> org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.shutdown(DefaultCompletedCheckpointStore.java:172)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.scheduler.SchedulerBase.shutDownCheckpointServices(SchedulerBase.java:222)
>  ~[classes/:?]
> {code}
> But the test still passes.
> cc: [~pnowojski]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[jira] [Commented] (FLINK-24938) Checkpoint cleaner is closed before checkpoints are discarded

2021-11-17 Thread Roman Khachatryan (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445046#comment-17445046
 ] 

Roman Khachatryan commented on FLINK-24938:
---

Doesn't happen without FLINK-23647.

> Checkpoint cleaner is closed before checkpoints are discarded
> -
>
> Key: FLINK-24938
> URL: https://issues.apache.org/jira/browse/FLINK-24938
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Checkpointing
>Affects Versions: 1.14.0, 1.15.0
>Reporter: Roman Khachatryan
>Priority: Major
> Fix For: 1.15.0, 1.14.1
>
>
> When CompletedCheckpointStore shuts down it tries to discard some checkpoints 
> using CheckpointCleaner. The latter is closed asynchronously since 
> FLINK-23647 and before the Store.
> Visible as warning when running 
> ResumeCheckpointManuallyITCase.testExternalizedIncrementalRocksDBCheckpointsZookeeper:
> {code}
> 2021-11-17 10:47:10,599 Fail to remove checkpoint during shutdown. 
> [DefaultCompletedCheckpointStore flink-akka.actor.default-dispatcher-5]
>  java.lang.IllegalStateException: CheckpointsCleaner has already been closed
>  at 
> org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) 
> ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.incrementNumberOfCheckpointsToClean(CheckpointsCleaner.java:105)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanup(CheckpointsCleaner.java:87)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanCheckpoint(CheckpointsCleaner.java:62)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.tryRemoveCompletedCheckpoint(DefaultCompletedCheckpointStore.java:2
>  at 
> org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.shutdown(DefaultCompletedCheckpointStore.java:172)
>  ~[classes/:?]
>  at 
> org.apache.flink.runtime.scheduler.SchedulerBase.shutDownCheckpointServices(SchedulerBase.java:222)
>  ~[classes/:?]
> {code}
> But the test still passes.
> cc: [~pnowojski]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * 971b874f8e0fd6483924dac21fbade6d31558f0d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] maver1ck commented on pull request #17795: [FLINK-23230] Upgrade frontend-maven-plugin

2021-11-17 Thread GitBox


maver1ck commented on pull request #17795:
URL: https://github.com/apache/flink/pull/17795#issuecomment-971410229


   @rmetzger 
   I think the best solution for protoc will be adding this file to maven 
central. Do we have any friends in protobuf project ?
   https://developers.google.com/protocol-buffers/


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (FLINK-24938) Checkpoint cleaner is closed before checkpoints are discarded

2021-11-17 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-24938:
-

 Summary: Checkpoint cleaner is closed before checkpoints are 
discarded
 Key: FLINK-24938
 URL: https://issues.apache.org/jira/browse/FLINK-24938
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Checkpointing
Affects Versions: 1.14.0, 1.15.0
Reporter: Roman Khachatryan
 Fix For: 1.15.0, 1.14.1


When CompletedCheckpointStore shuts down it tries to discard some checkpoints 
using CheckpointCleaner. The latter is closed asynchronously since FLINK-23647 
and before the Store.

Visible as warning when running 
ResumeCheckpointManuallyITCase.testExternalizedIncrementalRocksDBCheckpointsZookeeper:

{code}
2021-11-17 10:47:10,599 Fail to remove checkpoint during shutdown. 
[DefaultCompletedCheckpointStore flink-akka.actor.default-dispatcher-5]
 java.lang.IllegalStateException: CheckpointsCleaner has already been closed
 at 
org.apache.flink.util.Preconditions.checkState(Preconditions.java:193) 
~[classes/:?]
 at 
org.apache.flink.runtime.checkpoint.CheckpointsCleaner.incrementNumberOfCheckpointsToClean(CheckpointsCleaner.java:105)
 ~[classes/:?]
 at 
org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanup(CheckpointsCleaner.java:87)
 ~[classes/:?]
 at 
org.apache.flink.runtime.checkpoint.CheckpointsCleaner.cleanCheckpoint(CheckpointsCleaner.java:62)
 ~[classes/:?]
 at 
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.tryRemoveCompletedCheckpoint(DefaultCompletedCheckpointStore.java:2
 at 
org.apache.flink.runtime.checkpoint.DefaultCompletedCheckpointStore.shutdown(DefaultCompletedCheckpointStore.java:172)
 ~[classes/:?]
 at 
org.apache.flink.runtime.scheduler.SchedulerBase.shutDownCheckpointServices(SchedulerBase.java:222)
 ~[classes/:?]

{code}

But the test still passes.


cc: [~pnowojski]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * 971b874f8e0fd6483924dac21fbade6d31558f0d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17818: [FLINK-24800][runtime] Changed the assert condition for checking buff…

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17818:
URL: https://github.com/apache/flink/pull/17818#issuecomment-971400530


   
   ## CI report:
   
   * d4a68e7a626463d81df6315e622551106588cf8e Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26650)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot commented on pull request #17818: [FLINK-24800][runtime] Changed the assert condition for checking buff…

2021-11-17 Thread GitBox


flinkbot commented on pull request #17818:
URL: https://github.com/apache/flink/pull/17818#issuecomment-971400920


   Thanks a lot for your contribution to the Apache Flink project. I'm the 
@flinkbot. I help the community
   to review your pull request. We will use this comment to track the progress 
of the review.
   
   
   ## Automated Checks
   Last check on commit d4a68e7a626463d81df6315e622551106588cf8e (Wed Nov 17 
09:36:04 UTC 2021)
   
   **Warnings:**
* No documentation files were touched! Remember to keep the Flink docs up 
to date!
   
   
   Mention the bot in a comment to re-run the automated checks.
   ## Review Progress
   
   * ❓ 1. The [description] looks good.
   * ❓ 2. There is [consensus] that the contribution should go into to Flink.
   * ❓ 3. Needs [attention] from.
   * ❓ 4. The change fits into the overall [architecture].
   * ❓ 5. Overall code [quality] is good.
   
   Please see the [Pull Request Review 
Guide](https://flink.apache.org/contributing/reviewing-prs.html) for a full 
explanation of the review process.
The Bot is tracking the review progress through labels. Labels are applied 
according to the order of the review items. For consensus, approval by a Flink 
committer of PMC member is required Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot approve description` to approve one or more aspects (aspects: 
`description`, `consensus`, `architecture` and `quality`)
- `@flinkbot approve all` to approve all aspects
- `@flinkbot approve-until architecture` to approve everything until 
`architecture`
- `@flinkbot attention @username1 [@username2 ..]` to require somebody's 
attention
- `@flinkbot disapprove architecture` to remove an approval you gave earlier
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot commented on pull request #17818: [FLINK-24800][runtime] Changed the assert condition for checking buff…

2021-11-17 Thread GitBox


flinkbot commented on pull request #17818:
URL: https://github.com/apache/flink/pull/17818#issuecomment-971400530


   
   ## CI report:
   
   * d4a68e7a626463d81df6315e622551106588cf8e UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17637: [FLINK-24708][planner] Fix wrong results of the IN operator

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17637:
URL: https://github.com/apache/flink/pull/17637#issuecomment-957122792


   
   ## CI report:
   
   * 8f68a316bd96c317619d264fe8818f558253b97b Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26509)
 
   * 8e136dd10f4da8c8eba2c4d53424cdcae79e1eb6 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26649)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   * 971b874f8e0fd6483924dac21fbade6d31558f0d UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (FLINK-24800) BufferTimeoutITCase.testDisablingBufferTimeout failed on Azure

2021-11-17 Thread Anton Kalashnikov (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445039#comment-17445039
 ] 

Anton Kalashnikov commented on FLINK-24800:
---

[~gaoyunhaii] , yes, sure, I have prepared the PR - 
https://github.com/apache/flink/pull/17818.

> BufferTimeoutITCase.testDisablingBufferTimeout failed on Azure
> --
>
> Key: FLINK-24800
> URL: https://issues.apache.org/jira/browse/FLINK-24800
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Network
>Affects Versions: 1.13.3, 1.15.0
>Reporter: Yun Gao
>Assignee: Anton Kalashnikov
>Priority: Blocker
>  Labels: pull-request-available, test-stability
> Fix For: 1.15.0, 1.14.1
>
>
> {code:java}
> 2021-11-05T12:18:50.5272055Z Nov 05 12:18:50 [INFO] Results:
> 2021-11-05T12:18:50.5273369Z Nov 05 12:18:50 [INFO] 
> 2021-11-05T12:18:50.5274011Z Nov 05 12:18:50 [ERROR] Failures: 
> 2021-11-05T12:18:50.5274518Z Nov 05 12:18:50 [ERROR]   
> BufferTimeoutITCase.testDisablingBufferTimeout:85 
> 2021-11-05T12:18:50.5274871Z Nov 05 12:18:50 Expected: <0>
> 2021-11-05T12:18:50.5275150Z Nov 05 12:18:50  but: was <1>
> 2021-11-05T12:18:50.5276136Z Nov 05 12:18:50 [INFO] 
> 2021-11-05T12:18:50.5276667Z Nov 05 12:18:50 [ERROR] Tests run: 1849, 
> Failures: 1, Errors: 0, Skipped: 58
> {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26018&view=logs&j=a57e0635-3fad-5b08-57c7-a4142d7d6fa9&t=2ef0effc-1da1-50e5-c2bd-aab434b1c5b7&l=10850



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17815: [FLINK-22702][tests] Add test data supplier which provide null timestamp field to kafka connector tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17815:
URL: https://github.com/apache/flink/pull/17815#issuecomment-971312244


   
   ## CI report:
   
   * c654feccc34582ec2f2c6c22513c7a67bcd3de65 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26639)
 
   * 167488b16e036f8e3db30e4758d5ba14e2fea337 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26648)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17637: [FLINK-24708][planner] Fix wrong results of the IN operator

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17637:
URL: https://github.com/apache/flink/pull/17637#issuecomment-957122792


   
   ## CI report:
   
   * 8f68a316bd96c317619d264fe8818f558253b97b Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26509)
 
   * 8e136dd10f4da8c8eba2c4d53424cdcae79e1eb6 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] akalash opened a new pull request #17818: [FLINK-24800][runtime] Changed the assert condition for checking buff…

2021-11-17 Thread GitBox


akalash opened a new pull request #17818:
URL: https://github.com/apache/flink/pull/17818


   …er timeout disabling test
   
   
   
   ## What is the purpose of the change
   
   Backport of https://github.com/apache/flink/pull/17758
   
   ## Does this pull request potentially affect one of the following parts:
   
 - Dependencies (does it add or upgrade a dependency): (yes / **no**)
 - The public API, i.e., is any changed class annotated with 
`@Public(Evolving)`: (yes / **no**)
 - The serializers: (yes / **no** / don't know)
 - The runtime per-record code paths (performance sensitive): (yes / **no** 
/ don't know)
 - Anything that affects deployment or recovery: JobManager (and its 
components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / **no** / don't 
know)
 - The S3 file system connector: (yes / **no** / don't know)
   
   ## Documentation
   
 - Does this pull request introduce a new feature? (yes / **no**)
 - If yes, how is the feature documented? (not applicable / docs / JavaDocs 
/ not documented)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17815: [FLINK-22702][tests] Add test data supplier which provide null timestamp field to kafka connector tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17815:
URL: https://github.com/apache/flink/pull/17815#issuecomment-971312244


   
   ## CI report:
   
   * c654feccc34582ec2f2c6c22513c7a67bcd3de65 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26639)
 
   * 167488b16e036f8e3db30e4758d5ba14e2fea337 UNKNOWN
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Commented] (FLINK-24937) "kubernetes application HA test" hangs on azure

2021-11-17 Thread Yun Gao (Jira)


[ 
https://issues.apache.org/jira/browse/FLINK-24937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17445034#comment-17445034
 ] 

Yun Gao commented on FLINK-24937:
-

Hi [~wangyang0918] ~ Are you convenient to have a look at this issue~?

> "kubernetes application HA test" hangs on azure
> ---
>
> Key: FLINK-24937
> URL: https://issues.apache.org/jira/browse/FLINK-24937
> Project: Flink
>  Issue Type: Bug
>  Components: Runtime / Coordination
>Affects Versions: 1.14.1
>Reporter: Yun Gao
>Priority: Major
>  Labels: test-stability
>
> {code:java}
> 2021-11-17T02:15:23.4319085Z Nov 17 02:15:23 ##[endgroup]
> 2021-11-17T02:15:23.4319779Z Nov 17 02:15:23 Searching for .dump, .dumpstream 
> and related files in '/home/vsts/work/1/s'
> 2021-11-17T02:15:24.7906640Z dmesg: read kernel buffer failed: Operation not 
> permitted
> 2021-11-17T02:15:25.1156830Z Nov 17 02:15:25 No taskexecutor daemon to stop 
> on host fv-az123-364.
> 2021-11-17T02:15:25.3229454Z Nov 17 02:15:25 No standalonesession daemon to 
> stop on host fv-az123-364.
> 2021-11-17T06:09:57.2488148Z 
> ==
> 2021-11-17T06:09:57.2489380Z === WARNING: This task took already 95% of the 
> available time budget of 281 minutes ===
> 2021-11-17T06:09:57.2490646Z 
> ==
>  {code}
> https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26628&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=2562



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17538: [FLINK-24325][connectors/elasticsearch] Create Elasticsearch 6 Sink

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17538:
URL: https://github.com/apache/flink/pull/17538#issuecomment-948574914


   
   ## CI report:
   
   * 2d2e314314c0aca9b334ff09dd744d075b47cb53 UNKNOWN
   * 4527c1d3c6f5113b4e345845a2ec08a90954c8d5 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26608)
 
   * 08960150f629869f5aa92a706e96d4a9c036e059 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26647)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[GitHub] [flink] flinkbot edited a comment on pull request #17133: [FLINK-24138] Architectural tests

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17133:
URL: https://github.com/apache/flink/pull/17133#issuecomment-912323602


   
   ## CI report:
   
   * cfb98c4cc708adb38ced719788af16a50625a1c1 UNKNOWN
   * baebf8dcd90968968de5d6363449fa39345b2f55 Azure: 
[FAILURE](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=23657)
 
   * 89b1db5b650484d255a469e62e480f0f9df496a4 Azure: 
[PENDING](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26646)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




[jira] [Created] (FLINK-24937) "kubernetes application HA test" hangs on azure

2021-11-17 Thread Yun Gao (Jira)
Yun Gao created FLINK-24937:
---

 Summary: "kubernetes application HA test" hangs on azure
 Key: FLINK-24937
 URL: https://issues.apache.org/jira/browse/FLINK-24937
 Project: Flink
  Issue Type: Bug
  Components: Runtime / Coordination
Affects Versions: 1.14.1
Reporter: Yun Gao


{code:java}
2021-11-17T02:15:23.4319085Z Nov 17 02:15:23 ##[endgroup]
2021-11-17T02:15:23.4319779Z Nov 17 02:15:23 Searching for .dump, .dumpstream 
and related files in '/home/vsts/work/1/s'
2021-11-17T02:15:24.7906640Z dmesg: read kernel buffer failed: Operation not 
permitted
2021-11-17T02:15:25.1156830Z Nov 17 02:15:25 No taskexecutor daemon to stop on 
host fv-az123-364.
2021-11-17T02:15:25.3229454Z Nov 17 02:15:25 No standalonesession daemon to 
stop on host fv-az123-364.
2021-11-17T06:09:57.2488148Z 
==
2021-11-17T06:09:57.2489380Z === WARNING: This task took already 95% of the 
available time budget of 281 minutes ===
2021-11-17T06:09:57.2490646Z 
==
 {code}
https://dev.azure.com/apache-flink/apache-flink/_build/results?buildId=26628&view=logs&j=c88eea3b-64a0-564d-0031-9fdcd7b8abee&t=070ff179-953e-5bda-71fa-d6599415701c&l=2562



--
This message was sent by Atlassian Jira
(v8.20.1#820001)


[GitHub] [flink] flinkbot edited a comment on pull request #17814: [FLINK-24899][runtime] Enable data compression for blocking shuffle by default

2021-11-17 Thread GitBox


flinkbot edited a comment on pull request #17814:
URL: https://github.com/apache/flink/pull/17814#issuecomment-971129699


   
   ## CI report:
   
   * 24f77cae435bd8dfed5832b25b0d0bfb1791afb9 Azure: 
[SUCCESS](https://dev.azure.com/apache-flink/98463496-1af2-4620-8eab-a2ecc1a2e6fe/_build/results?buildId=26636)
 
   
   
   Bot commands
 The @flinkbot bot supports the following commands:
   
- `@flinkbot run azure` re-run the last Azure build
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@flink.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




<    1   2   3   4   5   >