512mb is just too small for a TaskManager. You would need to either
increase it, or decrease the other memory components (which currently use
default values).
The 64mb Total Flink Memory comes from the 512mb Total Process Memory minus
192mb minimum JVM Overhead and 256mb default JVM Metaspace.
Hi John,
May I know what is your Flink version you are trying?
On Thu, 23 Jun 2022 at 3:43 AM, John Tipper wrote:
> Hi all,
>
> I'm wanting to run quite a number of PyFlink jobs on Kubernetes, where the
> amount of state and number of events being processed is small and therefore
> I'd like
Hi，
It seems that you can't find the FlinkDeployment. I saw the api server
address is maskedip. Can you confirm whether it is the correct api server
address?
Best,
Yuan
On Thu, 23 Jun 2022 at 11:52 AM, Kishore Pola
wrote:
> Hello flink user group,
>
> When I am trying to create a flink
Hello flink user group,
When I am trying to create a flink deployment with the operator
programmatically, kubernetes cluster is returning HTTP 404 message. Any
pointers/help?
I am constructing the context using fabric8 client like this
Config config =
new ConfigBuilder()
this looks interesting Nasa Akka project https://github.com/NASARace/race
On Mon, Jun 20, 2022 at 7:06 PM sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> found one more flink tool
> https://www.splunk.com/en_us/products/stream-processing.html
>
> On Wed, Jun 15, 2022 at 1:18 PM
Hi.
I think you can use Expressions#callSql to convert the String to
Expression. Then you can use ExpressionResolver to resolve the converted
Expression.
Best,
Shengkai
Qing Lim 于2022年6月22日周三 23:58写道：
> Hi Xuyang,
>
>
>
> Thanks for the pointer, however it does not seems to achieve what I
I guess the problem here is that your JM pods do not have access to a
common upload folder. You need to mount a shared volume for all the
JobManagers and point to it using the 'web.upload.dir: property.
On Wed, Jun 22, 2022 at 8:45 PM calvin beloy wrote:
> Hi,
>
> Trying to deploy
Hi There!
I have a question regarding the ingestion of files from S3 that are not
motivated by the ContinuousFileMonitoringFunction. For a variety of reasons
I cannot use the ContinuousFileMonitoringFunction so I'd like to use a
Kafka source where a message contains both the path in S3, and the
Hi all,
I'm wanting to run quite a number of PyFlink jobs on Kubernetes, where the
amount of state and number of events being processed is small and therefore I'd
like to use as little memory in my clusters as possible so I can bin pack most
efficiently. I'm running a Flink cluster per job.
Hi,
Trying to deploy FlinkSessionJob with Flink Operator on HA enabled Jobmanager
(2 replicas) but getting below error. Changing job manager replica to 1 is
working fine. Is this a bug on Flink Operator that needs to support 2
Jobmanagers on HA mode?
at
Hi Xuyang,
Thanks for the pointer, however it does not seems to achieve what I want.
I would like to provide the input in String, instead of Expression, and it
would be best if I can reuse how flink does it.
For example, given a String: "col_a = 20 AND col_b < 10", is there any flink's
api
Hi, what about use `FieldReferenceExpression`[1] in test just like here[2] ?
[1]
https://github.com/apache/flink/blob/5bcef81356f965ee9e6a8ab54b5faca1e3979873/flink-table/flink-table-common/src/main/java/org/apache/flink/table/expressions/FieldReferenceExpression.java#L39
[2]
Sorry typo "jarring" should be "jar url".
Sent from Yahoo Mail on Android
On Wed, Jun 22, 2022 at 10:07 AM, calvin beloy wrote: Hi,
We are using Flink Operator to deploy FlinkSessionJob. The jarring is pointing
to our private internal repo which is using self signed ssl cert. What's the
Hi,
We are using Flink Operator to deploy FlinkSessionJob. The jarring is pointing
to our private internal repo which is using self signed ssl cert. What's the
easiest way for the operator to ignore ssl cert validation?
Thanks,Calvin
Sent from Yahoo Mail on Android
Hi Harshit,
Yes, this should be supported.
Have you tried the following doc [1] for Table API and [2] for DataStream
API?
Regards,
Dian
[1]
https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/python/table/table_environment/#statebackend-checkpoint-and-restart-strategy
[2]
Dear Team,
I request for your support in issue I am facing with Pyflink. I am using
Pyflink version 1.14.4.
I want to use RockDb for checkpointing in stateful operation but it only
make a directory of checkpoint but there is no data is there like I do in
HashMap backend . Is Rockdb is
Hi Flink User Group,
Is there a way to convert SQL String to a
org.apache.flink.table.expressions.ResolvedExpression easily? I wish use this
in test. I manage to reverse engineer part of it but I don't think it matches
what Flink is really doing, below is my ugly code.
private List
Hi Yang,
Thanks for the suggestion! I looked into this volume sharing on EKS
yesterday but I couldn't figure it out right away.
The way that people come into the Apache Hop project is often with very
little technical knowledge since that's sort of the goal of the project:
make things easy.
Hi Matyas,
Again thank you very much for the information. I'm a beginner and all
the help is really appreciated. After some diving into the script
behind s3-artifiact-fetcher I kind of figured it out. Have an folder
sync'ed into the pod container of the task manager. Then I guess we should
be
Thank you Xingbo and our community for creating this release!
Op wo 22 jun. 2022 om 05:51 schreef Xingbo Huang :
> The Apache Flink community is very happy to announce the release of Apache
> Flink 1.14.5, which is the fourth bugfix release for the Apache Flink 1.14
> series.
>
> Apache Flink® is
20 matches
Mail list logo
