Re: Identify the task within PartitionRequestQueue

Hi Chris, The PartitionRequestQueue is a netty handler which would be reused by multiple tasks, so actually there might be a list of tasks releated to each ParititonRequestQueue. If you want to establish the mapping betwwen them, it might establish the mapping between subpartiiton view and

Re: Disable local data transportation

Hi Chris, I am not sure why you do not want to use local channel. Are there any problems for local channel in your case? The root cause of local channel is determined by scheduler which schedules both producer and consumer tasks into the same task manager. So if you want to change this

Re: Multiple select single result

SORRY about sending mail without completing :) , I also tried out different approach , which is instead of UNION ALL, use OR as below. ( InterceptID = 4508724 AND Provider_Info = 'Dhanuka' AND LIID LIKE '%193400835%' ) OR ( InterceptID = 4508724 AND Provider_Info = 'Dhanuka' AND LIID LIKE

Re: Multiple select single result

Hi Hequn, I think it's obvious when we see the job graph for 200 unions. I have attached the screenshot here with. I also tried out different approach , which is instead of UNION ALL On Mon, Jan 14, 2019 at 2:57 PM Hequn Cheng wrote: > Hi dhanuka, > > > I am trying to deploy 200 SQL unions

Re: Multiple select single result

Hi dhanuka, > I am trying to deploy 200 SQL unions and it seems all the tasks getting failing after some time. Would be great if you can show us some information(say exception stack) about the failure. Is it caused by OOM of job manager? > How do i allocate memory for task manager and job

[jira] [Created] (FLINK-11312) The link to Zookeeper is broken in "jobmanager_high_availability" document

Biao Liu created FLINK-11312: Summary: The link to Zookeeper is broken in "jobmanager_high_availability" document Key: FLINK-11312 URL: https://issues.apache.org/jira/browse/FLINK-11312 Project: Flink

Re: [DISCUSS] Bot for stale PRs on GitHub

+1 to the bot, but -1 to the automatically closing PR behavior. Can we just use the bolt to detect and tag the PR with stale flag and leave the decision whether to close the PR to the author? Best, Kurt On Sun, Jan 13, 2019 at 11:49 PM Kostas Kloudas wrote: > +1 to try the bot. > > It may,

Re: Multiple select single result

Hi Fabian, Thanks for the prompt reply and its working 珞. I am trying to deploy 200 SQL unions and it seems all the tasks getting failing after some time. How do i allocate memory for task manager and job manager. What are the factors need to be considered . Cheers Dhanuka On Sun, 13 Jan

Re: An exception about checkpoint

Hi, Leor Seems like the checkpoint file `/app/flink/checkpoints/918f49d9eb23bdea016e865182718a06/chk-10631/6e86cce6-9ac9-4856-b0a3-42c81fcafadc` did not exist for some reason, you can check the life cycle of this file from hdfs audit log and find out why the file did not exist. maybe the

Disable local data transportation

Hi all, let's have a look at a simple Join with two DataSources and parallelism p=5. The whole Job consists of 3 parts: 1. DataSource Task 2. Join Task 3. DataSink Task In the first task, the data is provided and prepared for the Join task. In particular each DataSource task creates

Re: [DISCUSS] Bot for stale PRs on GitHub

+1 to try the bot. It may, at first, seem less empathetic than a solution that involves a human monitoring the PRs, but, in essence, having a PR stale for months (or even years) is at least as discouraging for a new contributor. Labels could further reduce the problem of noise, but I think that

Apply for flink contributor permission

Hi, everyone I would like to make contribution to JIRA(FLINK-11311). Would anyone kindly give me the contribution permission? My JIRA id: libenchao Best regards -- Benchao Li School of Electronics Engineering and Computer Science, Peking University Tel:+86-15650713730 Email:

[jira] [Created] (FLINK-11311) StreamSource implements StreamOperator interface multiple times.

Benchao Li created FLINK-11311: -- Summary: StreamSource implements StreamOperator interface multiple times. Key: FLINK-11311 URL: https://issues.apache.org/jira/browse/FLINK-11311 Project: Flink

Re: Multiple select single result

Hi Dhanuka, The important error message here is "AppendStreamTableSink requires that Table has only insert changes". This is because you use UNION instead of UNION ALL, which implies duplicate elimination. Unfortunately, UNION is currently internally implemented as a regular aggregration which

Multiple select single result

Hi All, I am trying to select multiple results from Kafka and send results to Kafka different topic using Table API. But I am getting below error. Could you please help me on this. Query: SELECT TiggerID,'Rule3' as RuleName,mytime(ts) as ts1 , mytime(CURRENT_TIMESTAMP) as ts2 FROM dataTable

Re: [DISCUSS] Bot for stale PRs on GitHub

> > Hey, > I agree with Timo here that we should introduce labels that will improve communication for PRs. IMHO this will show what percentage of PRs is really stale and not just abandoned due to the misunderstanding or other communication issues. Best Regards, Dom.

An exception about checkpoint

Hey, Recently I used flink1.6.3 to run a task and the following exception occurred. Can someone tell me how to solve this problem? AsynchronousException{java.lang.Exception: Could not materialize checkpoint 10631 for operator Source: Custom Source -> Flat Map -> (Map -> Timestamps/Watermarks ->