Re: How would I use OneInputStreamOperator to deal with data skew?

There is no reason for it, the operator and function doesn't rely on the logic which AbstractUdfStreamOperator supplied. Best, Kurt On Wed, Apr 17, 2019 at 4:35 PM Felipe Gutierrez < felipe.o.gutier...@gmail.com> wrote: > Thanks for the tip! I guess now it is working as it should be >

Re: How would I use OneInputStreamOperator to deal with data skew?

I mean no particular reason. Best, Kurt On Wed, Apr 17, 2019 at 7:44 PM Kurt Young wrote: > There is no reason for it, the operator and function doesn't rely on the > logic which AbstractUdfStreamOperator supplied. > > Best, > Kurt > > > On Wed, Apr 17, 2019 at 4:35 PM Felipe Gutierrez < > fel

Re: How would I use OneInputStreamOperator to deal with data skew?

Thanks for the tip! I guess now it is working as it should be . Just one last question. Why did you decide to use "AbstractStreamOperator" instead o

Re: How would I use OneInputStreamOperator to deal with data skew?

I think you might mixed some test codes with the operator. "List getOutputs()" is from "TestMapBundleFunction" and only used for validation. For the real usage, you need to write whatever records you want to emit to the "collector" which passed in during "finishBundle". Best, Kurt On Wed, Apr

Re: How would I use OneInputStreamOperator to deal with data skew?

Hi Kurt, How do you make the finishBundle method returns the combined tuples? I saw that there is a method "List getOutputs()" which is

Re: How would I use OneInputStreamOperator to deal with data skew?

I think you can simply copy the source codes to your project if maven dependency can not be used. Best, Kurt On Mon, Apr 15, 2019 at 9:47 PM Felipe Gutierrez < felipe.o.gutier...@gmail.com> wrote: > Hi again Kurt, > > could you please help me with the pom.xml file? I have included all Table > e

Re: How would I use OneInputStreamOperator to deal with data skew?

Hi again Kurt, could you please help me with the pom.xml file? I have included all Table ecosystem dependencies and the flink-table-runtime-blink as well. However the class org.apache.flink.table.runtime.context.ExecutionContext is still not found. I guess I am missing some dependency, but I do no

Re: How would I use OneInputStreamOperator to deal with data skew?

oh, yes. I just saw. I will use 1.9 then. thanks *--* *-- Felipe Gutierrez* *-- skype: felipe.o.gutierrez* *--* *https://felipeogutierrez.blogspot.com * On Mon, Apr 15, 2019 at 3:23 PM Kurt Young wrote: > It's because all blink codes are not shipped with

Re: How would I use OneInputStreamOperator to deal with data skew?

It's because all blink codes are not shipped with 1.8.0, they current only available in 1.9-SNAPSHOT. Best, Kurt On Mon, Apr 15, 2019 at 7:18 PM Felipe Gutierrez < felipe.o.gutier...@gmail.com> wrote: > Hi, > > what are the artifacts that I have to import on maven in order to use > Blink Api? >

Re: How would I use OneInputStreamOperator to deal with data skew?

Hi, what are the artifacts that I have to import on maven in order to use Blink Api? I am using Flink 1.8.0 and I am trying to import blink code to use its ExecutionContext

Re: How would I use OneInputStreamOperator to deal with data skew?

Cool, thanks Kurt! *-* *- Felipe Gutierrez* *- skype: felipe.o.gutierrez* *- **https://felipeogutierrez.blogspot.com * * * On Mon, Apr 15, 2019 at 6:06 AM Kurt Young wrote: > Hi, > > You can checkout the bundle opera

Re: How would I use OneInputStreamOperator to deal with data skew?

Hi, You can checkout the bundle operator which used in Blink to perform similar thing you mentioned: https://github.com/apache/flink/blob/blink/flink-libraries/flink-table/src/main/java/org/apache/flink/table/runtime/bundle/BundleOperator.java Best, Kurt On Fri, Apr 12, 2019 at 8:05 PM Felipe G

How would I use OneInputStreamOperator to deal with data skew?

Hi, I was trying to implement a better way to handle data skew using Flink and I found this talk from #FlinkForward SF 2017: "Cliff Resnick & Seth Wiesman - From Zero to Streaming " [1] which says that they used OneInputStreamOperator [2]. Through it, they could