Re: Getting runtime context from scalar and table functions

2018-04-04 Thread Fabian Hueske
Yes, metrics won't work for this use case. Before we had proper metrics support, accumulators were often used as a work around. In general, the Table API & SQL in Flink are designed to keep all data in tables and not "leak" data on the side. Best, Fabian 2018-04-04 22:08 GMT+02:00 Darshan Singh

Re: Getting runtime context from scalar and table functions

2018-04-04 Thread Darshan Singh
I doubt the metrics will work as I will need to get the String output. I will need to use figure out something else. Basically I will pass my function a string and will get some columns back but if my string is something special. Then I will need to get extra information. I am using the data set s

Re: Getting runtime context from scalar and table functions

2018-04-04 Thread Darshan Singh
Thanks for getting back to me. I was trying to see various options to accumulate(sort of list append) some of my data. The amount of appended data is quite small so I wanted to see if I can use accumulators and once the job is done I can get all the data and then use the way I want to use. I guess

Re: Getting runtime context from scalar and table functions

2018-04-04 Thread Fabian Hueske
Hi Darshan, Accumulators are not exposed to UDFs of the Table API / SQL. What's your use case for these? Would metrics do the job as well? Best, Fabian 2018-04-04 21:31 GMT+02:00 Darshan Singh : > Hi, > > I would like to use accumulators with table /scalar functions. However, I > am not able to