Re: Structured Streaming & Enrichment Broadcasts

2019-11-28 Thread hahaha sc
I have a scenario similar to yours, but we are using udf to do exactly that. But you need to get the value of a broadcast variable from the udf. But it's not clear how to achieve it, does anyone know? Burak Yavuz 于2019年11月19日周二 下午12:23写道: > If you store the data that you're going to broadcast as

Re: Operators supported by Spark Structured Streaming

2019-11-28 Thread hahaha sc
It is still not complete. For example, the supported operators are different under different outputmodes. For developers, only try. Jungtaek Lim 于2019年11月29日周五 下午1:36写道: > Hi, > > Unsupported operations in Structured Streaming is explained in the guide > doc. > > http://spark.apache.org/docs/lat