Operators supported by Spark Structured Streaming

2019-11-28 Thread shicheng31...@gmail.com
developing. How did you solve this problem? shicheng31...@gmail.com

ThriftServer gc over exceed and memory problem

2019-05-07 Thread shicheng31...@gmail.com
v.sh . And the executor's memory does increase. But the problem still exists. What puzzles me is The JDBC Server application serves as driver, only handle some code distribution and rpc connection works.Does it need so much meormy? If so , how to increase it's memory? shicheng31...@gmail.com

Structured Streaming initialized with cached data or others

2019-04-22 Thread shicheng31...@gmail.com
state'? Or other solutions? Thanks! shicheng31...@gmail.com

returning type of function that needs to be passed to method 'mapWithState'

2019-03-11 Thread shicheng31...@gmail.com
= keyValueDStream.mapWithState[StateType, MappedType](spec) Can anyone help me with this problem?Thanks! shicheng31...@gmail.com

Fw: how to reset streaming state regularly

2019-02-26 Thread shicheng31...@gmail.com
direct or indirect API for this in spark? Or is there any better solution for this? Thanks! shicheng31...@gmail.com