Re: Custom datasource: when acquire and release a lock?

2019-05-26 Thread Jörn Franke
What does your data source structure look like? Can’t you release it at the end of the build scan method? What technology is used in the transactional data endpoint? > Am 24.05.2019 um 15:36 schrieb Abhishek Somani : > > Hi experts, > > I am trying to create a custom Spark Datasource(v1) to r

Re: Custom datasource: when acquire and release a lock?

2019-05-26 Thread Abhishek Somani
Hi experts, I'll be very grateful if someone could help. Thanks, Abhishek On Fri, May 24, 2019 at 7:06 PM Abhishek Somani wrote: > Hi experts, > > I am trying to create a custom Spark Datasource(v1) to read from a > transactional data endpoint, and I need to acquire a lock with the endpoint >

Re: [VOTE][SPARK-27396] SPIP: Public APIs for extended Columnar Processing Support

2019-05-26 Thread Tom Graves
More feedback would be great, this has been open a long time though, let's extend til Wednesday the 29th and see where we are at. Tom Sent from Yahoo Mail on Android On Sat, May 25, 2019 at 6:28 PM, Holden Karau wrote: Same I meant to catch up after kubecon but had some unexpected trave