Re:Re: running updates using SPARK

2018-12-23 Thread 大啊
Hi Gourav Sengupta, Thank you provide the infomation of Databricks. At 2018-12-21 16:55:52, "Gourav Sengupta" wrote: Hi Jiaan, Spark does support UPDATES but in the version that Databricks has. The question to the community was asking when are they going to support it. Regards, Gourav

Re: running updates using SPARK

2018-12-21 Thread Gourav Sengupta
Hi Jiaan, Spark does support UPDATES but in the version that Databricks has. The question to the community was asking when are they going to support it. Regards, Gourav On Fri, 21 Dec 2018, 03:36 Jiaan Geng I think Spark is a Calculation engine design for OLAP or Ad-hoc.Spark is > not > a

Re: running updates using SPARK

2018-12-20 Thread Jiaan Geng
I think Spark is a Calculation engine design for OLAP or Ad-hoc.Spark is not a traditional relational database,UPDATE need some mandatory constraint like transaction and lock. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

running updates using SPARK

2018-12-20 Thread Gourav Sengupta
Hi, Is there any time soon that SPARK will support UPDATES? Databricks does provide Delta which supports UPDATE, but I think that the open source SPARK does not have the UPDATE option. HIVE has been supporting UPDATES for a very very long time now, and I was thinking when would that become