Re: Supports Dynamic Table Options for Spark SQL

It's useful to have a SQL API to specify table options, similar to the DataFrameReader API. However, I share the same concern from @Hyukjin Kwon and am not very comfortable with using hints to do it. In the PR, someone mentioned TVF. I think it's better than hints, but still has problems. For

Re: [VOTE] SPIP: Row-level operations in Data Source V2

+1 (non binding) view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical

Re: Supports Dynamic Table Options for Spark SQL

This concept is explained here somehow. If this is true why cannot we just use SELECT * FROM VERSION AS OF view my Linkedin profile

Re: [VOTE][RESULT] SPIP: Row-level operations in Data Source V2

Sorry, it should be 13 +1 votes and no -1 or +0 votes, I missed Yufei Gu's vote during editing the list. Updated vote list: Liang-Chi Hsieh* Anton Okolnychyi DB Tsai* Yufei Gu Huaxin Gao Dongjoon Hyun* Russell Spitzer Mich Talebzadeh Ryan Blue Chao Sun John Zhuge Wenchen Fan* Gengliang Wang * =

Re: Supports Dynamic Table Options for Spark SQL

Mich, time travel will use the newly added VERSION AS OF or TIMESTAMP AS OF syntax. On Tue, Nov 16, 2021 at 12:40 AM Mich Talebzadeh wrote: > As I stated before, hints are designed to direct the optimizer to choose > a certain query execution plan based on the specific criteria. > > > -- time

[VOTE][RESULT] SPIP: Row-level operations in Data Source V2

Hi all, The vote passed with the following 12 +1 votes and no -1 or +0 votes: Liang-Chi Hsieh* Anton Okolnychyi DB Tsai* Huaxin Gao Dongjoon Hyun* Russell Spitzer Mich Talebzadeh Ryan Blue Chao Sun John Zhuge Wenchen Fan* Gengliang Wang * = binding Thank you guys all for your feedback and

Re: [VOTE] SPIP: Row-level operations in Data Source V2

+1 (non-binding) On Tue, Nov 16, 2021 at 9:03 PM Wenchen Fan wrote: > +1 > > On Mon, Nov 15, 2021 at 2:54 AM John Zhuge wrote: > >> +1 (non-binding) >> >> On Sun, Nov 14, 2021 at 10:33 AM Chao Sun wrote: >> >>> +1 (non-binding). Thanks Anton for the work! >>> >>> On Sun, Nov 14, 2021 at 10:01

Re: [FYI] Build and run tests on Java 17 for Apache Spark 3.3

Great job! On Sat, Nov 13, 2021 at 11:18 AM Hyukjin Kwon wrote: > Awesome! > > On Sat, Nov 13, 2021 at 12:04 PM Xiao Li wrote: > >> Thank you! Great job! >> >> Xiao >> >> >> On Fri, Nov 12, 2021 at 7:02 PM Mridul Muralidharan >> wrote: >> >>> >>> Nice job ! >>> There are some nice API's which

Re: [VOTE] SPIP: Row-level operations in Data Source V2

+1 On Mon, Nov 15, 2021 at 2:54 AM John Zhuge wrote: > +1 (non-binding) > > On Sun, Nov 14, 2021 at 10:33 AM Chao Sun wrote: > >> +1 (non-binding). Thanks Anton for the work! >> >> On Sun, Nov 14, 2021 at 10:01 AM Ryan Blue wrote: >> >>> +1 >>> >>> Thanks to Anton for all this great work! >>>

Re: Supports Dynamic Table Options for Spark SQL

As I stated before, hints are designed to direct the optimizer to choose a certain query execution plan based on the specific criteria. -- time travel SELECT * FROM t /*+ OPTIONS('snapshot-id'='10963874102873L') */ The alternative would be to specify time travel by creating a snapshot based on