Re: [DISCUSS] USING syntax for Datasource V2

2018-08-21 Thread Russell Spitzer
So the external catalogue is really more of a connector to different source of truth fo table listings? That makes more sense. On Tue, Aug 21, 2018 at 6:16 PM Ryan Blue wrote: > I don’t understand why a Cassandra Catalogue wouldn’t be able to store > metadata references for a parquet table just

Re: [DISCUSS] USING syntax for Datasource V2

2018-08-21 Thread Ryan Blue
I don’t understand why a Cassandra Catalogue wouldn’t be able to store metadata references for a parquet table just as a Hive Catalogue can store references to a C* datastource. Sorry for the confusion. I’m not talking about a catalog that stores its information in Cassandra. I’m talking about a

Re: [DISCUSS] USING syntax for Datasource V2

2018-08-20 Thread Russell Spitzer
I'm not sure I follow what the discussion topic is here > For example, a Cassandra catalog or a JDBC catalog that exposes tables in those systems will definitely not support users marking tables with the “parquet” data source. I don't understand why a Cassandra Catalogue wouldn't be able to

Re: [DISCUSS] USING syntax for Datasource V2

2018-08-20 Thread Ryan Blue
Thanks for posting this discussion to the dev list, it would be great to hear what everyone thinks about the idea that USING should be a catalog-specific storage configuration. Related to this, I’ve updated the catalog PR, #21306 , to include an