Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-12 Thread Stefan Ziegler
if you remove a config from the "formats" section, Drill should not be able to parse the file in question. So for example if you don't have the 'csv' format or 'excel' then Drill will not be able to parse those formats. Best, -- C > On Jul 11, 2023, at 2:42 AM, Stefan Ziegler >

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-12 Thread Stefan Ziegler
way, IMHO, the best thing to do would be to make sure that the plugins > in your conf file do not have the same names as the pluigns that appear in > the UI. That's what I was getting at. Does that make sense? > Best, > -- C > > > On Jul 12, 2023, at 11:57 AM, Stefan Ziegler <

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-18 Thread Stefan Ziegler
Hi Charles it was indeed some conflict. After renaming my storage plugin to a distinct name it worked. regards Stefan On Wed, Jul 12, 2023 at 6:48 PM Stefan Ziegler wrote: > Thanks. Yes. I'm going to try the renaming approach. > > Not a rant but isn't the whole point of a "s

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-09 Thread Stefan Ziegler
Btw: I assumed that the list of formats act as a restriction. Probably I'm wrong. Stefan On Sun, Jul 9, 2023 at 5:27 PM Stefan Ziegler wrote: > Hi > > I'm using storage-plugins-override.conf to configure the storage plugins > on startup. My storage configurations contain onl

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-09 Thread Stefan Ziegler
Not defining a format seems to prevent the user from querying the specific format. E.g. after deleting the xml format definition in the web gui, I'm not able to query xml files anymore. So I guess my assumption was right. Stefan On Sun, Jul 9, 2023 at 5:41 PM Stefan Ziegler wrote: > Btw

Respecting formats restriction when using storage-plugins-override.conf

2023-07-09 Thread Stefan Ziegler
Hi I'm using storage-plugins-override.conf to configure the storage plugins on startup. My storage configurations contain only one or two formats (parquet, json, csv). Checking the storages in the web gui I noticed that for all the storages all formats are enabled, e.g. msaccess, iceberg etc. Is

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-10 Thread Stefan Ziegler
te with what format plugin. Out of curiosity, why are you using the > .conf files for this? > -- C > > > > On Jul 9, 2023, at 12:03 PM, Stefan Ziegler > wrote: > > > > Not defining a format seems to prevent the user from querying the > specific > > format. E.g.

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-10 Thread Stefan Ziegler
cation": "/", "writable": false, "defaultInputFormat": "parquet", "allowAccessOutsideWorkspace": false } }, "formats": { "parquet": { "type": "parquet"

Re: Respecting formats restriction when using storage-plugins-override.conf

2023-07-10 Thread Stefan Ziegler
> the UI versions have a higher priority than the .conf versions. Does that > make sense? > > -- C > > [1]: > https://drill.apache.org/docs/configuring-storage-plugins/#configuring-storage-plugins-with-the-storage-plugins-overrideconf-file > > > > > On Jul 10, 2023,