es.
>> I thought this can be achieved by overriding the defaut storages with the
>> “override” file. This seems to work except the strange behaviour with the
>> formats.
>> >
>> > regards
>> > Stefan
>> >
>> > Sent from Outlook for iOS<
storages with the
> “override” file. This seems to work except the strange behaviour with the
> formats.
> >
> > regards
> > Stefan
> >
> > Sent from Outlook for iOS<https://aka.ms/o0ukef>
> > ________
> > From: Cha
: Wednesday, July 12, 2023 5:04 PM
> To: user
> Subject: Re: Respecting formats restriction when using
> storage-plugins-override.conf
>
> Hi Stefan,
> My biggest piece of advice here would just be to make sure the plugins
> specified in the override file do not confli
with the
formats.
regards
Stefan
Sent from Outlook for iOS<https://aka.ms/o0ukef>
From: Charles Givre
Sent: Wednesday, July 12, 2023 5:04 PM
To: user
Subject: Re: Respecting formats restriction when using
storage-plugins-override.conf
Hi Stefan,
My b
Hi Stefan,
My biggest piece of advice here would just be to make sure the plugins
specified in the override file do not conflict with the UI-based configs. It
may make sense to have completely different configs in each location. IE:
dfs-conf and (plain) dfs.
I think that should solve all
HI Stefan,
What's in the config in the UI? Can you also please clarify what queries are
running which indicate that your configs aren't working?
Best,
-- C
> On Jul 10, 2023, at 1:11 PM, Stefan Ziegler
> wrote:
>
> "storage": {
> cp: {
>type: "file",
>connection: "classpath:///",
"storage": {
cp: {
type: "file",
connection: "classpath:///",
formats: {
"csv" : {
type: "text",
extensions: [ "csv" ],
delimiter: ","
}
}
enabled: true
}
}
"storage": {
dfs: {
type: "file",
connection: "file:///",
Can you share your configs with any sensitive info redacted? The lists don't
support images, so please just cut/paste the json.
I had another idea...
-- C
> On Jul 10, 2023, at 12:28 PM, Stefan Ziegler
> wrote:
>
> Yes, I think I'm following these instructions. And the file is not
>
Yes, I think I'm following these instructions. And the file is not
completely ignored. It creates additional format definitions. Let's say I
white list some formats in my storage configuration and Drill adds more
formats (which I don't want). Is there another way to start a "vanilla"
Drill
Hi Stefan,
My apologies.. Ok.. so the issue is that the storage-plugins-override.conf is
being ignored. I've never actually used this feature, so I wasn't familiar
with it, but are you folllowing the instructions here [1] with respect to
configuration and restarting Drill? My suggestion
Hi Charles
I use a "storage-plugins-override.conf" file. My attempt is to have the
configuration for my storages in a single file and Drill can pick up the
configuration on startup. I put "storage-plugins-override.conf" in the conf
directory and Drill creates the storages on startup but (and that
HI Stefan,
Thanks for your interest in Drill. You have to define the format config for
each storage plugin. Otherwise Drill doesn't know what extension to associate
with what format plugin. Out of curiosity, why are you using the .conf files
for this?
-- C
> On Jul 9, 2023, at 12:03
Not defining a format seems to prevent the user from querying the specific
format. E.g. after deleting the xml format definition in the web gui, I'm
not able to query xml files anymore. So I guess my assumption was right.
Stefan
On Sun, Jul 9, 2023 at 5:41 PM Stefan Ziegler
wrote:
> Btw: I
Btw: I assumed that the list of formats act as a restriction. Probably I'm
wrong.
Stefan
On Sun, Jul 9, 2023 at 5:27 PM Stefan Ziegler
wrote:
> Hi
>
> I'm using storage-plugins-override.conf to configure the storage plugins
> on startup. My storage configurations contain only one or two
14 matches
Mail list logo
