Re: Querying multiple s3 buckets

2020-11-22 Thread Sebastian Fischmeister
But this means that (1) the names have to be known upfront and (2) the list of buckets remains static. I'm looking for a method to dynamically search all buckets. Now, I could use the REST API to dynamically create drill bits after listing all buckets, but pushes responsibility to the user. It

Re: Querying multiple s3 buckets

2020-11-22 Thread Nitin Pawar
you can create multiple storages with different names to each bucker and query them in a single query On Sun, Nov 22, 2020 at 10:38 PM Sebastian Fischmeister < sfisc...@uwaterloo.ca> wrote: > Hi, > > I set up drill with min.io and have multiple buckets in minio. I was able > to setup an s3

Querying multiple s3 buckets

2020-11-22 Thread Sebastian Fischmeister
Hi, I set up drill with min.io and have multiple buckets in minio. I was able to setup an s3 connection to a single bucket, however, I actually want to run a query on all files in all buckets. Is this possible? Regards, Sebastian

Re: Does drill support variable arguments in customer UDAF

2020-11-22 Thread Vova Vysotskyi
Hi, Yes, it was implemented for both, UDF and UDAF. Please take a look at these examples of UADF var arg functions: https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/testing/CountArgumentsAggFunctions.java On 2020/10/28 19:34:25, Paul Rogers