Hi Rafael,
We are seeing increasing interest in Drill obtaining data via REST. At present,
there are no real standards for things like telling the server which fields are
wanted, or "pushing" filter conditions to the source. It would be great if we
can build on Charle's work to add some kind of solution.
Can you share a bit about the REST service to which you want to connect? How
does it handle the "projection" and "filter" issues described above? How does
it return the data? Streaming JSON? JSON embedded in a response structure?
Something else?
Thanks,
- Paul
On Tuesday, March 24, 2020, 7:17:20 AM PDT, Jaimes, Rafael - 0993 - MITLL
<rafael.jai...@ll.mit.edu> wrote:
Thank you so much. I apologize, looks like someone asked a similar question
right after I checked the archives yesterday. This looks great.
- Rafael
From: Charles Givre <cgi...@gmail.com>
Sent: Tuesday, March 24, 2020 10:14 AM
To: user@drill.apache.org
Cc: Jaimes, Rafael - 0993 - MITLL <rafael.jai...@ll.mit.edu>
Subject: Re: REST data source?
Hi Rafael,
Thanks for your interest in Drill. To answer your question, there is a PR in
progress which allows you to query REST APIs from Drill. [1]. Here's a link to
the documentation as well. [2]. The idea behind Drill is to be able to query a
wide variety of data sources, and this PR will enable you to reach out to REST
endpoints and query that data.
Mechanically, this is very different from how Drill queries other RDBMS systems
via JDBC. If you have any questions, please let me know.
Thanks,
[1]: https://github.com/apache/drill/pull/1892
[2]:
https://github.com/apache/drill/blob/27e72499a3a80c0b2927d532d2d4959d8be4eea6/contrib/storage-http/README.md
On Mar 24, 2020, at 9:22 AM, Jaimes, Rafael - 0993 - MITLL
<rafael.jai...@ll.mit.edu> wrote:
I know you can use REST API to query against Drill, but can Drill make REST
queries itself?
It might seem unnecessary but if the idea is one stop shop for all querying, I
don’t see how it’s different than using SQL against Drill which then queries
against a RDBMS using SQL.
Thanks in advance.
