Re: EMC ECS Configuration with Apache Drill

2019-08-21 Thread Paul Rogers
Hi Prabu & Ted, Ted is right, the next step to track this down is via debugging. As large projects go, Drill is actually easier to debug than most. (Hat's off the the team for achieving this valuable goal!) 1. Fork, clone and build Drill: [1] 2. In your IDE (both Eclipse and Intellij work) We

Re: EMC ECS Configuration with Apache Drill

2019-08-21 Thread Ted Dunning
Prabu, Yes. You can debug the code. It is a large codebase so that can be a bit of a trick to get started. I think that one of the most stable approaches is to build a test case that accesses the data you want (this doesn't have to become a public test case, it just makes debugging easier by

Re: EMC ECS Configuration with Apache Drill

2019-08-21 Thread Prabu Mohan
Thanks Ted. This is getting complex now, I thought that I might be missing something simple while configuring drill, but this seems to be far beyond that. I'm not sure whether I can get a proxy and also just in case if any other issues occur as well, is there a way I can debug the code to

Re: EMC ECS Configuration with Apache Drill

2019-08-19 Thread Ted Dunning
On Mon, Aug 19, 2019 at 11:33 AM Prabu Mohan wrote: > but i am able to connect to ECS via python using boto3 libraries without > any issues, I am able to write files to the bucket and read them back .. > > not sure why i am facing issues with drill though with the same credentials > The key

Re: EMC ECS Configuration with Apache Drill

2019-08-19 Thread Prabu Mohan
but i am able to connect to ECS via python using boto3 libraries without any issues, I am able to write files to the bucket and read them back .. not sure why i am facing issues with drill though with the same credentials On Mon, Aug 19, 2019 at 11:53 PM Ted Dunning wrote: > So that looks like

Re: EMC ECS Configuration with Apache Drill

2019-08-19 Thread Ted Dunning
So that looks like the security tokens aren't getting through to AWS correctly. On Mon, Aug 19, 2019 at 11:21 AM Prabu Mohan wrote: > Log info > > 2019-08-19 16:23:05,439 [22a54125-e1e7-29f6-a146-6cfd529b23d1:foreman] > INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id >

Re: EMC ECS Configuration with Apache Drill

2019-08-19 Thread Prabu Mohan
Log info 2019-08-19 16:23:05,439 [22a54125-e1e7-29f6-a146-6cfd529b23d1:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id 22a54125-e1e7-29f6-a146-6cfd529b23d1 issued by anonymous: use ecstest 2019-08-19 16:23:06,691 [22a54125-e1e7-29f6-a146-6cfd529b23d1:foreman]

Re: EMC ECS Configuration with Apache Drill

2019-08-19 Thread Ted Dunning
Did you see anything in any logs? On Sun, Aug 18, 2019 at 10:16 PM Prabu Mohan wrote: > I am able to connect to the http endpoint using boto3 from python (able to > retrieve files/store files), from IE with https and port 9021 , it comes > back with 403 Forbidden indicating that it was able

Re: EMC ECS Configuration with Apache Drill

2019-08-18 Thread Prabu Mohan
I am able to connect to the http endpoint using boto3 from python (able to retrieve files/store files), from IE with https and port 9021 , it comes back with 403 Forbidden indicating that it was able to connect to website but does not have permission to view the webpage ( may be due to credentials

Re: EMC ECS Configuration with Apache Drill

2019-08-18 Thread SorabhApache
Are you able to use the same configured endpoint *http://:9020* from your browser ? Thanks, Sorabh On Sun, Aug 18, 2019 at 11:55 AM Prabu Mohan wrote: > I'm trying to configure Apache Drill with EMC ECS, it was quite easy > configuring with AWS S3 and GCP Cloud Storage, but I'm facing issues >

EMC ECS Configuration with Apache Drill

2019-08-18 Thread Prabu Mohan
I'm trying to configure Apache Drill with EMC ECS, it was quite easy configuring with AWS S3 and GCP Cloud Storage, but I'm facing issues configuring with EMC ECS, When I use http with port 9020 as endpoint I face this error Error:SYSTEM ERROR: AmazonS3Exception: Status Code: 405, AWS