Steve Loughran created HADOOP-15364:
---------------------------------------
Summary: Add support for S3 Select to S3A
Key: HADOOP-15364
URL: https://issues.apache.org/jira/browse/HADOOP-15364
Project: Hadoop Common
Issue Type: Sub-task
Components: fs/s3
Reporter: Steve Loughran
Assignee: Steve Loughran
Expect a PoC patch for this in a couple of days;
* it'll depend on an SDK update to work, plus a couple of of other minor changes
* Adds command line option too
{code}
hadoop s3guard select -header use -compression gzip -limit 100
s3a://landsat-pds/scene_list.gz" \
"SELECT s.entityId FROM S3OBJECT s WHERE s.cloudCover = '0.0' "
{code}
For wider use we'll need to implement the HADOOP-15229 so that callers can pass
down the expression along with any other parameters
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
