Steve Loughran created HADOOP-15364:

             Summary: Add support for S3 Select to S3A
                 Key: HADOOP-15364
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3
            Reporter: Steve Loughran
            Assignee: Steve Loughran

Expect a PoC patch for this in a couple of days; 

* it'll depend on an SDK update to work, plus a couple of of other minor changes
* Adds command line option too 
hadoop s3guard select -header use -compression gzip -limit 100 
s3a://landsat-pds/scene_list.gz" \
"SELECT s.entityId FROM S3OBJECT s WHERE s.cloudCover = '0.0' "

For wider use we'll need to implement the HADOOP-15229 so that callers can pass 
down the expression along with any other parameters

This message was sent by Atlassian JIRA

To unsubscribe, e-mail:
For additional commands, e-mail:

Reply via email to