npawar opened a new pull request #6354:
URL: https://github.com/apache/incubator-pinot/pull/6354


   ## Description
   Adding APIs for uploading data to an offline table. These are meant for 
quick testing/trials, and not intended for production usage. We will be using 
these in the Cluster Manager to introduce a "Test a file" flow.
   
   **File ingest**
   ```
   curl 
"http://localhost:9000/ingestFromFile?tableName=transcript_OFFLINE&batchConfigMapStr={"inputFormat":"json"}";
  -F [email protected]
   ```
   
   **URI ingest** 
   Note: 
   1. The fs details only need to be provided if scheme is not already 
registered. 
   2. Credentials will by default be taken from local aws credentials
   ```
   curl 
"http://localhost:9000/ingestFromURI?tableName=transcript_OFFLINE&batchConfigMapStr={"inputFormat":"json","input.fs.className":"org.apache.pinot.plugin.filesystem.S3PinotFS","input.fs.prop.region":"us-central","input.fs.prop.accessKey":"foo","input.fs.prop.secretKey":"bar"}&sourceURIStr=s3://test.bucket/jsondata/part1.json";
 \
     -X POST
   ```
   
   ## Release Notes
   Introduced 2 new APIs `/ingestFromFile` and `/ingestFromURI`


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to