[jira] [Resolved] (APEXMALHAR-2369) S3 output module for tuple based output

2017-02-25 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaitanya resolved APEXMALHAR-2369. --- Resolution: Fixed Fix Version/s: 3.7.0 > S3 output module for tuple based out

[jira] [Commented] (APEXMALHAR-2369) S3 output module for tuple based output

2017-02-25 Thread ASF GitHub Bot (JIRA)
at: https://github.com/apache/apex-malhar/pull/542 > S3 output module for tuple based output > --- > > Key: APEXMALHAR-2369 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2369 > Project:

[jira] [Commented] (APEXMALHAR-2369) S3 output module for tuple based output

2017-01-24 Thread Yogi Devendra (JIRA)
S3 output module for tuple based output > --- > > Key: APEXMALHAR-2369 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2369 > Project: Apache Apex Malhar > Issue Type: Task >

[jira] [Updated] (APEXMALHAR-2369) S3 output module for tuple based output

2016-12-14 Thread Yogi Devendra (JIRA)
to HDFS. And then upload HDFS files to S3. This would lead to some end-to-end latency. But, it should OK for the S3 output case. > S3 output module for tuple based output > --- > > Key: APEXMALHAR-2369 >

[jira] [Created] (APEXMALHAR-2369) S3 output module for tuple based output

2016-12-14 Thread Yogi Devendra (JIRA)
Yogi Devendra created APEXMALHAR-2369: - Summary: S3 output module for tuple based output Key: APEXMALHAR-2369 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2369 Project: Apache Apex Malhar

[jira] [Resolved] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread Bhupesh Chawda (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhupesh Chawda resolved APEXMALHAR-2022. Resolution: Fixed Fix Version/s: 3.7.0 > S3 Output Module for file c

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread ASF GitHub Bot (JIRA)
at: https://github.com/apache/apex-malhar/pull/483 > S3 Output Module for file copy > -- > > Key: APEXMALHAR-2022 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2022 > Project: Apache Apex Malha

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread ASF GitHub Bot (JIRA)
request at: https://github.com/apache/apex-malhar/pull/483 > S3 Output Module for file copy > -- > > Key: APEXMALHAR-2022 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2022 > Project:

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread ASF GitHub Bot (JIRA)
request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR-2022-S3Output-multiPart Alternatively you

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-30 Thread chaithu14
GitHub user chaithu14 reopened a pull request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-30 Thread chaithu14
Github user chaithu14 closed the pull request at: https://github.com/apache/apex-malhar/pull/483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread ASF GitHub Bot (JIRA)
request at: https://github.com/apache/apex-malhar/pull/483 > S3 Output Module for file copy > -- > > Key: APEXMALHAR-2022 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2022 > Project:

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-30 Thread chaithu14
GitHub user chaithu14 reopened a pull request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-30 Thread ASF GitHub Bot (JIRA)
request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR-2022-S3Output-multiPart Alternatively you

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-30 Thread chaithu14
Github user chaithu14 closed the pull request at: https://github.com/apache/apex-malhar/pull/483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-28 Thread ASF GitHub Bot (JIRA)
request at: https://github.com/apache/apex-malhar/pull/483 > S3 Output Module for file copy > -- > > Key: APEXMALHAR-2022 > URL: https://issues.apache.org/jira/browse/APEXMALHAR-2022 > Project:

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-28 Thread chaithu14
GitHub user chaithu14 reopened a pull request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-28 Thread chaithu14
Github user chaithu14 closed the pull request at: https://github.com/apache/apex-malhar/pull/483 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-25 Thread Hitesh Kapoor (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Kapoor updated APEXMALHAR-2022: -- Assignee: Chaitanya (was: Hitesh Kapoor) > S3 Output Module for file c

[jira] [Commented] (APEXMALHAR-2022) S3 Output Module for file copy

2016-11-04 Thread ASF GitHub Bot (JIRA)
: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR-2022-S3Output-multiPart Alternatively you can

[GitHub] apex-malhar pull request #483: APEXMALHAR-2022 Developed S3 Output Module

2016-11-04 Thread chaithu14
GitHub user chaithu14 opened a pull request: https://github.com/apache/apex-malhar/pull/483 APEXMALHAR-2022 Developed S3 Output Module You can merge this pull request into a Git repository by running: $ git pull https://github.com/chaithu14/incubator-apex-malhar APEXMALHAR

Re: S3 Output Module

2016-10-27 Thread Mohit Jotwani
l, > > > > I am planning to implement the approach (2) of S3 Output Module which I > > proposed in my previous email. Performance would be better as compared to > > approach (1) because of uploading the blocks without saving it on HDFS. > > > > Please sha

Re: S3 Output Module

2016-10-27 Thread Sandeep Deshmukh
+1 Regards, Sandeep On Thu, Oct 27, 2016 at 1:53 PM, Chaitanya Chebolu < chaita...@datatorrent.com> wrote: > Hi All, > > I am planning to implement the approach (2) of S3 Output Module which I > proposed in my previous email. Performance would be better as compared to >

Re: S3 Output Module

2016-10-27 Thread Chaitanya Chebolu
Hi All, I am planning to implement the approach (2) of S3 Output Module which I proposed in my previous email. Performance would be better as compared to approach (1) because of uploading the blocks without saving it on HDFS. Please share your opinions. Regards, Chaitanya On Thu, Oct 20

Re: S3 Output Module

2016-10-20 Thread Chaitanya Chebolu
Hi All, I am proposing the below new design for S3 Output Module using multi part upload feature: Input to this Module: FileMetadata, FileBlockMetadata, ReaderRecord Steps for uploading files using S3 multipart feature: = 1. Initiate the upload. S3

[jira] [Updated] (APEXMALHAR-2022) S3 Output Module for file copy

2016-10-03 Thread Chaitanya (JIRA)
[ https://issues.apache.org/jira/browse/APEXMALHAR-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chaitanya updated APEXMALHAR-2022: -- Assignee: Hitesh Kapoor (was: Chaitanya) > S3 Output Module for file c