Re: GenericFileOutputOpeator doesn't work for all hadoop file systems

I would suggest, we override "openStream" in GenericFileOutputOpeator, as suggested in option 2 and then handle "append" in different way for FS which doesn't support append. Or else create concrete classes for all file systems which don't support append and override the required functions. -1

[jira] [Assigned] (APEXMALHAR-2183) Add user document for CsvFormatter operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Venkatesh Kottapalli reassigned APEXMALHAR-2183: Assignee: Venkatesh Kottapalli > Add user document for

[jira] [Commented] (APEXCORE-515) Refresh tokens failing in some scenarios with a login failure message

[ https://issues.apache.org/jira/browse/APEXCORE-515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436009#comment-15436009 ] ASF GitHub Bot commented on APEXCORE-515: - GitHub user PramodSSImmaneni opened a pull request:

[GitHub] apex-core pull request #374: APEXCORE-515 Providing principal for token refr...

GitHub user PramodSSImmaneni opened a pull request: https://github.com/apache/apex-core/pull/374 APEXCORE-515 Providing principal for token refresh @gauravgopi123 please see You can merge this pull request into a Git repository by running: $ git pull

[GitHub] apex-malhar pull request #378: Apexmalhar 2183

GitHub user venkateshkottapalli opened a pull request: https://github.com/apache/apex-malhar/pull/378 Apexmalhar 2183 You can merge this pull request into a Git repository by running: $ git pull https://github.com/venkateshkottapalli/apex-malhar APEXMALHAR-2183

[jira] [Updated] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bright chen updated APEXMALHAR-2190: Summary: Use reusable buffer to serial spillable data structure (was: Use shared

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435402#comment-15435402 ] Siyuan Hua commented on APEXMALHAR-2199: 0.9 operator should not have this problem > 0.8

[jira] [Commented] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435399#comment-15435399 ] Siyuan Hua commented on APEXMALHAR-2199: [~chaithu] Can you please take a look? The bug is in

[jira] [Updated] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

[ https://issues.apache.org/jira/browse/APEXMALHAR-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyuan Hua updated APEXMALHAR-2199: --- Affects Version/s: 3.5.0 3.4.0 > 0.8 kafka input operator doesn't

[jira] [Created] (APEXMALHAR-2199) 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support)

Siyuan Hua created APEXMALHAR-2199: -- Summary: 0.8 kafka input operator doesn't support chroot zookeeper path (multitenant kafka support) Key: APEXMALHAR-2199 URL:

[jira] [Commented] (APEXCORE-475) change the YARN_APPLICATION_TYPE from DataTorrent to ApacheApex

[ https://issues.apache.org/jira/browse/APEXCORE-475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435001#comment-15435001 ] ASF GitHub Bot commented on APEXCORE-475: - GitHub user sandeshh opened a pull request:

[GitHub] apex-core pull request #373: APEXCORE-475 1st part, as discussed in the jira...

GitHub user sandeshh opened a pull request: https://github.com/apache/apex-core/pull/373 APEXCORE-475 1st part, as discussed in the jira. This will make the c… …lient the forward compatible, then in the next release we can change the type to of the applicationt to ApacheApex

GenericFileOutputOpeator doesn't work for all hadoop file systems

Hi All, GenericFileOutputOpeator which is in Malhar repository works only for few file systems. GenericFileOutputOpeator is extended from AbstractFileOutputOperator. Reason: openStream() method which is in AbstractFileOutputOperator calls append operation. But, all the file systems doesn't

[jira] [Resolved] (APEXMALHAR-2185) Add a Deduper implementation for Bounded data

[ https://issues.apache.org/jira/browse/APEXMALHAR-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2185. --- Resolution: Resolved Fix Version/s: 3.5.0 > Add a Deduper

[jira] [Commented] (APEXMALHAR-2185) Add a Deduper implementation for Bounded data

[ https://issues.apache.org/jira/browse/APEXMALHAR-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434593#comment-15434593 ] ASF GitHub Bot commented on APEXMALHAR-2185: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #369: APEXMALHAR-2185: Added Bounded Deduper

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/369 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Resolved] (APEXMALHAR-2100) Development of Inner Join Operator using Spillable Datastructures

[ https://issues.apache.org/jira/browse/APEXMALHAR-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chinmay Kolhatkar resolved APEXMALHAR-2100. --- Resolution: Fixed Fix Version/s: 3.5.0 > Development of Inner

[GitHub] apex-malhar pull request #330: APEXMALHAR-2100 Implementation of Inner Join ...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/330 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2100) Development of Inner Join Operator using Spillable Datastructures

[ https://issues.apache.org/jira/browse/APEXMALHAR-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15434434#comment-15434434 ] ASF GitHub Bot commented on APEXMALHAR-2100: Github user asfgit closed the pull request