Re: Exactly Once scenario in JdbcPOJOInsertOutput operator

Connection.getTransactionIsolation() can be used to determine if transactions are supported at database level. In MySQL, in the same database we can have tables supporting transactions (e.g. InnoDB) and not supporting transactions. Regards, Hitesh On Mon, Oct 24, 2016 at 9:12 PM, Munagala

[jira] [Updated] (APEXMALHAR-2271) Special SpillableSetMultimap<K, Window.SessionWindow> handling in ManagedState in SpillableSessionWindowedStorage

[ https://issues.apache.org/jira/browse/APEXMALHAR-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXMALHAR-2271: -- Assignee: Siyuan Hua (was: David Yan) > Special SpillableSetMultimap

[jira] [Comment Edited] (APEXCORE-564) We should be able to remove loggers level settings

[ https://issues.apache.org/jira/browse/APEXCORE-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603449#comment-15603449 ] Vlad Rozov edited comment on APEXCORE-564 at 10/24/16 10:43 PM: No, it

[jira] [Commented] (APEXCORE-564) We should be able to remove loggers level settings

[ https://issues.apache.org/jira/browse/APEXCORE-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603449#comment-15603449 ] Vlad Rozov commented on APEXCORE-564: - No, it does not. Setting log level to null in

[jira] [Commented] (APEXMALHAR-2241) The metadata kafka consumer should also pickup the properties setting on the kafka input operator.

[ https://issues.apache.org/jira/browse/APEXMALHAR-2241?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1560#comment-1560 ] ASF GitHub Bot commented on APEXMALHAR-2241: Github user asfgit closed the pull request

[jira] [Resolved] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved APEXMALHAR-2190. -- Resolution: Fixed Fix Version/s: 3.6.0 > Use reusable buffer to serial

[jira] [Commented] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603162#comment-15603162 ] ASF GitHub Bot commented on APEXMALHAR-2190: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #404: APEXMALHAR-2190 #resolve #comment Use reusabl...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] apex-malhar pull request #465: APEXMALHAR-2190 Use reusable buffer for seria...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/465 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2190) Use reusable buffer to serial spillable data structure

[ https://issues.apache.org/jira/browse/APEXMALHAR-2190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603139#comment-15603139 ] ASF GitHub Bot commented on APEXMALHAR-2190: Github user asfgit closed the pull request

[jira] [Resolved] (APEXCORE-562) RecordingsAgent: returns records for offset beyond number of tuples

[ https://issues.apache.org/jira/browse/APEXCORE-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved APEXCORE-562. Resolution: Fixed > RecordingsAgent: returns records for offset beyond number of tuples >

[jira] [Updated] (APEXCORE-562) RecordingsAgent: returns records for offset beyond number of tuples

[ https://issues.apache.org/jira/browse/APEXCORE-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan updated APEXCORE-562: --- Fix Version/s: 3.5.0 > RecordingsAgent: returns records for offset beyond number of tuples >

[GitHub] apex-core pull request #412: APEXCORE-562: RecordingsAgent returns records f...

Github user asfgit closed the pull request at: https://github.com/apache/apex-core/pull/412 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (APEXCORE-562) RecordingsAgent: returns records for offset beyond number of tuples

[ https://issues.apache.org/jira/browse/APEXCORE-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603094#comment-15603094 ] ASF GitHub Bot commented on APEXCORE-562: - Github user asfgit closed the pull request at:

[jira] [Assigned] (APEXCORE-551) Shutdown the application with failed status

[ https://issues.apache.org/jira/browse/APEXCORE-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandesh reassigned APEXCORE-551: Assignee: Sandesh > Shutdown the application with failed status >

Exactly Once scenario in JdbcPOJOInsertOutput operator

Hi All, Need your views and suggestions regarding JdbcPOJOInsertOutput operator. This operator creates a transaction at the start of window, executes batches of SQL updates, and closes the transaction at the end of the window. Each tuple corresponds to an SQL insert statement. The operator groups

[jira] [Commented] (APEXMALHAR-2237) Dynamic partitioning support for FSInputModule

[ https://issues.apache.org/jira/browse/APEXMALHAR-2237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601734#comment-15601734 ] ASF GitHub Bot commented on APEXMALHAR-2237: Github user asfgit closed the pull request

[GitHub] apex-malhar pull request #428: APEXMALHAR-2237 : Changes in FSInputModule to...

Github user asfgit closed the pull request at: https://github.com/apache/apex-malhar/pull/428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequentialFileRead property of FSRecordReader

[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2314: Summary: Improper functioning in partitioning of sequentialFileRead property

[jira] [Updated] (APEXMALHAR-2314) Improper functioning in partitioning of sequencialFileRead property of FSRecordReader

[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Deepak Narkhede updated APEXMALHAR-2314: Description: Fix the StreamCodec for FSRecordReader, initially it was hashcode

[jira] [Commented] (APEXMALHAR-2314) Improper functioning in partitioning of sequencialFileRead property of FSRecordReader

[ https://issues.apache.org/jira/browse/APEXMALHAR-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601367#comment-15601367 ] ASF GitHub Bot commented on APEXMALHAR-2314: GitHub user deepak-narkhede opened a pull

[GitHub] apex-malhar pull request #468: APEXMALHAR-2314 Improper functioning in parti...

GitHub user deepak-narkhede opened a pull request: https://github.com/apache/apex-malhar/pull/468 APEXMALHAR-2314 Improper functioning in partitioning for sequencialFileRead for FSRecord Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly always

[jira] [Commented] (APEXMALHAR-2257) Add documentation for Transform operator

[ https://issues.apache.org/jira/browse/APEXMALHAR-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601311#comment-15601311 ] ASF GitHub Bot commented on APEXMALHAR-2257: GitHub user chaithu14 opened a pull request:

[GitHub] apex-malhar pull request #467: APEXMALHAR-2257 Added documentation of Transf...

GitHub user chaithu14 opened a pull request: https://github.com/apache/apex-malhar/pull/467 APEXMALHAR-2257 Added documentation of Transform Operator You can merge this pull request into a Git repository by running: $ git pull

[jira] [Created] (APEXMALHAR-2313) Jenkins checks failing intermittently at ApplicationTest.testIterationApp

Francis Fernandes created APEXMALHAR-2313: - Summary: Jenkins checks failing intermittently at ApplicationTest.testIterationApp Key: APEXMALHAR-2313 URL:

[jira] [Commented] (APEXMALHAR-2284) POJOInnerJoinOperatorTest fails in Travis CI

[ https://issues.apache.org/jira/browse/APEXMALHAR-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601145#comment-15601145 ] Chaitanya commented on APEXMALHAR-2284: --- I looked into the PR #434. This uses

[jira] [Commented] (APEXCORE-564) We should be able to remove loggers level settings

[ https://issues.apache.org/jira/browse/APEXCORE-564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601132#comment-15601132 ] Priyanka Gugale commented on APEXCORE-564: -- Our initial though was, we will set it to NULL so

[jira] [Commented] (APEXMALHAR-2309) TimeBasedDedupOperator marks new tuples as duplicates if expired tuples exist

[ https://issues.apache.org/jira/browse/APEXMALHAR-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601113#comment-15601113 ] ASF GitHub Bot commented on APEXMALHAR-2309: GitHub user francisf reopened a pull

[jira] [Commented] (APEXMALHAR-2309) TimeBasedDedupOperator marks new tuples as duplicates if expired tuples exist

[ https://issues.apache.org/jira/browse/APEXMALHAR-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601112#comment-15601112 ] ASF GitHub Bot commented on APEXMALHAR-2309: Github user francisf closed the pull request

[GitHub] apex-malhar pull request #464: APEXMALHAR-2309 Comparing times for newer tup...

GitHub user francisf reopened a pull request: https://github.com/apache/apex-malhar/pull/464 APEXMALHAR-2309 Comparing times for newer tuples with existing key @bhupeshchawda please review. Marking a tuple as unique if the time found for the key in asyncEvents is < current

[GitHub] apex-malhar pull request #464: APEXMALHAR-2309 Comparing times for newer tup...

Github user francisf closed the pull request at: https://github.com/apache/apex-malhar/pull/464 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (APEXMALHAR-2302) Exposing few properties of FSSplitter and BlockReader operators to FSRecordReaderModule to tune Application

[ https://issues.apache.org/jira/browse/APEXMALHAR-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15601061#comment-15601061 ] ASF GitHub Bot commented on APEXMALHAR-2302: GitHub user deepak-narkhede reopened a pull

[GitHub] apex-malhar pull request #457: APEXMALHAR-2302 Exposing few properties of FS...

GitHub user deepak-narkhede reopened a pull request: https://github.com/apache/apex-malhar/pull/457 APEXMALHAR-2302 Exposing few properties of FSSplitter and BlockReader operators to FSRecordReaderModule This change adds blockSize property from FileSplitter to