[jira] [Updated] (SAMZA-2136) Improve run.id generation for batch in standalone

2019-03-19 Thread Lakshmi Manasa Gaduputi (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lakshmi Manasa Gaduputi updated SAMZA-2136: --- Description: Improve the current read-write-lock based implementation [link

[jira] [Assigned] (SAMZA-2135) Provide a way inject ExternalContext to TestRunner

2019-03-19 Thread Sanil Jain (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanil Jain reassigned SAMZA-2135: - Assignee: Sanil Jain > Provide a way inject ExternalContext to TestRunner >

[samza] branch master updated: Release version updates (#944)

2019-03-19 Thread xinyu
This is an automated email from the ASF dual-hosted git repository. xinyu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new abe35df Release version updates (#944) abe35df is

[jira] [Created] (SAMZA-2136) Improve run.id generation for batch in standalone

2019-03-19 Thread Lakshmi Manasa Gaduputi (JIRA)
Lakshmi Manasa Gaduputi created SAMZA-2136: -- Summary: Improve run.id generation for batch in standalone Key: SAMZA-2136 URL: https://issues.apache.org/jira/browse/SAMZA-2136 Project: Samza

[jira] [Created] (SAMZA-2135) Provide a way inject ExternalContext to TestRunner

2019-03-19 Thread Sanil Jain (JIRA)
Sanil Jain created SAMZA-2135: - Summary: Provide a way inject ExternalContext to TestRunner Key: SAMZA-2135 URL: https://issues.apache.org/jira/browse/SAMZA-2135 Project: Samza Issue Type: Improv

[jira] [Created] (SAMZA-2134) Enable remote table rate limiter by default

2019-03-19 Thread Dengpan Yin (JIRA)
Dengpan Yin created SAMZA-2134: -- Summary: Enable remote table rate limiter by default Key: SAMZA-2134 URL: https://issues.apache.org/jira/browse/SAMZA-2134 Project: Samza Issue Type: Bug

[samza] branch master updated: SAMZA-2132: Flatten startpoint key when serialized. (#956)

2019-03-19 Thread shanthoosh
This is an automated email from the ASF dual-hosted git repository. shanthoosh pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 98355db SAMZA-2132: Flatten startpoint key w

[samza] branch master updated: SAMZA-2094: Implement the StartpointVisitor for the KafkaSystemConsumer. (#918)

2019-03-19 Thread shanthoosh
This is an automated email from the ASF dual-hosted git repository. shanthoosh pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 0967398 SAMZA-2094: Implement the Startpoint

[samza] branch master updated: SAMZA-2133: Fix the TestKeyValuePerformance test. (#959)

2019-03-19 Thread shanthoosh
This is an automated email from the ASF dual-hosted git repository. shanthoosh pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 4e2cabc SAMZA-2133: Fix the TestKeyValuePerf

[jira] [Commented] (SAMZA-1772) Support Table API for low-level Tasks with ExecutionPlanner

2019-03-19 Thread Aditya (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796547#comment-16796547 ] Aditya commented on SAMZA-1772: --- [~pmaheshwari] this is done. It could be marked fixed. >

[jira] [Commented] (SAMZA-1955) TableConfigGenerator.generateConfigsForTableSpecs should take in original user provided configs

2019-03-19 Thread Aditya (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796546#comment-16796546 ] Aditya commented on SAMZA-1955: --- Is it about the backdoor user configs to override the gene

[jira] [Updated] (SAMZA-2133) Fix the broken TestKeyValuePerformance test.

2019-03-19 Thread Shanthoosh Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shanthoosh Venkataraman updated SAMZA-2133: --- Description: Running the TestJeyValuePerformance test results in the followin

[jira] [Created] (SAMZA-2133) Fix the broken TestKeyValuePerformance test.

2019-03-19 Thread Shanthoosh Venkataraman (JIRA)
Shanthoosh Venkataraman created SAMZA-2133: -- Summary: Fix the broken TestKeyValuePerformance test. Key: SAMZA-2133 URL: https://issues.apache.org/jira/browse/SAMZA-2133 Project: Samza

[jira] [Resolved] (SAMZA-1684) Yarn Host Affinity Fixes

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1684. --- Resolution: Fixed > Yarn Host Affinity Fixes > > >

[jira] [Resolved] (SAMZA-1661) Window high level API: During shutdown of RocksDb store while shutting down Samza job, RocksDb runs into an assertion

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1661. --- Resolution: Fixed > Window high level API: During shutdown of RocksDb store while shu

[jira] [Resolved] (SAMZA-1662) LOG4J 1 is EOL. Support should be added for LOG4J2

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1662. --- Resolution: Fixed > LOG4J 1 is EOL. Support should be added for LOG4J2 > ---

[jira] [Commented] (SAMZA-2050) Move flushOffset code into LoggedStore and remove TaskStorageManager

2019-03-19 Thread Rayman (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796407#comment-16796407 ] Rayman commented on SAMZA-2050: --- Yes, still needs a minor cleanup. > Move flushOffset code

[jira] [Commented] (SAMZA-1746) Coordinator stuck connecting to a decommissioned NM

2019-03-19 Thread Rayman (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796406#comment-16796406 ] Rayman commented on SAMZA-1746: --- The default NM-client timeout in YARN-client version 2.6.0

[jira] [Commented] (SAMZA-1655) StreamProcessor skips all events from zookeeper server after zkClient session expiration.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796394#comment-16796394 ] Prateek Maheshwari commented on SAMZA-1655: --- [~spvenkat] Is this still an issue

[jira] [Commented] (SAMZA-1896) Support for StreamExpanders and InputTransformers

2019-03-19 Thread Sanil Jain (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796391#comment-16796391 ] Sanil Jain commented on SAMZA-1896: --- [~pmaheshwari] Yes, sure will do > Support for St

[jira] [Resolved] (SAMZA-1896) Support for StreamExpanders and InputTransformers

2019-03-19 Thread Sanil Jain (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanil Jain resolved SAMZA-1896. --- Resolution: Not A Problem We will work on it later if asked. > Support for StreamExpanders and Inpu

[jira] [Resolved] (SAMZA-1657) Docs for task.window.ms are outdated

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1657. --- Resolution: Fixed Fixed in latest docs. > Docs for task.window.ms are outdated > ---

[jira] [Commented] (SAMZA-1662) LOG4J 1 is EOL. Support should be added for LOG4J2

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796390#comment-16796390 ] Prateek Maheshwari commented on SAMZA-1662: --- [~cerskine] Samza 1.0 added suppor

[jira] [Commented] (SAMZA-1663) StreamProcessor fails after reestablishing zookeeper session.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796388#comment-16796388 ] Prateek Maheshwari commented on SAMZA-1663: --- [~spvenkat] Is this still relevant

[jira] [Commented] (SAMZA-1798) Bugs in MessageStreamAsset does not propagate exceptions to main

2019-03-19 Thread Sanil Jain (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796389#comment-16796389 ] Sanil Jain commented on SAMZA-1798: --- [~pmaheshwari] I don't think so, but is still a bu

[jira] [Commented] (SAMZA-1697) Flush hung on using default serde with MetricsSnapshotReporter

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796385#comment-16796385 ] Prateek Maheshwari commented on SAMZA-1697: --- [~rayman7718] Is this still releva

[jira] [Commented] (SAMZA-1701) SamzaContainer should not contain any logic related to store directories

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796362#comment-16796362 ] Prateek Maheshwari commented on SAMZA-1701: --- [~bharathkk] Still relevant? > Sa

[jira] [Resolved] (SAMZA-1707) Samza onTimer method triggering before init

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1707. --- Resolution: Fixed > Samza onTimer method triggering before init > ---

[jira] [Commented] (SAMZA-1734) Fix to ensure metrics-flush before producer shutdown at container-shutdown

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796358#comment-16796358 ] Prateek Maheshwari commented on SAMZA-1734: --- [~rayman7718] Still relevant? > F

[jira] [Resolved] (SAMZA-1720) Remove javafx.util dependency from samza-sql tests.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1720. --- Resolution: Fixed > Remove javafx.util dependency from samza-sql tests. > ---

[jira] [Resolved] (SAMZA-1719) Add caching support to Table API

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1719. --- Resolution: Fixed > Add caching support to Table API > --

[jira] [Commented] (SAMZA-1772) Support Table API for low-level Tasks with ExecutionPlanner

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796349#comment-16796349 ] Prateek Maheshwari commented on SAMZA-1772: --- [~atoomula] Is this still relevant

[jira] [Resolved] (SAMZA-1731) Daemonize threads spawned from SamzaEventHubClientManager.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1731. --- Resolution: Fixed > Daemonize threads spawned from SamzaEventHubClientManager. >

[jira] [Resolved] (SAMZA-1732) Reduce the coordination timeouts in TestZkLocalApplicationRunner tests.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1732. --- Resolution: Fixed > Reduce the coordination timeouts in TestZkLocalApplicationRunner

[jira] [Commented] (SAMZA-1923) Update ProcessorLifecycleListenerFactory API to use correct context

2019-03-19 Thread Cameron Lee (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796356#comment-16796356 ] Cameron Lee commented on SAMZA-1923: Yes, this is still relevant. The ProcessorContex

[jira] [Commented] (SAMZA-1746) Coordinator stuck connecting to a decommissioned NM

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796355#comment-16796355 ] Prateek Maheshwari commented on SAMZA-1746: --- [~jagadish1...@gmail.com] Is this

[jira] [Commented] (SAMZA-1793) Upgrade to recent API for kafka consumer / producer.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796342#comment-16796342 ] Prateek Maheshwari commented on SAMZA-1793: --- [~boryas] Is this still relevant?

[jira] [Resolved] (SAMZA-1783) Add Log4j2 functionality in Samza

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1783. --- Resolution: Fixed > Add Log4j2 functionality in Samza > -

[jira] [Resolved] (SAMZA-1748) Standalone failure tests.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1748. --- Resolution: Fixed > Standalone failure tests. > - > >

[jira] [Resolved] (SAMZA-1750) Samza host-affinity fixes

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1750. --- Resolution: Fixed > Samza host-affinity fixes > - > >

[jira] [Resolved] (SAMZA-1749) Use Json/String serializers as ZkSerializer so that data stored in zookeeper is easy to parse

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1749. --- Resolution: Duplicate See SAMZA-2091 > Use Json/String serializers as ZkSerializer s

[jira] [Resolved] (SAMZA-1762) Fix Memory link in the Timer Registry Map

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1762. --- Resolution: Fixed > Fix Memory link in the Timer Registry Map > -

[jira] [Resolved] (SAMZA-1761) Reduce runTime of TestZkUtils test.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1761. --- Resolution: Fixed > Reduce runTime of TestZkUtils test. > --

[jira] [Commented] (SAMZA-1766) FileUtil should use autoclosable for the read/writeWithChecksum

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796352#comment-16796352 ] Prateek Maheshwari commented on SAMZA-1766: --- [~xinyu] Is this still relevant?

[jira] [Resolved] (SAMZA-1770) TaskContext#getStore should return KeyValueStore not Object

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1770. --- Resolution: Fixed This is fixed in 1.0. > TaskContext#getStore should return KeyValu

[jira] [Resolved] (SAMZA-1769) AppRunner#Status should not throw exceptions

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1769. --- Resolution: Fixed > AppRunner#Status should not throw exceptions > --

[jira] [Resolved] (SAMZA-1774) Support low-level Table API

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1774. --- Resolution: Fixed > Support low-level Table API > --- > >

[jira] [Resolved] (SAMZA-1773) Side inputs for local stores

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1773. --- Resolution: Fixed > Side inputs for local stores > > >

[jira] [Resolved] (SAMZA-1777) Logged store OFFSET file write during flush should be atomic

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1777. --- Resolution: Fixed > Logged store OFFSET file write during flush should be atomic > --

[jira] [Resolved] (SAMZA-1823) Handle errors when launching containers

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1823. --- Resolution: Duplicate > Handle errors when launching containers > --

[jira] [Commented] (SAMZA-1829) MessageStreamAssert check throws NPE on expected.toArray()

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796329#comment-16796329 ] Prateek Maheshwari commented on SAMZA-1829: --- [~Sanil] Is this still relevant?

[jira] [Commented] (SAMZA-1780) Side Inputs Future Work

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796344#comment-16796344 ] Prateek Maheshwari commented on SAMZA-1780: --- [~bharathkk] Is this still relevan

[jira] [Resolved] (SAMZA-1778) SIGSEGV when reading properties (metrics) on a closed RocksDB store

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1778. --- Resolution: Fixed > SIGSEGV when reading properties (metrics) on a closed RocksDB sto

[jira] [Resolved] (SAMZA-1788) Introduce LocationIdProvider abstraction

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1788. --- Resolution: Fixed > Introduce LocationIdProvider abstraction > --

[jira] [Resolved] (SAMZA-1791) Fix compilation errors introduced by SAMZA-1733.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1791. --- Resolution: Fixed > Fix compilation errors introduced by SAMZA-1733. > --

[samza-beam-examples] branch master updated: Update scripts and docs based on Beam 2.11.0 release

2019-03-19 Thread xinyu
This is an automated email from the ASF dual-hosted git repository. xinyu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza-beam-examples.git The following commit(s) were added to refs/heads/master by this push: new 0243d04 Update scripts and docs bas

[jira] [Resolved] (SAMZA-1796) PassthroughJobCoordinator doesn't create changelog streams

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1796. --- Resolution: Fixed > PassthroughJobCoordinator doesn't create changelog streams >

[samza] branch master updated: SAMZA-2117: Handle race condition in container launch due to incorrect AM accounting

2019-03-19 Thread jagadish
This is an automated email from the ASF dual-hosted git repository. jagadish pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 0a0d081 SAMZA-2117: Handle race condition in c

[jira] [Resolved] (SAMZA-1859) Zookeeper MetadataStore implementation.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1859. --- Resolution: Fixed > Zookeeper MetadataStore implementation. > ---

[jira] [Commented] (SAMZA-1798) Bugs in MessageStreamAsset does not propagate exceptions to main

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796337#comment-16796337 ] Prateek Maheshwari commented on SAMZA-1798: --- [~Sanil] Is this still relevant?

[jira] [Commented] (SAMZA-1815) Use TableDescriptors to generate configurations during planning phase

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796332#comment-16796332 ] Prateek Maheshwari commented on SAMZA-1815: --- [~bharathkk] Is this still relevan

[jira] [Commented] (SAMZA-1896) Support for StreamExpanders and InputTransformers

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796318#comment-16796318 ] Prateek Maheshwari commented on SAMZA-1896: --- Is this for TestRunner? If so, let

[jira] [Resolved] (SAMZA-1824) Samza AM does not handle some failures during container launch

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1824. --- Resolution: Fixed > Samza AM does not handle some failures during container launch >

[jira] [Commented] (SAMZA-1828) MessageStreamAssert check passed but throwing exception

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796330#comment-16796330 ] Prateek Maheshwari commented on SAMZA-1828: --- [~Sanil] Is this still relevant?

[jira] [Resolved] (SAMZA-1832) Race condition between SamzaContainerListener.onContainerFailure(t) and StreamProcessor.stop()

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1832. --- Resolution: Fixed > Race condition between SamzaContainerListener.onContainerFailure(

[jira] [Resolved] (SAMZA-1845) Require setting serde for intermediate streams in High Level API

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1845. --- Resolution: Fixed > Require setting serde for intermediate streams in High Level API

[jira] [Resolved] (SAMZA-1848) Create HDFS System and Stream Descriptors

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1848. --- Resolution: Fixed > Create HDFS System and Stream Descriptors > -

[jira] [Commented] (SAMZA-1844) Implicitly set TaskNameGrouper factory for standalone.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796324#comment-16796324 ] Prateek Maheshwari commented on SAMZA-1844: --- [~spvenkat] Is this still relevant

[jira] [Resolved] (SAMZA-1846) Create EventHub System and Stream Descriptors

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1846. --- Resolution: Fixed > Create EventHub System and Stream Descriptors > -

[jira] [Resolved] (SAMZA-1847) Create Kinesis System and Stream Descriptors

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1847. --- Resolution: Fixed > Create Kinesis System and Stream Descriptors > --

[jira] [Resolved] (SAMZA-1925) Document frequently used configs

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1925. --- Resolution: Fixed > Document frequently used configs > --

[jira] [Resolved] (SAMZA-1855) Clean up overall java-docs for Samza 1.0 release

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1855. --- Resolution: Fixed > Clean up overall java-docs for Samza 1.0 release > --

[jira] [Resolved] (SAMZA-1851) Switch precedence of configs and descriptors in ExecutionPlanner

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1851. --- Resolution: Fixed > Switch precedence of configs and descriptors in ExecutionPlanner

[jira] [Resolved] (SAMZA-1872) taskStoreRestorationMetrics uses storeName in the metric name but the metric is only for the whole task

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1872. --- Resolution: Fixed Ray fixed this in a recent PR. > taskStoreRestorationMetrics uses

[jira] [Resolved] (SAMZA-1885) Improve samza build time.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1885. --- Resolution: Fixed > Improve samza build time. > - > >

[jira] [Resolved] (SAMZA-1888) minor improvements for the after commit for KafkaSystemAdmin and KafkaSystemConsumer.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1888. --- Resolution: Fixed > minor improvements for the after commit for KafkaSystemAdmin and

[jira] [Resolved] (SAMZA-1898) Create a new layout for the web-site eg: improved styling

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1898. --- Resolution: Fixed > Create a new layout for the web-site eg: improved styling > -

[jira] [Assigned] (SAMZA-1928) ExecutionPlanner should generate job.name and job.id from app.name and app.id

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari reassigned SAMZA-1928: - Assignee: Sanil Jain > ExecutionPlanner should generate job.name and job.id from

[jira] [Resolved] (SAMZA-1943) get rid of ExtendedSystemAdmin

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1943. --- Resolution: Fixed > get rid of ExtendedSystemAdmin > -- >

[jira] [Resolved] (SAMZA-1899) remove KafkaConfig.getKafkaSystemConsumerConfig

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1899. --- Resolution: Fixed > remove KafkaConfig.getKafkaSystemConsumerConfig > ---

[jira] [Resolved] (SAMZA-1947) Remove specific js/css files from rat excludes

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1947. --- Resolution: Fixed > Remove specific js/css files from rat excludes >

[jira] [Resolved] (SAMZA-1907) Add metrics to monitor watermarks

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1907. --- Resolution: Fixed > Add metrics to monitor watermarks > -

[jira] [Resolved] (SAMZA-1911) Add documentation for quick start.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1911. --- Resolution: Fixed > Add documentation for quick start. >

[jira] [Resolved] (SAMZA-1910) Update front-page content and introduce navigation template

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1910. --- Resolution: Fixed > Update front-page content and introduce navigation template > ---

[jira] [Resolved] (SAMZA-1953) Remove TableDescriptorsProvider interface

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1953. --- Resolution: Fixed > Remove TableDescriptorsProvider interface > -

[jira] [Resolved] (SAMZA-2019) support per stream broadcast config

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-2019. --- Resolution: Fixed > support per stream broadcast config > ---

[jira] [Resolved] (SAMZA-1916) Update hello-samza with latest APIs

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1916. --- Resolution: Fixed > Update hello-samza with latest APIs > ---

[jira] [Commented] (SAMZA-1923) Update ProcessorLifecycleListenerFactory API to use correct context

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796311#comment-16796311 ] Prateek Maheshwari commented on SAMZA-1923: --- [~cameronlee314] Is this still rel

[jira] [Resolved] (SAMZA-1920) Standalone user guide.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1920. --- Resolution: Fixed > Standalone user guide. > -- > >

[jira] [Resolved] (SAMZA-1921) Upgrade SamzaKafkaSystemAdmin to use latest AdminClient

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1921. --- Resolution: Fixed > Upgrade SamzaKafkaSystemAdmin to use latest AdminClient > ---

[jira] [Resolved] (SAMZA-1928) ExecutionPlanner should generate job.name and job.id from app.name and app.id

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1928. --- Resolution: Fixed > ExecutionPlanner should generate job.name and job.id from app.nam

[jira] [Resolved] (SAMZA-1926) Fix standalone configurations in configuration table.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1926. --- Resolution: Fixed > Fix standalone configurations in configuration table. > -

[jira] [Resolved] (SAMZA-1933) Fix NPE in LocalityManager.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1933. --- Resolution: Fixed > Fix NPE in LocalityManager. > > >

[jira] [Resolved] (SAMZA-1934) LocalApplicationRunner fails for LegacyTaskApplication app.class

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1934. --- Resolution: Fixed > LocalApplicationRunner fails for LegacyTaskApplication app.class

[jira] [Resolved] (SAMZA-1938) Support use cases to run multiple sql statements in one Samza job

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1938. --- Resolution: Fixed > Support use cases to run multiple sql statements in one Samza job

[jira] [Resolved] (SAMZA-1976) MetadataStore API cleanup.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1976. --- Resolution: Fixed > MetadataStore API cleanup. > -- > >

[jira] [Commented] (SAMZA-1945) get rid of deleteMessageCalled from KafkaSystemAdmin

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796307#comment-16796307 ] Prateek Maheshwari commented on SAMZA-1945: --- [~boryas] Still relevant? > get r

[jira] [Commented] (SAMZA-1944) refactor KafkaSystemAdmin not to keep Coordinator/Changelog/Intermediate streams info.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16796308#comment-16796308 ] Prateek Maheshwari commented on SAMZA-1944: --- [~boryas] Still relevant? > refac

[jira] [Resolved] (SAMZA-1952) StreamPartitionCountMonitor for standalone.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1952. --- Resolution: Fixed > StreamPartitionCountMonitor for standalone. > ---

[jira] [Resolved] (SAMZA-1954) User provided configuration should have higher precedence than generated configuration.

2019-03-19 Thread Prateek Maheshwari (JIRA)
[ https://issues.apache.org/jira/browse/SAMZA-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prateek Maheshwari resolved SAMZA-1954. --- Resolution: Fixed > User provided configuration should have higher precedence than ge

  1   2   >