[samza] branch master updated: SAMZA-398: Remove force NONE compression for changelog topic producer

2021-05-19 Thread nickpan47
This is an automated email from the ASF dual-hosted git repository. nickpan47 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 9d9ebc7 SAMZA-398: Remove force NONE

[samza] branch master updated: SAMZA-2558: Refactor app.runner.class

2020-09-10 Thread nickpan47
This is an automated email from the ASF dual-hosted git repository. nickpan47 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/samza.git The following commit(s) were added to refs/heads/master by this push: new 3fcced3 SAMZA-2558: Refactor

svn commit: r34862 - in /release/samza: 0.10.0/ 0.10.1/ 0.11.0/ 0.12.0/ 0.13.0/ 0.13.1/ 0.14.0/ 0.14.1/ 0.9.0/ 0.9.1/ 1.0.0/ 1.1.0/ 1.2.0/

2019-07-12 Thread nickpan47
Author: nickpan47 Date: Fri Jul 12 10:00:51 2019 New Revision: 34862 Log: Removing old .md5 and replace with new .sha256 files Added: release/samza/0.10.0/apache-samza-0.10.0-src.tgz.sha256 release/samza/0.10.1/apache-samza-0.10.1-src.tgz.sha256 release/samza/0.11.0/apache-samza

samza git commit: SAMZA-1832: Fix race condition between StreamProcessor and SamzaContainerListener

2018-10-04 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 603bd8eac -> 6e5e1621a SAMZA-1832: Fix race condition between StreamProcessor and SamzaContainerListener The PR addresses the following issues - We have few scenarios where there is a race condition between `SamzaContainerListener` and

[4/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
Reviewers: Prateek Maheshwari , Cameron Lee Closes #642 from nickpan47/SAMZA-1814 and squashes the following commits: 214373966 [Yi Pan (Data Infrastructure)] Merge branch 'master' into SAMZA-1814. With minor fixes to allow merge correctly. f8c8108ac [Yi Pan (Data Infrastructure)] SAMZA-1814: Fix

[2/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/cfbb9c6e/samza-core/src/test/java/org/apache/samza/execution/TestExecutionPlanner.java -- diff --git

[3/4] samza git commit: SAMZA-1814: consolidate JobNode and JobGraph configuration generation for high and low-level API applications

2018-09-26 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/cfbb9c6e/samza-core/src/main/java/org/apache/samza/execution/JobNode.java -- diff --git a/samza-core/src/main/java/org/apache/samza/execution/JobNode.java

samza git commit: SAMZA-1837: Fix TestLocalTableWithSideInputs failures.

2018-09-11 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 2b5970d81 -> 0e0a939df SAMZA-1837: Fix TestLocalTableWithSideInputs failures. * Fix TestRunner API config overriding. * By default, RocksDBTableProvider enables host affinity which failed this particular test. To fix test failure, turn

[1/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master b0b292200 -> abf49eaaa http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-test/src/test/java/org/apache/samza/test/table/TestLocalTable.java -- diff --git

[9/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
, Cameron Lee Closes #606 from nickpan47/app-runtime-with-processor-callbacks and squashes the following commits: 3e60d44a [Yi Pan (Data Infrastructure)] SAMZA-1789: final revision on ApplicationDescriptor and ApplicationRunner APIs bdb5b0fc [Yi Pan (Data Infrastructure)] SAMZA-1789

[4/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/test/java/org/apache/samza/operators/spec/TestPartitionByOperatorSpec.java -- diff --git

[7/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/main/java/org/apache/samza/operators/spec/OperatorSpec.java -- diff --git a/samza-core/src/main/java/org/apache/samza/operators/spec/OperatorSpec.java

[6/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-core/src/test/java/org/apache/samza/application/TestStreamApplicationDescriptorImpl.java -- diff --git

[2/9] samza git commit: SAMZA-1789: unify ApplicationDescriptor and ApplicationRunner for high- and low-level APIs in YARN and standalone environment

2018-09-07 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/abf49eaa/samza-test/src/main/java/org/apache/samza/test/integration/TestStandaloneIntegrationApplication.java -- diff --git

samza git commit: SAMZA-1836: StreamManager created before ExecutionPlanner should also apply configuration overrides

2018-08-31 Thread nickpan47
hor: Yi Pan (Data Infrastructure) Reviewers: Prateek Maheshwari , Boris S , Xinyu Liu , Shanthoosh Venkataraman Closes #620 from nickpan47/SAMZA-1836 and squashes the following commits: a376b888 [Yi Pan (Data Infrastructure)] SAMZA-1836: StreamManager created before ExecutionPlanner should a

samza git commit: SAMZA-1822: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception

2018-08-27 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 2a71baf7c -> 46685406f SAMZA-1822: Samza 0.14.1 not correctly handling OffsetOutOfRangeException exception Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/46685406

samza git commit: SAMZA-1826: Fix unit test failure in table tests

2018-08-26 Thread nickpan47
ble, TestLocalTableWithSideInputs) creates some conflicts in the static counter map and triggers test failure in certain sequence of ordering of tests. Fixing it by requiring explicit name of the join functions in tests and register / verify by unique op names. Author: Yi Pan (Data Infrastructure) Closes #617 from nickpa

samza git commit: SAMZA-1738: Merge in some minor additions from Linkedin branch

2018-06-28 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master f6c99a4c4 -> c5557140d SAMZA-1738: Merge in some minor additions from Linkedin branch Author: Cameron Lee Reviewers: Yi Pan Closes #549 from cameronlee314/sync_li_trunk Project: http://git-wip-us.apache.org/repos/asf/samza/repo

[10/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
z> Author: Xinyu Liu <xi...@xiliu-ld.linkedin.biz> Reviewers: Jagadish <jvenkatra...@linkedin.com>, Prateek Maheshwari <pmahe...@linkedin.com> Closes #475 from nickpan47/serializable-opspec-only-Jan-24-18 and squashes the following commits: db0dea73 [Yi Pan (Data Infrastructure)

[06/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/TestStreamGraphSpec.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/TestStreamGraphSpec.java

[03/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-sql/src/test/java/org/apache/samza/sql/testutil/TestSamzaSqlQueryParser.java -- diff --git

[02/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-test/src/main/java/org/apache/samza/example/BroadcastExample.java -- diff --git a/samza-test/src/main/java/org/apache/samza/example/BroadcastExample.java

[04/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-sql/src/main/java/org/apache/samza/sql/translator/ProjectTranslator.java -- diff --git

[05/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/spec/OperatorSpecTestUtils.java -- diff --git

[08/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/main/java/org/apache/samza/operators/triggers/TriggerImpl.java -- diff --git

[07/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java -- diff --git a/samza-core/src/test/java/org/apache/samza/operators/TestJoinOperator.java

[09/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-core/src/main/java/org/apache/samza/operators/StreamGraphImpl.java -- diff --git a/samza-core/src/main/java/org/apache/samza/operators/StreamGraphImpl.java

[01/10] samza git commit: SAMZA-1659: Serializable OperatorSpec

2018-05-25 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master bc4a0c2de -> 53d7f2625 http://git-wip-us.apache.org/repos/asf/samza/blob/53d7f262/samza-test/src/test/java/org/apache/samza/test/table/TestLocalTable.java -- diff --git

samza git commit: SD-1599: Improve the efficiency of the AsynRunLoop when some partitio…

2018-03-29 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 13ff09024 -> 57fea260a SD-1599: Improve the efficiency of the AsynRunLoop when some partitio… …ns are empty. Author: James Lent Reviewers: Yi Pan , Xinyu Liu Closes #436

[1/2] samza git commit: SAMZA-1555: Move creation of checkpoint and changelog streams to the Job Coordinators

2018-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 718c66612 -> 6dc89e100 http://git-wip-us.apache.org/repos/asf/samza/blob/6dc89e10/samza-core/src/main/scala/org/apache/samza/coordinator/JobModelManager.scala -- diff --git

[2/2] samza git commit: SAMZA-1555: Move creation of checkpoint and changelog streams to the Job Coordinators

2018-02-16 Thread nickpan47
. **Motivations** There are three driving forces for this refactoring. The first motivation is to assign the creation of the changelog and checkpoint streams to the JobCoordinators where it is most appropriate. This was discussed in more detail with nickpan47 . The second motivation is to have any potential

svn commit: r23996 - in /release/samza/0.14.0: samza-tools-0.14.0.tgz samza-tools-0.14.0.tgz.MD5 samza-tools-0.14.0.tgz.asc

2018-01-03 Thread nickpan47
Author: nickpan47 Date: Wed Jan 3 19:33:13 2018 New Revision: 23996 Log: upload samza-tools bin and MD5 and asc altogether Added: release/samza/0.14.0/samza-tools-0.14.0.tgz.MD5 release/samza/0.14.0/samza-tools-0.14.0.tgz.asc Modified: release/samza/0.14.0/samza-tools-0.14.0.tgz

svn commit: r23983 - in /release/samza/0.14.0: ./ apache-samza-0.14.0-src.tgz apache-samza-0.14.0-src.tgz.MD5 apache-samza-0.14.0-src.tgz.asc samza-tools-0.14.0.tgz

2018-01-02 Thread nickpan47
Author: nickpan47 Date: Tue Jan 2 17:34:53 2018 New Revision: 23983 Log: uploading tarballs for 0.14.0 release Added: release/samza/0.14.0/ release/samza/0.14.0/apache-samza-0.14.0-src.tgz (with props) release/samza/0.14.0/apache-samza-0.14.0-src.tgz.MD5 release/samza/0.14.0

samza git commit: SAMZA-1412 replace mockito-all with mockito-core

2017-11-28 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 9961023f7 -> d262f6663 SAMZA-1412 replace mockito-all with mockito-core ran "./gradlew clean check" and all tests passed Author: Fred Ji Reviewers: Prateek Maheshwari Closes #365 from

samza git commit: SAMZA-1482: add config documentation for auto-restart/fail behavior o…

2017-11-20 Thread nickpan47
org> Closes #363 from nickpan47/partition-change-docsite and squashes the following commits: 5342ea0 [Yi Pan (Data Infrastructure)] SAMZA-1482: fix configuration table in documentation site 7c9f326 [Yi Pan (Data Infrastructure)] SAMZA-1482: add config documentation for auto-restart/fail behavi

samza git commit: SAMZA-1482: Restart or fail Samza jobs in YARN when detecting changes…

2017-11-14 Thread nickpan47
nickpa...@gmail.com> Reviewers: Jacob Maes <jm...@linkedin.com>, Jagadish <jagad...@apache.org> Closes #351 from nickpan47/restart-on-partition-change and squashes the following commits: 8d04cd6 [Yi Pan (Data Infrastructure)] SAMZA-1482: restart or fail the job when input topic pa

[samza] Git Push Summary

2017-10-11 Thread nickpan47
Repository: samza Updated Branches: refs/heads/0.13.2 [deleted] 90fa985ec

svn commit: r21301 - in /release/samza/0.13.1: apache-samza-0.13.1-src.tgz.MD5 apache-samza-0.13.1-src.tgz.md5

2017-08-25 Thread nickpan47
Author: nickpan47 Date: Fri Aug 25 17:30:33 2017 New Revision: 21301 Log: rename .MD5 to .md5 per guidance from Apache board Added: release/samza/0.13.1/apache-samza-0.13.1-src.tgz.md5 Removed: release/samza/0.13.1/apache-samza-0.13.1-src.tgz.MD5 Added: release/samza/0.13.1/apache-samza

[12/23] samza git commit: Samza-1364: Handle ZKExceptions in zkCoordinationUtils.reset.

2017-08-09 Thread nickpan47
Samza-1364: Handle ZKExceptions in zkCoordinationUtils.reset. In some cases LocalAppRunner.waitForFinish indefinitely blocks after LocalApplicationRunner.kill. Last step in LocalAppRunner.kill(streamApp) is zkClient.close()[zkClient belongs to ZkCoordinationService]. ApplicationRunner.kill

[21/23] samza git commit: SAMZA-1380: Create Utility Class for interacting with Azure Blob Storage

2017-08-09 Thread nickpan47
SAMZA-1380: Create Utility Class for interacting with Azure Blob Storage PR 1: AzureClient + AzureConfig PR 2: LeaseBlobManager **PR 3: BlobUtils + JobModelBundle** (current PR) Author: PawasChhokra Author: PawasChhokra Reviewers: Navina Ramesh

[13/23] samza git commit: SAMZA-1370; Memory leak in CachedStore when using ByteBufferSerde as key Serde

2017-08-09 Thread nickpan47
SAMZA-1370; Memory leak in CachedStore when using ByteBufferSerde as key Serde ByteBufferSerde uses relative bulk get to serialize the provided ByteBuffer which changes its internal position. ByteBuffer's `equals` and `hashCode` depend upon its remaining elements, i.e. on its position. This

[15/23] samza git commit: SAMZA-1366: ScriptRunner should allow callers to control the child pr…

2017-08-09 Thread nickpan47
SAMZA-1366: ScriptRunner should allow callers to control the child pr… …ocess environment. Author: Jacob Maes Reviewers: Jagadish , Shanthoosh Venkataraman Closes #245 from jmakes/script-runner-improvements

[08/23] samza git commit: Fix log messages from StreamProcessor(onJobModelExpired event).

2017-08-09 Thread nickpan47
Fix log messages from StreamProcessor(onJobModelExpired event). Log messages published in onJobModelExpired event have `processorId` as null. `processorId` is cached as final var in jobCoordinatorListener method. JLS for final fields/variables states that they're initialized before the

[16/23] samza git commit: SAMZA-1365: Calling zkClient.close from zkWatch impl blocks indefinitely.

2017-08-09 Thread nickpan47
SAMZA-1365: Calling zkClient.close from zkWatch impl blocks indefinitely. Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh Closes #253 from shanthoosh/SAMZA-1365 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit:

[02/23] samza git commit: SAMZA-1324: Fix NullPointerException in ZkUtils api's.

2017-08-09 Thread nickpan47
SAMZA-1324: Fix NullPointerException in ZkUtils api's. Problem: Read/Write api methods in ZkUtils updates counters/timers in `metrics` field. In a ZkUtils constructor this fields is not initialized properly. Java default for uninitialized field is null resulting in NPE. Fix: Initialize private

[07/23] samza git commit: SAMZA-1368; make sure new job model will be generated in case of barrier timeout.

2017-08-09 Thread nickpan47
SAMZA-1368; make sure new job model will be generated in case of barrier timeout. Author: Boris Shkolnik Reviewers: Shanthoosh V Closes #247 from sborya/onBarrierTimeout1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit:

[03/23] samza git commit: SAMZA-1304: Handling duplicate stream processor registration.

2017-08-09 Thread nickpan47
SAMZA-1304: Handling duplicate stream processor registration. When a stream processor registers with same processorId as already existing processor in processor group, it's registration should fail. Author: Shanthoosh Venkataraman Reviewers: Navina Ramesh

[05/23] samza git commit: SAMZA-1336. Session disconnect propagation.

2017-08-09 Thread nickpan47
SAMZA-1336. Session disconnect propagation. If ZK doesn't receive any communication from a zkClient (including heartbeats), it closes the session with the client. It removes all the ephemeral nodes associated with the client. That's why we need to restore all these nodes - need to re-register.

[09/23] samza git commit: SAMZA-1359; Handle phantom container notifications cleanly during an RM fail-over

2017-08-09 Thread nickpan47
SAMZA-1359; Handle phantom container notifications cleanly during an RM fail-over 1. Improved our container handling logic to be resilient to phantom notifications. 2. Added a new metric to Samza's ContainerProcessManager module that tracks the number of such invalid notifications. 3. Add a

[10/23] samza git commit: SAMZA-1282: Spinning up more containers than number of tasks.

2017-08-09 Thread nickpan47
SAMZA-1282: Spinning up more containers than number of tasks. Changes * Stop streamProcessor in onNewJobModelAvailable eventHandler(instead of onNewJobModelConfirmed eventHandler) when it's not part of the group and prevent it from joining the barrier. * When numContainerIds > numTaskModels,

[01/23] samza git commit: SAMZA-1358: fix the bug in validating task.class empty string when app.class is configured

2017-08-09 Thread nickpan47
nickpa...@gmail.com> Reviewers: Jacob Maes <jm...@linkedin.com> Closes #242 from nickpan47/SAMZA-1358 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/be989935 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/be989935 D

samza git commit: SAMZA-1334: fix pre-condition for ContainerAllocator to work properly

2017-06-20 Thread nickpan47
ure) <nickpa...@gmail.com> Reviewers: Jagadish <jagadish1...@gmail.com> Closes #228 from nickpan47/SAMZA-1334 and squashes the following commits: ad3320f [Yi Pan (Data Infrastructure)] SAMZA-1334: fix the pre-conditions for ContainerAllocator to work properly. Make sure JobModel i

[samza] Git Push Summary

2017-06-14 Thread nickpan47
Repository: samza Updated Tags: refs/tags/release-0.13.0 [created] 6a29b39f9

samza git commit: SAMZA-1226: relax type parameters in MessageStream functions

2017-04-21 Thread nickpan47
: Prateek Maheshwari <pmahe...@linkedin.com>, Navina Ramesh <nav...@apache.org>, Jacob Maes <jm...@linkedin.com> Closes #133 from nickpan47/SAMZA-1226 and squashes the following commits: b8d3461 [Yi Pan (Data Infrastructure)] SAMZA-1226: cleanup code example in StreamApplication ja

samza git commit: SAMZA-868: support elasticsearch version 2.x

2017-04-20 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master de8cffdfa -> e753c8de3 SAMZA-868: support elasticsearch version 2.x Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/e753c8de Tree:

samza git commit: SAMZA-1217: Fix broken build due to TestCheckstyle problem.

2017-04-18 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master abe39676e -> d50b1791b SAMZA-1217: Fix broken build due to TestCheckstyle problem. Author: Shanthoosh Venkataraman Reviewers: Yi Pan Closes #130 from shanthoosh/master Project:

samza git commit: SAMZA-1157: Serialization/deserialization throwables should not be suppressed

2017-04-18 Thread nickpan47
s: Navina Ramesh <nav...@apache.org> Closes #128 from nickpan47/fix-serde-error-suppressed Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/abe39676 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/abe39676 Diff:

samza git commit: SAMZA-1215, SAMZA-1216: remove ProcessKiller and change the ZooKeeper connection string in test

2017-04-18 Thread nickpan47
Reviewers: Navina Ramesh <nav...@apache.org> Closes #129 from nickpan47/fix-some-tests Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/0b0b2958 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/0b0b2958 Diff:

samza git commit: SAMZA-1145: Provide Ability To Confgure The Default Number Of Changel…

2017-04-14 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 34178a63f -> 925866d9b SAMZA-1145: Provide Ability To Confgure The Default Number Of Changel… …og Replicas Author: James Lent Reviewers: Yi Pan , Jagadish Closes #86

samza git commit: SAMZA-1195 fix bug in Samza application master on Kerberos

2017-04-14 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 66cbac5c7 -> 34178a63f SAMZA-1195 fix bug in Samza application master on Kerberos Author: Chen Song Reviewers: Yi Pan Closes #119 from garlicbulb-puzhuo/SAMZA-1195 Project:

samza git commit: SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer

2017-03-18 Thread nickpan47
din.com>, Chris Pettitt <cpett...@linkedin.com> Closes #65 from nickpan47/SAMZA-1093 and squashes the following commits: 9daf451 [Yi Pan (Data Infrastructure)] SAMZA-1093: added javadoc for TaskFactoryUtil class 078fee3 [Yi Pan (Data Infrastructure)] Merge branch 'master' into SAMZA-1093 e7be9

[2/3] samza git commit: Merge branch 'SAMZA-1093' into samza-fluent-api-v1

2017-02-27 Thread nickpan47
Merge branch 'SAMZA-1093' into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/cf267f8a Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/cf267f8a Diff:

[3/3] samza git commit: Merge branch 'samza-fluent-api-v1' of http://git-wip-us.apache.org/repos/asf/samza into samza-fluent-api-v1

2017-02-27 Thread nickpan47
Merge branch 'samza-fluent-api-v1' of http://git-wip-us.apache.org/repos/asf/samza into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/a9b213c1 Tree:

[1/3] samza git commit: SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer (WIP)

2017-02-27 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 dde754246 -> a9b213c13 SAMZA-1093: instantiating StreamOperatorTask in SamzaContainer (WIP) SAMZA-1093: Instantiating StreamOperatorTask in SamzaContainer SAMZA-1093: fix import SAMZA-1093: code ready, more unit tests

samza git commit: SAMZA-1092: replace stream spec in fluent API

2017-02-23 Thread nickpan47
linkedin.com> Closes #58 from nickpan47/replace-stream-spec and squashes the following commits: 761ebb5 [Yi Pan (Data Infrastructure)] SAMZA-1092: replace StreamSpec w/ new class in system package df953c2 [Yi Pan (Data Infrastructure)] SAMZA-1092: fix unit test 71331d8 [Yi Pan (Data Infrastructu

samza git commit: SAMZA-1097: update master branch to use 0.13.0-SNAPSHOT version

2017-02-21 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 062ac56d1 -> eab180010 SAMZA-1097: update master branch to use 0.13.0-SNAPSHOT version Author: Yi Pan (Data Infrastructure) <nickpa...@gmail.com> Reviewers: jagadish <jvenk...@linkedin.com> Closes #59 from nickpan47/SAMZA

[1/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master daaad7b84 -> 8515448a2 http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-operator/src/test/java/org/apache/samza/operators/TestMessageStreamImplUtil.java --

[5/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
SAMZA-1073: moving all operator classes into samza-core Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/8515448a Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/8515448a Diff:

[3/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.java -- diff --git

[4/5] samza git commit: SAMZA-1073: moving all operator classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/8515448a/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEnvironment.java -- diff --git

[3/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-core/src/test/java/org/apache/samza/operators/impl/TestOperatorImpls.java -- diff --git

[4/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-core/src/main/java/org/apache/samza/system/StandaloneExecutionEnvironment.java -- diff --git

[5/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
1...@gmail.com> Closes #55 from nickpan47/remove-operator-module and squashes the following commits: 74d806e [Yi Pan (Data Infrastructure)] SAMZA-1073: fixed build.gradle ba841b4 [Yi Pan (Data Infrastructure)] SAMZA-1073: move operator code to samza-core Project: http://git-wip-us.apache.o

[1/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 5d416cfc4 -> 2c7309cf6 http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-operator/src/test/java/org/apache/samza/operators/TestMessageStreamImplUtil.java

[2/5] samza git commit: SAMZA-1073: Remove operator module. Move all classes into samza-core

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/2c7309cf/samza-operator/src/main/java/org/apache/samza/operators/spec/PartialJoinOperatorSpec.java -- diff --git

[13/14] samza git commit: Merge branch 'master' into samza-fluent-api-v1

2017-02-16 Thread nickpan47
Merge branch 'master' into samza-fluent-api-v1 Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/55d7988b Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/55d7988b Diff:

[07/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
SAMZA-1073: top-level fluent API ` Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/b3dd886d Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/b3dd886d Diff: http://git-wip-us.apache.org/repos/asf/samza/diff/b3dd886d

[05/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/b3dd886d/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperatorImpl.java -- diff --git

[01/14] samza git commit: SAMZA-1082 : Implement Leader Election using ZK

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 001be632d -> 5d416cfc4 SAMZA-1082 : Implement Leader Election using ZK Simple implementation of leader election recipe along with unit tests Author: navina Reviewers: Xinyu Liu ,

[06/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/b3dd886d/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java -- diff --git a/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java

[08/14] samza git commit: SAMZA-1087: Schedule after debounce time

2017-02-16 Thread nickpan47
SAMZA-1087: Schedule after debounce time SAMZA-1087: Allows scheduling an action (a Runnable) after some de-bounce delay. Author: Boris Shkolnik Author: Boris Shkolnik Reviewers: Navina Ramesh , Fred Ji

[09/14] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-operator/src/test/java/org/apache/samza/example/TestJoinExample.java -- diff --git a/samza-operator/src/test/java/org/apache/samza/example/TestJoinExample.java

[11/14] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java -- diff --git a/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java

[03/14] samza git commit: SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder.

2017-02-16 Thread nickpan47
SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder. Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/4bde68b4 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/4bde68b4 Diff:

[04/14] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/b3dd886d/samza-operator/src/test/java/org/apache/samza/example/TestFluentStreamTasks.java -- diff --git

[02/14] samza git commit: SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder.

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/4bde68b4/samza-operator/src/test/java/org/apache/samza/example/TestWindowExample.java -- diff --git a/samza-operator/src/test/java/org/apache/samza/example/TestWindowExample.java

[10/14] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperatorImpl.java -- diff --git

[4/4] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
SAMZA-1073: top-level fluent API `Initial draft of top-level fluent API for operator DAGs Author: Yi Pan (Data Infrastructure) <nickpa...@gmail.com> Reviewers: Xinyu Liu <xi...@linkedin.com>, Jacob Maes <jm...@linkedin.com>, Prateek Maheshwari <pmahe...@linkedin.com> C

[2/4] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperatorImpl.java -- diff --git

[1/4] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 09bf8339c -> c249443b1 http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-operator/src/test/java/org/apache/samza/example/TestJoinExample.java -- diff --git

[3/4] samza git commit: SAMZA-1073: top-level fluent API

2017-02-16 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/c249443b/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java -- diff --git a/samza-api/src/main/java/org/apache/samza/operators/windows/Windows.java

[1/2] samza git commit: SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder.

2017-02-14 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 373048aa0 -> 001be632d http://git-wip-us.apache.org/repos/asf/samza/blob/001be632/samza-operator/src/test/java/org/apache/samza/example/TestWindowExample.java

[2/2] samza git commit: SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder.

2017-02-14 Thread nickpan47
SAMZA-1073: Addressing review feedbacks. Change StreamGraphFactory to StreamGraphBuilder. Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/001be632 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/001be632 Diff:

[1/4] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-09 Thread nickpan47
Repository: samza Updated Branches: refs/heads/samza-fluent-api-v1 [created] 373048aa0 http://git-wip-us.apache.org/repos/asf/samza/blob/373048aa/samza-operator/src/test/java/org/apache/samza/example/TestFluentStreamTasks.java

[2/4] samza git commit: SAMZA-1073: top-level fluent API `

2017-02-09 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/373048aa/samza-operator/src/main/java/org/apache/samza/operators/impl/SinkOperatorImpl.java -- diff --git

samza git commit: Fix checkstyle failure

2016-12-23 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 965a645d8 -> a47e8819f Fix checkstyle failure Project: http://git-wip-us.apache.org/repos/asf/samza/repo Commit: http://git-wip-us.apache.org/repos/asf/samza/commit/a47e8819 Tree: http://git-wip-us.apache.org/repos/asf/samza/tree/a47e8819

samza git commit: SAMZA-1069: Fix Deadlock between KafkaSystemProducer and KafkaProducer

2016-12-23 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 492a3d79d -> 52ff04197 SAMZA-1069: Fix Deadlock between KafkaSystemProducer and KafkaProducer Moving the producer.close() and sources.flush() outside the lock so it won't have race condition with the kafka network thread callbacks.

samza git commit: SAMZA-1031: Update to Java 1.8 source compatibility in Samza

2016-12-21 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 9930e5fee -> ced0c SAMZA-1031: Update to Java 1.8 source compatibility in Samza Author: Shanthoosh Venkataraman Reviewers: Yi Pan Closes #34 from shanthoosh/update_check_all_script

samza git commit: SAMZA-469: Update Scala version to 2.11

2016-12-21 Thread nickpan47
Repository: samza Updated Branches: refs/heads/master 7e1c92c08 -> 9930e5fee SAMZA-469: Update Scala version to 2.11 Author: McIntosh, Craig Reviewers: Yi Pan , Shanthoosh Venkataraman Closes #28 from

[2/6] samza git commit: SAMZA-1054: Refactor Operator APIs

2016-12-01 Thread nickpan47
http://git-wip-us.apache.org/repos/asf/samza/blob/00543804/samza-operator/src/test/java/org/apache/samza/operators/TestMessageStreamImpl.java -- diff --git

  1   2   3   4   5   >