Re: [ANNOUNCE] Welcome Daniel Chen as Samza Committer

2021-09-17 Thread weisong44
Congrats Daniel !!! On Sep 17, 2021 at 11:25, Yi Pan wrote: Congrats, Daniel, well deserved!!! -Yi On Fri, Sep 17, 2021 at 11:23 AM Xinyu Liu wrote: > Hi, all, > > I am glad to announce that Daniel Chen has officially accepted our > invitation and become an Apache Samza Committer now. > >

[GitHub] samza pull request #896: SAMZA-2085: Add table serde generation

2019-01-24 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/896 SAMZA-2085: Add table serde generation Currently the serde configuration generation is consolidated to JobNodeConfigurationGenerator, which runs during planning stage, it is not executed when

[GitHub] samza pull request #893: SAMZA-2085 Add table serde generation

2019-01-24 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/893 SAMZA-2085 Add table serde generation Currently the serde configuration generation is consolidated to JobNodeConfigurationGenerator, which runs during planning stage, it is not executed when

[GitHub] samza pull request #887: SAMZA-2076 RocksDbTableDescriptor should use Long t...

2019-01-17 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/887 SAMZA-2076 RocksDbTableDescriptor should use Long type for TTL Samza uses millisec as config value, while in rocksDB it's defined as int32. It's currently defined as integer

[GitHub] samza pull request #880: SAMZA-2066 Refactor remote tables to separate vario...

2019-01-14 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/880 SAMZA-2066 Refactor remote tables to separate various concerns Currently different features such as rate limiting, retries, etc. are implemented together in remote table, the implementation

[GitHub] samza pull request #861: SAMZA-2043: Consolidate ReadableTable and ReadWrite...

2018-12-13 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/861 SAMZA-2043: Consolidate ReadableTable and ReadWriteTable So far we've not seen a lot of use in maintaining separate implementation for ReadableTable and ReadWriteTable, which adds quite a bit

[GitHub] samza pull request #842: SAMZA-2026: Refactor remote table API to separate r...

2018-12-04 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/842 SAMZA-2026: Refactor remote table API to separate retry policy settings As per subject, the goal is to make configuration of retry policies consistent with other API's. You can merge this pull

[GitHub] samza pull request #835: SAMZA-2015: Refactor timer handling in tables to be...

2018-11-30 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/835 SAMZA-2015: Refactor timer handling in tables to be consistent with stores Currently when timer is disabled, we do not instantiate timer instances for tables, this introduced potential

[GitHub] samza pull request #828: SAMZA-2011: Add ability to disable store timers

2018-11-30 Thread weisong44
Github user weisong44 closed the pull request at: https://github.com/apache/samza/pull/828 ---

[GitHub] samza pull request #828: SAMZA-2011: Add ability to disable store timers

2018-11-29 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/828 SAMZA-2011: Add ability to disable store timers Add same ability for store timers as in SAMZA-2004 https://issues.apache.org/jira/browse/SAMZA-2004 You can merge this pull request into a Git

[GitHub] samza pull request #827: SAMZA-2010: Handle null value in LocalReadWriteTabl...

2018-11-29 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/827 SAMZA-2010: Handle null value in LocalReadWriteTable.putAll() To be consistent with put(), null values in input should be delete operation You can merge this pull request into a Git

[GitHub] samza pull request #826: SAMZA-2009: Add ability to disable table metrics

2018-11-29 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/826 SAMZA-2009: Add ability to disable table metrics This is to back port SAMZA-2004 to 0.14.1, due to the extend of changed made in Samza 1.0, the back port is actually done manually. More

[GitHub] samza pull request #822: SAMZA-2004: Add ability to disable table metrics

2018-11-27 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/822 SAMZA-2004: Add ability to disable table metrics For jobs with very high throughput, it is desirable to disable metrics on tables. We would introduce the option to disable all metrics for a table

[GitHub] samza pull request #813: SAMZA-2004: Add ability to disable table metrics

2018-11-27 Thread weisong44
Github user weisong44 closed the pull request at: https://github.com/apache/samza/pull/813 ---

[GitHub] samza pull request #816: SAMZA-2006: Removed config from table provider cons...

2018-11-26 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/816 SAMZA-2006: Removed config from table provider constructor With the latest API change in Samza 1.0, config can be obtained from Context object during init(), therefore we do not to pass

[GitHub] samza pull request #813: SAMZA-2004: Add ability to disable table metrics

2018-11-26 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/813 SAMZA-2004: Add ability to disable table metrics For jobs with very high throughput, it is desirable to disable metrics on tables. We would introduce the option to disable all metrics for a table

[GitHub] samza pull request #807: SAMZA-1998: Table API refactoring

2018-11-15 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/807 SAMZA-1998: Table API refactoring Table API refactoring - Removed TableSpec - Consolidated configuration for tables to table descriptors - Refactored constructor so

[GitHub] samza pull request #799: SAMZA-1981: Consolidate table descriptors to samza-...

2018-11-07 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/799 SAMZA-1981: Consolidate table descriptors to samza-api As per subject, table descriptors moved are - LocalTableDescriptor - RemoteTableDescriptor - HybridTableDescriptor

[GitHub] samza pull request #798: SAMZA-1980 Rename LocalStoreBackedTable to LocalTab...

2018-11-07 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/798 SAMZA-1980 Rename LocalStoreBackedTable to LocalTable As per subject, this is to keep naming of local tables consistent with other table types. You can merge this pull request into a Git

[GitHub] samza pull request #747: SAMZA-1964 Make getTableSpec() in RemoteTableDescri...

2018-10-19 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/747 SAMZA-1964 Make getTableSpec() in RemoteTableDescriptor reentrant As per subject You can merge this pull request into a Git repository by running: $ git pull https://github.com/weisong44

[GitHub] samza pull request #735: SAMZA-1959: Modify EmbeddedTaggedRateLimiter to use...

2018-10-16 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/735 SAMZA-1959: Modify EmbeddedTaggedRateLimiter to use total number of tasks for effective rate calculation The EmbeddedTaggedRateLimiter currently uses number of tasks assigned to the currently

[GitHub] samza pull request #709: SAMZA-1891: Updated javadoc to include config behav...

2018-10-11 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/709 SAMZA-1891: Updated javadoc to include config behavior Instead of referring users to the Samza Configuration Guide, TableDescriptors should copy the documentation instead. If the goal is to let

[GitHub] samza pull request #706: SAMZA-1948 Updated hybrid table descriptors to take...

2018-10-11 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/706 SAMZA-1948 Updated hybrid table descriptors to take underlying table descriptors Hybrid Table Descriptors, e.g. CachingTableDescriptor, should take both tables as a constructor param instead

[GitHub] samza pull request #682: SAMZA-1929: Expose Kafka topic level configuration ...

2018-10-01 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/682 SAMZA-1929: Expose Kafka topic level configuration in local store backed table descriptors The changelog Kafka topic level configuration may be useful for adjustment, when TTL is set on a RocksDB

[GitHub] samza pull request #666: Samza 1915: Added docs for table API

2018-09-26 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/666 Samza 1915: Added docs for table API As per subject You can merge this pull request into a Git repository by running: $ git pull https://github.com/weisong44/samza SAMZA-1915 Alternatively

[GitHub] samza pull request #657: SAMZA-1905: Added case study for eBay, Optimizely, ...

2018-09-24 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/657 SAMZA-1905: Added case study for eBay, Optimizely, Redfin and TripAdvisor As per subject You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] samza pull request #656: Samza 1904: Added test case in TestLocalTest for lo...

2018-09-24 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/656 Samza 1904: Added test case in TestLocalTest for low level API As per subject, adding a new test case that uses TaskApplication You can merge this pull request into a Git repository by running

[GitHub] samza pull request #649: Samza 1849

2018-09-19 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/649 Samza 1849 Changed table descriptor to take serde in constructor, and removed withSerde() from all table descriptors. You can merge this pull request into a Git repository by running: $ git

[GitHub] samza pull request #645: SAMZA-1854: Changed caching table descriptor to tak...

2018-09-17 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/645 SAMZA-1854: Changed caching table descriptor to take table descriptor instead of run-time objects As per subject, changed caching table descriptor to take table descriptor instead of run-time

[GitHub] samza pull request #636: Reuse table instances in TableManager

2018-09-11 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/636 Reuse table instances in TableManager We currently are invoking TableProvider.getTable() when TableManager.getTable(tableId) is invoked every time, this would in turn cause a new table instance

[GitHub] samza pull request #611: SAMZA-1812: Added configuration for changelog to lo...

2018-08-20 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/611 SAMZA-1812: Added configuration for changelog to local store backed tables Currently changelog for tables can be supported implicitly by adding user defined configuration, to be more user friendly

[GitHub] samza pull request #600: SAMZA-1802: Enable host affinity when RocksDB is pr...

2018-08-06 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/600 SAMZA-1802: Enable host affinity when RocksDB is present We should enable host affinity when RocksDB table is present, this should be done in RocksDB table provider You can merge this pull

[GitHub] samza pull request #579: SAMZA-1784: Update committers.md

2018-07-24 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/579 SAMZA-1784: Update committers.md Added "Wei Song" to committer list You can merge this pull request into a Git repository by running: $ git pull https://github.com/weisong44/samza

[GitHub] samza pull request #560: Fixed failed unit tests in TestCachingTable

2018-06-22 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/560 Fixed failed unit tests in TestCachingTable This is due to the recent refactoring of table metrics, for some reason running build locally didn't catch these failed tests. You can merge this pull

[GitHub] samza pull request #555: Refactored metrics for table API

2018-06-15 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/555 Refactored metrics for table API Refactored metrics for table API - Added TableMetricsUtil that encapsulates required parameters, maintains naming consistency and simplifies metrics creation

[GitHub] samza pull request #547: Convert a put to to a delete operation in ReadWrite...

2018-06-06 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/547 Convert a put to to a delete operation in ReadWriteTable and TableWriteFunction when input value is null Currently, the behavior of putting a null value is inconsistent: it is a delete

[GitHub] samza pull request #429: Added rate limiter interface and embedded implement...

2018-02-28 Thread weisong44
Github user weisong44 closed the pull request at: https://github.com/apache/samza/pull/429 ---

[GitHub] samza pull request #429: Added rate limiter interface and embedded implement...

2018-02-22 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/429 Added rate limiter interface and embedded implementation Added rate limiter interface and embedded implementation - EmbeddedRateLimiter - EmbeddedTaggedRateLimiter You can merge

[GitHub] samza pull request #387: Added document for table API to feature preview

2017-12-13 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/387 Added document for table API to feature preview Added document for table API to feature preview - Brief description of table - sendTo() operator for table - join() operator

[GitHub] samza pull request #349: Initial version of Table API

2017-11-01 Thread weisong44
GitHub user weisong44 opened a pull request: https://github.com/apache/samza/pull/349 Initial version of Table API Initial version of table API, it includes - Core table API (Table, TableDescriptor, TableSpec) - Local table implementation for in-memory and RocksDb