Re: InMemorySystemDescriptor ignores serde

2019-01-19 Thread Tom Davis
Thanks Xinyu, I really appreciate it! The IMS allowed me to test my library without the use of live integration tests, so I was quite happy to find it in any case. There were a few rough edges, particularly around setting the correct factories for certain components, but overall I was glad for the

Re: InMemorySystemDescriptor ignores serde

2019-01-17 Thread Xinyu Liu
Hi, Tom, First, your observation about current InMemorySystem is exactly right and thanks for raising this issue to the community! The current InMemorySystem came up with a tight coupling with the Samza test framework, which I believe put quite a lot of limitations on its uses, e.g. using

Re: InMemorySystemDescriptor ignores serde

2019-01-17 Thread Tom Davis
Hey Sanil, thanks for the reply. I eventually figured that not supporting serdes for in-memory streams was an intentional restriction, I was just pointing out that it is inconsistent with earlier versions since it was relatively easy to supply stream serdes directly before the Descriptor API. I

Re: InMemorySystemDescriptor ignores serde

2019-01-16 Thread Sanil Jain
Hi Tom, InMemorySystem is a system that is supposed to only support NoOpSerde since all the associated steams for this system are maintained in memory. In addition to this, if your test is using the Samza's Test Framework, it will override any explicit serde configs specified for streams to NoOp.

Re: InMemorySystemDescriptor ignores serde

2019-01-08 Thread Sanil Jain
me a snippet of test you are trying to fix, so that I can understand the problem better? Thanks Sanil From: Tom Davis Sent: Tuesday, January 8, 2019 5:28:20 PM To: dev@samza.apache.org Subject: InMemorySystemDescriptor ignores serde I am in the process

Re: InMemorySystemDescriptor ignores serde

2019-01-08 Thread Sanil Jain
ignores serde I am in the process of updating a project to 1.0 and spent today debugging a rather odd test failure. When using input/output streams with IntegerSerde, things worked fine -- however, using LongSerde, every message value was 0! I eventually found that InMemorySystemDescriptor

InMemorySystemDescriptor ignores serde

2019-01-08 Thread Tom Davis
I am in the process of updating a project to 1.0 and spent today debugging a rather odd test failure. When using input/output streams with IntegerSerde, things worked fine -- however, using LongSerde, every message value was 0! I eventually found that InMemorySystemDescriptor#getInputDescriptor