Re: Kafka topic naming conventions

2015-03-19 Thread Renato Marroquín Mogrovejo
There was an interesting discussion over in the kafka mailing list that might give you more ideas Roger. Although they don't mention anything about the number of partitions when doing so, anyways maybe it helps. Renato M. [1] https://www.mail-archive.com/users@kafka.apache.org/msg11976.html 201

Message processing stuck after invalid JSON [BUG?!] - Version 0.8.x

2015-03-19 Thread Michael Strobl
Hey there, I used the config setting "task.drop.deserialization.errors=true" to drop all invalid JSON messages. It seems to work fine, in case of an ongoing message stream. But the system will stuck when the last message was invalid and the queue will be empty. Upcoming messages won't be proces

Re: Kafka topic naming conventions

2015-03-19 Thread Roger Hoover
Renato, Thanks for the link. Some interesting suggests there as well. On Thu, Mar 19, 2015 at 2:28 AM, Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > There was an interesting discussion over in the kafka mailing list that > might give you more ideas Roger. > Although they do

Re: Message processing stuck after invalid JSON [BUG?!] - Version 0.8.x

2015-03-19 Thread Chris Riccomini
Hey Michael, Hmm. I checked the SystemConsumers code, and nothing jumped out at me as broken. Could you paste your logs somewhere (pastebin/gist) with DEBUG-level logging enabled? Cheers, Chris On Thu, Mar 19, 2015 at 6:52 AM, Michael Strobl < michael.str...@gameforge.com> wrote: > Hey there, >

Re: Review Request 32147: SAMZA-465

2015-03-19 Thread Chris Riccomini
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32147/#review77063 --- * Comb over all docs and update checkpoint manager docs. * Add some

How to pass quoted string in the configuration

2015-03-19 Thread Bae, Jae Hyeon
Hi Samza Devs I want to pass the quoted string like filter.map.filter1.property=xpath("name") in ("uiBrowseStartup.ended", "subscription.ended", "uiStartup.ended") or xpath("category") = "uiIntent" through the configuration to the container but AM keeps failing Application application_142309072

Re: How to pass quoted string in the configuration

2015-03-19 Thread Chris Riccomini
Hey Jae, If you're using the PropertiesConfigFactory (the default), then it's just a Java Properties object. You should be able to escape it. I'm actually not even sure if quotes are a problem in Java Properties objects. I would think that they wouldn't be. The second '=' sign might be, though. I

Re: How to pass quoted string in the configuration

2015-03-19 Thread Bae, Jae Hyeon
The problem is json processing. I have to use the different expression format... hm... Java HotSpot(TM) 64-Bit Server VM (build 24.71-b01, mixed mode) Exception in thread "main" org.codehaus.jackson.JsonParseException: Unrecognized character escape ')' (code 41) at [Source: java.io.StringReader@7

Re: How to pass quoted string in the configuration

2015-03-19 Thread Bae, Jae Hyeon
Double quote character is escaped as the following but the \\" cannot be correctly parsed as the string. It should be \". \"filter.map.filter1.property\":\"xpath(\\"name\\") in (\\"uiBrowseStartup.ended\\", \\"subscription.ended\\", \\"uiStartup.ended\\") or xpath(\\"category\\") = \\"uiIntent\\"\

Re: Message processing stuck after invalid JSON [BUG?!] - Version 0.8.x

2015-03-19 Thread Chris Riccomini
Hey all, I've reproduced and documented the bug here: https://issues.apache.org/jira/browse/SAMZA-608 Cheers, Chris On Thu, Mar 19, 2015 at 9:08 AM, Chris Riccomini wrote: > Hey Michael, > > Hmm. I checked the SystemConsumers code, and nothing jumped out at me as > broken. Could you paste y

Re: How to pass quoted string in the configuration

2015-03-19 Thread Naveen Somasundaram
Hey Jae, I verified passing Java properties with the property you specified and it seems to be working fine. However, if I pass the same properties to the hello-samza, it fails with same error you have. I have opened a bug to track this here: https://issues.apache.org/jira/browse/SAMZA-60

Re: How to pass quoted string in the configuration

2015-03-19 Thread Bae, Jae Hyeon
Thanks Naveen On Thu, Mar 19, 2015 at 4:23 PM, Naveen Somasundaram < nsomasunda...@linkedin.com.invalid> wrote: > Hey Jae, > I verified passing Java properties with the property you specified > and it seems to be working fine. However, if I pass the same properties to > the hello-samza, it