Re: How to create partitions from input

nstantiate your SystemConsumer. Turn the log-level > >>to > >> debug, so you can see the full stack trace. > >> > >> Cheers, > >> Chris > >> > >> From: Renato Marroquín Mogrovejo >> renatoj.marroq...@gmail.com>> > >&

Re: How to create partitions from input

Samza is unable to instantiate your SystemConsumer. Turn the log-level >>to >> debug, so you can see the full stack trace. >> >> Cheers, >> Chris >> >> From: Renato Marroquín Mogrovejo > renatoj.marroq...@gmail.com>> >> Reply-To: "dev@sa

Re: How to create partitions from input

mza.incubator.apache.org>" dev@samza.incubator.apache.org>> > Date: Wednesday, November 5, 2014 9:14 AM > To: "dev@samza.incubator.apache.org<mailto:dev@samza.incubator.apache.org>" > mailto:dev@samza.incubator.apache.org>> > Subject: Re: How to create pa

Re: How to create partitions from input

November 5, 2014 9:14 AM To: "dev@samza.incubator.apache.org<mailto:dev@samza.incubator.apache.org>" mailto:dev@samza.incubator.apache.org>> Subject: Re: How to create partitions from input Hi Chris, I am attaching them. Please let me know if they go through if not I can try putting them

Re: How to create partitions from input

Hey Renato, It looks like your config is good. I'm wondering if your consumer is failing to get created. I'm looking for this line in the logs: "Failed to create a consumer for order, so skipping" If the consumer creation fails, Samza will continue on, and assume that you won't use the consum

Re: How to create partitions from input

Hi Chris, This is what my config file looks like: # Job job.factory.class=org.apache.samza.job.yarn.YarnJobFactory job.name=order-feed # YARN yarn.package.path=file://${basedir}/target/${project.artifactId}-${pom.version}-dist.tar.gz # Task task.class=samza.examples.order.task.OrderFeedStreamTask

Re: How to create partitions from input

Hey Renato, Could you send the config for your job? The stack trace is indicating that you are using a system "task.inputs" that isn't defined in the configuration. For example, if you have: task.inputs=kafka.my-topic But, you haven't defined a "kafka" system (systems.kafka.*) then you will s

Re: How to create partitions from input

Hi Renato, 1) In the task.inputs option you told me that I should use something like "ordersystem.order", I guess I have to use ordersystem because of the factory name "OrderSystemFactory"? I tried using "order.order" but I got an So I imagine there is a naming convention for classes, inputs, and

Re: How to create partitions from input

Thanks for the help Yang! I think I understand more things now, but I also have more questions :) 1) In the task.inputs option you told me that I should use something like "ordersystem.order", I guess I have to use ordersystem because of the factory name "OrderSystemFactory"? I tried using "order.

Re: How to create partitions from input

Hi Renato, on the hello-samza example for each new incoming message which belongs to a channel, a new partition is created, right? -- In WikipediaFeed job of hello-samza, each channel actually is treated as one stream of the Wikipedia System. Each stream has on partition 0. This is the code: Syst