FlinkKafkaConsumer09 not reading from all partitions?

2016-09-20 Thread Curtis Wilde
I’m just getting my feet wet with Flink, doing a quick implementation on my 
laptop following the examples.

I’m consuming from a Kafka 0.9 cluster using FlinkKafkaConsumer09 from a topic 
with 50 partitions.

I see offset commit messages for partitions 0-9, but I don’t see offsets being 
committed for partitions 10-49.

Any ideas what’s going on?

I’ve been messing around with consumer configs to no avail:

enable.auto.commit=true,
group.id=flink-test,
flink.poll-timeout=9223372036854775807,
auto.offset.reset=earliest,
session.timeout.ms=12,
bootstrap.servers=n1:9092,n2:9092,n3:9092,n4:9092,n5:9092,
request.timeout.ms=120500,
topic=mytopic,
max.partition.fetch.bytes=13631488,
auto.commit.interval.ms=5000


REST Interface to JobManager

2016-09-22 Thread Curtis Wilde
I would like to be able to use Jenkins to deploy jobs to Flink.
I’ve seen talk of a REST interface that might allow me to do this 
https://issues.apache.org/jira/browse/FLINK-1228
Is there any documentation around this feature?