Re: Cassandra POJO sink flink 1.4.0 in scala

2017-12-27 Thread Michael Fong
/flink-cassandra-connector-examples/ Regards, On Thu, Dec 28, 2017 at 1:11 PM, Michael Fong <mcfong.o...@gmail.com> wrote: > Hi, shashank agarwal > > > AFAIK, in java side, for a pojo data type, you don't need to set query > since the CQL data mapping would take care of that

Re: Cassandra POJO sink flink 1.4.0 in scala

2017-12-27 Thread Michael Fong
Hi, shashank agarwal AFAIK, in java side, for a pojo data type, you don't need to set query since the CQL data mapping would take care of that whereas dealing with java tuples, you do need to provide a upsert query so that cassandra knows what to insert into the table. Scala tuple case is clear,

Re: Building scala examples

2017-09-26 Thread Michael Fong
> > Afaik, there is no simple switch to turn off Java or Scala examples. You > may > either adapt the pom.xml or create your own Project with the examples and > programming languages you need. > > > Nico > > > On Saturday, 23 September 2017 12:45:04 CEST Michael

Re: need instruction on how the Flink metric works

2017-09-19 Thread Michael Fong
ook at?) > > > and flink-conf.yaml has: > > # metrics > > metrics.reporters: jmx > > metrics.reporter.jmx.class: org.apache.flink.metrics.jmx.JMXReporter > > metrics.reporter.jmx.port: 28780-28790 > > > and taskmanager log looks ok regarding JMX > >

Re: need instruction on how the Flink metric works

2017-09-18 Thread Michael Fong
sole, it listed > com.apache.flink.runtime.jobmanager..:[port] > as one of the Local Process, i was able to connect to it with insecure > connection, but i was not able to locate the Counter metrics, I only saw > some system metrics. > > On Sun, Sep 17, 2017 at 7:39 PM, Michael Fon

Re: need instruction on how the Flink metric works

2017-09-17 Thread Michael Fong
Hi, You may enable metrics reporter to see the output of your metrics; counter in your example. There is a brief documentation regarding to metrics and reporter setup at link . The easiest approach, in my

Re: Sink metric numRecordsIn drops temporarily

2017-09-17 Thread Michael Fong
Hi, Thank you for your description. What I tried to understand is what the counter value is at that moment of spikes. Grafana would take the average out of a continuous data values before rendering result to UI. That is, if the metrics value is not transmitted continuously, where at some data

Re: Sink metric numRecordsIn drops temporarily

2017-09-17 Thread Michael Fong
Missed to cc to user@flink.apache.org Hi, > > Just wondering what is the value of that counter (wo/ applying > NonNegativeDerivative > function) when you observe the spikes? If I remember correctly, Grafana > is known to aggregate those values by averaging them across the time > duration

Quick start guide

2017-09-03 Thread Michael Fong
Hi, I was following the quick start guide on official documents , and I came cross a line that caused a bit confusion. $ tail -f log/flink-*-jobmanager-*.out It is said the wordcount program would