Hi,
Using gobblin_0.10.0, we want to use module, KafkaSimpleJsonExtractor.java in
order to see both kafka record keys and values.
How does one configure a job to achieve it?
Hi,
In gobblin-distribution-0.10.0.tar.gz no jar contains the classes defined in
Kafka09ConsumerClient.java.
Is this expected? Or must I build the jar from source?
Thanks.
upport customization of the
gobblin-distribution build.. One of the core features of Gobblin is ability to
integrate for a number of systems for data management (sources, targets,
monitoring, etc.)
gobblin.readthedocs.io
From: Kidwell, Jack
mailto:jack_kidwel...@comca
to see the keys/values
rendered in the logs while the extraction is being done?
Why can't you have the other subscriber to the kafka which will render the
values rather than KafkaExtractor implementation rendering the same?
On Wed, Apr 11, 2018 at 11:17 PM, Kidwell, Jack
mailto:jack_k
er.
On Thu, Apr 12, 2018 at 6:47 PM, Kidwell, Jack
mailto:jack_kidwel...@comcast.com>> wrote:
We want to extract both key and value from a Kafka message and publish the
combined information to HDFS. Keys contain numeric ids for the strings
contained in values.
Please explain “other subscr
n you can use KafkaSimpleJsonExtractor which was asked at
the beginning.
So to conclude what I understand is that you don't want the data to be stored
in the byte array, you require json (or other format).
On Thu, Apr 12, 2018 at 8:09 PM, Kidwell, Jack
mailto:jack_kidwel...@comcast.c
tions it will have and why
this was not done earlier. I require some time to look deeper into it, hope
will take some time during the weekend.
On Sat, Apr 14, 2018 at 2:41 AM, Kidwell, Jack
mailto:jack_kidwel...@comcast.com>> wrote:
Our correspondence helps with understanding Gobblin. ☺
/incubator-gobblin/blob/master/README.md
I did not got a chance to add the Alias annotation, I am bit busy this weekend.
I will try to take out some time and see if I can test it.
On Fri, Apr 20, 2018 at 5:58 AM, Kidwell, Jack
mailto:jack_kidwel...@comcast.com>> wrote:
So far I have
