Kafka Producer from Oozie

2017-01-16 Thread dhvanika.shah
Hi Friends

I have a Kafka Producer written in Java bundled in a Jar file.

While running this Producer from Oozie [Using Hue or Command line Interfaces], 
I run into multiple issues.

Issue number 1:
Oozie is not able to find the Configuration files and shared Java libs required 
for my executable producer jar.

Issue Number 2:
File 
"/opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/lib/hue/apps/hbase/src/hbase/views.py",
 line 86, in clean
json.dumps(data)
  File "/usr/lib64/python2.6/json/__init__.py", line 230, in dumps
return _default_encoder.encode(obj)
  File "/usr/lib64/python2.6/json/encoder.py", line 367, in encode
chunks = list(self.iterencode(o))
  File "/usr/lib64/python2.6/json/encoder.py", line 317, in _iterencode
for chunk in self._iterencode_default(o, markers):
  File "/usr/lib64/python2.6/json/encoder.py", line 323, in _iterencode_default
newobj = self.default(o)
  File "/usr/lib64/python2.6/json/encoder.py", line 344, in default
raise TypeError(repr(o) + " is not JSON serializable")
TypeError: TCell(timestamp=1484296786740, value='003') is not JSON serializable

If someone tried running Kafka Producer from oozie and faced similar issues, 
your help would be really appreciated.


Regards
Dhvanika
The information contained in this electronic message and any attachments to 
this message are intended for the exclusive use of the addressee(s) and may 
contain proprietary, confidential or privileged information. If you are not the 
intended recipient, you should not disseminate, distribute or copy this e-mail. 
Please notify the sender immediately and destroy all copies of this message and 
any attachments. WARNING: Computer viruses can be transmitted via email. The 
recipient should check this email and any attachments for the presence of 
viruses. The company accepts no liability for any damage caused by any virus 
transmitted by this email. www.wipro.com


Re: Extended attributes

2017-01-16 Thread Peter Cseh
Hi,

the patch for OOZIE-1770
 changes
the hadoop version to 2.6.0.
We're working on getting it to the master branch.

gp


On Mon, Jan 16, 2017 at 2:37 AM, Artem Ervits  wrote:

> Hello all, I'm trying to extend FS action functionality to extended
> attributes and I realized that this functionality is not exposed in Hadoop
> 2.4. All major distros moved to 2.6.1 at the least, what are the plans to
> migrate these libraries?
>



-- 
Peter Cseh
Software Engineer