Hello,

I am new to this mailing list and would like to say hi to everybody.

I am using oozie 3.3.2-chd4.3.0 to import about a year of data to hive.
Data are stored hourly, so the coordinator need to create about 8000 jobs
to import all the data.

The problem is that oozie coordinator is too slow in creating jobs. It only
creates about 300 jobs per day with my setup. I tried to increase the
concurrency parameter of the coordinator job but it does not help.

Is there a knob anywhere making the coordinator create jobs faster,
preferably multiple jobs at once since those can be executed in parallel ?

Ideas and suggestions are much appreciated.

Regards,
Nam

Reply via email to