We are using Pig for report generation and Pig scripts are being run with org.apache.pig:pig jar in a Java project. There are parameters like start_date, end_date and report_id etc. These are used for parameter substitution in Pig script.
I assume I can pass these parameters via Oozie. But I wonder whether I can validate some of these parameters. When Oozie starts a Pig job, can it connect to MySQL database and see if given report_id exists in reports table? Does Oozie support this kind of custom validation? I searched the net but could not find a similar topic. On Mon, Mar 10, 2014 at 7:45 PM, Mona Chitnis <[email protected]> wrote: > Hi Isa, > > Can you elaborate a bit more on what parameters you’d wish to check in > Oozie? > > — > Mona > > On 3/10/14, 5:33 AM, "isa olmez" <[email protected]> wrote: > > >Hi, > >I dont know if this is the right place but I want to ask a question. > > > >We are trying to run our Pig scripts on Oozie. Right now they are being > >run > >by org.apache.pig.PigServer class in a Java project. When collecting > >parameters from properties files and command line, there are some > >validations that are running against database. These validations check > >whether parameter X exists on database table Y etc. > > > >Can I do a similar validation with oozie? > > > > > >Best Regards. > > > >İsa. > >
