[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15722916#comment-15722916 ] Thomas Poepping commented on OOZIE-2616: Ping, this issue has been open for entirely too long. Can someone please take a look? [~abhishekbafna] [~gezapeti] [~rkanter] > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch, > OOZIE-2616-3.patch, OOZIE-2616-4.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684907#comment-15684907 ] Thomas Poepping commented on OOZIE-2616: [~abhishekbafna][~gezapeti] Can I get some help? > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch, > OOZIE-2616-3.patch, OOZIE-2616-4.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2616: --- Attachment: OOZIE-2616-4.patch Re-rebased patch. Can I please get someone to look at this patch? It's been open for many months with very little response. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch, > OOZIE-2616-3.patch, OOZIE-2616-4.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592469#comment-15592469 ] Thomas Poepping commented on OOZIE-2616: Hello, ping on this issue? > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch, > OOZIE-2616-3.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2616: --- Attachment: OOZIE-2616-3.patch Attached rebased patch. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch, > OOZIE-2616-3.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping reassigned OOZIE-2616: -- Assignee: Thomas Poepping > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping >Assignee: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1843#comment-1843 ] Thomas Poepping commented on OOZIE-2616: double ping? If we're freezing Oozie-4.3.0 at EOD today, it'd be great to get this in beforehand. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491048#comment-15491048 ] Thomas Poepping commented on OOZIE-2616: ping? it wouldn't make sense for this patch to add/modify any testcase.otherwise result is +1 > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2530: --- Attachment: OOZIE-2530.03.patch > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.02.patch, > OOZIE-2530.03.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491029#comment-15491029 ] Thomas Poepping commented on OOZIE-2530: You're right, oops. Uploading a new patch now. > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.02.patch, > OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2616: --- Attachment: OOZIE-2616-2.patch Added wiki documentation. Appreciate comments. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch, OOZIE-2616-2.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15435378#comment-15435378 ] Thomas Poepping commented on OOZIE-2530: new diff attached, appreciate comments. > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.02.patch, > OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2530: --- Attachment: OOZIE-2530.02.patch > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.02.patch, > OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433222#comment-15433222 ] Thomas Poepping commented on OOZIE-2616: The settings that work for me are -Dhadoop.version=2.7.2 -Dpig.version=0.16.0 -Dhive.version=2.1.0 -Ptez -Phadoop-2 Let me know what you find. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433092#comment-15433092 ] Thomas Poepping commented on OOZIE-2616: Hi [~gezapeti], why wouldn't we still want the hive and pig versions to be up to the user? There could be multiple versions of those applications for which bringing in Tez is a valid use case. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419156#comment-15419156 ] Thomas Poepping commented on OOZIE-2530: Yes Robert, sounds good. I should be able to attach an updated patch later today. > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419155#comment-15419155 ] Thomas Poepping commented on OOZIE-2616: Hi Peter, could you explain what you mean? > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402643#comment-15402643 ] Thomas Poepping commented on OOZIE-2530: Bump? > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402640#comment-15402640 ] Thomas Poepping commented on OOZIE-2616: Same irrelevant failures as before, so I'll cancel and resubmit the patch again. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15402641#comment-15402641 ] Thomas Poepping commented on OOZIE-2616: It'd be good to have someone look at this. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15398118#comment-15398118 ] Thomas Poepping commented on OOZIE-2530: Pig directly depends on jline as a compile dependency. In my testing, it looks like the pig sharelib should transitively load the required jline dependency from the dependency on org.apache.pig, removing the requirement for the explicit dependency. The reason for this patch is that other sharelibs (like Hive) also depend on jline, but on a later incompatible version. If there is an explicit dependency defined in the root pom, then the transitive jline dependency loaded from the hive jars for the hive sharelib will be managed to the incompatible version, causing Hive actions to fail. Does Oozie not have any integration tests that install oozie, install the sharelib, and run through the examples? That would answer our question. > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394085#comment-15394085 ] Thomas Poepping commented on OOZIE-2616: It looks like the compilation failure was due to: "[ERROR] Failed to execute goal on project oozie-workflowgenerator: Could not resolve dependencies for project org.apache.oozie:oozie-workflowgenerator:war:4.3.0-SNAPSHOT: Failure to find com.orange.links:gwt-links:jar:1.3-SNAPSHOT in http://gwt-links.googlecode.com/svn/repository was cached in the local repository, resolution will not be reattempted until the update interval of gwt-links has elapsed or updates are forced -> [Help 1]" which in no way is related to my patch. The two tests that failed: https://builds.apache.org/job/oozie-trunk-precommit-build/3047/testReport/ are both not part of sharelibs or actions, so those failures should also not be related to my patch. The distro tarball failed because: "[ERROR] Failed to execute goal org.apache.maven.plugins:maven-site-plugin:2.0-beta-6:site (default) on project oozie-docs: The site descriptor cannot be resolved from the repository: Could not transfer artifact org.apache:apache:xml:site:17 from/to apache.snapshots.repo (https://repository.apache.org/content/groups/snapshots): Connect to repository.apache.org:443 [repository.apache.org/207.244.88.143] failed: Connection timed out [ERROR] org.apache:apache:xml:17" which is not related to my patch. I'll resubmit the patch to hopefully get a clean run without timeouts in the compilation. A thing to note is that because I'm simply adding a profile, nothing in the build should change. This is a purely optional thing for users. > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
[ https://issues.apache.org/jira/browse/OOZIE-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2616: --- Attachment: OOZIE-2616-1.patch > Add Tez profile for Hive and Pig sharelibs > -- > > Key: OOZIE-2616 > URL: https://issues.apache.org/jira/browse/OOZIE-2616 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2616-1.patch > > > More recent versions of Hive and Pig depend on Tez as their default execution > engine. As the sharelib for those applications stands today, those > applications are unable to run Tez jobs. This patch adds an optional profile > to the root pom that will include the proper Tez dependencies into those > sharelibs, while excluding problematic jars to keep the sharelibs from having > classpath duplication issues. *Note*: this patch will only be required for > those clients who specify their own, newer versions of Hive or Pig. This > change is not required for the current supported versions of those > applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (OOZIE-2616) Add Tez profile for Hive and Pig sharelibs
Thomas Poepping created OOZIE-2616: -- Summary: Add Tez profile for Hive and Pig sharelibs Key: OOZIE-2616 URL: https://issues.apache.org/jira/browse/OOZIE-2616 Project: Oozie Issue Type: Improvement Affects Versions: trunk Reporter: Thomas Poepping More recent versions of Hive and Pig depend on Tez as their default execution engine. As the sharelib for those applications stands today, those applications are unable to run Tez jobs. This patch adds an optional profile to the root pom that will include the proper Tez dependencies into those sharelibs, while excluding problematic jars to keep the sharelibs from having classpath duplication issues. *Note*: this patch will only be required for those clients who specify their own, newer versions of Hive or Pig. This change is not required for the current supported versions of those applications (hence why the profile is off by default). -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340455#comment-15340455 ] Thomas Poepping commented on OOZIE-2530: Do you have a recommendation for how we can figure out which component needs jline? Compiling oozie with no direct jline dependencies succeeds, which leads me to believe it isn't needed by any components (pig included) > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340212#comment-15340212 ] Thomas Poepping commented on OOZIE-2530: What would be your suggested course of action here? Add the jline dependency back in the pig sharelib pom? > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Comment Edited] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15340212#comment-15340212 ] Thomas Poepping edited comment on OOZIE-2530 at 6/20/16 7:16 PM: - What would be your suggested course of action here? Add the jline dependency back in the pig sharelib pom? Pig appears to compile correctly when I run it locally. was (Author: poeppt): What would be your suggested course of action here? Add the jline dependency back in the pig sharelib pom? > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15323133#comment-15323133 ] Thomas Poepping commented on OOZIE-2530: Ping? > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284920#comment-15284920 ] Thomas Poepping commented on OOZIE-2530: This test doesn't appear to be related. Can I get something on this issue? > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283047#comment-15283047 ] Thomas Poepping commented on OOZIE-2530: https://reviews.apache.org/r/47351/ > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283043#comment-15283043 ] Thomas Poepping commented on OOZIE-2530: Patch applies cleanly to master in my workspace -- resubmitting patch with slightly different diff format. > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2530: --- Attachment: OOZIE-2530.01.patch > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.01.patch, OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (OOZIE-2530) Remove jline from parent and sharelib pig pom
[ https://issues.apache.org/jira/browse/OOZIE-2530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Poepping updated OOZIE-2530: --- Attachment: OOZIE-2530.patch > Remove jline from parent and sharelib pig pom > - > > Key: OOZIE-2530 > URL: https://issues.apache.org/jira/browse/OOZIE-2530 > Project: Oozie > Issue Type: Improvement >Affects Versions: trunk >Reporter: Thomas Poepping > Attachments: OOZIE-2530.patch > > > This patch removes an unnecessary hardcoded dependency on jline in the oozie > parent pom and pig sharelib pom. > The jline dependencies were required before OOZIE-704, which removed the > direct dependencies on jline in oozie code. Since that patch, the direct > dependency on jline in oozie has been unnecessary. This will also fix > OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (OOZIE-2530) Remove jline from parent and sharelib pig pom
Thomas Poepping created OOZIE-2530: -- Summary: Remove jline from parent and sharelib pig pom Key: OOZIE-2530 URL: https://issues.apache.org/jira/browse/OOZIE-2530 Project: Oozie Issue Type: Improvement Affects Versions: trunk Reporter: Thomas Poepping This patch removes an unnecessary hardcoded dependency on jline in the oozie parent pom and pig sharelib pom. The jline dependencies were required before OOZIE-704, which removed the direct dependencies on jline in oozie code. Since that patch, the direct dependency on jline in oozie has been unnecessary. This will also fix OOZIE-2409. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (OOZIE-2409) hive2 action with hive 1.2.1 failed
[
https://issues.apache.org/jira/browse/OOZIE-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241682#comment-15241682
]
Thomas Poepping commented on OOZIE-2409:
If there is no jline.version property in the Oozie parent pom, how can we
specify it in mkdistro
> hive2 action with hive 1.2.1 failed
> ---
>
> Key: OOZIE-2409
> URL: https://issues.apache.org/jira/browse/OOZIE-2409
> Project: Oozie
> Issue Type: Bug
> Components: build
>Affects Versions: 4.2.0
>Reporter: KWON BYUNGCHANG
>Priority: Minor
> Attachments: OOZIE-2409.01.patch, OOZIE-2409.02.patch,
> OOZIE-2409.patch
>
>
> hive2 action with hive 1.2.1 failed.
> stack trace
> {code}
> 015-11-26 15:47:39,141 WARN Hive2ActionExecutor:523 - SERVER[myhost.com]
> USER[myuser] GROUP[-] TOKEN[] APP[test]
> JOB[401-151125114930017-oozie-irte-W]
> ACTION[401-151125114930017-oozie-irte-W@HIVEJOB] Launcher exception:
> jline/console/history/History
> java.lang.NoClassDefFoundError: jline/console/history/History
> at
> org.apache.oozie.action.hadoop.Hive2Main.runBeeline(Hive2Main.java:240)
> at org.apache.oozie.action.hadoop.Hive2Main.run(Hive2Main.java:223)
> at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:47)
> at org.apache.oozie.action.hadoop.Hive2Main.main(Hive2Main.java:56)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}
> hive 1.2.1 need to jline-2.12.jar.
> But hive2 shareblib has jline-0.9.94.jar.
> jline-0.9.94.jar does not have jline/console/history/History class.
> I have changed {{sharelib/hive2/pom.xml}} temporarily.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (OOZIE-2409) hive2 action with hive 1.2.1 failed
[
https://issues.apache.org/jira/browse/OOZIE-2409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15241587#comment-15241587
]
Thomas Poepping commented on OOZIE-2409:
Ping! Are you suggesting that we add a property to the parent pom
, set it to the current default, then when doing mkdistro we can
set the version?
> hive2 action with hive 1.2.1 failed
> ---
>
> Key: OOZIE-2409
> URL: https://issues.apache.org/jira/browse/OOZIE-2409
> Project: Oozie
> Issue Type: Bug
> Components: build
>Affects Versions: 4.2.0
>Reporter: KWON BYUNGCHANG
>Priority: Minor
> Attachments: OOZIE-2409.01.patch, OOZIE-2409.02.patch,
> OOZIE-2409.patch
>
>
> hive2 action with hive 1.2.1 failed.
> stack trace
> {code}
> 015-11-26 15:47:39,141 WARN Hive2ActionExecutor:523 - SERVER[myhost.com]
> USER[myuser] GROUP[-] TOKEN[] APP[test]
> JOB[401-151125114930017-oozie-irte-W]
> ACTION[401-151125114930017-oozie-irte-W@HIVEJOB] Launcher exception:
> jline/console/history/History
> java.lang.NoClassDefFoundError: jline/console/history/History
> at
> org.apache.oozie.action.hadoop.Hive2Main.runBeeline(Hive2Main.java:240)
> at org.apache.oozie.action.hadoop.Hive2Main.run(Hive2Main.java:223)
> at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:47)
> at org.apache.oozie.action.hadoop.Hive2Main.main(Hive2Main.java:56)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> {code}
> hive 1.2.1 need to jline-2.12.jar.
> But hive2 shareblib has jline-0.9.94.jar.
> jline-0.9.94.jar does not have jline/console/history/History class.
> I have changed {{sharelib/hive2/pom.xml}} temporarily.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
