[ 
https://issues.apache.org/jira/browse/PIG-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16520364#comment-16520364
 ] 

Niels Basjes commented on PIG-5343:
-----------------------------------

I'm still working on this because I'm having problems with what I have created 
so far.

I was trying to get PIG-2599 (Mavenize Pig) running and I got stuck on a large 
number of unit tests that simply fail with hard to trace errors.
Get this  [https://github.com/nielsbasjes/MavenizePig] and the run.sh script 
will locally create a rearranged version of the Pig source tree which compiles 
pig and piggybank.

So I decided to see how the ant based build works and compare where it goes 
wrong (i.e. this issue popped up to fix the docker setup to do just that)

At this point my best guess is that there is a problem in relation to the 
PigServer + a 'non-local' MiniCluster and the use of HDFS which cause jobs to 
fail under Java 1.8.

Try this one for example: in TestOrcStoragePushdown the BeforeClass method  
createInputData the very simple pigserver job to create the test file on HDFS 
fails and produces an empty file (hence all subsequent tests in that file fail 
too).

It seems to be Java 1.7 / 1.8 related but at this point I'm stuck and I could 
use some help/pointers where to look next.

 

Most importantly: Do you have these effects too? 

 

 

 

> Upgrade developer build environment
> -----------------------------------
>
>                 Key: PIG-5343
>                 URL: https://issues.apache.org/jira/browse/PIG-5343
>             Project: Pig
>          Issue Type: Improvement
>          Components: build
>            Reporter: Niels Basjes
>            Assignee: Niels Basjes
>            Priority: Major
>         Attachments: PIG-5343-1.patch, PIG-5343-2.patch
>
>
> The docker image that can be used to setup the build environment still uses 
> Java 1.7 and is based on a very old version of Ubuntu.
> Both of these should be updated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to