Re: Publishing maven snapshots for 0.23?
On 14/10/11 20:53, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. As I said on -general, I'd like some stable-ish pre-alpha artifacts for downstream projects to use, something like a weekly -or after a big fix- should be sufficient. Unlike SNAPSHOT these shouldn't change without warning, letting people switch backwards and forwards to catch regressions
Re: Publishing maven snapshots for 0.23?
Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcon t...@cloudera.com wrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- Todd Lipcon Software Engineer, Cloudera
Re: Publishing maven snapshots for 0.23?
Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. -Giri On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcont...@cloudera.com wrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- -Giri
Re: Publishing maven snapshots for 0.23?
I've just uploaded a patch for MAPREDUCE-3003. What is left to test is to get HDFS/MR2 running for a build and run an example. I don't think I'll have a chance to do that test today. If somebody volunteers and does the run and +1 then it can be committed to trunk and on Monday or Tuesday we can commit to to 0.23 as part of HADOOP-7741 Thanks. Alejandro On Fri, Oct 14, 2011 at 1:26 PM, Todd Lipcon t...@cloudera.com wrote: I was able to publish HDFS and Common, but couldn't publish MR/YARN due to: [ERROR] Failed to execute goal org.apache.maven.plugins:maven-deploy-plugin:2.5:deploy (default-deploy) on project hadoop-yarn-api: Deployment failed: repository element was not specified in the POM inside distributionManagement element or in -DaltDeploymentRepository=id::layout::url parameter - [Help 1] I think this is MAPREDUCE-3003. Will wait on Tom or Alejandro to fix that. -Todd On Fri, Oct 14, 2011 at 12:57 PM, Arun C Murthy a...@hortonworks.com wrote: +1, thanks Todd. On Oct 14, 2011, at 12:53 PM, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it. -Todd On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcont...@cloudera.com wrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- -Giri -- Todd Lipcon Software Engineer, Cloudera -- Todd Lipcon Software Engineer, Cloudera
Re: Publishing maven snapshots for 0.23?
Okay, I ve done the 0.23 commit setup. Builds up and running for common/hdfs and Mapred https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Commit/ -Giri On 10/14/11 12:53 PM, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it. -Todd On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcont...@cloudera.comwrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- -Giri -- -Giri
Re: Publishing maven snapshots for 0.23?
Thanks Giri! mahadev On Fri, Oct 14, 2011 at 3:30 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Okay, I ve done the 0.23 commit setup. Builds up and running for common/hdfs and Mapred https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Commit/ -Giri On 10/14/11 12:53 PM, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it. -Todd On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcont...@cloudera.com wrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- -Giri -- -Giri
Re: Publishing maven snapshots for 0.23?
Looks like recent snapshots have been pushed for common and hdfs, but not mapred/mapreduce: https://repository.apache.org/content/repositories/snapshots/org/apache/hado op/hadoop-mapred/0.23.0-SNAPSHOT/ https://repository.apache.org/content/repositories/snapshots/org/apache/hado op/hadoop-mapreduce/0.23.0-SNAPSHOT/ We are looking for this to build pig for .23 On 10/14/11 4:08 PM, Olga Natkovich ol...@yahoo-inc.com wrote: Is this what we needed? -Original Message- From: Mahadev Konar [mailto:maha...@hortonworks.com] Sent: Friday, October 14, 2011 4:00 PM To: common-dev@hadoop.apache.org Cc: Todd Lipcon Subject: Re: Publishing maven snapshots for 0.23? Thanks Giri! mahadev On Fri, Oct 14, 2011 at 3:30 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Okay, I ve done the 0.23 commit setup. Builds up and running for common/hdfs and Mapred https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Common-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Hdfs-0.23-Commit/ https://builds.apache.org/view/G-L/view/Hadoop/job/Hadoop-Mapreduce-0.23-Comm it/ -Giri On 10/14/11 12:53 PM, Todd Lipcon wrote: On Fri, Oct 14, 2011 at 12:39 PM, giridharan kesavan gkesa...@hortonworks.com wrote: Todd, I like the idea of setting up commit builds for 23 branch; I can set this up. OK. Mind if I manually mvn deploy for now? Some HBase work is blocked on it. -Todd On 10/14/11 12:23 PM, Todd Lipcon wrote: Looks like the Hadoop-*-Commit builds for trunk do a mvn deploy, but not the 0.23 builds. It seems we should either (a) add mvn deploy to the Hadoop-*-0.23-Build targets (which run nightly), or (b) add a cross-project 0.23-commit build which is triggered on any commit to 0.23 and does a mvn deploy across all the projects, without running any tests. Any preferences? On Fri, Oct 14, 2011 at 12:18 PM, Todd Lipcont...@cloudera.com wrote: It seems that we're not publishing maven snapshots correctly. I'm not entirely sure why, but if you look at: https://repository.apache.org/content/groups/snapshots/org/apache/hadoop/ hadoop-common/ you'll see the latest snapshots are from 9/14 or so. Anyone have any idea what's going on here? -Todd -- Todd Lipcon Software Engineer, Cloudera -- -Giri -- -Giri
