Re: Heads up: branch-2.1-beta

2013-06-16 Thread Ralph Castain
? This doesn't show up on any blocker list. http://s.apache.org/hadoop-blocker-bugs Arun On Jun 15, 2013, at 4:44 PM, Ralph Castain wrote: Not trying to be a pain, but I am trying to get clarification. The protocol buffer support is still broken. Do you intend to release 2.1

Re: Heads up: branch-2.1-beta

2013-06-15 Thread Ralph Castain
Just curious of your procedures. Given that there is at least one blocker JIRA out there that has yet to be fully resolved, do you intend to release anyway? On Jun 15, 2013, at 8:19 AM, Alejandro Abdelnur t...@cloudera.com wrote: If the intention is to get the release out in time for the

Error in protobuf definitions

2013-05-29 Thread Ralph Castain
Hi folks On line 228 of hadoop-hdfs-project/hadoop-hdfs/src/main/proto/NamenodeProtocol.proto, someone named a function using a reserved name: /** * Request to register a sub-ordinate namenode */ rpc register(RegisterRequestProto) returns(RegisterResponseProto); You cannot name a

[jira] [Created] (HADOOP-9606) Protocol buffer support cannot compile under C

2013-05-29 Thread Ralph Castain (JIRA)
Ralph Castain created HADOOP-9606: - Summary: Protocol buffer support cannot compile under C Key: HADOOP-9606 URL: https://issues.apache.org/jira/browse/HADOOP-9606 Project: Hadoop Common

Problem building branch-2

2013-05-24 Thread Ralph Castain
Hi folks I'm trying to build the head of branch-2 on a CentOS box and hitting a rash of errors like the following (all from the protobuf support area): [ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:2.5.1:compile (default-compile) on project hadoop-common:

Help with error

2012-04-09 Thread Ralph Castain
Hi folks I'm trying to develop an AM for the 0.23 branch and running into a problem that I'm having difficulty debugging. My client relocates some supporting files to HDFS, creates the application object for the AM, and submits it to the RM. The file relocation request doesn't generate an

Re: Help with error

2012-04-09 Thread Ralph Castain
I move an archive, which is why I was hoping to look at the HDFS end to see what files are present, and in what locations so I can set the paths accordingly. Thanks Ralph --Bobby Evans On 4/9/12 11:10 AM, Ralph Castain r...@open-mpi.org wrote: Hi folks I'm trying to develop an AM

Re: Help with error

2012-04-09 Thread Ralph Castain
? It might be ending up in an unexpected place. Kihwal On 4/9/12 12:45 PM, Ralph Castain r...@open-mpi.org wrote: Hi Bobby On Apr 9, 2012, at 11:40 AM, Robert Evans wrote: What do you mean by relocated some supporting files to HDFS? How do you relocate them? What API do you

Re: Help with error

2012-04-09 Thread Ralph Castain
like the home directory does not exist but the copy went through. Can you try to LOG the key fields in destStatus including path? It might be ending up in an unexpected place. Kihwal On 4/9/12 12:45 PM, Ralph Castain r...@open-mpi.org wrote: Hi Bobby On Apr 9, 2012, at 11:40 AM

Re: Help with error

2012-04-09 Thread Ralph Castain
Solved the realm warning courtesy of stackoverflow: export HADOOP_OPTS=-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk solves it. Didn't help resolve the problem, as expected. On Apr 9, 2012, at 2:26 PM, Ralph Castain wrote: Finally managed to chase

Re: Help with error

2012-04-09 Thread Ralph Castain
of fs.default.name set to in core-site.xml? configuration property namefs.default.name/name valuehdfs://localhost:9000/value /property /configuration Kihwal On 4/9/12 3:26 PM, Ralph Castain r...@open-mpi.org wrote: Finally managed to chase down the 0.23 API docs and get the FileStatus

Re: Proto files

2012-03-26 Thread Ralph Castain
a...@hortonworks.com wrote: Is your AM written in Java or C? On Mar 26, 2012, at 3:55 PM, Ralph Castain wrote: Perhaps it would help if I outline the use case. I have a Java client that needs to launch a non-Java application manager. Obviously, the client talks to the RM using the Java APIs. The AM

Re: MPI Java bindings now available

2012-02-22 Thread Ralph Castain
drwxrwxr-x 2 nwatkins nwatkins 4096 2012-02-22 09:49 pkgconfig On Feb 22, 2012, at 10:25 AM, Ralph Castain wrote: Hi Noah Your LD_LIBRARY_PATH has to include the path to the OMPI libraries so we can find libmpi. Did you include your $prefix/lib[64] in it? On Feb 22, 2012, at 11:02

MPI Java bindings now available

2012-02-21 Thread Ralph Castain
Hi folks With support from EMC, several of us in the Open MPI community (including LANL, Cisco, HLRS, Oracle, and IBM) have integrated Java bindings into the Open MPI code. The new bindings are not part of a formal release as this time (will be in the upcoming 1.7 series), but can be obtained

Re: MPI: Java/JNI help

2012-02-01 Thread Ralph Castain
of wrapper to dlopen() the real thing (the one plug-ins depend on) with RTLD_GLOBAL, so that the fact that the jni library is loaded in a specific name space does not matter. Kihwal On 1/31/12 4:34 PM, Ralph Castain r...@open-mpi.org wrote: I was able to dig further into this, and we

Re: MPI: Java/JNI help

2012-01-31 Thread Ralph Castain
bit and the other is 64, it won't work. Kihwal On 1/30/12 5:58 PM, Ralph Castain r...@open-mpi.org wrote: Hi folks As per earlier emails, I'm just about ready to release the Java MPI bindings. I have one remaining issue and would appreciate some help. We typically build OpenMPI

Re: MPI: Java/JNI help

2012-01-31 Thread Ralph Castain
, Kihwal Lee wrote: It doesn't have to be static. Do architectures match between the node manager jvm and the library? If one is 32 bit and the other is 64, it won't work. Kihwal On 1/30/12 5:58 PM, Ralph Castain r...@open-mpi.org wrote: Hi folks As per earlier emails, I'm just about ready

MPI: Java/JNI help

2012-01-30 Thread Ralph Castain
Hi folks As per earlier emails, I'm just about ready to release the Java MPI bindings. I have one remaining issue and would appreciate some help. We typically build OpenMPI dynamically. For the Java bindings, this means that the JNI code underlying the Java binding must dynamically load OMPI

Re: MPI: Java/JNI help

2012-01-30 Thread Ralph Castain
On Jan 30, 2012, at 5:13 PM, Kihwal Lee wrote: It doesn't have to be static. Do architectures match between the node manager jvm and the library? If one is 32 bit and the other is 64, it won't work. That's a good question - I'll check... Kihwal On 1/30/12 5:58 PM, Ralph Castain r

RM AM for Hadoop

2011-12-30 Thread Ralph Castain
Hi folks I have been familiarizing myself with the Hadoop 0.23 code tree, and found myself wondering if people were aware of the tools commonly used by the HPC community as I worked my way thru the code. Just in case the community isn't, I thought it might be worth a very brief summary of the

Re: Hadoop + MPI

2011-11-23 Thread Ralph Castain
the views of any organization, past or present, the author might be affiliated with.) On 11/21/11 3:54 PM, Ralph Castain r...@open-mpi.org wrote: Hi Milind Glad to hear of the progress - I recall our earlier conversation. I gather you have completed step 1 (wireup) - have you given any

Hadoop + MPI

2011-11-21 Thread Ralph Castain
of systems, and don't foresee major problems doing it for Hadoop (though I would welcome a chance to get a brief walk-thru the code from someone). Please let me know if this would be of interest to the Hadoop community. Thanks Ralph Castain

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
poke my nose over there...thanks! thanks, Arun On Nov 21, 2011, at 3:35 PM, Ralph Castain wrote: Hi folks I am a lead developer in the Open MPI community, mostly focused on integrating that package with various environments. Over the last few months, I've had a couple of people ask me

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
, and don't foresee major problems doing it for Hadoop (though I would welcome a chance to get a brief walk-thru the code from someone). Please let me know if this would be of interest to the Hadoop community. Thanks Ralph Castain

Re: Hadoop + MPI

2011-11-21 Thread Ralph Castain
. - milind --- Milind Bhandarkar Greenplum Labs, EMC (Disclaimer: Opinions expressed in this email are those of the author, and do not necessarily represent the views of any organization, past or present, the author might be affiliated with.) On 11/21/11 3:54 PM, Ralph Castain r...@open