Re: problems when I use hadoop2.6

2014-10-30 Thread Rui Zhang
similar. On 29 October 2014 15:24, Rui Zhang rzh...@vertica.com wrote: Hi, I am using the hadoop2.6 I compiled myself. When I run exists command, it has this error. What's the problem? I have included all the libraries in the slider_client.xml. ~/Slider_Vertica/Linux64/slider-0.51.0/bin/slider

problems when I use hadoop2.6

2014-10-29 Thread Rui Zhang
) at org.apache.slider.core.main.ServiceLauncher.serviceMain(ServiceLauncher.java:628) at org.apache.slider.Slider.main(Slider.java:49) 2014-10-29 11:09:28,604 [main] INFO util.ExitUtil - Exiting with status 56 Thanks, Rui -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: application not started when I kill a nodemanager manually

2014-10-29 Thread Rui Zhang
have enough resources for all of the requested components to start? On Tue, Oct 28, 2014 at 11:40 AM, Rui Zhang rzh...@vertica.com wrote: Made the fix but still cannot make it. Actually, the steps to reproduce in SLIDER-439 is different from mine. What I do is first use freeze command

Re: application not started when I kill a nodemanager manually

2014-10-28 Thread Rui Zhang
://issues.apache.org/jira/browse/SLIDER-439 - that specifically fixed this issue. thanks -Sumit On Tue, Oct 28, 2014 at 10:36 AM, Rui Zhang rzh...@vertica.com wrote: Hi, When I killed a node manager manually and restart the application, it seems that an instance previously ran on that node manager is not able

Re: application not started when I kill a nodemanager manually

2014-10-28 Thread Rui Zhang
It seems I didn't use the new one after compilation. Forget my question. I am trying the new one. On 10/28/2014 02:40 PM, Rui Zhang wrote: Made the fix but still cannot make it. Actually, the steps to reproduce in SLIDER-439 is different from mine. What I do is first use freeze command

hadoop2.6

2014-10-28 Thread Rui Zhang
The latest slider requires hadoop2.6. I found it is not released. How can I get the hadoop2.6 tar ball now? Should I compile the source code myself or can you please provide me the tar ball? Thanks, Rui -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

One question about flex method

2014-10-16 Thread Rui Zhang
Hi. everyone. When the new size is less than the original size in the flex command, how to determine which nodes to stop? Thanks. -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: ssl error after changing to slider-dev branch

2014-08-20 Thread Rui Zhang
. Thanks, Rui On 08/20/2014 01:59 PM, Jon Maron wrote: jvm.heapsize: 256M, jvm.opts: -Djavax.net.debug=all -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: ssl error after changing to slider-dev branch

2014-08-20 Thread Rui Zhang
PM, Rui Zhang wrote: I found this in the slider-out log: Extension ec_point_formats, formats: [uncompressed, ansiX962_compressed_prime, ansiX962_compressed_char2] Extension elliptic_curves, curve names: {sect571r1, sect571k1, secp521r1, sect409k1, sect409r1, secp384r1, sect283k1, sect283r1

Re: ssl error after changing to slider-dev branch

2014-08-19 Thread Rui Zhang
, at 12:05 PM, Rui Zhang rzh...@vertica.com wrote: Having done all of these but still got this error. It also says that it is not verified when I opened the link in the browser. Maybe there is some issue with my openssl. I will try to solve and report to you my progress. Thanks. On 08/15

Re: ssl error after changing to slider-dev branch

2014-08-19 Thread Rui Zhang
Log attached. This is generated when I run the command logger example. On 08/19/2014 03:38 PM, Jon Maron wrote: I guess send the full agent and AM logs - I just this morning setup a cluster with no issue (admittedly this was on centos 6.4) — Jon On Aug 19, 2014, at 3:20 PM, Rui Zhang rzh

Re: ssl error after changing to slider-dev branch

2014-08-15 Thread Rui Zhang
with a fresh installation directory and HDFS resources? The default communication mechanism was changed to SSL, and there have been updates to accommodate that update across the board. Going Mobile On Aug 14, 2014, at 4:18 PM, Rui Zhang rzh...@vertica.com wrote: Yes. I removed all the files

Re: ssl error after changing to slider-dev branch

2014-08-15 Thread Rui Zhang
...@hortonworks.com wrote: On 15 August 2014 06:59, Rui Zhang rzh...@vertica.com wrote: Exception in thread main java.lang.NoClassDefFoundError: com/codahale/metrics/MetricRegistry at org.apache.slider.server.appmaster.SliderAppMaster. clinit(SliderAppMaster.java:206) Caused

Re: ssl error after changing to slider-dev branch

2014-08-15 Thread Rui Zhang
has been modified to communicate via SSL. That code is downloaded to each launched container from /slider/agent HDFS folder (slider-agent.tar.gz). If you have installed an up to date version of slider you’ll need to update that file in HDFS. -- Rui Zhang Software engineer Intern Vertica, an HP

ssl error after changing to slider-dev branch

2014-08-14 Thread Rui Zhang
. How to solve it? Thanks -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: ssl error after changing to slider-dev branch

2014-08-14 Thread Rui Zhang
trace from either the agent logs or the application master log? Thanks! Going Mobile On Aug 14, 2014, at 3:54 PM, Rui Zhang rzh...@vertica.com wrote: Hi, everyone, I have changed to the dev branch but now it has this error. ERROR 2014-08-14 15:52:28,244 NetUtil.py:52 - [Errno 8] _ssl.c:510

Re: ssl error after changing to slider-dev branch

2014-08-14 Thread Rui Zhang
Yes. I removed all the files in the original directory and clone the new branch and then compiled. On 08/14/2014 04:15 PM, Jon Maron wrote: Also, can you describe the upgrade process? Did you reinstall or just update the core jar? Going Mobile On Aug 14, 2014, at 3:54 PM, Rui Zhang rzh

Role History Question

2014-07-30 Thread Rui Zhang
on those machines if the role history does not ensure this, we will lose data when restarting. Thanks, -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

When the stop method and restart method will be called in the python agents

2014-07-30 Thread Rui Zhang
can override the function restart, and when is restart method called? Thanks, -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: Start a role always IN_PROGRESS status

2014-07-24 Thread Rui Zhang
Actually Vertica is not killed by the script and run perfectly. But Slider will think that Vertica is killed and try again. On 07/24/2014 04:52 PM, Rui Zhang wrote: Hi, thanks for your reply. I know why it hangs. I have read the code of agent/PythonExecutor.py It blocks in the line

Re: Start a role always IN_PROGRESS status

2014-07-24 Thread Rui Zhang
, *wait_for_finish=False* ) See the memecached sample I shared. How does your start() implementation look like? -Sumit On Thu, Jul 24, 2014 at 1:56 PM, Rui Zhang rzh...@vertica.com wrote: Actually Vertica is not killed by the script and run perfectly. But Slider will think that Vertica is killed

Convenient way to know the number of running instances for a role

2014-07-18 Thread Rui Zhang
Hi, Is there a convenient way to know the number of running instances for a role? Such as REST APIs? Thanks -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: Port number issues

2014-07-16 Thread Rui Zhang
. -Sumit On Tue, Jul 15, 2014 at 12:24 PM, Rui Zhang rzh...@vertica.com wrote: Hi, If Slider give me containers on the same machine for the same role of my application. Is it possible for the python agents in Slider to know there are the same roles that are going to be started in the same machine

Re: Port number issues

2014-07-16 Thread Rui Zhang
:11 AM, Rui Zhang rzh...@vertica.com wrote: My command should set the port number for my application. So if Slider allocates the port number for it, I don't need to set it in the python script any more, right? Vertica nodes are peers and can all be connected by clients. The dba needs to know

[jira] [Created] (SLIDER-239) Add port number advertising feature

2014-07-16 Thread Rui Zhang (JIRA)
Rui Zhang created SLIDER-239: Summary: Add port number advertising feature Key: SLIDER-239 URL: https://issues.apache.org/jira/browse/SLIDER-239 Project: Slider Issue Type: Wish

Re: Port number issues

2014-07-16 Thread Rui Zhang
One more question, if I understand correctly, I can tell the registry I want a port number and it will tell me the port number allocated to me. And how can I publish my configurations? One more thing, can I tell the registry my preferred port numbers? On 07/16/2014 11:28 AM, Rui Zhang wrote

Re: error when I run flex

2014-07-08 Thread Rui Zhang
./slider flex cl3 --component [component name] 2 --filesystem hdfs://localhost:9000/ And the component name is the one in resource.json. On 07/07/2014 08:05 PM, Sumit Mohanty wrote: What is the exact command you used? On Mon, Jul 7, 2014 at 1:55 PM, Rui Zhang rzh...@vertica.com wrote: Hi

Re: error when I run flex

2014-07-08 Thread Rui Zhang
It should fail because I run on the same machine with the same port number but why this error? On 07/08/2014 10:11 AM, Rui Zhang wrote: ./slider flex cl3 --component [component name] 2 --filesystem hdfs://localhost:9000/ And the component name is the one in resource.json. On 07/07/2014 08

error when I run flex

2014-07-07 Thread Rui Zhang
the problem? I am using slider-0.3.0. Thanks, -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Changing cluster size?

2014-07-02 Thread Rui Zhang
Hi, Is there a way to change the size of an application cluster in Slider? For example, change the number of nodes of existing HBase cluster running on Slider. Thanks, Rui -- Rui Zhang Software engineer Intern Vertica, an HP Company rzh...@vertica.com

Re: HBase example run

2014-06-20 Thread Rui Zhang
identified by yarn.nodemanager.log-dirs. You can look for component instance logs @ a path similar to ./log/application_1403274157370_0002/container_1403274157370_0002_01_09/app/log/hbase-yarn-master-c6401.ambari.apache.org.log -Sumit On Fri, Jun 20, 2014 at 9:37 AM, Rui Zhang rzh...@vertica.com

Some tutorials to run my own apps on Slider

2014-06-20 Thread Rui Zhang
Hi, I have just ran HBase on Slider successfully. Now I want to run my own app on Slider such as Vertica, is there some tutorials for me to do this? What is the start point? Thanks, Rui

Re: HBase example run

2014-06-19 Thread Rui Zhang
Yes. I am using 0.30. Is the version a problem? On 06/19/2014 05:58 PM, Ted Yu wrote: Looks like you were using 0.30 Can you build from tip of develop branch ? You would get 0.31.0-incubating-SNAPSHOT. Thanks On Thu, Jun 19, 2014 at 2:49 PM, Rui Zhang rzh...@vertica.com wrote: Hi, I am

Re: HBase example run

2014-06-19 Thread Rui Zhang
=$HADOOP_CONF_DIR` On 6/19/14, 2:49 PM, Rui Zhang wrote: Hi, I am new to Slider and try to run the HBase example under your instruction. But I have met an error, the logs for the container are: OpenJDK 64-Bit Server VM warning: You have loaded library /opt/hadoop/lib/native/libhadoop.so