Re: Welcoming a new committer

2018-02-26 Thread Ted Yu
Welcome, Kyungwan ! On Mon, Feb 26, 2018 at 9:16 AM, Billie Rinaldi wrote: > I'd like to welcome Kyungwan Nam, a new committer and PPMC member for > Apache Slider! >

Re: May report draft

2018-05-02 Thread Ted Yu
+1 On Wed, May 2, 2018 at 8:27 AM, Billie Rinaldi wrote: > Hi all, here is a draft of our report due today. If there are no objections > / suggestions, I'll post this by the end of the day. > > Slider > > Slider is a collection of tools and technologies to package, deploy, and > manage long runn

Re: slider report

2014-11-05 Thread Ted Yu
bq. We have added one committer / PMC member. I think we should mention Gour's name in the above sentence. lgtm On Wed, Nov 5, 2014 at 12:12 PM, Billie Rinaldi wrote: > I drafted the following Slider report. If anyone wants to edit or add > anything, please do so on the wiki: > https://wiki.a

Re: Maven repository?

2014-11-05 Thread Ted Yu
Slider maven repo is here: https://git-wip-us.apache.org/repos/asf/incubator-slider.git You can checkout develop branch. Cheers On Wed, Nov 5, 2014 at 6:36 PM, hsy...@gmail.com wrote: > Is there a public maven repository that I can checkout the slider library? > > Best, > Siyuan >

Re: Q: How to define component configuration?

2014-11-10 Thread Ted Yu
To my knowledge, there is no direct support for this. You can create different components, each with corresponding properties. Cheers On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com wrote: > If I want to have several instances of some component. But I want to set > some of the properties to

Re: [VOTE] Apache Slider Incubating Release 0.60.0-incubating RC1

2014-11-17 Thread Ted Yu
+1 verified licenses ran test suite. On Mon, Nov 17, 2014 at 10:24 AM, Billie Rinaldi wrote: > +1 > verified licenses, checksums, and signatures > checked that the tarball, zip, and tag have the same contents > ran basic tests > > On Fri, Nov 14, 2014 at 11:26 AM, Steve Loughran > wrote: > > >

Re: slider stop bug?

2014-11-18 Thread Ted Yu
Did you specify --force ? You can find explanation for this flag here: http://slider.incubator.apache.org/docs/manpage.html On Tue, Nov 18, 2014 at 12:00 PM, hsy...@gmail.com wrote: > If the application is stuck in ACCEPT status, slider stop command doesn't > stop the yarn application. > > I di

Re: Current Status of HOYA

2014-11-19 Thread Ted Yu
Yes. HOYA is now Apache Slider. Release 0.60 was announced yesterday. See http://slider.incubator.apache.org/ (Download link will be pointing to 0.60 soon) Also added dev@slider.incubator to CC. Cheers On Wed, Nov 19, 2014 at 3:43 AM, Kevin O'dell wrote: > I think it is called slider now? >

Re: Is it able to specify the percentage of memory instead of # of MB

2014-12-02 Thread Ted Yu
I created SLIDER-691 for this feature. Cheers On Tue, Dec 2, 2014 at 7:09 AM, Steve Loughran wrote: > I don't even think we can ask yarn for the percentage of memory > > I do understand what you are trying to do: ask for >51%. > > We could do something where we can query YARN for the maximum am

Specification of user for registry command

2014-12-19 Thread Ted Yu
Hi, As user hrt_qa, I issued command to retrieve hbase-site.xml for an instance owned by user hbase. I got: 2014-12-19 21:01:09,279 [main] DEBUG main.ServiceLauncher (ServiceLauncher.java:convertToExitException(522)) - While running service Slider Client: /registry/users/hrt_qa/services/org-apache

Re: Specification of user for registry command

2014-12-20 Thread Ted Yu
I don't see --path parameter for registry command on: http://slider.incubator.apache.org/docs/manpage.html FYI On Sat, Dec 20, 2014 at 4:45 AM, Steve Loughran wrote: > On 19 December 2014 at 21:06, Ted Yu wrote: > > > > Should registry command accept a parameter which sp

review board

2014-12-21 Thread Ted Yu
Hi, Who should I contact so that patch for Slider can be added to https://reviews.apache.org/r/new/ ? Cheers

Re: review board

2014-12-21 Thread Ted Yu
e. > > On Monday, December 22, 2014, Jon Maron wrote: > > > I’ve wondered about that myself. I’m wondering if anything is really > > required administratively, or can we simply install RBTools and start > > posting reviews? > > > > On Dec 21, 2014, at 4:28 PM, Te

Re: Fail to build Slider 0.60.0

2014-12-22 Thread Ted Yu
On my Mac, ~/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom lines 5 and 6 are in license header. ls -l ~/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom -rw-r--r-- 1 tyu staff 4711 Jun 30 2013 /Users/tyu/.m2/repository/net/java/jvnet-parent/1/jvnet-parent-1.pom Can you cl

Re: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
Currently memory for one component (region server in your case) has to have same amount of memory. Cheers On Dec 25, 2014, at 7:45 PM, "liujs3" wrote: > When I run the slider , I want to flex a specified memory regionserver which > is different in other running regionservers that memory. >

Re: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

2014-12-25 Thread Ted Yu
bq. WARN security.SecurityUtils: Command openssl pkcs12 Are you deploying in a secure cluster ? Can you try with 0.60.0 and hadoop 2.6.0 ? Cheers On Thu, Dec 25, 2014 at 7:17 PM, liujs3 wrote: > 14/12/24 03:15:35 WARN util.NativeCodeLoader: Unable to load native-hadoop > library for your platf

Re: 答复: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
sed is 4g all components, and this time I used 3g for all > regionservers ? > > > Best Regards! > ocean floyd > 亚信科技(中 国)有限公司 > www.asiainfo.com > BDX > Mp:18513780630 > E-mail:liu...@asiainfo.com > > > > > -邮件原件- > 发件人: Ted Yu [mailto:yuz

Re: 答复: 答复: flex a different resource component . so i can use the all memory

2014-12-25 Thread Ted Yu
> BDX > Mp:18513780630 > E-mail:liu...@asiainfo.com > > > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2014年12月26日 13:17 > 收件人: dev@slider.incubator.apache.org > 主题: Re: 答复: flex a different resource component . so i can use the all > memory > &g

Re: 答复: when i run slider0.40+hadoop2.4 i found the error log in slider-error.log

2014-12-26 Thread Ted Yu
.4.x86_64.rpm , then slider work. > > In my cluster ,I doesn’t config the secure . how can confirm it used > secure cluster? > > -邮件原件- > 发件人: Ted Yu [mailto:yuzhih...@gmail.com] > 发送时间: 2014年12月26日 12:33 > 收件人: dev@slider.incubator.apache.org > 主题: Re:

Re: how to get get the port of memcached

2014-12-27 Thread Ted Yu
When you go to AppMaster UI (slider 0.60), you should see an entry for org.apache.slider.registry e.g. http://hor15n22.gq1.ygridcore.net:44221/ws/v1/slider/registry which has two nodes: services and users. You can navigate to: http://hor11n14.gq1.ygridcore.net:8088/proxy/application_1419019592694_

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
bq. host list of all the instances of a component Are you using node labels feature of YARN ? If not, the list would comprise of all the nodes in your YARN cluster. Cheers On Tue, Dec 30, 2014 at 4:43 PM, Yong Feng wrote: > Hi Team, > > The template of regionserver of HBase application uses fo

Re: How Sliders configure configuration file of regionserver of HBase

2014-12-30 Thread Ted Yu
t; in the conf file of slave. Changing membership of master need restart whole > cluster so we will not support flex up/down role of master. > > How can I know the host list of master role in Slider script or template? > > Thanks, > > Yong > > On Tue, Dec 30, 2014 at

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-01 Thread Ted Yu
orted by either Slider or YARN. > >> > [Yong] If there is only one instance of master role, at least I could > >> know > >> > its host name by COMPONENT_HOST in slave hosts, right? If so, I could > >> work > >> > it around to just configure one

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-02 Thread Ted Yu
er to > manage both HPC wlm and BigData wlm. Mesos/Marathon is another choice > however I prefer Yarn/Slider due to its BigData DNA. > > Looking forward to getting more support from Slider and Yarn team. > > Thanks, > > Yong > > > On Thu, Jan 1, 2015 at 10:31 PM, Ted

Re: How Sliders configure configuration file of regionserver of HBase

2015-01-03 Thread Ted Yu
od to do that, but you can get a > label-to-nodes mapping using YarnClient.getNodeToLabels(). > > We can consider to add a method label-to-nodes mapping in future release > if necessary. > > Thanks, > Wangda > > On Fri, Jan 2, 2015 at 9:11 AM, Ted Yu wrote: > &g

Re: [jira] [Created] (SLIDER-736) build hbase

2015-01-04 Thread Ted Yu
See app-packages/hbase/appConfig-default.json in source code where you can find example for hbase-site. core-site and hdfs-site can be plugged in the same manner. e.g.: "site.hdfs-site.dfs.namenode.kerberos.principal": "${TODO-NN-PRINCIPAL}", "site.hdfs-site.dfs.namenode.kerberos.internal.

Re: How to set jvm option for HMaster

2015-01-05 Thread Ted Yu
杨浩: See the following example appConfig.json snippet: "components": { "HBASE_MASTER": { }, "slider-appmaster": { "*jvm.heapsize*": "256M", Cheers On Mon, Jan 5, 2015 at 7:27 AM, Steve Loughran wrote: > can you post your appconfig.json file, under your .slider/CLUSTERNAME di

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Ted Yu
Here is the meaning of 2 (see PlacementPolicy): * No data locality; do not bother trying to ask for any location */ public static final int NO_DATA_LOCALITY = 2; On Tue, Jan 6, 2015 at 4:15 PM, Gour Saha wrote: > Try setting property *yarn.component.placement.policy* to 2 for the > co

Re: Locality results in instance shut-down due to single bad instance

2015-01-06 Thread Ted Yu
Anti-affinity has not been implemented yet. Cheers On Tue, Jan 6, 2015 at 5:26 PM, 杨浩 wrote: > I have read the PlacementPolicy.java, but it seems there is no call to > ANTI_AFFINITY_REQUIRED > > 2015-01-07 8:52 GMT+08:00 Ted Yu : > > > Here is the meaning of 2

Re: the component ha

2015-01-06 Thread Ted Yu
w.r.t. region ha, did you mean read replica ? bq. how config the backhmaster Did you mean secondary master ? You can specify 2 instances of HBASE_MASTER in resources.json Cheers On Tue, Jan 6, 2015 at 6:39 PM, liujs3 wrote: > hi, i see the least news about hbase ,it will support region ha,whe

Re: 答复: the component ha

2015-01-06 Thread Ted Yu
Phase 2 of read replica hasn't been fully integrated to Apache HBase yet. Once that is done, you can produce hbase app package and utilize this feature. FYI On Tue, Jan 6, 2015 at 7:52 PM, liujs3 wrote: > Yes ,I mean that read replica > > > > > -----邮件原件- >

Re: The utility exported by resource management of slider agent

2015-01-10 Thread Ted Yu
We have wiki but it is very out of date: https://cwiki.apache.org/confluence/collector/pages.action?key=SLIDER Cheers On Sat, Jan 10, 2015 at 9:00 PM, Yong Feng wrote: > Hi Ted and Team > > I have written a slider package for a HPC cluster by taking hbase > slider package as example. It runs we

Re: defeated by maven automated release process

2015-01-20 Thread Ted Yu
I browsed the staging repo - looks good. On Tue, Jan 20, 2015 at 6:05 AM, Steve Loughran wrote: > We have our first repository! > > > https://repository.apache.org/content/repositories/orgapacheslider-1002/org/apache/slider/ > > big zip file is in > > > https://repository.apache.org/content/repo

Re: ApacheCon NA CFP

2015-01-21 Thread Ted Yu
I submitted a talk on Slider. Fyi > On Jan 21, 2015, at 2:45 AM, Steve Loughran wrote: > > If anyone wants to submit a talk to ApacheCon North America on Slider or > using it, they have until Feb 1 > > http://events.linuxfoundation.org/events/apachecon-north-america > > -Steve > > -- >

Re: [VOTE] Apache Slider Incubating Release 0.61.0-incubating

2015-01-29 Thread Ted Yu
+1 * Checked signatures * Built from source * Ran test suite On Thu, Jan 29, 2015 at 3:00 PM, Josh Elser wrote: > +1 (binding) > > * Filenames have -incubating > * Xsums+sigs check out > * KEYS has signing key > * Built from source > * Tarballs have LICENSE/NOTICE/DISCLAIMER > * Looked over th

Re: review board

2015-01-30 Thread Ted Yu
: >> >>> It might help (a little) if the component were listed as ReviewBoard. I >>> think only Ted can change this. >>> >>>> On Mon, Jan 5, 2015 at 7:06 AM, Jon Maron >>> wrote: >>> >>>> Is there a way to poke one of

Re: review board

2015-01-30 Thread Ted Yu
r than one large one (if portions can be broken > into commits that do not break the overall functionality). > > — Jon > > On Jan 30, 2015, at 9:18 AM, Ted Yu wrote: > > > The INFRA JIRA has been resolved. > > > > We should be able to use reviewboard now. > >

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
Tim: We have been improving role history in develop branch. Take a look at the recent JIRAs: SLIDER-743. Include node failure history when choosing placement hints SLIDER-647 allocation requests not being satisfied when a cluster goes to labels SLIDER-81. Support placement of containers on labeled

Re: Slider 0.50.2 requests container from decommissioned node.

2015-01-31 Thread Ted Yu
The two JIRAs you mentioned were in 0.60 release (HDP 2.2) Please consider upgrading. Cheers On Sat, Jan 31, 2015 at 4:05 PM, Tim Israel wrote: > Thanks Ted, SLIDER-647 and SLIDER-439 were exactly what I was looking for. > > Tim > > On Sat, Jan 31, 2015 at 6:34 PM, Ted Yu w

Re: How do HBase and Accumulo handle failures during client RPC operations

2015-02-04 Thread Ted Yu
What Josh described w.r.t. client failing over to new server is mostly applicable to HBase as well. Cheers On Wed, Feb 4, 2015 at 8:12 AM, Josh Elser wrote: > For Accumulo, like you said, information is published in ZK for clients to > find. Thinking about just the Accumulo master process (tabl

Re: start service as another user

2015-02-20 Thread Ted Yu
Discussed with Sumit. The ability to start as a different user is better implemented by YARN, instead of Slider. Cheers On Fri, Feb 20, 2015 at 9:42 AM, Sumit Mohanty wrote: > As the agent does not run as root (either as YARN user on non-secured or > the principal that started on secured), Sli

Re: [VOTE] Move Slider to JDK7+

2015-02-20 Thread Ted Yu
+1 On Fri, Feb 20, 2015 at 2:00 PM, Sumit Mohanty wrote: > Given that Java 6 is no longer supported (even Java 7 will not be supported > after Spring 2015) and Hadoop 2.7+ is JDK7+, we should have Slider move to > JDK7+. > > This is a call to vote to have Slider move to JDK7+ after the upcoming

Re: [VOTE] Apache Slider Incubating Release 0.70.0-incubating

2015-03-09 Thread Ted Yu
+1 Checked hash/sigs Built from tag Ran test suite On Mon, Mar 9, 2015 at 6:06 PM, Josh Elser wrote: > +1 > > * Checked hash/sigs > * Fetched Gour's key > * Built from tag (a8919c84) > * Ran rat check on source release > * Verified issues from IPMC vote on 0.61.0 were resolved > > One note, mak

Re: [VOTE] Release Apache Slider 0.70.0-incubating

2015-03-13 Thread Ted Yu
Checked signature Ran test suite. +1 On Fri, Mar 13, 2015 at 5:37 AM, 杨浩 wrote: > +1 > > 2015-03-13 0:48 GMT+08:00 Steve Loughran : > > > > > > On 11 Mar 2015, at 13:43, Gour Saha wrote: > > > > > > Hello, > > > > > > This is a call for a vote for releasing Apache Slider > 0.70.0-incubating. >

Re: Apache Slider stop function not working

2015-03-14 Thread Ted Yu
Kishore: Looks like logging was at INFO level. Do you mind turning on DEBUG logging ? Thanks On Sat, Mar 14, 2015 at 7:39 AM, Krishna Kishore Bonagiri < write2kish...@gmail.com> wrote: > Hi Steve, > > This is what I see in the AM's log since the STOP command is issued. Even > though it indicat

Re: Anti-affinity

2015-03-17 Thread Ted Yu
Support from YARN is needed. Please see https://issues.apache.org/jira/browse/YARN-1042 Cheers On Tue, Mar 17, 2015 at 1:56 AM, Krishna Kishore Bonagiri < write2kish...@gmail.com> wrote: > Hi, > > Is there any plan to implement anti-affinity? I know it would obviously > depend on the support

Re: [VOTE] Apache Slider Incubating Release 0.70.1-incubating

2015-03-19 Thread Ted Yu
+1 as well. Verified signatures. Ran test suite. On Thu, Mar 19, 2015 at 7:36 AM, Josh Elser wrote: > +1 > > Verified 814 and 815 were fixed. > Ensured build passed > sigs+xsums pass > > > Gour Saha wrote: > >> Hello, >> >> This is a call for a vote on Apache Slider 0.70.1-incubating release. >

Re: Redundant container request from slider causing high load on busy cluster

2015-03-23 Thread Ted Yu
The JIRAs you mentioned are somewhat dormant. You can open a Slider JIRA to track this issue. Thanks On Mon, Mar 23, 2015 at 10:44 AM, Shrijeet Paliwal < shrijeet.pali...@gmail.com> wrote: > More evidence: > > Spark is also affected: https://issues.apache.org/jira/browse/SPARK-2687 > One more r

Re: storm-slider-client availability

2015-05-04 Thread Ted Yu
Have you looked at https://git-wip-us.apache.org/repos/asf/incubator-slider.git ? Branch: develop Cheers On Mon, May 4, 2015 at 8:50 AM, Jean-Baptiste Note wrote: > Hi folks, > > First, thanks a lot for making slider available. This is awesome for > consolidating YARN as a generic-purpose resou

Re: storm-slider-client availability

2015-05-04 Thread Ted Yu
Slider 0.80.0 release is coming by May 15, 2015 - according to Gour. storm-slider would be in that release. To keep up with latest development, please use develop branch. Cheers On Mon, May 4, 2015 at 8:59 AM, Jean-Baptiste Note wrote: > Thanks a huge lot, storm-slider is indeed in develop. >

Re: slider may report

2015-05-06 Thread Ted Yu
+1 On Wed, May 6, 2015 at 6:05 AM, Jon Maron wrote: > +1 > > > On May 6, 2015, at 8:58 AM, Billie Rinaldi > wrote: > > > > How does this draft look? > > > > Slider > > > > Slider is a collection of tools and technologies to package, deploy, and > > manage long running applications on Apache Had

Re: Question on the Slider-HBase application (0.80 build)

2015-05-10 Thread Ted Yu
Thanks for trying out 0.80.0 release. The error you saw was due to hbase.tmp.dir pointing to path which was valid on the node where container was running but invalid on the client. In the retrieved hbase-site.xml, you can replace with the following: hbase.tmp.dir/tmp/hbase-tmp This step is done

Re: [VOTE] Apache Slider Incubating Release 0.80.0-incubating

2015-05-12 Thread Ted Yu
+1 downloaded .ZIP file built on Linux and ran test suite checked Apache license On Mon, May 11, 2015 at 2:43 PM, Steve Loughran wrote: > > > On 8 May 2015, at 16:14, Gour Saha wrote: > > > > Hello, > > > > This is a call for a vote on Apache Slider 0.80.0-incubating release. > > > > This is a

Re: Re: slider registry --name cl1 --conf hbase --format xml cannot work with java 1.8

2015-05-16 Thread Ted Yu
Looks like you were reading out of date Slider doc. amwebfilter is no longer used in current develop branch. I searched *.md files and didn't find amwebfilter mentioned. Cheers On Sat, May 16, 2015 at 6:01 AM, wrote: > hello guys: > i want fix this problem,so i read a lot slider docs,

Re: Interest in including a package for Solr in Slider?

2015-05-27 Thread Ted Yu
Please open a JIRA. Thanks On Wed, May 27, 2015 at 6:24 AM, Timothy Potter wrote: > Hi, > > I'm a committer on the Lucene/Solr project and have developed a basic > solution for deploying Solr to YARN using Slider, see: > https://github.com/LucidWorks/solr-slider > > I'm reaching out to see if t

Re: Building Slider with Hadoop 2.7 (trying to use updateBlackList method in AMRMClientAsync)

2015-05-29 Thread Ted Yu
There is a release-2.7 profile you can use without modifying hadoop.version in pom.xml Can you pastebin the stack trace you got w.r.t. updateBlackList ? Cheers On Fri, May 29, 2015 at 8:38 PM, Rajesh Kartha wrote: > Hello all, > > I am using the > mvn clean site:site site:stage package -Dskip

Re: new committer

2015-07-07 Thread Ted Yu
Welcome, Thomas. On Tue, Jul 7, 2015 at 9:49 AM, Billie Rinaldi wrote: > Welcome Thomas Liu, a new committer and PPMC member for Apache Slider! >

Re: [VOTE] Apache Slider Incubating Release 0.81.1-incubating

2015-10-24 Thread Ted Yu
I used the following command on Linux: ~/apache-maven-3.3.3/bin/mvn clean -Dslider.conf.dir=src/test/clusters/offline/slider/ package Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.49 sec <<< FAILURE! - in org.apache.slider.providers.agent.TestAgentClientProvider2 initializatio

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
I ran test suite (against hadoop 2.7.0) on Linux and got: Tests in error: TestAgentClientProvider2.initializationError » Verify Bad method call f... TestSliderClientMethods.initializationError » Verify Bad method call fr... initializationError(org.apache.slider.providers.agent.TestAgentClie

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
ably lots of my tests just no-op'ed themselves). > > Out of curiosity, were you running OpenJDK or Oracle? > > Ted Yu wrote: > >> I ran test suite (against hadoop 2.7.0) on Linux and got: >> >> Tests in error: >>TestA

Re: [VOTE] Apache Slider (incubating) release 0.90.2-incubating-RC1

2015-12-29 Thread Ted Yu
M, Jon Maron wrote: > Does looks like this issue: > https://bugs.openjdk.java.net/browse/JDK-8051012. I can find instances > on the web referencing the version you use with this issue (groovy > compatibility issue) > > > On Dec 29, 2015, at 12:31 PM, Ted Yu wrote: > > >

Re: Podling Report Reminder - February 2017

2017-02-02 Thread Ted Yu
+1 On Thu, Feb 2, 2017 at 8:47 AM, Gour Saha wrote: > Billie, thank you for the draft. > > +1. It looks good to me. > > -Gour > > On 2/2/17, 6:31 AM, "Billie Rinaldi" wrote: > > >Here's a draft of the board report which is due today. Let me know if you > >have any additions. > > > >--- > >S

Re: unit test failure

2014-05-15 Thread Ted Yu
I ran unit tests under slider-core and there was one test failure: Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 48.447 sec <<< FAILURE! - in org.apache.slider.providers.agent.TestAgentEcho testEchoOperation(org.apache.slider.providers.agent.TestAgentEcho) Time elapsed: 47.561 s

Re: [VOTE] Apache Slider 0.30-incubating RC0

2014-05-27 Thread Ted Yu
When running TestAgentEcho, I saw the following error several times: 2014-05-28 03:55:34,757 [ContainersLauncher #1] WARN nodemanager.DefaultContainerExecutor (DefaultContainerExecutor.java:launchContainer(213)) - Exception from container-launch with container ID: container_1401249324170_0001_01_

Re: [VOTE] Apache Slider 0.30-incubating RC0

2014-05-28 Thread Ted Yu
I installed Python 2.7.6 and reran the test - it passed. +1 from me on this RC. On Tue, May 27, 2014 at 9:47 PM, Sumit Mohanty wrote: > You may need to install argparse or use python 2.7. > > -Sumit > > > On Tue, May 27, 2014 at 9:28 PM, Ted Yu wrote: > > > When r

Re: Incubator report reminders sent for Jun 2014

2014-06-04 Thread Ted Yu
The report looks good. On Wed, Jun 4, 2014 at 1:37 PM, Steve Loughran wrote: > It's up into git; > > > https://github.com/apache/incubator-slider/blob/develop/src/docs/reports/2014-06-04-report.txt > > Have a look -and if you are happy post it off > > -steve > > > On 4 June 2014 16:00, Billie R

Re: confluence logins

2014-06-12 Thread Ted Yu
yuzhih...@gmail.com On Thu, Jun 12, 2014 at 1:21 PM, Steve Loughran wrote: > Can everyone who is a committer tell me their apache confluence user name > -create one if you don't- so I can get you signed up as a committer on the > new slider wiki > https://cwiki.apache.org/confluence/display/SLI

specifying slider.conf.dir for functional tests

2014-06-16 Thread Ted Yu
Hi, I looked at slider-funtest/target/surefire-reports/org.apache.slider.funtest.commands.TestListCommand.txt and found the following: Caused by: java.lang.RuntimeException: Undefined property slider.conf.dir at org.apache.slider.funtest.framework.CommandTestBase.sysprop(CommandTestBase.g

Re: specifying slider.conf.dir for functional tests

2014-06-16 Thread Ted Yu
014 at 3:53 PM, Ted Yu wrote: > Hi, > I looked > at > slider-funtest/target/surefire-reports/org.apache.slider.funtest.commands.TestListCommand.txt > and found the following: > > Caused by: java.lang.RuntimeException: Undefined property slid

Re: specifying slider.conf.dir for functional tests

2014-06-16 Thread Ted Yu
r skipping tests. On Mon, Jun 16, 2014 at 4:07 PM, Sumit Mohanty wrote: > Its ./src/test/clusters/offline (looks like a typo in the md file) > > -Sumit > > > On Mon, Jun 16, 2014 at 4:02 PM, Ted Yu wrote: > > > From src/site/markdown/developing/functional_tests.md : &

Re: jenkins build

2014-06-16 Thread Ted Yu
I changed build command to: clean -Dslider.conf.dir=src/test/clusters/offline/slider/ package Let's see what test failure(s) come up. Cheers On Mon, Jun 16, 2014 at 3:38 PM, Billie Rinaldi wrote: > Okay, https://builds.apache.org/job/Slider-develop had a successful build > with tests skipped

Re: jenkins build

2014-06-16 Thread Ted Yu
without saying properly goodbye. VM crash or System. exit called ? I sometimes got similar failure on flubber. Will dig deeper. Cheers On Mon, Jun 16, 2014 at 6:30 PM, Ted Yu wrote: > I changed build command to: > clean -Dslider.conf.dir=src/test/clusters/offline/slider/ package > > Le

TestWorkflowForkedProcessService#getFinalOutput()

2014-06-17 Thread Ted Yu
Hi, I was looking at test failures on Jenkins: Failed tests: TestLongLivedProcess.testEcho:108->WorkflowServiceTestBase.assertStringInOutput:121->Assert.assertTrue:41->Assert.fail:88 Empty output list In javadoc I saw: /** * Get the final output. includes a quick sleep for the tail ou

python2.6 not found on Jenkins

2014-06-17 Thread Ted Yu
Hi, >From https://builds.apache.org/job/Slider-develop/9/console : [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2:exec (python-test) on project slider-agent: Command execution failed. Cannot run program "python2.6" (in directory "/home/jenkins/jenkins-slave/workspace/Slider

Re: python2.6 not found on Jenkins

2014-06-17 Thread Ted Yu
esa...@hortonworks.com> wrote: > Ted, > > I don't seem to have sudo access on juno.apache.org, where the slider > build seem to run. > You might want to send an email to bui...@apache.org > > -giri > > > On Tue, Jun 17, 2014 at 11:01 AM, Ted Yu wrote: > >>

Re: python2.6 not found on Jenkins

2014-06-17 Thread Ted Yu
tions ? On Tue, Jun 17, 2014 at 1:15 PM, Ted Yu wrote: > I added a step which shows the version of python on Jenkins machine: > > + python --version > Python 2.7.3 > > > Can someone confirm whether the above version suffices ? > > > I want to gather more information

Re: python2.6 not found on Jenkins

2014-06-17 Thread Ted Yu
/apache/ambari/blob/trunk/ambari-common/src/main/unix/ambari-python-wrap > > > > The slider-agent/pom.xml has python2.6 hardcoded as the executable. It > > seems to have a preference for python 2, so I don't know if there will be > > an issue if python 3 is installed instead.

running functional tests on flubber

2014-06-17 Thread Ted Yu
Hi, I tried to run functional tests on flubber (as user yarn) and I saw a lot of exceptions in the following form: Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=yarn, access=WRITE, inode="/":hdfs:hdfs:drwxr-xr-x

DISABLE_CLEAN_UP

2014-06-17 Thread Ted Yu
Hi, >From https://builds.apache.org/job/Slider-develop/16/console : org.apache.slider.providers.hbase.funtest.TestHBaseNodeFailure Time elapsed: 0.571 sec <<< ERROR! java.lang.ExceptionInInitializerError ... Caused by: java.lang.RuntimeException: Undefined property slider.disable.cleanup

Re: running functional tests on flubber

2014-06-18 Thread Ted Yu
a...@gmail.com> > > wrote: > > > > > As I understand it, there are some manual steps you need to perform to > be > > > able to run the functional tests (including but not limited to creating > > > appropriate directories in HDFS that the yarn user can

running TestAppsThroughAgent on (secure) cluster

2014-06-18 Thread Ted Yu
Hi, I got the following error (127 being the shell return code): 2014-06-18 23:22:58,145 [JUnit] INFO lifecycle.AgentCommandTestBase (?:call(?)) - command is java -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -Xmx256m -Djava.confdir=/home/yarn/slider/src/test/clusters/ec2/slider --clas

Re: running TestAppsThroughAgent on (secure) cluster

2014-06-18 Thread Ted Yu
I didn't find application on the GUI: http://172.18.145.239:8088/cluster FYI On Wed, Jun 18, 2014 at 4:31 PM, Steve Loughran wrote: > On 18 June 2014 16:27, Ted Yu wrote: > > > Time elapsed: 10.769 sec <<< FAILURE! > > java.lang.AssertionError: Old cl

Re: running TestAppsThroughAgent on (secure) cluster

2014-06-18 Thread Ted Yu
d line? > > What does return error code 127 stand for? > > > On Wed, Jun 18, 2014 at 4:33 PM, Ted Yu wrote: > > > I didn't find application on the GUI: > > > > http://172.18.145.239:8088/cluster > > > > FYI > > > > > > On Wed,

Re: HBase example run

2014-06-19 Thread Ted Yu
Looks like you were using 0.30 Can you build from tip of develop branch ? You would get 0.31.0-incubating-SNAPSHOT. Thanks On Thu, Jun 19, 2014 at 2:49 PM, Rui Zhang wrote: > Hi, > > I am new to Slider and try to run the HBase example under your instruction. > > But I have met an error, the l

Re: HBase example run

2014-06-19 Thread Ted Yu
Can you pastebin the contents of core-site.xml and hdfs-site.xml which are in SLIDER_CLASSPATH ? Thanks On Thu, Jun 19, 2014 at 3:27 PM, Rui Zhang wrote: > Now there is a different error after I set the SLIDER_CLASSPATH. > > 14/06/19 18:24:06 WARN util.NativeCodeLoader: Unable to load native-h

Re: jenkins hanging

2014-06-19 Thread Ted Yu
I aborted this job. Cheers On Jun 19, 2014, at 9:55 PM, Steve Loughran wrote: > jenkins is hanging > https://builds.apache.org/job/Slider-develop/lastBuild/console > > I cant seem to log in .. can someone with the permissions kill the job? > > Interesting where its hung though -in the agent

Re: jenkins hanging

2014-06-20 Thread Ted Yu
Build #27 was green. FYI On Jun 19, 2014, at 9:55 PM, Steve Loughran wrote: > jenkins is hanging > https://builds.apache.org/job/Slider-develop/lastBuild/console > > I cant seem to log in .. can someone with the permissions kill the job? > > Interesting where its hung though -in the agent t

Re: HBase example run

2014-06-20 Thread Ted Yu
Let us know if you encounter any other error. Cheers On Fri, Jun 20, 2014 at 8:18 AM, Rui Zhang wrote: > I am stupid. There is a punctuation error in this configuration file. > Sorry about that. > > Thanks. Billie and Ted. > > > On 06/20/2014 11:13 AM, Rui Zhang wrote: > >> My slider-client.xm

Re: Some tutorials to run my own apps on Slider

2014-06-20 Thread Ted Yu
Rui: w.r.t. creating app packages, please take a look at the structure under app-packages/hbase in the develop branch. For hbase 0.98, package/files/hbase-0.98.3-hadoop2-bin.tar.gz needs to be copied manually since release tarball is not in maven yet. Cheers On Fri, Jun 20, 2014 at 2:14 PM, Jon

Changing recommended app_log_dir

2014-06-24 Thread Ted Yu
Hi, Using the following recommended value for app_log_dir, "site.global.app_log_dir": "${AGENT_LOG_ROOT}/app/log", I observed the actual log directory having deeply nested structure: -Dhbase.log.dir=/grid/0/hdp/yarn/log/application_1403300788015_0005/container_1403300788015_0005_01_03,/gr

Re: Changing recommended app_log_dir

2014-06-24 Thread Ted Yu
I logged SLIDER-163. So far I only modified app-packages/hbase/appConfig.json Similar change can be applied to ./app-packages/accumulo/appConfig.json later. Cheers On Tue, Jun 24, 2014 at 10:25 AM, Ted Yu wrote: > Hi, > Using the following recommended value for app_l

turn on DEBUG logging

2014-06-27 Thread Ted Yu
Hi, In conf/log4j.properties, I specified: log4j.logger.org.apache.slider=DEBUG log4j.logger.org.apache.slider.server.appmaster.state.RoleHistory=DEBUG,subprocess But in AppMaster log, I don't see DEBUG logs from RoleHistory. What did I miss ? Cheers

Re: turn on DEBUG logging

2014-06-28 Thread Ted Yu
This seems to be a known issue - as confirmed by Sumit. I plan to add a commandline flag which tells Slider to log at detail level implemented through log.info() calls. Please comment. On Fri, Jun 27, 2014 at 1:46 PM, Ted Yu wrote: > Hi, > In conf/log4j.properties, I spe

Re: turn on DEBUG logging

2014-06-28 Thread Ted Yu
; We need to understand where the log settings are coming from and make sure > that the slider conf ones are the set being used. > > > On 28 June 2014 15:57, Ted Yu wrote: > > > This seems to be a known issue - as confirmed by Sumit. > > > > I plan to add a comman

retrieving configuration for provider

2014-06-30 Thread Ted Yu
Hi, For user to retrieve effective hbase-site configuration, the following needs to be done: issue 'slider status' command extract value for "info.am.web.url" from the output append '/ws/v1/slider/publisher/slider/hbase-site' to the URL The output from last step is JSON. I want to get some sugge

Re: allocated port issue

2014-06-30 Thread Ted Yu
Billie: Can you post the stack trace for the exception ? Thanks On Mon, Jun 30, 2014 at 5:04 PM, Billie Rinaldi wrote: > Has anything happened with ALLOCATED_PORT recently? In my funtest, I'm > getting an exception from Accumulo saying that the value for the monitor > port property isn't in t

Re: HBase maven app packaging failing

2014-07-07 Thread Ted Yu
I have added a note to app-packages/hbase/README.txt Cheers On Mon, Jul 7, 2014 at 7:12 AM, Sumit Mohanty wrote: > You need to copy the hbase tarball to > ~/.m2/repository/org/apache/hbase/hbase/0.98.3-hadoop2/. > I do not know why it needs to be done as "mvn install:install-file ..." > should

Re: HBase maven app packaging failing

2014-07-07 Thread Ted Yu
:2.8:copy (copy) @ slider-funtest --- > [INFO] Configured Artifact: > org.apache.slider:apache-slider-command-logger:?:zip > [INFO] > org.apache.slider:apache-slider-command-logger:0.31.0-incubating-SNAPSHOT:zip > already exists in > /Users/jmaron/dev/workspaces/slider-asf/incubator-slider/slider-fu

compilation error

2014-07-07 Thread Ted Yu
I saw the following errors using 'mvn clean package -DskipTests' under root of workspace: [ERROR] /homes/hortonzy/slider/slider-providers/hbase/hbase-funtests/src/test/groovy/org/apache/slider/providers/hbase/funtest/HBaseCommandTestBase.groovy:[1,1] 3. ERROR in /homes/hortonzy/slider/slider-provi

excluding build output from app package

2014-07-08 Thread Ted Yu
Hi, Once I produce app package for hbase, the next build would complain about the following. Unapproved licenses: app-packages/hbase/target/archive-tmp/appConfig.json.1746534752.filtered app-packages/hbase/target/archive-tmp/appConfig.json.727813455.filtered app-packages/hbase/target/maven-s

  1   2   3   4   5   >