[jira] [Resolved] (SLIDER-534) Create a standalone HA page in apache slider doc

2014-11-11 Thread Gour Saha (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gour Saha resolved SLIDER-534.
--
   Resolution: Fixed
Fix Version/s: (was: Slider 0.70)
   Slider 0.60

> Create a standalone HA page in apache slider doc
> 
>
> Key: SLIDER-534
> URL: https://issues.apache.org/jira/browse/SLIDER-534
> Project: Slider
>  Issue Type: Documentation
>Affects Versions: Slider 0.50
>Reporter: Gour Saha
>Assignee: Gour Saha
> Fix For: Slider 0.60
>
>
> Provide details on the properties that needs to be set for RM HA and NN HA. 
> Also provide details on work preserving RM and work preserving NM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Q: How to define component configuration?

2014-11-11 Thread Sumit Mohanty
components": {
"COMPONENT1": {
  *"mykey": "myvalue"*
},

This is not wired up in the AgentProviderService to send to the agents. So
as a work-around you may have to use something like

"global": {
"COMPONENT1.mykey": "myvaluep",

Can you file a JIRA to add support for reading component specific configs
from appConfig.json and make them available at the container? This seems to
be a good feature to support.

-Sumit

On Tue, Nov 11, 2014 at 2:42 PM, hsy...@gmail.com  wrote:

> Thanks Steve, but I logged all the properties in params.py,  I couldn't
> find any key named *mykey*
>
>
> *config = Script.get_config()*
>   for key in config.keys():
> print "key: " + key
>   for key in config['global'].keys():
> print "key: " + key
>
> Best
>
> On Tue, Nov 11, 2014 at 5:04 AM, Steve Loughran 
> wrote:
>
> > that should be it. What happens each component gets the properties of
> >
> > component-level union global-level
> >
> > that is, everything that is global, extended with anything that is at the
> > component level. If a component overrides the global value, that override
> > is picked up
> >
> > It's essentially a form of prototype-based programming, except only of
> > properties, not methods:
> > http://en.wikipedia.org/wiki/Prototype-based_programming
> >
> > On 11 November 2014 01:30, hsy...@gmail.com  wrote:
> >
> > > Thanks Ted, but back to my first question, how can you define component
> > > level property? in appConfig.json?
> > >
> > > I tried to define like this :
> > >
> > >
> > > {
> > >   "schema": "http://example.org/specification/v2.0.0";,
> > >   "metadata": {
> > >   },
> > >   "global": {
> > > "application.def": "app-package-0.1.zip",
> > > "java_home": "/usr/lib/jvm/java-7-oracle/",
> > > "package_list": "files/app.tgz",
> > > "agent.conf": "/user/siyuan/agent/conf/agent.ini",
> > >
> > > "site.global.app_user": "siyuan",
> > > "site.global.app_root":
> > > "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1",
> > > "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install",
> > > "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid",
> > >
> > >   },
> > >   "components": {
> > > "COMPONENT1": {
> > >   *"mykey": "myvalue"*
> > > },
> > > "slider-appmaster": {
> > >   "jvm.heapsize": "256M"
> > > }
> > >   }
> > > }
> > >
> > > Is it able to make the component1 read the value for *mykey* ?
> > >
> > >
> > > Best,
> > > Siyuan
> > >
> > > On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu  wrote:
> > >
> > > > To my knowledge, there is no direct support for this.
> > > >
> > > > You can create different components, each with corresponding
> > properties.
> > > >
> > > > Cheers
> > > >
> > > > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com 
> > > > wrote:
> > > >
> > > > > If I want to have several instances of some component. But I want
> to
> > > set
> > > > > some of the properties to different value for different instances.
> > How
> > > > can
> > > > > I do it?
> > > > >
> > > > > Thanks!
> > > > >
> > > > > Best,
> > > > > Siyuan
> > > > >
> > > > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com <
> hsy...@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Hi guys,
> > > > > >
> > > > > > Is there an example of component configuration? Is there a way to
> > > give
> > > > > > different value to same property for different instances?
> > > > > >
> > > > > > Siyuan
> > > > > >
> > > > >
> > > >
> > >
> >
> > --
> > CONFIDENTIALITY NOTICE
> > NOTICE: This message is intended for the use of the individual or entity
> to
> > which it is addressed and may contain information that is confidential,
> > privileged and exempt from disclosure under applicable law. If the reader
> > of this message is not the intended recipient, you are hereby notified
> that
> > any printing, copying, dissemination, distribution, disclosure or
> > forwarding of this communication is strictly prohibited. If you have
> > received this communication in error, please contact the sender
> immediately
> > and delete it from your system. Thank You.
> >
>



-- 
thanks
Sumit


[jira] [Updated] (SLIDER-617) review conf/ directories in slider-assembly

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty updated SLIDER-617:
-
Sprint:   (was: Slider November #1)

> review conf/ directories in slider-assembly
> ---
>
> Key: SLIDER-617
> URL: https://issues.apache.org/jira/browse/SLIDER-617
> Project: Slider
>  Issue Type: Test
>Reporter: Steve Loughran
> Fix For: Slider 0.70
>
>
> have a look at the assembly/src/conf dirs and make sure we are happy with them



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SLIDER-631) Slider should provide auto replacement of ganglia properties

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved SLIDER-631.
--
Resolution: Won't Fix

> Slider should provide auto replacement of ganglia properties
> 
>
> Key: SLIDER-631
> URL: https://issues.apache.org/jira/browse/SLIDER-631
> Project: Slider
>  Issue Type: Bug
>  Components: agent-provider, client
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
> Fix For: Slider 0.70
>
>
> Noticed an issue where if ganglia is not enabled then the ganglia patterns 
> are left as is. For example:
> "site.storm-site.worker.childopts": "-Xmx768m 
> -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM"
> * ${@//site/global/ganglia_server_host}
> * ${@//site/global/ganglia_server_port}
> There is probably more elegant way of handling it but setting them to 
> "localhost" and "0" might be an option.
> Any recommendations?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-631) Slider should provide auto replacement of ganglia properties

2014-11-11 Thread Sumit Mohanty (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207467#comment-14207467
 ] 

Sumit Mohanty commented on SLIDER-631:
--

setting them to "localhost" and "0" is not an option.

These should be changes by the application package itself to read a flag and 
not populate the ganglia properties so that overall generated config is clean. 
This is fairly easy as through resource_management scripts.  Slider should not 
provide any support for custom configs such as for ganglia.

> Slider should provide auto replacement of ganglia properties
> 
>
> Key: SLIDER-631
> URL: https://issues.apache.org/jira/browse/SLIDER-631
> Project: Slider
>  Issue Type: Bug
>  Components: agent-provider, client
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
> Fix For: Slider 0.70
>
>
> Noticed an issue where if ganglia is not enabled then the ganglia patterns 
> are left as is. For example:
> "site.storm-site.worker.childopts": "-Xmx768m 
> -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM"
> * ${@//site/global/ganglia_server_host}
> * ${@//site/global/ganglia_server_port}
> There is probably more elegant way of handling it but setting them to 
> "localhost" and "0" might be an option.
> Any recommendations?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SLIDER-575) Slider fun-test stabilization

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved SLIDER-575.
--
   Resolution: Fixed
Fix Version/s: (was: Slider 0.70)
   Slider 0.60

They are stable on CentOS6 and Windows. Tested manually.

> Slider fun-test stabilization
> -
>
> Key: SLIDER-575
> URL: https://issues.apache.org/jira/browse/SLIDER-575
> Project: Slider
>  Issue Type: Bug
>  Components: test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
> Fix For: Slider 0.60
>
> Attachments: SLIDER-575.HBasePackage.patch
>
>
> Run and stabilize the fun-tests prior to the next release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-629) Slider's count of failure threshold may not be accurate or it could be a logging issue

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty updated SLIDER-629:
-
Sprint:   (was: Slider November #1)

> Slider's count of failure threshold may not be accurate or it could be a 
> logging issue
> --
>
> Key: SLIDER-629
> URL: https://issues.apache.org/jira/browse/SLIDER-629
> Project: Slider
>  Issue Type: Bug
>  Components: appmaster
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
> Fix For: Slider 0.70
>
>
> One of the long running HBase tests failed with the following error:
> {noformat}
> 2014-11-08 01:07:26,407 [AmExecutor-008] ERROR appmaster.SliderAppMaster - 
> Cluster teardown triggered 
> org.apache.slider.core.exceptions.TriggerClusterTeardownException: Unstable 
> Application Instance : - failed with component H   BASE_REGIONSERVER 
> failing 8 times (0 in startup); threshold is 5 - last failure: Failure 
> container_1415341585168_0005_01_08 on host onprem-slider23: 
> http://onprem-slider21:19888/jobhistory/logs/onprem-slider23:45454/contai 
>   ner_1415341585168_0005_01_08/ctx/hadoop^M
> {noformat}
> However, there were total of "9" REGION_SERVERs created.
> {noformat}
> 2014-11-07 16:00:35,346 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_02, on onprem-slider25:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_05, on onprem-slider24:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_07, on onprem-slider22:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_08, on onprem-slider23:45454,
> 2014-11-07 23:51:20,040 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_09, on onprem-slider22:45454,
> 2014-11-07 23:58:44,810 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_13, on onprem-slider24:45454,
> 2014-11-08 00:12:17,804 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_15, on onprem-slider22:45454,
> 2014-11-08 00:15:57,373 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_18, on onprem-slider25:45454,
> 2014-11-08 01:06:36,771 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_20, on onprem-slider25:45454,
> {noformat}
> As the ask was for 4 but 9 were created, obviously there are 5 failures.
> Perhaps its a logging issue. Can we also print the Window - e.g. 5 failures 
> in X minutes or hours.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved SLIDER-630.
--
   Resolution: Fixed
Fix Version/s: (was: Slider 0.70)
   Slider 0.60

> slider-agent unit tests fail on debian and suse and windows
> ---
>
> Key: SLIDER-630
> URL: https://issues.apache.org/jira/browse/SLIDER-630
> Project: Slider
>  Issue Type: Bug
>  Components: agent, test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
>Priority: Critical
> Fix For: Slider 0.60
>
>
> The tests fail because they do not find correct python on certain OSes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Q: How to define component configuration?

2014-11-11 Thread hsy...@gmail.com
Thanks Steve, but I logged all the properties in params.py,  I couldn't
find any key named *mykey*


*config = Script.get_config()*
  for key in config.keys():
print "key: " + key
  for key in config['global'].keys():
print "key: " + key

Best

On Tue, Nov 11, 2014 at 5:04 AM, Steve Loughran 
wrote:

> that should be it. What happens each component gets the properties of
>
> component-level union global-level
>
> that is, everything that is global, extended with anything that is at the
> component level. If a component overrides the global value, that override
> is picked up
>
> It's essentially a form of prototype-based programming, except only of
> properties, not methods:
> http://en.wikipedia.org/wiki/Prototype-based_programming
>
> On 11 November 2014 01:30, hsy...@gmail.com  wrote:
>
> > Thanks Ted, but back to my first question, how can you define component
> > level property? in appConfig.json?
> >
> > I tried to define like this :
> >
> >
> > {
> >   "schema": "http://example.org/specification/v2.0.0";,
> >   "metadata": {
> >   },
> >   "global": {
> > "application.def": "app-package-0.1.zip",
> > "java_home": "/usr/lib/jvm/java-7-oracle/",
> > "package_list": "files/app.tgz",
> > "agent.conf": "/user/siyuan/agent/conf/agent.ini",
> >
> > "site.global.app_user": "siyuan",
> > "site.global.app_root":
> > "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1",
> > "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install",
> > "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid",
> >
> >   },
> >   "components": {
> > "COMPONENT1": {
> >   *"mykey": "myvalue"*
> > },
> > "slider-appmaster": {
> >   "jvm.heapsize": "256M"
> > }
> >   }
> > }
> >
> > Is it able to make the component1 read the value for *mykey* ?
> >
> >
> > Best,
> > Siyuan
> >
> > On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu  wrote:
> >
> > > To my knowledge, there is no direct support for this.
> > >
> > > You can create different components, each with corresponding
> properties.
> > >
> > > Cheers
> > >
> > > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com 
> > > wrote:
> > >
> > > > If I want to have several instances of some component. But I want to
> > set
> > > > some of the properties to different value for different instances.
> How
> > > can
> > > > I do it?
> > > >
> > > > Thanks!
> > > >
> > > > Best,
> > > > Siyuan
> > > >
> > > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com 
> > > > wrote:
> > > >
> > > > > Hi guys,
> > > > >
> > > > > Is there an example of component configuration? Is there a way to
> > give
> > > > > different value to same property for different instances?
> > > > >
> > > > > Siyuan
> > > > >
> > > >
> > >
> >
>
> --
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity to
> which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
>


VOTE: release Apache Slider 0.60.0

2014-11-11 Thread Steve Loughran
Hi

This is a call for a vote on Apache Slider 0.60.0-incubating release.

This is the big one: it is fully in sync with hadoop 2.6.0 which is being
voted on on the hadoop lists; now that there are up to date hadoop
artifacts we can build and release against it.

This release is intended to be the first one people can use without the IDE
to hand; a lot of work has been done (by others, I must add) to make it a
lot easier to work with, along with support for new Hadoop 2.6 features:
labelled nodes, log aggregation, yarn registry, ... In fact, if you look at
a lot of the changes in Hadoop 2.6, you can say "done for slider and other
YARN services"

Git source tag:

https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;a=shortlog;h=refs/tags/release-0.60.0-incubating-rc0

Staging site:
http://people.apache.org/~stevel/slider/slider-release-0.60.0-incubating-rc0

PGP release keys
http://pgp.mit.edu:11371/pks/lookup?op=vindex&search=ste...@apache.org

The issues fixed in this release are listed at at:
https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315422&version=12327198

Note that this is a source only release and we are voting on the source.

Build instructions at:
http://slider.incubator.apache.org/developing/building.html

Voting will be open for 72 hours

[ ] +1 approve
[ ] +0 no opinion
[ ] -1 disapprove (and reason why)

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


[jira] [Updated] (SLIDER-208) Ongoing: keep Jenkins builds working

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-208:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Ongoing: keep Jenkins builds working
> 
>
> Key: SLIDER-208
> URL: https://issues.apache.org/jira/browse/SLIDER-208
> Project: Slider
>  Issue Type: Task
>  Components: build
>Affects Versions: Slider 0.40
>Reporter: Steve Loughran
> Fix For: Slider 0.70
>
>
> Uber-JIRA that never gets finished: keep Jenkins working. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-193) Improve site documentation

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-193:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Improve site documentation
> --
>
> Key: SLIDER-193
> URL: https://issues.apache.org/jira/browse/SLIDER-193
> Project: Slider
>  Issue Type: Improvement
>  Components: site
>Affects Versions: Slider 0.30
>Reporter: Steve Loughran
>  Labels: feedback
> Fix For: Slider 0.70
>
>
> Based on feedback, improve site docs where appropriate. Note that this is 
> reported against the 0.30 bundled docs, not the forthcoming CMS site



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-617) review conf/ directories in slider-assembly

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-617:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> review conf/ directories in slider-assembly
> ---
>
> Key: SLIDER-617
> URL: https://issues.apache.org/jira/browse/SLIDER-617
> Project: Slider
>  Issue Type: Test
>Reporter: Steve Loughran
> Fix For: Slider 0.70
>
>
> have a look at the assembly/src/conf dirs and make sure we are happy with them



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-534) Create a standalone HA page in apache slider doc

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-534:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Create a standalone HA page in apache slider doc
> 
>
> Key: SLIDER-534
> URL: https://issues.apache.org/jira/browse/SLIDER-534
> Project: Slider
>  Issue Type: Documentation
>Affects Versions: Slider 0.50
>Reporter: Gour Saha
>Assignee: Gour Saha
> Fix For: Slider 0.70
>
>
> Provide details on the properties that needs to be set for RM HA and NN HA. 
> Also provide details on work preserving RM and work preserving NM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-552) remove root registry path setup in AM

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-552:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> remove root registry path setup in AM
> -
>
> Key: SLIDER-552
> URL: https://issues.apache.org/jira/browse/SLIDER-552
> Project: Slider
>  Issue Type: Sub-task
>  Components: registry
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Critical
> Fix For: Slider 0.70
>
>
> once YARN-2571 is in, downgrade the {{RegistryOperations}} instance 
> instantied in the slider AM from a {{RegistryRMOperationsService}} —which 
> creates the root paths on startup— to a normal client.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-575) Slider fun-test stabilization

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-575:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Slider fun-test stabilization
> -
>
> Key: SLIDER-575
> URL: https://issues.apache.org/jira/browse/SLIDER-575
> Project: Slider
>  Issue Type: Bug
>  Components: test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
> Fix For: Slider 0.70
>
> Attachments: SLIDER-575.HBasePackage.patch
>
>
> Run and stabilize the fun-tests prior to the next release.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-623) jenkins failing on cento5; python exec failing

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-623:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> jenkins failing on cento5; python exec failing
> --
>
> Key: SLIDER-623
> URL: https://issues.apache.org/jira/browse/SLIDER-623
> Project: Slider
>  Issue Type: Sub-task
>  Components: test
>Affects Versions: Slider 0.60
> Environment: centos5
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.70
>
>
> unit tests failing with exit code 2 when execing python



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-629) Slider's count of failure threshold may not be accurate or it could be a logging issue

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-629:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Slider's count of failure threshold may not be accurate or it could be a 
> logging issue
> --
>
> Key: SLIDER-629
> URL: https://issues.apache.org/jira/browse/SLIDER-629
> Project: Slider
>  Issue Type: Bug
>  Components: appmaster
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
> Fix For: Slider 0.70
>
>
> One of the long running HBase tests failed with the following error:
> {noformat}
> 2014-11-08 01:07:26,407 [AmExecutor-008] ERROR appmaster.SliderAppMaster - 
> Cluster teardown triggered 
> org.apache.slider.core.exceptions.TriggerClusterTeardownException: Unstable 
> Application Instance : - failed with component H   BASE_REGIONSERVER 
> failing 8 times (0 in startup); threshold is 5 - last failure: Failure 
> container_1415341585168_0005_01_08 on host onprem-slider23: 
> http://onprem-slider21:19888/jobhistory/logs/onprem-slider23:45454/contai 
>   ner_1415341585168_0005_01_08/ctx/hadoop^M
> {noformat}
> However, there were total of "9" REGION_SERVERs created.
> {noformat}
> 2014-11-07 16:00:35,346 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_02, on onprem-slider25:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_05, on onprem-slider24:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_07, on onprem-slider22:45454,
> 2014-11-07 16:00:35,347 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_08, on onprem-slider23:45454,
> 2014-11-07 23:51:20,040 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_09, on onprem-slider22:45454,
> 2014-11-07 23:58:44,810 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_13, on onprem-slider24:45454,
> 2014-11-08 00:12:17,804 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_15, on onprem-slider22:45454,
> 2014-11-08 00:15:57,373 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_18, on onprem-slider25:45454,
> 2014-11-08 01:06:36,771 [AMRM Callback Handler Thread] INFO  state.AppState - 
> Assigning role HBASE_REGIONSERVER to container 
> container_1415341585168_0005_01_20, on onprem-slider25:45454,
> {noformat}
> As the ask was for 4 but 9 were created, obviously there are 5 failures.
> Perhaps its a logging issue. Can we also print the Window - e.g. 5 failures 
> in X minutes or hours.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-631) Slider should provide auto replacement of ganglia properties

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-631:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Slider should provide auto replacement of ganglia properties
> 
>
> Key: SLIDER-631
> URL: https://issues.apache.org/jira/browse/SLIDER-631
> Project: Slider
>  Issue Type: Bug
>  Components: agent-provider, client
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
> Fix For: Slider 0.70
>
>
> Noticed an issue where if ganglia is not enabled then the ganglia patterns 
> are left as is. For example:
> "site.storm-site.worker.childopts": "-Xmx768m 
> -javaagent:${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/lib/jmxetric-1.0.4.jar\u003dhost\u003d${@//site/global/ganglia_server_host},port\u003d${@//site/global/ganglia_server_port},wireformat31x\u003dtrue,mode\u003dmulticast,config\u003d${AGENT_WORK_ROOT}/app/install/apache-storm-0.9.3.2.2.0.0-1876/external/storm-jmxetric/conf/jmxetric-conf.xml,process\u003dWorker_%ID%_JVM"
> * ${@//site/global/ganglia_server_host}
> * ${@//site/global/ganglia_server_port}
> There is probably more elegant way of handling it but setting them to 
> "localhost" and "0" might be an option.
> Any recommendations?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-149) Support a YARN service registry

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-149:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Support a YARN service registry
> ---
>
> Key: SLIDER-149
> URL: https://issues.apache.org/jira/browse/SLIDER-149
> Project: Slider
>  Issue Type: New Feature
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.70
>
>  Time Spent: 96h
>  Remaining Estimate: 0h
>
> YARN-913 proposes a YARN-wide service registry; we must integrate with this 
> as it is implemented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-630:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> slider-agent unit tests fail on debian and suse and windows
> ---
>
> Key: SLIDER-630
> URL: https://issues.apache.org/jira/browse/SLIDER-630
> Project: Slider
>  Issue Type: Bug
>  Components: agent, test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
>Priority: Critical
> Fix For: Slider 0.70
>
>
> The tests fail because they do not find correct python on certain OSes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-632) intermittent assertion failure of TestHeartbeatMonitor.testRegularHeartbeat

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-632:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> intermittent assertion failure of TestHeartbeatMonitor.testRegularHeartbeat
> ---
>
> Key: SLIDER-632
> URL: https://issues.apache.org/jira/browse/SLIDER-632
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
> Environment: mac with a VM doing lots of work in the background
>Reporter: Steve Loughran
>Assignee: Gour Saha
>Priority: Minor
> Fix For: Slider 0.70
>
>
> I got a failure of {{TestHeartbeatMonitortestRegularHeartbeat}} while doing a 
> full core test. I did not see it when I ran the single test.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-544) Release Slider 0.6.0

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-544:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> Release Slider 0.6.0
> 
>
> Key: SLIDER-544
> URL: https://issues.apache.org/jira/browse/SLIDER-544
> Project: Slider
>  Issue Type: Task
>  Components: build
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.70
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-622:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.70
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-527) add slider demo script/tuning

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-527:
--
Fix Version/s: (was: Slider 0.60)
   Slider 0.70

> add slider demo script/tuning
> -
>
> Key: SLIDER-527
> URL: https://issues.apache.org/jira/browse/SLIDER-527
> Project: Slider
>  Issue Type: Improvement
>Affects Versions: Slider 0.70
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.70
>
>
> prepare slider demo for presentation; tune any usability issues that crop up, 
> including logging.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Documenting key configuration properties (appConfig, mostly)

2014-11-11 Thread Jon Maron
Hi,

  I’ve started adding some documentation about key configuration properties to 
the incubator site’s core.md file (the core configuration spec).  Perhaps these 
need to be pulled out as a separate document, but for the time being I thought 
I’d let it be known in case you are looking for a mechanism to document new 
configuration options.

— Jon


-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


[jira] [Created] (SLIDER-642) apache rat not found in mvn repos

2014-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created SLIDER-642:
-

 Summary: apache rat not found in mvn repos
 Key: SLIDER-642
 URL: https://issues.apache.org/jira/browse/SLIDER-642
 Project: Slider
  Issue Type: Bug
  Components: build
Affects Versions: Slider 0.60
Reporter: Steve Loughran
Priority: Minor


{code}
$ mvn apache-rat:check
{code}
leads to
{code}
[ERROR] No plugin found for prefix 'apache-rat' in the current project and in 
the plugin groups [org.apache.maven.plugins, org.codehaus.mojo] available from 
the repositories [local (/Users/stevel/.m2/repository), ASF Staging 
(https://repository.apache.org/content/groups/staging/), central 
(http://repo.maven.apache.org/maven2)] -> [Help 1]

{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-544) Release Slider 0.6.0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207010#comment-14207010
 ] 

ASF subversion and git services commented on SLIDER-544:


Commit 50158dc91e6d6ddc70a898631f0530425fcce125 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=50158dc ]

SLIDER-544 updating release POMs for 0.60.0-incubating


> Release Slider 0.6.0
> 
>
> Key: SLIDER-544
> URL: https://issues.apache.org/jira/browse/SLIDER-544
> Project: Slider
>  Issue Type: Task
>  Components: build
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SLIDER-634) slider wrapper should look for and use python version >= 2.6

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty resolved SLIDER-634.
--
   Resolution: Fixed
Fix Version/s: Slider 0.60

> slider wrapper should look for and use python version >= 2.6
> 
>
> Key: SLIDER-634
> URL: https://issues.apache.org/jira/browse/SLIDER-634
> Project: Slider
>  Issue Type: Bug
>Reporter: thomas liu
>Assignee: thomas liu
> Fix For: Slider 0.60
>
> Attachments: slider634.patch
>
>
> Need to have slider script pick up appropriate version of python to run



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-641) two slider-agent tarballs in lib dir

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207002#comment-14207002
 ] 

Steve Loughran commented on SLIDER-641:
---

{code}
-rw-r--r--  1 stevel  staff   698976 11 Nov 20:10 
slider-agent-0.60-incubating.tar.gz
-rw-r--r--  1 stevel  staff   698976 11 Nov 20:10 slider-agent.tar.gz
{code}

> two slider-agent tarballs in lib dir
> 
>
> Key: SLIDER-641
> URL: https://issues.apache.org/jira/browse/SLIDER-641
> Project: Slider
>  Issue Type: Bug
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>
> full builds create two versions of the agent tarball, one with a version 
> number, one without



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SLIDER-641) two slider-agent tarballs in lib dir

2014-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created SLIDER-641:
-

 Summary: two slider-agent tarballs in lib dir
 Key: SLIDER-641
 URL: https://issues.apache.org/jira/browse/SLIDER-641
 Project: Slider
  Issue Type: Bug
  Components: build
Affects Versions: Slider 0.60
Reporter: Steve Loughran


full builds create two versions of the agent tarball, one with a version 
number, one without



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-544) Release Slider 0.6.0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206998#comment-14206998
 ] 

ASF subversion and git services commented on SLIDER-544:


Commit 4bb804a2e4bcdad73015fd5c9e1d9f4dc2499d7c in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=4bb804a ]

SLIDER-544 Release Slider 0.6.0 - fix versions so that site command builds


> Release Slider 0.6.0
> 
>
> Key: SLIDER-544
> URL: https://issues.apache.org/jira/browse/SLIDER-544
> Project: Slider
>  Issue Type: Task
>  Components: build
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran resolved SLIDER-640.
---
Resolution: Fixed

> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206909#comment-14206909
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit d1441e391360ed59b5e80edd393a3450aa02be68 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d1441e3 ]

SLIDER-640: switch build to hadoop-2.6.0


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206905#comment-14206905
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit 7c6e0ffc642f77a6f8abfb5f9e574cd2cc1b3462 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7c6e0ff ]

SLIDER-640: switch build to hadoop-2.6.0


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206907#comment-14206907
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit 33eb8d656d7ea040328da364d38953f18200bed0 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=33eb8d6 ]

SLIDER-640 add PDB debug images


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206908#comment-14206908
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit a0372d6c4cca5d6da9397fadd85e7e73b55f4aab in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=a0372d6 ]

Merge branch 'feature/SLIDER-640-hadoop-2.6' into develop


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206906#comment-14206906
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit d536e33f3ea3fdf183d74239800063779b7f5619 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d536e33 ]

SLIDER-640 add hadoop locally built hadoop 2.6.0 binaries to the path


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206897#comment-14206897
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit 33eb8d656d7ea040328da364d38953f18200bed0 in incubator-slider's branch 
refs/heads/feature/SLIDER-640-hadoop-2.6 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=33eb8d6 ]

SLIDER-640 add PDB debug images


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-534) Create a standalone HA page in apache slider doc

2014-11-11 Thread Gour Saha (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206886#comment-14206886
 ] 

Gour Saha commented on SLIDER-534:
--

Adding and polishing a new standalone page 
http://slider.incubator.apache.org/docs/high_availability.html
 

> Create a standalone HA page in apache slider doc
> 
>
> Key: SLIDER-534
> URL: https://issues.apache.org/jira/browse/SLIDER-534
> Project: Slider
>  Issue Type: Documentation
>Affects Versions: Slider 0.50
>Reporter: Gour Saha
>Assignee: Gour Saha
> Fix For: Slider 0.60
>
>
> Provide details on the properties that needs to be set for RM HA and NN HA. 
> Also provide details on work preserving RM and work preserving NM.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206756#comment-14206756
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit d536e33f3ea3fdf183d74239800063779b7f5619 in incubator-slider's branch 
refs/heads/feature/SLIDER-640-hadoop-2.6 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=d536e33 ]

SLIDER-640 add hadoop locally built hadoop 2.6.0 binaries to the path


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-637:
--
Sprint:   (was: Slider November #1)

> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-623) jenkins failing on cento5; python exec failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206673#comment-14206673
 ] 

ASF subversion and git services commented on SLIDER-623:


Commit 4039ec56fafbb1869d7aad6fa1179cb51d7bde56 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~jmaron]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=4039ec5 ]

SLIDER-623 wrapping 2.4 incompatible print statment in try except


> jenkins failing on cento5; python exec failing
> --
>
> Key: SLIDER-623
> URL: https://issues.apache.org/jira/browse/SLIDER-623
> Project: Slider
>  Issue Type: Sub-task
>  Components: test
>Affects Versions: Slider 0.60
> Environment: centos5
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> unit tests failing with exit code 2 when execing python



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-623) jenkins failing on cento5; python exec failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206669#comment-14206669
 ] 

ASF subversion and git services commented on SLIDER-623:


Commit 65c33e787dae82187be095a618dfbf71a896f4fb in incubator-slider's branch 
refs/heads/develop from [~jmaron]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=65c33e7 ]

SLIDER-623 wrapping 2.4 incompatible print statment in try except


> jenkins failing on cento5; python exec failing
> --
>
> Key: SLIDER-623
> URL: https://issues.apache.org/jira/browse/SLIDER-623
> Project: Slider
>  Issue Type: Sub-task
>  Components: test
>Affects Versions: Slider 0.60
> Environment: centos5
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> unit tests failing with exit code 2 when execing python



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-634) slider wrapper should look for and use python version >= 2.6

2014-11-11 Thread Sumit Mohanty (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sumit Mohanty updated SLIDER-634:
-
Assignee: thomas liu

> slider wrapper should look for and use python version >= 2.6
> 
>
> Key: SLIDER-634
> URL: https://issues.apache.org/jira/browse/SLIDER-634
> Project: Slider
>  Issue Type: Bug
>Reporter: thomas liu
>Assignee: thomas liu
> Attachments: slider634.patch
>
>
> Need to have slider script pick up appropriate version of python to run



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206647#comment-14206647
 ] 

ASF subversion and git services commented on SLIDER-640:


Commit 7c6e0ffc642f77a6f8abfb5f9e574cd2cc1b3462 in incubator-slider's branch 
refs/heads/feature/SLIDER-640 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7c6e0ff ]

SLIDER-640: switch build to hadoop-2.6.0


> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206551#comment-14206551
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 44c4bb996e428b5265ad351c2035f05bf2e614d8 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=44c4bb9 ]

Merge branch 'feature/SLIDER-622-windows' into develop


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206550#comment-14206550
 ] 

ASF subversion and git services commented on SLIDER-639:


Commit 76f3e72df7210d9fb6f4981ebbb60a08f6a66d5a in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=76f3e72 ]

SLIDER-639 workarounds for windows


> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206552#comment-14206552
 ] 

ASF subversion and git services commented on SLIDER-639:


Commit 010127abf16c630331e86ae68f4219a92565ad4e in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=010127a ]

SLIDER-639 workarounds for windows


> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created SLIDER-640:
-

 Summary: Slider to build and test against Hadoop 2.6RC0
 Key: SLIDER-640
 URL: https://issues.apache.org/jira/browse/SLIDER-640
 Project: Slider
  Issue Type: New Feature
Affects Versions: Slider 0.60
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Blocker
 Fix For: Slider 0.60


switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-640) Slider to build and test against Hadoop 2.6RC0

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-640:
--
Sprint: Slider November #1

> Slider to build and test against Hadoop 2.6RC0
> --
>
> Key: SLIDER-640
> URL: https://issues.apache.org/jira/browse/SLIDER-640
> Project: Slider
>  Issue Type: New Feature
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Blocker
> Fix For: Slider 0.60
>
>
> switch the build to Hadoop 2.6 RC0



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206546#comment-14206546
 ] 

ASF subversion and git services commented on SLIDER-639:


Commit 76f3e72df7210d9fb6f4981ebbb60a08f6a66d5a in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=76f3e72 ]

SLIDER-639 workarounds for windows


> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206510#comment-14206510
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 89073b13444728eded65d93373058bac227585ec in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=89073b1 ]

SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path 
is file://


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206513#comment-14206513
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 36e5d435196fb6068bf00acb01fd52d1dd7c0fa5 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=36e5d43 ]

Merge branch 'feature/SLIDER-622-windows' into develop


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206515#comment-14206515
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 7596387040446aa8bac157f09fc028fe4b699981 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=7596387 ]

SLIDER-622 spin for deletion


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206517#comment-14206517
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit f5324897d1649f79db9775b2f917282edfb9c810 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=f532489 ]

SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path 
is file://


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206514#comment-14206514
 ] 

ASF subversion and git services commented on SLIDER-637:


Commit 632346e540e1cac1ae6bac6b8ce1ed5bc5ba9772 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=632346e ]

SLIDER-637 rm unneeded test in TestZKIntegration


> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206516#comment-14206516
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 5afa9b39d21d396052d82b5472b344e7903a13db in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=5afa9b3 ]

SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206512#comment-14206512
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit eba57bb508fc26ee96affcc79a5374af900d05d8 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=eba57bb ]

SLIDER-622 ensuring unique names for instances in a test


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206509#comment-14206509
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 3dd6ac495ea2b87ced7069f19ce04cf8d52559f2 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=3dd6ac4 ]

SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206518#comment-14206518
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 56e16c391524f8799a6f5d56beaafaf968a5c5c8 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56e16c3 ]

SLIDER-622 ensuring unique names for instances in a test


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206508#comment-14206508
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 749484c2df3e170f30bba71afa9c5a242238af3b in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=749484c ]

SLIDER-622 spin for deletion


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206503#comment-14206503
 ] 

Steve Loughran commented on SLIDER-639:
---

{code}Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 
sec <<< FAILURE! - in org.apache.slider.provider
s.agent.TestBuildBasicAgent
testBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent)  
Time elapsed: 63.985 sec  <<< ERROR!
java.io.IOException: Unable to delete file: 
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json

at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279)
at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown 
Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615)
at 
org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown
 Source)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579)
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSit
e.java:187)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at 
org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520)
at 
org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151)
at 
org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)

{code}

> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Issue Comment Deleted] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-639:
--
Comment: was deleted

(was: {code}
C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]:
 it still exists.Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 103.125 sec <<< FAILURE! - in 
org.apache.slider.providers.agent.TestBuildBasicAgenttestBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent)
  Time elapsed: 63.985 sec  <<< ERROR!java.io.IOException: Unable to delete 
file: 
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json
at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279)
at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown 
Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615)
at 
org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown
 Source)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579)
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at 
org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520)
at 
org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151)
at 
org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)Results
 :Tests in error:  
TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrBuildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615
 ╗ IOTests run: 9, Failures: 0, Errors: 1, Skipped: 0
{code})

> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206501#comment-14206501
 ] 

Steve Loughran commented on SLIDER-639:
---

{code}
C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]:
 it still exists.Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time 
elapsed: 103.125 sec <<< FAILURE! - in 
org.apache.slider.providers.agent.TestBuildBasicAgenttestBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent)
  Time elapsed: 63.985 sec  <<< ERROR!java.io.IOException: Unable to delete 
file: 
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json
at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279)
at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown 
Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615)
at 
org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown
 Source)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579)
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSite.java:187)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at 
org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520)
at 
org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151)
at 
org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)Results
 :Tests in error:  
TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrBuildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615
 ╗ IOTests run: 9, Failures: 0, Errors: 1, Skipped: 0
{code}

> SliderClient.buildInstanceDefinition() creates a directory that can't be 
> deleted in the same JVM
> 
>
> Key: SLIDER-639
> URL: https://issues.apache.org/jira/browse/SLIDER-639
> Project: Slider
>  Issue Type: Bug
>  Components: client, core
>Affects Versions: Slider 0.60
> Environment: Windows
>Reporter: Steve Loughran
>Priority: Minor
> Fix For: Slider 0.70
>
>
> In {{SliderClient.buildInstanceDefinition() }} some file handle or something 
> is kept open to the extent that if the definition is being saved to NTFS, it 
> can't be deleted.
> This condition holds for the duration of the JVM, hence the conclusion that 
> this is a file handle.
> As production instances have to use HDFS for their instance definitions, this 
> is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206498#comment-14206498
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit eba57bb508fc26ee96affcc79a5374af900d05d8 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=eba57bb ]

SLIDER-622 ensuring unique names for instances in a test


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SLIDER-639) SliderClient.buildInstanceDefinition() creates a directory that can't be deleted in the same JVM

2014-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created SLIDER-639:
-

 Summary: SliderClient.buildInstanceDefinition() creates a 
directory that can't be deleted in the same JVM
 Key: SLIDER-639
 URL: https://issues.apache.org/jira/browse/SLIDER-639
 Project: Slider
  Issue Type: Bug
  Components: client, core
Affects Versions: Slider 0.60
 Environment: Windows
Reporter: Steve Loughran
Priority: Minor
 Fix For: Slider 0.70


In {{SliderClient.buildInstanceDefinition() }} some file handle or something is 
kept open to the extent that if the definition is being saved to NTFS, it can't 
be deleted.

This condition holds for the duration of the JVM, hence the conclusion that 
this is a file handle.

As production instances have to use HDFS for their instance definitions, this 
is only a test problem



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206491#comment-14206491
 ] 

Steve Loughran commented on SLIDER-622:
---

Moving to native IO operations does not fix this problem; the directory cannot 
be deleted on windows
{code}
C:\Work\slider\slider-core\target\zookeeper-testBuildMultipleRoles\data\version-2\log.7]:
 it still exists.
Tests run: 9, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 103.125 sec <<< 
FAILURE! - in org.apache.slider.provider
s.agent.TestBuildBasicAgent
testBuildMultipleRoles(org.apache.slider.providers.agent.TestBuildBasicAgent)  
Time elapsed: 63.985 sec  <<< ERROR!
java.io.IOException: Unable to delete file: 
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json

at org.apache.commons.io.FileUtils.forceDelete(FileUtils.java:2279)
at org.apache.commons.io.FileUtils.cleanDirectory(FileUtils.java:1653)
at org.apache.commons.io.FileUtils.deleteDirectory(FileUtils.java:1535)
at org.apache.commons.io.FileUtils$deleteDirectory$0.call(Unknown 
Source)
at 
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:116)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:615)
at 
org.apache.slider.test.YarnMiniClusterTestBase$rigorousDelete$2.callCurrent(Unknown
 Source)
at 
org.apache.slider.test.YarnMiniClusterTestBase.rigorousDelete(YarnMiniClusterTestBase.groovy:579)
at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrap.invoke(PogoMetaMethodSit
e.java:187)
at 
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)
at 
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at 
org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:520)
at 
org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151)
at 
org.apache.slider.providers.agent.TestBuildBasicAgent.testBuildMultipleRoles(TestBuildBasicAgent.groovy:178)


Results :

Tests in error:
  
TestBuildBasicAgent.testBuildMultipleRoles:178->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrB
uildCluster:520->YarnMiniClusterTestBase.rigorousDelete:579->YarnMiniClusterTestBase.rigorousDelete:615
 ╗ IO

Tests run: 9, Failures: 0, Errors: 1, Skipped: 0
{code}

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206481#comment-14206481
 ] 

ASF subversion and git services commented on SLIDER-637:


Commit 56bc48dc4fd1c34bc4f5115242081ed8adb57277 in incubator-slider's branch 
refs/heads/develop from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56bc48d ]

SLIDER-637 purge ZKInstance uses in the accumulo and hbase providers


> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206480#comment-14206480
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 89073b13444728eded65d93373058bac227585ec in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=89073b1 ]

SLIDER-622 bypass Haddop APIs and go to commons IO directory delete if the path 
is file://


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206454#comment-14206454
 ] 

Steve Loughran commented on SLIDER-622:
---

file-in-use/delete problems on NTFS, even if no process other than the test JVM 
itself is running:
{code}
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: 
it still exists.
2014-11-11 14:15:36,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: 
it still exists.
2014-11-11 14:15:36,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: 
it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.app_config.json.crc]:
 it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.internal.json.crc]:
 it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.resources.json.crc]:
 it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: 
it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: 
it still exists.
2014-11-11 14:15:37,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: 
it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.app_config.json.crc]:
 it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.internal.json.crc]:
 it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\.resources.json.crc]:
 it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\app_config.json]: 
it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\internal.json]: 
it still exists.
2014-11-11 14:15:38,660 [Thread-1905] WARN  fs.FileUtil 
(FileUtil.java:deleteImpl(187)) - Failed to delete file or dir [
C:\Users\Administrator\.slider\cluster\testbuildmultipleroles\resources.json]: 
it still exists.
2014-11-11 14:15:39,660 [Thread-1905] ERROR tools.CoreFileSystem 
(CoreFileSystem.java:verifyDirectoryNonexistent(291)) -
 Dir file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles 
exists: file:/C:/Users/Administrator/.slider/cl
uster/testbuildmultipleroles/app_config.json1196
file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles/internal.json
   1439
file:/C:/Users/Administrator/.slider/cluster/testbuildmultipleroles/resources.json
  915
{code}

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206450#comment-14206450
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 3dd6ac495ea2b87ced7069f19ce04cf8d52559f2 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=3dd6ac4 ]

SLIDER-622 add spin-checks for cluster dir deletion...deals with NTFS problems


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206446#comment-14206446
 ] 

ASF subversion and git services commented on SLIDER-637:


Commit 56bc48dc4fd1c34bc4f5115242081ed8adb57277 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=56bc48d ]

SLIDER-637 purge ZKInstance uses in the accumulo and hbase providers


> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206448#comment-14206448
 ] 

ASF subversion and git services commented on SLIDER-637:


Commit 2bb2323ccd0921da56bfdc502ece5d5b96ee8237 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=2bb2323 ]

SLIDER-637 rm unneeded test in TestZKIntegration


> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206449#comment-14206449
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 749484c2df3e170f30bba71afa9c5a242238af3b in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=749484c ]

SLIDER-622 spin for deletion


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206447#comment-14206447
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit f9d7d4503491fbdcbb462d828996157d3b5d462d in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=f9d7d45 ]

Merge branch 'develop' into feature/SLIDER-622-windows


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SLIDER-638) Allow python executable to be specified per component (role)

2014-11-11 Thread Jonathan Maron (JIRA)
Jonathan Maron created SLIDER-638:
-

 Summary: Allow python executable to be specified per component 
(role)
 Key: SLIDER-638
 URL: https://issues.apache.org/jira/browse/SLIDER-638
 Project: Slider
  Issue Type: Bug
  Components: agent, appmaster
Reporter: Jonathan Maron
 Fix For: Slider 2.0.0


The "agent.python.exec.path" option is currently specified as a global option 
and read as such in AgentProviderService.  It may be a good idea to allow for a 
per-role python command, accounting for heterogeneous environments (where 
labeling can ensure that a component is mapped to a specific set of hosts with 
a specific OS).  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-636) Slider destroy does not delete the keytabs folder

2014-11-11 Thread Jonathan Maron (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206427#comment-14206427
 ] 

Jonathan Maron commented on SLIDER-636:
---

I think that would make sense.  Another possibility is "purge-slider-resources" 
to clean up both.

> Slider destroy does not delete the keytabs folder
> -
>
> Key: SLIDER-636
> URL: https://issues.apache.org/jira/browse/SLIDER-636
> Project: Slider
>  Issue Type: Bug
>  Components: client
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Jonathan Maron
>Priority: Critical
> Fix For: Slider 2.0.0
>
>
> Slider destroy does not delete keytabs folder for the app. This forces the 
> users to use force to overwrite the keytabs.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-637:
--
 Priority: Major  (was: Critical)
Fix Version/s: (was: Slider 0.60)
   Slider 2.0.0

too complex to remove easily; leaving code as is —for now. Purged use in a lot 
of tests

> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 2.0.0
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206420#comment-14206420
 ] 

Steve Loughran commented on SLIDER-637:
---

SLIDER-634 shows how it is currently used, even though it doesn't work properly 
in a secure cluster.
proposed: 
# purge from all the tests
# build paths up from {{RegistryUtils}} to match yarn registry logic.
# include a (configurable) base path. Not the YARN registry, as the 
app-specific path is for things like Accumulo and HBase.

In slider 2 we can/should switch to the {{CuratorService}} to get security

> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Critical
> Fix For: Slider 0.60
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Q: How to define component configuration?

2014-11-11 Thread Steve Loughran
that should be it. What happens each component gets the properties of

component-level union global-level

that is, everything that is global, extended with anything that is at the
component level. If a component overrides the global value, that override
is picked up

It's essentially a form of prototype-based programming, except only of
properties, not methods:
http://en.wikipedia.org/wiki/Prototype-based_programming

On 11 November 2014 01:30, hsy...@gmail.com  wrote:

> Thanks Ted, but back to my first question, how can you define component
> level property? in appConfig.json?
>
> I tried to define like this :
>
>
> {
>   "schema": "http://example.org/specification/v2.0.0";,
>   "metadata": {
>   },
>   "global": {
> "application.def": "app-package-0.1.zip",
> "java_home": "/usr/lib/jvm/java-7-oracle/",
> "package_list": "files/app.tgz",
> "agent.conf": "/user/siyuan/agent/conf/agent.ini",
>
> "site.global.app_user": "siyuan",
> "site.global.app_root":
> "${AGENT_WORK_ROOT}/app/install/kafka_2.10-0.8.1.1",
> "site.global.app_install_dir": "${AGENT_WORK_ROOT}/app/install",
> "site.global.pid_file": "${AGENT_WORK_ROOT}/app/run/app.pid",
>
>   },
>   "components": {
> "COMPONENT1": {
>   *"mykey": "myvalue"*
> },
> "slider-appmaster": {
>   "jvm.heapsize": "256M"
> }
>   }
> }
>
> Is it able to make the component1 read the value for *mykey* ?
>
>
> Best,
> Siyuan
>
> On Mon, Nov 10, 2014 at 4:15 PM, Ted Yu  wrote:
>
> > To my knowledge, there is no direct support for this.
> >
> > You can create different components, each with corresponding properties.
> >
> > Cheers
> >
> > On Mon, Nov 10, 2014 at 4:13 PM, hsy...@gmail.com 
> > wrote:
> >
> > > If I want to have several instances of some component. But I want to
> set
> > > some of the properties to different value for different instances. How
> > can
> > > I do it?
> > >
> > > Thanks!
> > >
> > > Best,
> > > Siyuan
> > >
> > > On Mon, Nov 10, 2014 at 1:26 PM, hsy...@gmail.com 
> > > wrote:
> > >
> > > > Hi guys,
> > > >
> > > > Is there an example of component configuration? Is there a way to
> give
> > > > different value to same property for different instances?
> > > >
> > > > Siyuan
> > > >
> > >
> >
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.


[jira] [Updated] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread Steve Loughran (JIRA)

 [ 
https://issues.apache.org/jira/browse/SLIDER-637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Steve Loughran updated SLIDER-637:
--
Sprint: Slider November #1

> Review ZKIntegration use and purge it -ideally, all of it
> -
>
> Key: SLIDER-637
> URL: https://issues.apache.org/jira/browse/SLIDER-637
> Project: Slider
>  Issue Type: Improvement
>  Components: client
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
>Priority: Critical
> Fix For: Slider 0.60
>
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> The ZK Integration class predates the YARN registry, uses an out of date path 
> setup logic, and doesn't handle security. There should be no place for it in 
> the Slider Client. If we can pull it there, we can remove the class and the 
> tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (SLIDER-637) Review ZKIntegration use and purge it -ideally, all of it

2014-11-11 Thread Steve Loughran (JIRA)
Steve Loughran created SLIDER-637:
-

 Summary: Review ZKIntegration use and purge it -ideally, all of it
 Key: SLIDER-637
 URL: https://issues.apache.org/jira/browse/SLIDER-637
 Project: Slider
  Issue Type: Improvement
  Components: client
Affects Versions: Slider 0.60
Reporter: Steve Loughran
Assignee: Steve Loughran
Priority: Critical
 Fix For: Slider 0.60


The ZK Integration class predates the YARN registry, uses an out of date path 
setup logic, and doesn't handle security. There should be no place for it in 
the Slider Client. If we can pull it there, we can remove the class and the 
tests that are causing trouble in Windows.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206332#comment-14206332
 ] 

ASF subversion and git services commented on SLIDER-622:


Commit 8a3258ee73e723d4b583493c6a993e3fe762998c in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~ste...@apache.org]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=8a3258e ]

SLIDER-622: fix ZK Integration tests to be more independent and better @ 
cleaning up


> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206331#comment-14206331
 ] 

ASF subversion and git services commented on SLIDER-630:


Commit e04c51b0e1539c0dd1f66ba79536a7ab68f62ab7 in incubator-slider's branch 
refs/heads/releases/slider-0.60 from [~jmaron]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=e04c51b ]

SLIDER-630 python path specified via slider-client.xml or app config global prop


> slider-agent unit tests fail on debian and suse and windows
> ---
>
> Key: SLIDER-630
> URL: https://issues.apache.org/jira/browse/SLIDER-630
> Project: Slider
>  Issue Type: Bug
>  Components: agent, test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
>Priority: Critical
> Fix For: Slider 0.60
>
>
> The tests fail because they do not find correct python on certain OSes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206299#comment-14206299
 ] 

Steve Loughran commented on SLIDER-622:
---

{code}
org.codehaus.groovy.runtime.powerassert.PowerAssertionError: assert 
clusters.size() == 2
   ||  |
   |4  false
   [cluster-02, cluster-01, cluster-03, 
cluster-00]
at 
org.codehaus.groovy.runtime.InvokerHelper.assertFailed(InvokerHelper.java:398)
at 
org.codehaus.groovy.runtime.ScriptBytecodeAdapter.assertFailed(ScriptBytecodeAdapter.java:646)
at 
org.apache.slider.common.tools.TestZKIntegration.testListUserClustersWithTwoCluster(TestZKIntegration.groovy:96)
{code}

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206294#comment-14206294
 ] 

Steve Loughran commented on SLIDER-622:
---

YARN-2845 covers change needed in {{MicroZKCluster}} for the duplicate 
registration problem. Until then: make sure all tests use unique service names, 
to derive unique paths

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206282#comment-14206282
 ] 

Steve Loughran commented on SLIDER-622:
---

...looks like MicroZKService in the YARN registry (and presumably it's twill 
parent) doesn't do the shutdown

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-622) jenkins on windows failing

2014-11-11 Thread Steve Loughran (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206274#comment-14206274
 ] 

Steve Loughran commented on SLIDER-622:
---

HBASE-6820 highlights how their ZK mini cluster doesn't close down properly. As 
the Slider one is based on it, we need the same patch for windows

> jenkins on windows failing
> --
>
> Key: SLIDER-622
> URL: https://issues.apache.org/jira/browse/SLIDER-622
> Project: Slider
>  Issue Type: Sub-task
>  Components: build
>Affects Versions: Slider 0.60
>Reporter: Steve Loughran
>Assignee: Steve Loughran
> Fix For: Slider 0.60
>
>
> Jenkins windows builds are failing:
> [[https://builds.apache.org/job/slider-develop-windows/]]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-630) slider-agent unit tests fail on debian and suse and windows

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206269#comment-14206269
 ] 

ASF subversion and git services commented on SLIDER-630:


Commit 1da0c8d35ba8ba854f2858bdad697c103853b740 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~jmaron]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=1da0c8d ]

SLIDER-630 python path specified via slider-client.xml or app config global prop


> slider-agent unit tests fail on debian and suse and windows
> ---
>
> Key: SLIDER-630
> URL: https://issues.apache.org/jira/browse/SLIDER-630
> Project: Slider
>  Issue Type: Bug
>  Components: agent, test
>Affects Versions: Slider 0.50
>Reporter: Sumit Mohanty
>Assignee: Sumit Mohanty
>Priority: Critical
> Fix For: Slider 0.60
>
>
> The tests fail because they do not find correct python on certain OSes.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Commented] (SLIDER-634) slider wrapper should look for and use python version >= 2.6

2014-11-11 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/SLIDER-634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206270#comment-14206270
 ] 

ASF subversion and git services commented on SLIDER-634:


Commit 68263b4edccc635ec30b1d3aa6ba3f66e17e4c60 in incubator-slider's branch 
refs/heads/feature/SLIDER-622-windows from [~sumitmohanty]
[ https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;h=68263b4 ]

SLIDER-634. slider wrapper should look for and use python version greater than 
or equal to 2.6 (Yu Liu via smohanty)


> slider wrapper should look for and use python version >= 2.6
> 
>
> Key: SLIDER-634
> URL: https://issues.apache.org/jira/browse/SLIDER-634
> Project: Slider
>  Issue Type: Bug
>Reporter: thomas liu
> Attachments: slider634.patch
>
>
> Need to have slider script pick up appropriate version of python to run



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Fwd: [VOTE] Release Apache Hadoop 2.6.0

2014-11-11 Thread Steve Loughran
FYI, 2.6 RC0 is up

I'm going to set up a profile for this and do the test runs, to qualify
that the RC works for slider. Then we can +1 the RC and use it as the basis
for our 0.60 release

-- Forwarded message --
From: Arun C Murthy 
Date: 11 November 2014 02:52
Subject: [VOTE] Release Apache Hadoop 2.6.0
To: "common-...@hadoop.apache.org" , "
hdfs-...@hadoop.apache.org" , "
yarn-...@hadoop.apache.org" , "
mapreduce-...@hadoop.apache.org" 


Folks,

I've created a release candidate (rc0) for hadoop-2.6.0 that I would like
to see released.

The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.6.0-rc0
The RC tag in git is: release-2.6.0-rc0

The maven artifacts are available via repository.apache.org at
https://repository.apache.org/content/repositories/orgapachehadoop-1012.

Please try the release and vote; the vote will run for the usual 5 days.

thanks,
Arun


--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.