[jira] [Resolved] (MYRIAD-157) Concurrency issues while trying to flexup and flexdown NMs at the same time

2015-10-20 Thread Santosh Marella (JIRA)

 [ 
https://issues.apache.org/jira/browse/MYRIAD-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santosh Marella resolved MYRIAD-157.

Resolution: Fixed

> Concurrency issues while trying to flexup and flexdown NMs at the same time
> ---
>
> Key: MYRIAD-157
> URL: https://issues.apache.org/jira/browse/MYRIAD-157
> Project: Myriad
>  Issue Type: Bug
>  Components: Scheduler
>Reporter: Yuliya Feldman
>Assignee: Yuliya Feldman
> Fix For: Myriad 0.1.0
>
>
> When trying to flex up and down multiple NMs at the same time multiple issues 
>  coming up with synchronization of SchedulerState 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (MYRIAD-157) Concurrency issues while trying to flexup and flexdown NMs at the same time

2015-10-20 Thread Santosh Marella (JIRA)

 [ 
https://issues.apache.org/jira/browse/MYRIAD-157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santosh Marella updated MYRIAD-157:
---
Affects Version/s: (was: Myriad 0.1.0)

> Concurrency issues while trying to flexup and flexdown NMs at the same time
> ---
>
> Key: MYRIAD-157
> URL: https://issues.apache.org/jira/browse/MYRIAD-157
> Project: Myriad
>  Issue Type: Bug
>  Components: Scheduler
>Reporter: Yuliya Feldman
>Assignee: Yuliya Feldman
> Fix For: Myriad 0.1.0
>
>
> When trying to flex up and down multiple NMs at the same time multiple issues 
>  coming up with synchronization of SchedulerState 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Reopened] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-10-20 Thread Sarjeet Singh (JIRA)

 [ 
https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sarjeet Singh reopened MYRIAD-140:
--

Reopening this as I am still getting NullPointerException with NM flex down 
only, when tried with latest code. Everything else works just fine.

> NullPointerException on NM flex up/down API when no params passed to HTTP PUT 
> request.
> --
>
> Key: MYRIAD-140
> URL: https://issues.apache.org/jira/browse/MYRIAD-140
> Project: Myriad
>  Issue Type: Bug
>Affects Versions: Myriad 0.1.0
>Reporter: Sarjeet Singh
>Assignee: Yuliya Feldman
>
> Observed the NullPointerException when tried to flex up using curl without 
> any params passed to http request. (didn't use myriad UI for flexing)
> 15/09/22 14:54:50 INFO api.ClustersResource: Received Flexup Cluster Request
> 15/09/22 14:54:50 INFO api.ClustersResource: Instances: null
> 15/09/22 14:54:50 INFO api.ClustersResource: Profile: null
> Sep 22, 2015 2:54:50 PM com.sun.jersey.spi.container.ContainerResponse 
> mapMappableContainerException
> SEVERE: The RuntimeException could not be mapped to a response, re-throwing 
> to the HTTP container
> java.lang.NullPointerException
>   at 
> java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
>   at 
> java.util.concurrent.ConcurrentHashMap.containsKey(ConcurrentHashMap.java:1016)
>   at 
> com.ebay.myriad.scheduler.NMProfileManager.exists(NMProfileManager.java:44)
>   at com.ebay.myriad.api.ClustersResource.flexUp(ClustersResource.java:84)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>   at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>   at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>   at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>   at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>   at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
>   at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
>   at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
>   at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>   at 
> com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
>   at 
> com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
>   at 
> com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
>   at 
> com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
>   at 
> com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
>   at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
>   at 
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>   at 
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>   at 
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>   at 
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>   at org.mortbay.jetty.Server.handle(Server.java:326)
>   at 
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>   at 
> 

[jira] [Commented] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-10-20 Thread Yuliya Feldman (JIRA)

[ 
https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965604#comment-14965604
 ] 

Yuliya Feldman commented on MYRIAD-140:
---

Submitted PR: https://github.com/apache/incubator-myriad/pull/16  to fix this 
issue

> NullPointerException on NM flex up/down API when no params passed to HTTP PUT 
> request.
> --
>
> Key: MYRIAD-140
> URL: https://issues.apache.org/jira/browse/MYRIAD-140
> Project: Myriad
>  Issue Type: Bug
>Affects Versions: Myriad 0.1.0
>Reporter: Sarjeet Singh
>Assignee: Yuliya Feldman
>
> Observed the NullPointerException when tried to flex up using curl without 
> any params passed to http request. (didn't use myriad UI for flexing)
> 15/09/22 14:54:50 INFO api.ClustersResource: Received Flexup Cluster Request
> 15/09/22 14:54:50 INFO api.ClustersResource: Instances: null
> 15/09/22 14:54:50 INFO api.ClustersResource: Profile: null
> Sep 22, 2015 2:54:50 PM com.sun.jersey.spi.container.ContainerResponse 
> mapMappableContainerException
> SEVERE: The RuntimeException could not be mapped to a response, re-throwing 
> to the HTTP container
> java.lang.NullPointerException
>   at 
> java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
>   at 
> java.util.concurrent.ConcurrentHashMap.containsKey(ConcurrentHashMap.java:1016)
>   at 
> com.ebay.myriad.scheduler.NMProfileManager.exists(NMProfileManager.java:44)
>   at com.ebay.myriad.api.ClustersResource.flexUp(ClustersResource.java:84)
>   at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>   at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>   at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>   at java.lang.reflect.Method.invoke(Method.java:606)
>   at 
> com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
>   at 
> com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
>   at 
> com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
>   at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>   at 
> com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
>   at 
> com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
>   at 
> com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
>   at 
> com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
>   at 
> com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
>   at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
>   at 
> com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
>   at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
>   at 
> com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
>   at 
> com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
>   at 
> com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
>   at 
> com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
>   at 
> com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
>   at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
>   at 
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>   at 
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>   at 
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>   at 
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>   at org.mortbay.jetty.Server.handle(Server.java:326)
>   at 
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>   at 
> 

[jira] [Commented] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-10-20 Thread Sarjeet Singh (JIRA)

[ 
https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965600#comment-14965600
 ] 

Sarjeet Singh commented on MYRIAD-140:
--

15/10/20 12:23:15 INFO api.ClustersResource: Received flex down request. 
Profile: null, Instances: null, Constraints: null
15/10/20 12:23:15 ERROR api.ClustersResource: 'profile' is null or empty
Oct 20, 2015 12:23:15 PM com.sun.jersey.spi.container.ContainerResponse 
mapMappableContainerException
SEVERE: The RuntimeException could not be mapped to a response, re-throwing to 
the HTTP container
java.lang.NullPointerException
at 
java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
at 
java.util.concurrent.ConcurrentHashMap.get(ConcurrentHashMap.java:988)
at 
com.ebay.myriad.scheduler.ServiceProfileManager.get(ServiceProfileManager.java:21)
at 
com.ebay.myriad.api.ClustersResource.getNumFlexedupNMs(ClustersResource.java:262)
at 
com.ebay.myriad.api.ClustersResource.flexDown(ClustersResource.java:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60)
at 
com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$ResponseOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:205)
at 
com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75)
at 
com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288)
at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at 
com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108)
at 
com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147)
at 
com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349)
at 
com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339)
at 
com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537)
at 
com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at 
com.google.inject.servlet.ServletDefinition.doService(ServletDefinition.java:263)
at 
com.google.inject.servlet.ServletDefinition.service(ServletDefinition.java:178)
at 
com.google.inject.servlet.ManagedServletPipeline.service(ManagedServletPipeline.java:91)
at 
com.google.inject.servlet.FilterChainInvocation.doFilter(FilterChainInvocation.java:62)
at 
com.google.inject.servlet.ManagedFilterPipeline.dispatch(ManagedFilterPipeline.java:118)
at com.google.inject.servlet.GuiceFilter.doFilter(GuiceFilter.java:113)
at 
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
at 
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
at 
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at 
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:326)
at 
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
at 
org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
at 
org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410)
at 
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

> NullPointerException on NM flex up/down API when no params passed to HTTP PUT 
> request.
> --
>
> Key: MYRIAD-140
> URL: 

[jira] [Commented] (MYRIAD-41) Apache Licensing

2015-10-20 Thread Santosh Marella (JIRA)

[ 
https://issues.apache.org/jira/browse/MYRIAD-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965526#comment-14965526
 ] 

Santosh Marella commented on MYRIAD-41:
---

Also https://github.com/apache/incubator-myriad/pull/15

> Apache Licensing
> 
>
> Key: MYRIAD-41
> URL: https://issues.apache.org/jira/browse/MYRIAD-41
> Project: Myriad
>  Issue Type: Bug
>Reporter: Adam B
>Assignee: Jim Klucar
> Fix For: Myriad 0.1.0
>
>
> We need the license header at the top of each file, as well as a LICENSE and 
> NOTICE file at the root of the repo.
> See examples:
> https://github.com/apache/mesos/blob/master/LICENSE
> https://github.com/apache/hadoop/blob/trunk/LICENSE.txt
> https://github.com/apache/mesos/blob/master/NOTICE
> https://github.com/apache/hadoop/blob/trunk/NOTICE.txt



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Resolved] (MYRIAD-146) Add hadoop distribution override for RM Docker image

2015-10-20 Thread Santosh Marella (JIRA)

 [ 
https://issues.apache.org/jira/browse/MYRIAD-146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Santosh Marella resolved MYRIAD-146.

Resolution: Fixed

> Add hadoop distribution override for RM Docker image
> 
>
> Key: MYRIAD-146
> URL: https://issues.apache.org/jira/browse/MYRIAD-146
> Project: Myriad
>  Issue Type: Bug
>Reporter: Brandon Gulla
>Assignee: Brandon Gulla
> Fix For: Myriad 0.1.0
>
>
> An issue was brought up a few weeks ago on the call that there is a desire to 
> make the Hadoop distribution targz configurable for the RM docker image. 
> I'll knock this out and test against Apache Hadoop and MapR's distribution. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Myriad mail list

2015-10-20 Thread carl.m.dukatz
Sign me up!


Carl Dukatz
Accenture Technology Labs - Data Insights
carl.m.duk...@accenture.com
313-731-2363




This message is for the designated recipient only and may contain privileged, 
proprietary, or otherwise confidential information. If you have received it in 
error, please notify the sender immediately and delete the original. Any other 
use of the e-mail by you is prohibited. Where allowed by local law, electronic 
communications with Accenture and its affiliates, including e-mail and instant 
messaging (including content), may be scanned by our systems for the purposes 
of information security and assessment of internal compliance with Accenture 
policy.
__

www.accenture.com


Re: Add TOC in wiki

2015-10-20 Thread Santosh Marella
There was one option that I quickly tried to display the page tree on the
left hand nav bar. Let me know if you like this. I'll explore some more too.

Santosh

On Tue, Oct 20, 2015 at 4:51 PM, Ruth Harris  wrote:

> Hi,
>
> Could one of the wiki administrator's add a TOC into the left navigation?
> It's probably some sort of navigation or children macro that can be added.
>
> https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home
>
>
> It's really hard to navigate through the content when you can't see
> everything.
>
> --
> Ruth Harris
> Sr. Technical Writer, MapR
>


Re: Add TOC in wiki

2015-10-20 Thread Ruth Harris
It works fine. Thanks!  -Ruth

On Tue, Oct 20, 2015 at 5:29 PM, Santosh Marella 
wrote:

> There was one option that I quickly tried to display the page tree on the
> left hand nav bar. Let me know if you like this. I'll explore some more
> too.
>
> Santosh
>
> On Tue, Oct 20, 2015 at 4:51 PM, Ruth Harris  wrote:
>
> > Hi,
> >
> > Could one of the wiki administrator's add a TOC into the left navigation?
> > It's probably some sort of navigation or children macro that can be
> added.
> >
> > https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home
> >
> >
> > It's really hard to navigate through the content when you can't see
> > everything.
> >
> > --
> > Ruth Harris
> > Sr. Technical Writer, MapR
> >
>



-- 
Ruth Harris
Sr. Technical Writer, MapR


Add TOC in wiki

2015-10-20 Thread Ruth Harris
Hi,

Could one of the wiki administrator's add a TOC into the left navigation?
It's probably some sort of navigation or children macro that can be added.

https://cwiki.apache.org/confluence/display/MYRIAD/Myriad+Home


It's really hard to navigate through the content when you can't see
everything.

-- 
Ruth Harris
Sr. Technical Writer, MapR