[
https://issues.apache.org/jira/browse/SLIDER-773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14511535#comment-14511535
]
Steve Loughran commented on SLIDER-773:
---------------------------------------
Two of the slider-core tests are failing on my machine
{code}
Tests in error:
TestAddonPackage.testNoSuchPackageFile:106->SliderTestUtils.launch:953 »
BadCommandArguments
Remover received java.lang.InterruptedException: sleep interrupted
2015-04-24 19:28:04,455 [Thread-1] INFO resourcemanager.ResourceManager
(ResourceManager.java:transitionToStandby(1068)) - Transitioned to standby state
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 6.601 sec <<<
FAILURE! - in org.apache.slider.providers.agent.TestAddonPackage
testNoSuchPackageFile(org.apache.slider.providers.agent.TestAddonPackage) Time
elapsed: 5.308 sec <<< ERROR!
org.apache.slider.core.exceptions.BadCommandArgumentsException: Unable to
access supplied pkg file at
/Users/stevel/Projects/Hortonworks/Projects/slider/slider-core/src/test/app_packages/test_addon_pkg/master-app-pkg.zip
at
org.apache.slider.client.SliderClient.actionPackageInstall(SliderClient.java:1430)
at
org.apache.slider.client.SliderClient.actionPackage(SliderClient.java:1292)
at org.apache.slider.client.SliderClient.exec(SliderClient.java:482)
at
org.apache.slider.client.SliderClient.runService(SliderClient.java:388)
at
org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:188)
at
org.apache.slider.test.SliderTestUtils.launch(SliderTestUtils.groovy:953)
at org.apache.slider.test.SliderTestUtils$launch.call(Unknown Source)
at
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:45)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:108)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:136)
at
org.apache.slider.providers.agent.TestAddonPackage.testNoSuchPackageFile(TestAddonPackage.groovy:106)
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 7.82 sec <<<
FAILURE! - in org.apache.slider.providers.agent.TestAgentEcho
testEchoOperationForAddonPackages(org.apache.slider.providers.agent.TestAgentEcho)
Time elapsed: 6.52 sec <<< ERROR!
org.apache.slider.core.exceptions.BadConfigException: Error retrieving metainfo
data at /Users/yliu/.slider/package/FAKE/master-app-pkg.zip:
java.io.FileNotFoundException: File
/Users/yliu/.slider/package/FAKE/master-app-pkg.zip does not exist
at
org.apache.slider.providers.agent.AgentClientProvider.getApplicationTags(AgentClientProvider.java:289)
at
org.apache.slider.client.SliderClient.launchApplication(SliderClient.java:1993)
at
org.apache.slider.client.SliderClient.startCluster(SliderClient.java:1864)
at
org.apache.slider.client.SliderClient.actionCreate(SliderClient.java:716)
at org.apache.slider.client.SliderClient.exec(SliderClient.java:427)
at
org.apache.slider.client.SliderClient.runService(SliderClient.java:388)
at
org.apache.slider.core.main.ServiceLauncher.launchService(ServiceLauncher.java:188)
at
org.apache.slider.test.SliderTestUtils.execSliderCommand(SliderTestUtils.groovy:939)
at
org.apache.slider.test.SliderTestUtils.launchClientAgainstRM(SliderTestUtils.groovy:990)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:90)
at groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:324)
at groovy.lang.MetaClassImpl.invokeStaticMethod(MetaClassImpl.java:1462)
at
org.codehaus.groovy.runtime.callsite.StaticMetaClassSite.callStatic(StaticMetaClassSite.java:62)
at
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallStatic(CallSiteArray.java:53)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:189)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callStatic(AbstractCallSite.java:217)
at
org.apache.slider.test.YarnMiniClusterTestBase.launchClientNoExitCodeCheck(YarnMiniClusterTestBase.groovy:378)
at
org.apache.slider.test.YarnMiniClusterTestBase$launchClientNoExitCodeCheck$3.callCurrent(Unknown
Source)
at
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:169)
at
org.apache.slider.test.YarnMiniClusterTestBase.launchClientAgainstMiniMR(YarnMiniClusterTestBase.groovy:359)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:207)
at
org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:56)
at
org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:49)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:149)
at
org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:169)
at
org.apache.slider.test.YarnMiniClusterTestBase.createOrBuildCluster(YarnMiniClusterTestBase.groovy:536)
at
org.apache.slider.providers.agent.AgentTestBase.buildAgentCluster(AgentTestBase.groovy:151)
at
org.apache.slider.providers.agent.TestAgentEcho.testEchoOperationForAddonPackages(TestAgentEcho.groovy:165)
Results :
Tests in error:
TestAgentEcho.testEchoOperationForAddonPackages:165->AgentTestBase.buildAgentCluster:151->YarnMiniClusterTestBase.createOrBuildCluster:536->YarnMiniClusterTestBase.launchClientAgainstMiniMR:359->YarnMiniClusterTestBase.launchClientNoExitCodeCheck:378->SliderTestUtils.launchClientAgainstRM:990->SliderTestUtils.execSliderCommand:939
» BadConfig
{code}
> Add co-processor support for app packages
> -----------------------------------------
>
> Key: SLIDER-773
> URL: https://issues.apache.org/jira/browse/SLIDER-773
> Project: Slider
> Issue Type: Bug
> Components: app-package, client
> Affects Versions: Slider 0.60
> Reporter: Sumit Mohanty
> Assignee: thomas liu
> Priority: Critical
> Fix For: Slider 0.80
>
> Attachments: 773-suggest.txt, Co-processorSupport.pdf,
> SLIDER-773_review_comments.patch, SLIDER-773_review_comments_part2.patch,
> coprocessor-after.patch, coprocessor-apri-4th.patch, coprocessor.patch,
> coprocessor.patch
>
>
> It is typical for applications to allow plugins/co-processors that are
> essentially a set of additional jar files in the classpath and optionally a
> set of config files or config changes.
> Current, slider app packages can handle additional config changes/entries
> very well. Additional configs files can be added as well but it is not easy
> if the config files include parameters that need to be resolved by the agent.
> This requires app package changes. Dropping additional jar files into the
> class path is not easy and requires app package changes.
> It is not efficient to modify the app package to support such plugins. App
> packaging and create command should be modified such that the user can
> dynamically specify additional jars, config files, configs etc.
> Specific scenarios are modifying HBase to add support for Phoenix or Ranger.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
