Please add "falcon.current.colo=eng" to both runtime.properties in prism and falcon and then try it out.
On Sat, Jan 7, 2017 at 12:30 AM, Aaron Turner <synfina...@gmail.com> wrote: > I guess that will work for now. At some point I'm sure we'll want > that feature. Anyways, made progress, but now I'm stuck again. > > error from the falcon submit command is now: > > $ ./bin/falcon entity -submit -debug -type cluster -file > /etc/falcon/cluster.xml > Hadoop is installed, adding hadoop classpath to falcon classpath > SLF4J: Class path contains multiple SLF4J bindings. > SLF4J: Found binding in > [jar:file:/usr/lib/falcon-server/client/lib/falcon-cli- > 0.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/usr/lib/falcon-server/client/lib/slf4j- > log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] > SLF4J: Found binding in > [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/ > StaticLoggerBinder.class] > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an > explanation. > SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] > POST http://localhost:16444/api/entities/submit/cluster returned a > response status of 400 Bad Request > ERROR: Bad Request;eng/Current colo (default) is not eng > > ok, that seems straight forward... just need to check my > runtime.properties files: > > Here is what I have for both server/prism runtime.properties: > > #### To configure falcon servers with prism #### > #prism should have the following properties > *.all.colos=eng > *.falcon.eng.endpoint=http://localhost:15000 > > # falcon server should have the following properties > *.current.colo=eng > > That looks good to me?? > > and my cluster.xml: > > <?xml version="1.0" encoding="UTF-8"?> > <!-- https://falcon.apache.org/EntitySpecification.html# > Cluster_Specification > --> > <cluster colo="eng" description="test cluster" name="hdpt" > xmlns="uri:falcon:cluster:0.1" > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";> > <interfaces> > ... > </interfaces> > ... > </cluster> > > Again, colo=eng? I tried specifying the -colo eng flag on the falcon > CLI, but it complains that's not valid. > > prism logs: > > 2017-01-06 10:49:38,838 DEBUG - [352083716@qtp-771418758-0 - > 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner/127.0.0.1 > performed request > http://localhost:16444/api/options?user.name=aaron_turner (127.0.0.1) > at time 2017-01-06T18:49Z (FalconAuditFilter:86) > 2017-01-06 10:49:38,839 INFO - [352083716@qtp-771418758-0 - > 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/options?user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > 2017-01-06 10:49:38,839 INFO - [352083716@qtp-771418758-0 - > 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/options?user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > 2017-01-06 10:49:38,843 DEBUG - [352083716@qtp-771418758-0 - > 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner/127.0.0.1 > performed request > http://localhost:16444/api/options?user.name=aaron_ > turner&user.name=aaron_turner > (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86) > 2017-01-06 10:49:38,844 INFO - [352083716@qtp-771418758-0 - > 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/options?user.name=aaron_ > turner&user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > 2017-01-06 10:49:38,844 INFO - [352083716@qtp-771418758-0 - > 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/options?user.name=aaron_ > turner&user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > 2017-01-06 10:49:39,202 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Logging in aaron_turner (CurrentUser:65) > 2017-01-06 10:49:39,202 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Request from authenticated user: aaron_turner, > URL=/api/entities/submit/cluster, doAs user: null > (FalconAuthenticationFilter:185) > 2017-01-06 10:49:39,207 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Parsed Entity: hdpt (EntityParser:94) > 2017-01-06 10:49:39,207 DEBUG - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=eng&; > (HTTPChannel:96) > 2017-01-06 10:49:39,209 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore > (SecureHTTPChannel:56) > 2017-01-06 10:49:39,325 ERROR - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Request failed: 400 (HTTPChannel:123) > 2017-01-06 10:49:39,329 ERROR - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Request failed (HTTPChannel:131) > org.apache.falcon.FalconWebException > at org.apache.falcon.FalconWebException.newAPIException( > FalconWebException.java:62) > at org.apache.falcon.FalconWebException.newAPIException( > FalconWebException.java:54) > at org.apache.falcon.resource.channel.HTTPChannel.invoke( > HTTPChannel.java:124) > at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$ > 2.doExecute(SchedulableEntityManagerProxy.java:176) > at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$ > EntityProxy.execute(SchedulableEntityManagerProxy.java:841) > at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy. > submit_aroundBody2(SchedulableEntityManagerProxy.java:178) > at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$ > AjcClosure3.run(SchedulableEntityManagerProxy.java:1) > at org.aspectj.runtime.reflect.JoinPointImpl.proceed( > JoinPointImpl.java:149) > at org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored( > AbstractFalconAspect.java:51) > at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit( > SchedulableEntityManagerProxy.java:156) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:498) > at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke( > JavaMethodInvokerFactory.java:60) > at com.sun.jersey.server.impl.model.method.dispatch. > AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch( > AbstractResourceMethodDispatchProvider.java:185) > at com.sun.jersey.server.impl.model.method.dispatch. > ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher. > java:75) > at com.sun.jersey.server.impl.uri.rules.HttpMethodRule. > accept(HttpMethodRule.java:288) > at com.sun.jersey.server.impl.uri.rules.RightHandPathRule. > accept(RightHandPathRule.java:147) > at com.sun.jersey.server.impl.uri.rules.ResourceClassRule. > accept(ResourceClassRule.java:108) > at com.sun.jersey.server.impl.uri.rules.RightHandPathRule. > accept(RightHandPathRule.java:147) > at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept( > RootResourceClassesRule.java:84) > at com.sun.jersey.server.impl.application.WebApplicationImpl._ > handleRequest(WebApplicationImpl.java:1469) > at com.sun.jersey.server.impl.application.WebApplicationImpl._ > handleRequest(WebApplicationImpl.java:1400) > at com.sun.jersey.server.impl.application.WebApplicationImpl. > handleRequest(WebApplicationImpl.java:1349) > at com.sun.jersey.server.impl.application.WebApplicationImpl. > handleRequest(WebApplicationImpl.java:1339) > at com.sun.jersey.spi.container.servlet.WebComponent.service( > WebComponent.java:416) > at com.sun.jersey.spi.container.servlet.ServletContainer. > service(ServletContainer.java:537) > at com.sun.jersey.spi.container.servlet.ServletContainer. > service(ServletContainer.java:699) > at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1221) > at org.apache.falcon.security.FalconAuthorizationFilter.doFilter( > FalconAuthorizationFilter.java:108) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1212) > at org.apache.falcon.security.FalconAuthenticationFilter$2.doFilter( > FalconAuthenticationFilter.java:188) > at org.apache.hadoop.security.authentication.server. > AuthenticationFilter.doFilter(AuthenticationFilter.java:622) > at org.apache.hadoop.security.authentication.server. > AuthenticationFilter.doFilter(AuthenticationFilter.java:574) > at org.apache.falcon.security.FalconAuthenticationFilter.doFilter( > FalconAuthenticationFilter.java:197) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1212) > at org.apache.falcon.security.FalconAuditFilter.doFilter( > FalconAuditFilter.java:64) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1212) > at org.apache.falcon.security.HostnameFilter.doFilter( > HostnameFilter.java:82) > at org.mortbay.jetty.servlet.ServletHandler$CachedChain. > doFilter(ServletHandler.java:1212) > at org.mortbay.jetty.servlet.ServletHandler.handle( > ServletHandler.java:399) > at org.mortbay.jetty.security.SecurityHandler.handle( > SecurityHandler.java:216) > at org.mortbay.jetty.servlet.SessionHandler.handle( > SessionHandler.java:182) > at org.mortbay.jetty.handler.ContextHandler.handle( > ContextHandler.java:767) > at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at org.mortbay.jetty.handler.HandlerWrapper.handle( > HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at org.mortbay.jetty.HttpConnection$RequestHandler. > content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at org.mortbay.jetty.bio.SocketConnector$Connection. > run(SocketConnector.java:228) > at org.mortbay.thread.QueuedThreadPool$PoolThread. > run(QueuedThreadPool.java:582) > 2017-01-06 10:49:39,330 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ {Action:submit, Dimensions:{colo=NULL, entityType=cluster}, Status: > FAILED, Time-taken:126927782 ns} (METRIC:38) > 2017-01-06 10:49:39,330 ERROR - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner: > POST//entities/submit/cluster] > ~ Exception in sending Notification from > EmailNotificationPlugin:java.lang.NullPointerException > (EmailNotificationPlugin:71) > 2017-01-06 10:49:39,331 DEBUG - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner/127.0.0.1 > performed request http://localhost:16444/api/entities/submit/cluster > (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86) > 2017-01-06 10:49:39,331 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/entities/submit/cluster > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > 2017-01-06 10:49:39,331 INFO - [352083716@qtp-771418758-0 - > 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:16444/api/entities/submit/cluster > (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) > > server logs: > > 2017-01-06 10:55:07,924 INFO - [1234586997@qtp-1262548561-0 - > 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner: > POST//sync/submit/cluster] > ~ Logging in aaron_turner (CurrentUser:65) > 2017-01-06 10:55:07,924 INFO - [1234586997@qtp-1262548561-0 - > 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner: > POST//sync/submit/cluster] > ~ Request from authenticated user: aaron_turner, > URL=/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner, doAs > user: null (FalconAuthenticationFilter:185) > 2017-01-06 10:55:07,925 DEBUG - [1234586997@qtp-1262548561-0 - > 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner/127.0.0.1 > performed request > http://localhost:15000/secure/sync/submit/cluster?colo=eng&&; > user.name=aaron_turner > (127.0.0.1) at time 2017-01-06T18:55Z (FalconAuditFilter:86) > 2017-01-06 10:55:07,925 INFO - [1234586997@qtp-1262548561-0 - > 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&; > user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48) > 2017-01-06 10:55:07,926 INFO - [1234586997@qtp-1262548561-0 - > 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1 > performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&; > user.name=aaron_turner > (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48) > > I'm guessing the prism backtrace is significant, but I don't see a > smoking gun in the server log which explains what is going on. If I > connect to tcp/15000 I can login as "aaron_turner" in the falcon > server web UI just fine. > -- > Aaron Turner > https://synfin.net/ Twitter: @synfinatic > Those who would give up essential Liberty, to purchase a little temporary > Safety, deserve neither Liberty nor Safety. > -- Benjamin Franklin > > > On Thu, Jan 5, 2017 at 7:11 PM, Pallavi Rao <pallavi....@inmobi.com> > wrote: > > Aaron, > > If you don't plan to use the graph API, you can disable > MetadataMappingService > > (by commenting out that line) in the startup.properties as a work-around. > > > > On Thu, Jan 5, 2017 at 11:48 PM, Aaron Turner <synfina...@gmail.com> > wrote: > > > >> Ok, I think I see what my problem is. > >> > >> First, my falcon-prism/conf/runtime.properties had: > >> > >> prism.falcon.local.endpoint=http://localhost:16444 > >> > >> which pointed back at itself, not: > >> > >> prism.falcon.local.endpoint=http://localhost:15000 > >> > >> which points at falcon server. So I fixed that and restarted > >> falcon-prism. Now I get a different error: > >> > >> POST http://localhost:16444/api/entities/submit/cluster returned a > >> response status of 400 Bad Request > >> ERROR: Bad Request;local/org.apache.falcon.FalconException::org. > >> apache.falcon.FalconException: > >> <html> > >> <head> > >> <meta http-equiv="Content-Type" content="text/html; > charset=ISO-8859-1"/> > >> <title>Error 503 SERVICE_UNAVAILABLE</title> > >> </head> > >> <body> > >> <h2>HTTP ERROR: 503</h2> > >> <p>Problem accessing /secure/sync/submit/cluster. Reason: > >> <pre> SERVICE_UNAVAILABLE</pre></p> > >> <hr /><i><small>Powered by Jetty://</small></i> > >> > >> The prism.application.log now says it's trying to talk to falcon-server: > >> > >> 2017-01-05 10:12:53,952 DEBUG - [352083716@qtp-771418758-0 - > >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: > >> POST//entities/submit/cluster] > >> ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo= > local& > >> (HTTPChannel:96) > >> 2017-01-05 10:12:53,953 INFO - [352083716@qtp-771418758-0 - > >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: > >> POST//entities/submit/cluster] > >> ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore > >> (SecureHTTPChannel:56) > >> 2017-01-05 10:12:54,033 ERROR - [352083716@qtp-771418758-0 - > >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: > >> POST//entities/submit/cluster] > >> ~ Request failed: 503 (HTTPChannel:127) > >> 2017-01-05 10:12:54,035 ERROR - [352083716@qtp-771418758-0 - > >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: > >> POST//entities/submit/cluster] > >> ~ Request failed (HTTPChannel:134) > >> > >> Trying in my browser to connect to tcp/15000 gives me the same 503 > >> error. So I went looking in the falcon.application.log for what the > >> problem is: > >> > >> > >> 2017-01-05 10:09:05,551 INFO - [main:] ~ Initializing graph db > >> (MetadataMappingService:143) > >> 2017-01-05 10:09:05,610 INFO - [main:] ~ The HBase version > >> 1.2.0-cdh5.8.2 is not explicitly supported by Titan. Loading Titan's > >> compatibility layer for its most recent supported HBase version (1.1) > >> (HBaseCompatLoader:57) > >> > >> <snip> > >> > >> 2017-01-05 10:09:05,832 WARN - [main:] ~ > >> hbase.regionserver.global.memstore.upperLimit is deprecated by > >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55) > >> 2017-01-05 10:09:06,084 WARN - [main:] ~ The short-circuit local > >> reads feature cannot be used because libhadoop cannot be loaded. > >> (DomainSocketFactory:117) > >> 2017-01-05 10:09:06,088 INFO - [main:] ~ Set a new configuration for > >> the first time. (N:110) > >> 2017-01-05 10:09:06,119 INFO - [main:] ~ mapred.task.id is > >> deprecated. Instead, use mapreduce.task.attempt.id (deprecation:1174) > >> 2017-01-05 10:09:06,120 INFO - [main:] ~ Scheduling statistics report > >> every 2000 millisecs (u:110) > >> 2017-01-05 10:09:06,120 INFO - [main:] ~ Initialized the distributed > >> file system (ThrottledDistributedFileSystem:110) > >> 2017-01-05 10:09:06,421 INFO - [main:] ~ hadoop.native.lib is > >> deprecated. Instead, use io.native.lib.available (deprecation:1174) > >> 2017-01-05 10:09:06,514 WARN - [main:] ~ > >> hbase.regionserver.global.memstore.upperLimit is deprecated by > >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55) > >> 2017-01-05 10:09:06,521 ERROR - [main:] ~ Failed to initialize service > >> org.apache.falcon.metadata.MetadataMappingService > >> (ServiceInitializer:49) > >> java.lang.RuntimeException: GraphFactory could not instantiate this > >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. > >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50) > >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB( > >> MetadataMappingService.java:146) > >> at org.apache.falcon.metadata.MetadataMappingService.init( > >> MetadataMappingService.java:113) > >> at org.apache.falcon.service.ServiceInitializer.initialize( > >> ServiceInitializer.java:47) > >> at org.apache.falcon.listener.ContextStartupListener. > contextInitialized( > >> ContextStartupListener.java:56) > >> at org.mortbay.jetty.handler.ContextHandler.startContext( > >> ContextHandler.java:550) > >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136) > >> at org.mortbay.jetty.webapp.WebAppContext.startContext( > >> WebAppContext.java:1282) > >> at org.mortbay.jetty.handler.ContextHandler.doStart( > >> ContextHandler.java:519) > >> at org.mortbay.jetty.webapp.WebAppContext.doStart( > WebAppContext.java:499) > >> at org.mortbay.component.AbstractLifeCycle.start( > >> AbstractLifeCycle.java:50) > >> at org.mortbay.jetty.handler.HandlerWrapper.doStart( > >> HandlerWrapper.java:130) > >> at org.mortbay.jetty.Server.doStart(Server.java:224) > >> at org.mortbay.component.AbstractLifeCycle.start( > >> AbstractLifeCycle.java:50) > >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58) > >> at org.apache.falcon.FalconServer.main(FalconServer.java:118) > >> Caused by: java.lang.reflect.InvocationTargetException > >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> at sun.reflect.NativeMethodAccessorImpl.invoke( > >> NativeMethodAccessorImpl.java:62) > >> at sun.reflect.DelegatingMethodAccessorImpl.invoke( > >> DelegatingMethodAccessorImpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:498) > >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45) > >> ... 15 more > >> Caused by: java.lang.NoSuchMethodError: > >> org.apache.hadoop.hbase.HTableDescriptor.addFamily( > >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/ > >> HTableDescriptor; > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1. > >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49) > >> at com.thinkaurelius.titan.diskstorage.hbase. > >> HBaseStoreManager.createTable(HBaseStoreManager.java:728) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> ensureTableExists(HBaseStoreManager.java:711) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> getLocalKeyPartition(HBaseStoreManager.java:511) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> getDeployment(HBaseStoreManager.java:352) > >> at com.thinkaurelius.titan.diskstorage.hbase. > >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395) > >> at com.thinkaurelius.titan.graphdb.configuration. > >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276) > >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93) > >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73) > >> ... 20 more > >> 2017-01-05 10:09:06,524 ERROR - [main:] ~ Failed startup of context > >> org.mortbay.jetty.webapp.WebAppContext@6caf7803{/,/usr/ > >> lib/falcon-server/server/webapp/falcon} > >> (log:87) > >> java.lang.RuntimeException: org.apache.falcon.FalconException: > >> java.lang.RuntimeException: GraphFactory could not instantiate this > >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. > >> at org.apache.falcon.listener.ContextStartupListener. > contextInitialized( > >> ContextStartupListener.java:59) > >> at org.mortbay.jetty.handler.ContextHandler.startContext( > >> ContextHandler.java:550) > >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136) > >> at org.mortbay.jetty.webapp.WebAppContext.startContext( > >> WebAppContext.java:1282) > >> at org.mortbay.jetty.handler.ContextHandler.doStart( > >> ContextHandler.java:519) > >> at org.mortbay.jetty.webapp.WebAppContext.doStart( > WebAppContext.java:499) > >> at org.mortbay.component.AbstractLifeCycle.start( > >> AbstractLifeCycle.java:50) > >> at org.mortbay.jetty.handler.HandlerWrapper.doStart( > >> HandlerWrapper.java:130) > >> at org.mortbay.jetty.Server.doStart(Server.java:224) > >> at org.mortbay.component.AbstractLifeCycle.start( > >> AbstractLifeCycle.java:50) > >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58) > >> at org.apache.falcon.FalconServer.main(FalconServer.java:118) > >> Caused by: org.apache.falcon.FalconException: > >> java.lang.RuntimeException: GraphFactory could not instantiate this > >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. > >> at org.apache.falcon.service.ServiceInitializer.initialize( > >> ServiceInitializer.java:50) > >> at org.apache.falcon.listener.ContextStartupListener. > contextInitialized( > >> ContextStartupListener.java:56) > >> ... 11 more > >> Caused by: java.lang.RuntimeException: GraphFactory could not > >> instantiate this Graph implementation > >> [com.thinkaurelius.titan.core.TitanFactory]. > >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50) > >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB( > >> MetadataMappingService.java:146) > >> at org.apache.falcon.metadata.MetadataMappingService.init( > >> MetadataMappingService.java:113) > >> at org.apache.falcon.service.ServiceInitializer.initialize( > >> ServiceInitializer.java:47) > >> ... 12 more > >> Caused by: java.lang.reflect.InvocationTargetException > >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > >> at sun.reflect.NativeMethodAccessorImpl.invoke( > >> NativeMethodAccessorImpl.java:62) > >> at sun.reflect.DelegatingMethodAccessorImpl.invoke( > >> DelegatingMethodAccessorImpl.java:43) > >> at java.lang.reflect.Method.invoke(Method.java:498) > >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45) > >> ... 15 more > >> Caused by: java.lang.NoSuchMethodError: > >> org.apache.hadoop.hbase.HTableDescriptor.addFamily( > >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/ > >> HTableDescriptor; > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1. > >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49) > >> at com.thinkaurelius.titan.diskstorage.hbase. > >> HBaseStoreManager.createTable(HBaseStoreManager.java:728) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> ensureTableExists(HBaseStoreManager.java:711) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> getLocalKeyPartition(HBaseStoreManager.java:511) > >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. > >> getDeployment(HBaseStoreManager.java:352) > >> at com.thinkaurelius.titan.diskstorage.hbase. > >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395) > >> at com.thinkaurelius.titan.graphdb.configuration. > >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276) > >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93) > >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73) > >> ... 20 more > >> 2017-01-05 10:09:06,525 INFO - [main:] ~ Started > >> SocketConnector@0.0.0.0:15000 (log:67) > >> 2017-01-05 10:14:04,983 INFO - [Thread-16:] ~ config.location is set, > >> using: /usr/lib/falcon-server/conf/runtime.properties > >> (ApplicationProperties:120) > >> 2017-01-05 10:14:04,983 INFO - [Thread-16:] ~ Initializing > >> org.apache.falcon.util.RuntimeProperties properties with domain falcon > >> (ApplicationProperties:156) > >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ > >> feed.retry.policy=exp-backoff (ApplicationProperties:162) > >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ > >> feed.retry.frequency=minutes(5) (ApplicationProperties:162) > >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ > >> workflow.status.retry.count=30 (ApplicationProperties:162) > >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ > >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=* > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.late.allowed=true > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> webservices.default.results.per.page=10 (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> feed.retry.onTimeout=false (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> falcon.jms.notification.enabled=true (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> falcon.retention.keep.instances.beyond.validity=true > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> feed.late.policy=exp-backoff (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ current.colo=local > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ domain=falcon > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> feed.late.frequency=hours(3) (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> falcon.skip.dryrun=false (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.retry.attempts=3 > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ > >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=* > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,984 INFO - [Thread-16:] ~ config.location is set, > >> using: /usr/lib/falcon-server/conf/runtime.properties > >> (ApplicationProperties:120) > >> 2017-01-05 10:14:04,985 INFO - [Thread-16:] ~ Initializing > >> org.apache.falcon.util.RuntimeProperties properties with domain falcon > >> (ApplicationProperties:156) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> feed.retry.policy=exp-backoff (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> feed.retry.frequency=minutes(5) (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> workflow.status.retry.count=30 (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=* > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.late.allowed=true > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> webservices.default.results.per.page=10 (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> feed.retry.onTimeout=false (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> falcon.jms.notification.enabled=true (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> falcon.retention.keep.instances.beyond.validity=true > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> feed.late.policy=exp-backoff (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ current.colo=local > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ domain=falcon > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> feed.late.frequency=hours(3) (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> falcon.skip.dryrun=false (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.retry.attempts=3 > >> (ApplicationProperties:162) > >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ > >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=* > >> (ApplicationProperties:162) > >> > >> So it appears my problem is that CDH5.8.2 is shipping a more recent > >> version of Hbase then Titan supports? Not sure if there is a work > >> around or should I switch to BerkeleyDB? > >> > > > > -- > > _____________________________________________________________ > > The information contained in this communication is intended solely for > the > > use of the individual or entity to whom it is addressed and others > > authorized to receive it. It may contain confidential or legally > privileged > > information. If you are not the intended recipient you are hereby > notified > > that any disclosure, copying, distribution or taking any action in > reliance > > on the contents of this information is strictly prohibited and may be > > unlawful. If you have received this communication in error, please notify > > us immediately by responding to this email and then delete it from your > > system. The firm is neither liable for the proper and complete > transmission > > of the information contained in this communication nor for any delay in > its > > receipt. >
