Hi Roshan, This happens when you have a malformed HA cluster. When you put the master count as 2, the spark cluster would not get initiated until there are 2 members in the analytics cluster. when the count as 2 and there is a task scheduled already, you may come across this issue, until the 2nd node is up and running. You should see that after sometime, the exception gets resolved., and that is when the analytics cluster is at a workable state.
But I agree, an NPE is not acceptable here and this has been already fixed in 3.0.1 [1] as per the query modification, yes, the query gets modified to handle multi tenancy in the spark runtime. hope this resolves your issues. rgds [1] https://wso2.org/jira/browse/DAS-329 On Fri, Dec 11, 2015 at 11:40 AM, Roshan Wijesena <[email protected]> wrote: > I reproduced the error. If we set carbon.spark.master.count value to 2 > this error will occur. Any solution available in this case? > > > On Thu, Dec 10, 2015 at 9:05 PM, Roshan Wijesena <[email protected]> wrote: > >> After I enabled the debug, it looks like below >> >> [2015-12-10 22:03:00,001] INFO >> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the >> schedule task for: httpd_log_analytics for tenant id: -1234 >> [2015-12-10 22:03:00,013] DEBUG >> {org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor} - >> Executing : CREATE TEMPORARY TABLE X1234_HttpLogTable USING >> org.wso2.carbon.analytics.spark.core.sources.AnalyticsRelationProvider >> OPTIONS (tableName "ORG_WSO2_SAMPLE_HTTPD_LOGS" , tenantId "-1234") >> [2015-12-10 22:03:00,013] ERROR >> {org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter} - Error in >> executing task: null >> java.lang.NullPointerException >> at >> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQueryLocal(SparkAnalyticsExecutor.java:710) >> at >> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQuery(SparkAnalyticsExecutor.java:692) >> at >> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeQuery(CarbonAnalyticsProcessorService.java:199) >> at >> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeScript(CarbonAnalyticsProcessorService.java:149) >> at >> org.wso2.carbon.analytics.spark.core.AnalyticsTask.execute(AnalyticsTask.java:57) >> at >> org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter.execute(TaskQuartzJobAdapter.java:67) >> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >> at >> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >> at >> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >> at java.lang.Thread.run(Thread.java:745) >> >> does that query got modified? >> >> CREATE TEMPORARY TABLE X1234_HttpLogTable USING >> org.wso2.carbon.analytics.spark.core.sources.AnalyticsRelationProvider >> OPTIONS (tableName "ORG_WSO2_SAMPLE_HTTPD_LOGS" , tenantId "-1234") >> >> >> >> >> >> >> On Thu, Dec 10, 2015 at 6:53 PM, Roshan Wijesena <[email protected]> wrote: >> >>> Hi DAS teaam, >>> >>> I am getting below null pointer exception while trying to execute a >>> scheduled task. What I simply did was created a two node HA cluster and >>> tried to run this example[1]. It has a scheduled task. However, this error >>> can not be observed in a single node fresh pack. >>> >>> The error is, >>> >>> [2015-12-10 19:32:00,573] INFO >>> {org.wso2.carbon.analytics.spark.core.AnalyticsTask} - Executing the >>> schedule task for: httpd_log_analytics for tenant id: -1234 >>> [2015-12-10 19:32:21,899] INFO >>> {org.wso2.carbon.event.processor.manager.core.internal.CarbonEventManagementService} >>> - Starting polling event receivers >>> [2015-12-10 19:32:32,096] ERROR >>> {org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter} - Error in >>> executing task: null >>> java.lang.NullPointerException >>> at >>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQueryLocal(SparkAnalyticsExecutor.java:710) >>> at >>> org.wso2.carbon.analytics.spark.core.internal.SparkAnalyticsExecutor.executeQuery(SparkAnalyticsExecutor.java:692) >>> at >>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeQuery(CarbonAnalyticsProcessorService.java:199) >>> at >>> org.wso2.carbon.analytics.spark.core.CarbonAnalyticsProcessorService.executeScript(CarbonAnalyticsProcessorService.java:149) >>> at >>> org.wso2.carbon.analytics.spark.core.AnalyticsTask.execute(AnalyticsTask.java:57) >>> at >>> org.wso2.carbon.ntask.core.impl.TaskQuartzJobAdapter.execute(TaskQuartzJobAdapter.java:67) >>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>> at >>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) >>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) >>> at >>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) >>> at >>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) >>> at java.lang.Thread.run(Thread.java:745) >>> >>> >>> [1] https://docs.wso2.com/display/DAS300/Analyzing+HTTPD+Logs >>> >>> -- >>> Roshan Wijesena. >>> Senior Software Engineer-WSO2 Inc. >>> Mobile: *+94719154640 <%2B94719154640>* >>> Email: [email protected] >>> *WSO2, Inc. :** wso2.com <http://wso2.com/>* >>> lean.enterprise.middleware. >>> >> >> >> >> -- >> Roshan Wijesena. >> Senior Software Engineer-WSO2 Inc. >> Mobile: *+94719154640 <%2B94719154640>* >> Email: [email protected] >> *WSO2, Inc. :** wso2.com <http://wso2.com/>* >> lean.enterprise.middleware. >> > > > > -- > Roshan Wijesena. > Senior Software Engineer-WSO2 Inc. > Mobile: *+94719154640 <%2B94719154640>* > Email: [email protected] > *WSO2, Inc. :** wso2.com <http://wso2.com/>* > lean.enterprise.middleware. > -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 <https://twitter.com/N1R44> https://pythagoreanscript.wordpress.com/
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
