Re: [Dev] Visualizing room data with BAM
Hi Corey,Di, Would it be useful if we sync and discuss on how to use DAS for your project(s). Regards, Iranga On Wed, Jul 29, 2015 at 1:21 PM, Gihan Anuruddha gi...@wso2.com wrote: Mainly we changed the analytics engine(Hive/Hadoop to Spark) and introduced the plugable data layer. In BAM, we are bound to Cassandra as a primary persistent storage, but with DAS you can use RDBMS, HBase or Cassandra. Also, we introduced Lucene based indexing and much improved dashboard creation tools. Your existing event publishing will work OOB, so you don't need to do anything. If you have and hive script, then you need to convert those to Spark SQL based script. On Wed, Jul 29, 2015 at 12:32 PM, Corey Denault co...@wso2.com wrote: When I originially started the project it was recommended that I use BAM, however since then I've received several suggestions to use DAS instead. What exactly is the difference between the two frameworks? Would it be worth trying to transfer all of my work so far? -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- Thanks Regards Iranga Muthuthanthri (M) -0777-255773 Team Product Management ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
Mainly we changed the analytics engine(Hive/Hadoop to Spark) and introduced the plugable data layer. In BAM, we are bound to Cassandra as a primary persistent storage, but with DAS you can use RDBMS, HBase or Cassandra. Also, we introduced Lucene based indexing and much improved dashboard creation tools. Your existing event publishing will work OOB, so you don't need to do anything. If you have and hive script, then you need to convert those to Spark SQL based script. On Wed, Jul 29, 2015 at 12:32 PM, Corey Denault co...@wso2.com wrote: When I originially started the project it was recommended that I use BAM, however since then I've received several suggestions to use DAS instead. What exactly is the difference between the two frameworks? Would it be worth trying to transfer all of my work so far? -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
Hi Corey, this looks very much like the debs 2014 challenge, isn't it? [1] are you using BAM 2.5.0 or the upcoming DAS 3.0 for your work? rgds [1] http://dl.acm.org/citation.cfm?id=2611333 On Wed, Jul 29, 2015 at 12:06 PM, Corey Denault co...@wso2.com wrote: Hi, I'm currently working on pushing the following data set to bam. http://courses.media.mit.edu/2004fall/mas622j/04.projects/home/ My goal is to produce a web app that summarises the data based on frequency of activities, time spent on those activities, and usage of each sensor. Additionally, I would like to do some prediction of activities, such as at what time certain activities are likely to occur. So far I am working on pushing the data to Cassandra tables. Right now I am hung up on splitting up columns of string arrays into columns of single strings. I will continue to update this thread as my project progresses. Thanks, Corey Denault ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
Hi Corey, Is there any specific reason to use BAM? If it's not can you use DAS[1] for this? Current data publishing will work without any issue. You can find the documentation for DAS[2]. [1] - https://svn.wso2.org/repos/wso2/people/inosh/wso2das-3.0.0-BETA.zip [2] - https://docs.wso2.com/display/DAS300/Event+Streams Regards, Gihan On Wed, Jul 29, 2015 at 12:22 PM, Niranda Perera nira...@wso2.com wrote: Hi Corey, this looks very much like the debs 2014 challenge, isn't it? [1] are you using BAM 2.5.0 or the upcoming DAS 3.0 for your work? rgds [1] http://dl.acm.org/citation.cfm?id=2611333 On Wed, Jul 29, 2015 at 12:06 PM, Corey Denault co...@wso2.com wrote: Hi, I'm currently working on pushing the following data set to bam. http://courses.media.mit.edu/2004fall/mas622j/04.projects/home/ My goal is to produce a web app that summarises the data based on frequency of activities, time spent on those activities, and usage of each sensor. Additionally, I would like to do some prediction of activities, such as at what time certain activities are likely to occur. So far I am working on pushing the data to Cassandra tables. Right now I am hung up on splitting up columns of string arrays into columns of single strings. I will continue to update this thread as my project progresses. Thanks, Corey Denault ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- *Niranda Perera* Software Engineer, WSO2 Inc. Mobile: +94-71-554-8430 Twitter: @n1r44 https://twitter.com/N1R44 https://pythagoreanscript.wordpress.com/ ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev -- W.G. Gihan Anuruddha Senior Software Engineer | WSO2, Inc. M: +94772272595 ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
[Dev] Visualizing room data with BAM
Hi, I'm currently working on pushing the following data set to bam. http://courses.media.mit.edu/2004fall/mas622j/04.projects/home/ My goal is to produce a web app that summarises the data based on frequency of activities, time spent on those activities, and usage of each sensor. Additionally, I would like to do some prediction of activities, such as at what time certain activities are likely to occur. So far I am working on pushing the data to Cassandra tables. Right now I am hung up on splitting up columns of string arrays into columns of single strings. I will continue to update this thread as my project progresses. Thanks, Corey Denault ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
Re: [Dev] Visualizing room data with BAM
When I originially started the project it was recommended that I use BAM, however since then I've received several suggestions to use DAS instead. What exactly is the difference between the two frameworks? Would it be worth trying to transfer all of my work so far? ___ Dev mailing list Dev@wso2.org http://wso2.org/cgi-bin/mailman/listinfo/dev
