[
https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350237#comment-14350237
]
Vinshul Arora commented on VXQUERY-131:
---------------------------------------
Hi Preston, I am Vinshul. I am in final year of my bachelor studies in ECE. I
have worked on hadoop during my Internship. My project was based on programming
a parallel version of machine learning algorithm to be deployed on hadoop. So I
have basic knowledge about parallel programming and data handling on parallel
architectures. I am proficient in python and C++. I want to explore this Idea
to know whether i will able to work on it or not.
So can you give me any directions to move..
Like what exactly is required as a output from this Idea?
Is it only reading XML Data and all the strategy surrounding it??
> Supporting Hadoop data and cluster management
> ---------------------------------------------
>
> Key: VXQUERY-131
> URL: https://issues.apache.org/jira/browse/VXQUERY-131
> Project: VXQuery
> Issue Type: Improvement
> Reporter: Preston Carman
> Assignee: Preston Carman
> Labels: gsoc, gsoc2015, hadoop, java, mentor, xml
>
> Many organizations support Hadoop. It would be nice to be able to read data
> from this source. The project will include creating a strategy (with the
> mentor's guidance) for reading XML data from HDFS and implementing it. When
> connecting VXQuery to HDFS, the strategy may need to consider how to read
> sections of an XML file.
> In addition, we could use Yarn as our cluster manager. The Apache Hadoop YARN
> (Yet Another Resource Negotiator) would be a good cluster management tool for
> VXQuery. If VXQuery can read data from HDFS, then why not also manage the
> cluster with a tool provided by Hadoop. The solution would replace the
> current custom python scripts for cluster management.
> Goal
> - Read XML from HDFS
> - Manage the VXQuery cluster with Yarn
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
