Re: [#131] Supporting Hadoop data and cluster management

2015-05-24 Thread Till Westmann
On 22 May 2015, at 3:26, Efi wrote: Thank you for the recursively tag check, Steven told me about it yesterday as well.I hadnt thought of it so far but I will think of ways to implement it for these methods so it does not create problems. My question was not exactly that, I was considering

Re: [#131]Supporting Hadoop data and cluster management

2015-05-22 Thread Efi
Thank you for the recursively tag check, Steven told me about it yesterday as well.I hadnt thought of it so far but I will think of ways to implement it for these methods so it does not create problems. My question was not exactly that, I was considering if the query engine could parse data

Re: [#131]Supporting Hadoop data and cluster management

2015-05-21 Thread Steven Jacobs
This seems correct to me. Since our objective in implementing HDFS is to deal with very large XML files, I think we should avoid any size limitations. Regarding the tags, does anyone have any thoughts on this? In the case of searching for all elements with a given name regardless of depth, this

Re: [#131]Supporting Hadoop data and cluster management

2015-05-21 Thread Till Westmann
(1) I agree that [1] looks better (thanks for the diagrams - we should add them to the docs!). (2) I think that it’s ok to have the restriction, that the given tag (a) identifies the root element of the elements that we want to work with and (b) is not used recursively (and I would

Re: [#131]Supporting Hadoop data and cluster management

2015-05-21 Thread Efi
Hello everyone, For this week the two different methods for reading complete items according to a specific tag are completed and tested in standalone hdfs deployment.In detail what each method does: The first method, I call it One Buffer Method, reads a block, saves it in a buffer, and

Re: [#131]Supporting Hadoop data and cluster management

2015-05-18 Thread Steven Jacobs
Great work! Steven On Sun, May 17, 2015 at 1:15 PM, Efi efika...@gmail.com wrote: Hello everyone, This is my update on what I have been doing this last week: Created an XMLInputFormat java class with the functionalities that Hamza described in the issue [1] .The class reads from blocks

Re: [#131]Supporting Hadoop data and cluster management

2015-05-18 Thread Michael Carey
+1 Sounds great! On 5/18/15 8:33 AM, Steven Jacobs wrote: Great work! Steven On Sun, May 17, 2015 at 1:15 PM, Efi efika...@gmail.com wrote: Hello everyone, This is my update on what I have been doing this last week: Created an XMLInputFormat java class with the functionalities that Hamza

[#131]Supporting Hadoop data and cluster management

2015-05-17 Thread Efi
Hello everyone, This is my update on what I have been doing this last week: Created an XMLInputFormat java class with the functionalities that Hamza described in the issue [1] .The class reads from blocks located in HDFS and returns complete items according to a specified xml tag. I also

[jira] [Issue Comment Deleted] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-04-28 Thread Hamza Zafar (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hamza Zafar updated VXQUERY-131: Comment: was deleted (was: Hey Efi, Congrats for getting selected! While I was researching this

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-04-28 Thread Steven Jacobs (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14517275#comment-14517275 ] Steven Jacobs commented on VXQUERY-131: --- One other thing to note is that every XML

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-04-22 Thread Efi Kaltirimidou (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507108#comment-14507108 ] Efi Kaltirimidou commented on VXQUERY-131: -- Thank you Steven for your

[jira] [Issue Comment Deleted] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-04-21 Thread Hamza Zafar (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hamza Zafar updated VXQUERY-131: Comment: was deleted (was: Dear Preston, My Background: I am Hamza Zafar, a final year undergrad

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-04-15 Thread Efi Kaltirimidou (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497346#comment-14497346 ] Efi Kaltirimidou commented on VXQUERY-131: -- Dear Preston, my name is Efi

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-20 Thread Till Westmann (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370862#comment-14370862 ] Till Westmann commented on VXQUERY-131: --- To subscribe to the mailing list you can

[jira] [Issue Comment Deleted] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-20 Thread Till Westmann (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Westmann updated VXQUERY-131: -- Comment: was deleted (was: Referring to your comment: Can we do a simple query on HDFS? (Start

[jira] [Issue Comment Deleted] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-20 Thread Till Westmann (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Westmann updated VXQUERY-131: -- Comment: was deleted (was: To subscribe to the mailing list you can either - click on the

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-19 Thread AASHEESH RANJAN (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369808#comment-14369808 ] AASHEESH RANJAN commented on VXQUERY-131: - sir presently i am working on this

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-18 Thread Hamza Zafar (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367290#comment-14367290 ] Hamza Zafar commented on VXQUERY-131: - Since HDFS supports blocks of fixed sizes

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-18 Thread Preston Carman (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14367609#comment-14367609 ] Preston Carman commented on VXQUERY-131: Check out this application template for

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-17 Thread AASHEESH RANJAN (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366264#comment-14366264 ] AASHEESH RANJAN commented on VXQUERY-131: - sir i am a 4th year cse student. sir i

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-14 Thread Till Westmann (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14361885#comment-14361885 ] Till Westmann commented on VXQUERY-131: --- Good questions :) 1. VXQuery currently is

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-09 Thread Preston Carman (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354032#comment-14354032 ] Preston Carman commented on VXQUERY-131:

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-09 Thread Preston Carman (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354036#comment-14354036 ] Preston Carman commented on VXQUERY-131: Python Scripts -

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-09 Thread Preston Carman (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14354054#comment-14354054 ] Preston Carman commented on VXQUERY-131: Look forward to see your proposal.

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-07 Thread Vinshul Arora (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351485#comment-14351485 ] Vinshul Arora commented on VXQUERY-131: --- Thanks Preston, That cleared a lot of

[jira] [Commented] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-03-07 Thread sagarsharma (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351489#comment-14351489 ] sagarsharma commented on VXQUERY-131: - Thanks Preston, that will help quite a lot ,

[jira] [Updated] (VXQUERY-131) Supporting Hadoop data and cluster management

2015-01-28 Thread Till Westmann (JIRA)
[ https://issues.apache.org/jira/browse/VXQUERY-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Westmann updated VXQUERY-131: -- Issue Type: Improvement (was: Test) Supporting Hadoop data and cluster management