Hi Preston, My username is menaka123
On 25 June 2016 at 00:29, Preston Carman <[email protected]> wrote: > We can give him access. I just need to know his username. > > On Fri, Jun 24, 2016 at 11:31 AM, Steven Jacobs <[email protected]> wrote: > > Is it possible to give Menaka edit access for that page? I think this > would > > be helpful throughout the summer. Or would he need to be a committee? > > Steven > > > > On Friday, June 24, 2016, Menaka Madushanka <[email protected]> > wrote: > > > >> Thank you very much Preston. :-) > >> > >> I can do that. > >> > >> On 24 June 2016 at 21:24, Preston Carman <[email protected] > >> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >> > >>> What do you think about adding your description of the update process > >>> to the wiki [1]? We can use this as the start of documenting the > >>> indexing functionality. You have written a nice description and it > >>> would be nice to have the in a place that others can see it to learn > >>> about our indexing process. > >>> > >>> [1] > >>> > https://cwiki.apache.org/confluence/display/VXQUERY/Lucene+Indexing+Project+2016 > >>> > >>> On Thu, Jun 23, 2016 at 3:39 PM, Menaka Madushanka > >>> <[email protected] > >>> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >>> > Hello, > >>> > > >>> > I modified the implementation to use only one argument for update > index > >>> > query. > >>> > > >>> > So the new query structure would be, > >>> > > >>> > *update-index(index_folder)* > >>> > > >>> > Collection information is stored when creating the index for the > first > >>> time > >>> > in build-index-on-collection query and stored as metadata. > >>> > > >>> > Thank you very much > >>> > Menaka > >>> > > >>> > On 24 June 2016 at 03:42, Menaka Madushanka <[email protected] > >>> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >>> > > >>> >> Hello Steven, > >>> >> > >>> >> Almost done. :-) > >>> >> > >>> >> On 24 June 2016 at 03:16, Steven Jacobs <[email protected] > >>> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >>> >> > >>> >>> Auto-correct is always changing your name when I don't pay > attention, > >>> I > >>> >>> apologize Menaka. > >>> >>> Steven > >>> >>> > >>> >>> On Thu, Jun 23, 2016 at 2:45 PM, Steven Jacobs <[email protected] > >>> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >>> >>> > >>> >>>> Melaka- One high level comment. I think it will be better to have > >>> >>>> update-index take a single argument as we discussed (just the > index > >>> >>>> folder). The collection location can be saved as part of the > metadata > >>> >>>> information in the collection folder. > >>> >>>> Steven > >>> >>>> > >>> >>>> On Wed, Jun 22, 2016 at 2:04 PM, Menaka Madushanka < > >>> >>>> [email protected] > >>> <javascript:_e(%7B%7D,'cvml','[email protected]');>> wrote: > >>> >>>> > >>> >>>>> Hello, > >>> >>>>> > >>> >>>>> This is the summary of the implementation. (Included in Pull > Request > >>> >>>>> message as well) > >>> >>>>> > >>> >>>>> *Update Index Query* > >>> >>>>> The update-index query takes two arguments, collection directory > and > >>> >>>>> index directory. > >>> >>>>> It shares some of the functionalities from > build-index-on-collection > >>> >>>>> query so, some changes were done to the following classes in > order > >>> to use > >>> >>>>> them in updating index process and to maximize code reuse > >>> >>>>> > >>> >>>>> > >>> >>>>> 1. IndexConstructorUtil.java : Created a new function to get > an > >>> >>>>> instance of IndexDocumentBuilder which can be used in > >>> IndexUpdater.java > >>> >>>>> class. > >>> >>>>> 2. IndexDocumentBuilder.java : Added a new string filed > >>> containing > >>> >>>>> the corresponding file path which is needed to retrieve a > >>> document related > >>> >>>>> to an XML file. > >>> >>>>> > >>> >>>>> > >>> >>>>> *Metadata handling* > >>> >>>>> Here a POJO is created to properly manage the metadata for a > file. > >>> >>>>> (XmlMetadata.java) > >>> >>>>> Currently it contains following fields. > >>> >>>>> > >>> >>>>> > >>> >>>>> 1. File path > >>> >>>>> 2. File Name (Not used) > >>> >>>>> 3. Checksum String > >>> >>>>> > >>> >>>>> When storing metadata, a HashMap is created with file path as the > >>> key > >>> >>>>> and XmlMetadata object. This map is then serialized and written > to > >>> a file > >>> >>>>> named metadata.file and stored in the same directory where the > >>> index is > >>> >>>>> stored. > >>> >>>>> > >>> >>>>> *Update Index process* > >>> >>>>> > >>> >>>>> - If a file is detected as modified, the current index > document > >>> >>>>> related to that file is deleted and newly created index > document > >>> is added. > >>> >>>>> - If a new file is detected, a new index document will be > created > >>> >>>>> and added to the existing index. > >>> >>>>> - If the file is deleted, delete the index document related to > >>> that > >>> >>>>> file. > >>> >>>>> - After every task, update the metadata object and after all > >>> >>>>> processes completed, write the new metadata map to the file. > >>> >>>>> > >>> >>>>> Please review the pull request and merge. > >>> >>>>> > >>> >>>>> https://github.com/apache/vxquery/pull/62 > >>> >>>>> > >>> >>>>> Thank you > >>> >>>>> Menaka > >>> >>>>> > >>> >>>>> > >>> >>>>> -- > >>> >>>>> *Menaka Madushanka Jayawardena* > >>> >>>>> Faculty of Engineering, <http://www.pdn.ac.lk/eng> > >>> >>>>> University of Peradeniyaya. > >>> >>>>> LinkedIn <http://lk.linkedin.com/in/menakajayawardena> > >>> >>>>> TP:- 071 885 1183/ 071 350 5470 > >>> >>>>> > >>> >>>> > >>> >>>> > >>> >>> > >>> >> > >>> >> > >>> >> -- > >>> >> *Menaka Madushanka Jayawardena* > >>> >> Faculty of Engineering, <http://www.pdn.ac.lk/eng> > >>> >> University of Peradeniyaya. > >>> >> LinkedIn <http://lk.linkedin.com/in/menakajayawardena> > >>> >> TP:- 071 885 1183/ 071 350 5470 > >>> >> > >>> > > >>> > > >>> > > >>> > -- > >>> > *Menaka Madushanka Jayawardena* > >>> > Faculty of Engineering, <http://www.pdn.ac.lk/eng> > >>> > University of Peradeniyaya. > >>> > LinkedIn <http://lk.linkedin.com/in/menakajayawardena> > >>> > TP:- 071 885 1183/ 071 350 5470 > >>> > >> > >> > >> > >> -- > >> *Menaka Madushanka Jayawardena* > >> Faculty of Engineering, <http://www.pdn.ac.lk/eng> > >> University of Peradeniyaya. > >> LinkedIn <http://lk.linkedin.com/in/menakajayawardena> > >> TP:- 071 885 1183/ 071 350 5470 > >> > -- *Menaka Madushanka Jayawardena* Faculty of Engineering, <http://www.pdn.ac.lk/eng> University of Peradeniyaya. LinkedIn <http://lk.linkedin.com/in/menakajayawardena> TP:- 071 885 1183/ 071 350 5470
