[julia-users] Parsing large XML files

[Brandon Booth]

I'm trying to parse a series of XML files and write selected values to an 
SQLite database. My code works on smaller files, but crashes when I get to 
anything above about 1 GB. 

I'm using Atom with the Hydrogen plugin on Julia 0.4.2.

Any suggestions on what is going wrong or alternative approaches?

Thanks.

Brandon


using LightXML


function iparse(file)  f = open(file)  n = countlines(f)  vals = 
Array(ASCIIString,n,3)  seekstart(f)  c = 1  while !eof(f)    try      st = 
parse_string(readline(f))      r = root(st)      l1 = 
get_elements_by_tagname(r, "firstlevel)

      l2 = find_element(l1[1], "secondlevel")

      vals[c,1] = content(find_element(l2, "thirdlevel1")

      vals[c,2] = content(find_element(l2, "thirdlevel2")

      vals[c,1] = content(find_element(l2, "thirdlevel3")      c += 1    catch  
    nothing    end  end  return vals  close(f)end