Good stab, yes maybe. Read R docu again and maybe it could be a weak reference instead. Since not sure what needs to be cleaned up in the finalizer, or how; the pointer points back to the data.table it's an attribute of. Will try changing to weak to see if it helps as a first step.
I was rather hoping, though, that someone could work out what the users are doing in these reports, why they're churning through memory and if they're using data.table efficiently/correctly. The examples seem to be iterating and taking a long time (hours) which doesn't sit well. If there is a leak then it needs to be fixed of course, but maybe there's a simpler way to code it. Matthew > Hi, > > A (short) stab at the dark: > > I know you do some fancy mojo in C land (over allocate and some self > ref stuff) -- I wonder if you need to explicitly delete the extra > stuff via some RegisterCFinalizer cleanup-voodoo in C land as well, > which is triggered when the R object is `rm`d. > > Maybe? > -steve > > On Tue, Sep 25, 2012 at 11:52 AM, Matthew Dowle <[email protected]> > wrote: >> >> Dear datatablers, >> >> We have 2 similar independently reported bug reports : >> >> https://r-forge.r-project.org/tracker/index.php?func=detail&aid=2191&group_id=240&atid=975 >> >> https://r-forge.r-project.org/tracker/index.php?func=detail&aid=2284&group_id=240&atid=975 >> >> I've already spent quite a bit of time on the first one (see history on >> #2191) but couldn't get to the crux of it. For me, I could see memory >> slowly growing, but not fast enough to cause a problem on my machine. >> The >> second one is newly reported. >> >> Has anyone else seen this? >> Can anyone else reproduce? >> Does anyone have an inkling what it might be? >> >> I haven't tried the second one yet (#2284). Thought I'd ask onlist >> first. >> >> Thanks! >> Matthew >> >> >> >> _______________________________________________ >> datatable-help mailing list >> [email protected] >> https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help > > > > -- > Steve Lianoglou > Graduate Student: Computational Systems Biology > | Memorial Sloan-Kettering Cancer Center > | Weill Medical College of Cornell University > Contact Info: http://cbio.mskcc.org/~lianos/contact > _______________________________________________ datatable-help mailing list [email protected] https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help
