[datatable-help] Memory leak bug reports

[Matthew Dowle]

Good stab, yes maybe. Read R docu again and maybe it could be a weak
reference instead. Since not sure what needs to be cleaned up in the
finalizer, or how; the pointer points back to the data.table it's an
attribute of. Will try changing to weak to see if it helps as a first
step.

I was rather hoping, though, that someone could work out what the users
are doing in these reports, why they're churning through memory and if
they're using data.table efficiently/correctly. The examples seem to be
iterating and taking a long time (hours) which doesn't sit well. If there
is a leak then it needs to be fixed of course, but maybe there's a simpler
way to code it.

Matthew

> Hi,
>
> A (short) stab at the dark:
>
> I know you do some fancy mojo in C land (over allocate and some self
> ref stuff) -- I wonder if you need to explicitly delete the extra
> stuff via some RegisterCFinalizer cleanup-voodoo in C land as well,
> which is triggered when the R object is `rm`d.
>
> Maybe?
> -steve
>
> On Tue, Sep 25, 2012 at 11:52 AM, Matthew Dowle <mdowle at mdowle.plus.com>
> wrote:
>>
>> Dear datatablers,
>>
>> We have 2 similar independently reported bug reports :
>>
>> https://r-forge.r-project.org/tracker/index.php?func=detail&aid=2191&group_id=240&atid=975
>>
>> https://r-forge.r-project.org/tracker/index.php?func=detail&aid=2284&group_id=240&atid=975
>>
>> I've already spent quite a bit of time on the first one (see history on
>> #2191) but couldn't get to the crux of it. For me, I could see memory
>> slowly growing, but not fast enough to cause a problem on my machine.
>> The
>> second one is newly reported.
>>
>> Has anyone else seen this?
>> Can anyone else reproduce?
>> Does anyone have an inkling what it might be?
>>
>> I haven't tried the second one yet (#2284). Thought I'd ask onlist
>> first.
>>
>> Thanks!
>> Matthew
>>
>>
>>
>> _______________________________________________
>> datatable-help mailing list
>> datatable-help at lists.r-forge.r-project.org
>> https://lists.r-forge.r-project.org/cgi-bin/mailman/listinfo/datatable-help
>
>
>
> --
> Steve Lianoglou
> Graduate Student: Computational Systems Biology
>  | Memorial Sloan-Kettering Cancer Center
>  | Weill Medical College of Cornell University
> Contact Info: http://cbio.mskcc.org/~lianos/contact
>