Hi, Greg,
Thanks for the information. Looks like we might have neglected to
close some index files or somehow mishandled some index files. There
is only easy thing for us to check, this is related to the handling of
categorical values (the columns of type ibis::CATEGORY). Would you
mind tell us if my_primary_key is an integer column or a CATEGORY column?
If it is not a CATEGORY, then we might have something a little bit
more complex. We would appreciate a small test case to replicate the
problem.
John
On 8/10/12 5:32 PM, Greg Barker wrote:
> Hello -
>
> I am attempting to append some new data to some existing data, and ran
> into some trouble. When loading, I join the new data to the existing
> data on a particular column, and then deactivate & purgeInactive on
> the matching records. Then when I try to append the new data to the
> existing data, I hit a seg fault using rev 536. If I
> call purgeIndexFiles before the append, it seems to avoid the crash,
> but I wasn't sure if that was recommended?
>
> My code is essentially:
>
> ibis::part existing_part("my_data");
> ibis::part incoming_part("new_data");
> std::auto_ptr<ibis::quaere>
> join(ibis::quaere::create(&existing_part, &incoming_part,
> "my_primary_key"));
> std::auto_ptr<ibis::table> rs(join->select("my_primary_key"));
> //then build the where clause
> working_part.deactivate("my_primary_key in (3, 4, 5)");
> working_part.purgeInactive();
> working_part.append(incoming_data);
>
>
> Which yields the following:
>
> part[my_data]::deactivate marked 9 rows as inactive, leaving 10
> active rows out of 19
> part[my_data]::purgeInactive to remove 9 out of 19 rows
> Warning -- fileManager::flushDir can not remove in-memory file
> (my_data/my_primary_key.idx). It is in use
> Warning -- fileManager::flushDir(my_data) finished with 1 file
> still in memory
> Constructed a part named my_data
> filter::sift1S -- processing data partition my_data
> Segmentation fault (core dumped)
>
> Many Thanks,
> Greg
_______________________________________________
FastBit-users mailing list
[email protected]
https://hpcrdm.lbl.gov/cgi-bin/mailman/listinfo/fastbit-users
