Ah, that's good to know. Yes, I see definitely the warning is helping
people to flush periodically and helping preventing data corruption.
Thanks for the feedback,
Francesc
On 6/10/13 5:16 PM, Edward Vogel wrote:
> I initially didn't sync at all until after completing writing - about
> 1 milli
I initially didn't sync at all until after completing writing - about 1
million rows total. My main concern was preventing data corruption. After
seeing the warning I had a sync for every iteration of the inner loop,
which was slow. Syncing after the inner loop is a little slower than not
syncing,
Hi Ed,
After fixing the issue, does performance has been enhanced? I'm the one
who put the warning, so I'm curious on whether this actually helps
people or not.
Thanks,
Francesc
On 6/10/13 3:28 PM, Edward Vogel wrote:
> Yes, exactly.
> I'm pulling data out of C that has a 1 to many relationsh
On Mon, Jun 10, 2013 at 2:28 PM, Edward Vogel wrote:
> Yes, exactly.
> I'm pulling data out of C that has a 1 to many relationship, and dumping
> it into pytables for easier analysis. I'm creating extension classes in
> cython to get access to the C structures.
> It looks like this (basically, eac
Yes, exactly.
I'm pulling data out of C that has a 1 to many relationship, and dumping it
into pytables for easier analysis. I'm creating extension classes in cython
to get access to the C structures.
It looks like this (basically, each cv1 has several cv2s):
h5.create_table('/', 'cv1', schema_cv1
Hi Ed,
Are you inside of a nested loop? You probably just need to flush after the
innermost loop.
Do you have some sample code you can share?
Be Well
Anthony
On Mon, Jun 10, 2013 at 1:44 PM, Edward Vogel wrote:
> I have a dataset that I want to split between two tables. But, when I
> iterate
I have a dataset that I want to split between two tables. But, when I
iterate over the data and append to both tables, I get a warning:
/usr/local/lib/python2.7/site-packages/tables/table.py:2967:
PerformanceWarning: table ``/cv2`` is being preempted from alive nodes
without its buffers being flus
