Hi Andreas, The issue should not be connected at all to plugin_pipe_size and plugin_buffer_size sizes - did you find a link between the issue and these config directives somewhere in the archives?
This may be more connected to sql_cache_entries (although you seem to have it configured already large enough). You did not show the 'aggregate' line of your config - can you please post it? A way to troubleshoot (or tackle) the issue is to add an id field to the SQL table structure like described here: http://wiki.pmacct.net/CustomizingTheSqlIndexes This will prevent the current error message and, summarizing data without the id field should make evident what behaviour duplicate entries are following, ie. whether a specific field is responsible for this. Cheers, Paolo On Sat, Nov 14, 2015 at 04:10:39PM +0100, Andreas Nitsche wrote: > Hi, > > I've already found some discussions about the duplicate entry problem > and tried to adjust plugin_pipe_size (5 GB) and plugin_buffer_size (50 MB). > > Nov 14 14:35:19 ERROR ( default/mysql ): Duplicate entry > '0----0-0-0-212.224.83.112-212.224.83.74-54644-4949-tcp-0-2015-11' for > key 'PRIMARY' > > This is the main part of my pmacctd.conf configuration: > > ... > ! > ! MEMORY CONFIG > ! > imt_path: /tmp/pmacct.pipe.eth0 > ! echo 5*1024*1024*1024 | bc -l (5 GB) > plugin_pipe_size: 5368709120 > ! echo 50*1024*1024 | bc -l (50 MB) > plugin_buffer_size: 52428800 > > !plugins: mysql > ... > sql_table_version: 7 > ... > sql_dont_try_update: true > sql_optimize_clauses: true > sql_refresh_time: 60 > sql_history: 1m > sql_history_roundoff: m > sql_cache_entries: 10000000 > ... > > I'm writing the data in monthly divided tables where a table is from 3.6 > to 7.4 GiB large. > > Could you give me some hints to get rid of this error? What are the > largest values I should try? Is there any possibility to check the size > of the memory table while pmacctd is running? > > thanks in advance > Andi > > _______________________________________________ > pmacct-discussion mailing list > http://www.pmacct.net/#mailinglists _______________________________________________ pmacct-discussion mailing list http://www.pmacct.net/#mailinglists
