It sounds like there's something causing significantly more cardinality than expected, which is causing the OS to kill the process with an out of memory error before it finishes loading tag index.
>From what you've described, it looks like schema 2 is a more appropriate schema. How are you translating that schema into line protocol? Also, is the "1221036842" in the sensor ID a timestamp that changes when each point is reported? On Wed, Jul 20, 2016 at 2:00 PM, <[email protected]> wrote: > I have 70,000 sensors that report one point every day. I'm using influxDB > 0.13 on a linux VM with 20GB or RAM. The second I startup my database, it > consumes 100% of system memory and then dies silently. > > Here are the schema's I've tried: > > Schema 1: > > Series: <SENSOR ID> > > Measurement: <SENSOR ID> > Fields: [reading] > > --> Result: OOM > > > Schema 2: > > Series: sensorReadings > > Measurement: sensorReadings > Fields: [reading] > > Tags: [<SENSOR ID>] > > --> Result: OOM > > > > Again: > > ~70,000 distinct sensors > > ~1440 distinct points > > >20GB memory consumption > > > > here's an example SENSOR ID: > "uid:bla.blaaa.blaa-bla:jazz.funtime:1221036842" > > > > Is there something I missed? Why would influx consume >20GB for an 8GB > database? Why nothing in the logs before it dies? > > > -- > Remember to include the InfluxDB version number with all issue reports > --- > You received this message because you are subscribed to the Google Groups > "InfluxDB" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at https://groups.google.com/group/influxdb. > To view this discussion on the web visit > https://groups.google.com/d/msgid/influxdb/e98c991e-af9b-4683-9e2c-1e9785ddbf76%40googlegroups.com > <https://groups.google.com/d/msgid/influxdb/e98c991e-af9b-4683-9e2c-1e9785ddbf76%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- Gunnar Aasen InfluxDB -- Remember to include the InfluxDB version number with all issue reports --- You received this message because you are subscribed to the Google Groups "InfluxDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/influxdb. To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/CAJZX7zMSAyrHTuSstQEpmVS9SRW8AoA6-VjjKYJND1ipdGXbtg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
