Hi there! 

I'm trying to do a one-time index of about 800,000 records into an instance 
of elasticsearch. But I'm having a bit of trouble. It continually fails 
around 200,000 records. Looking at in the Elasticsearch Head Plugin, my 
index goes offline and becomes unrecoverable. 

For now, I have it running on a VM on my personal machine. 

VM Config: 
Ubuntu Server 14.04 64-Bit
8 GB RAM
2 Processors
32 GB SSD

Java
java version "1.7.0_65"
OpenJDK Runtime Environment (IcedTea 2.5.1) (7u65-2.5.1-4ubuntu1~0.14.04.2)
OpenJDK 64-Bit Server VM (build 24.65-b04, mixed mode)

Elasticsearch is using mostly the defaults. This is the output of: 
curl http://localhost:9200/_nodes/process?pretty
{
  "cluster_name" : "property_transaction_data",
  "nodes" : {
    "KlFkO_qgSOKmV_jjj5xeVw" : {
      "name" : "Marvin Flumm",
      "transport_address" : "inet[/192.168.133.131:9300]",
      "host" : "ubuntu-es",
      "ip" : "127.0.1.1",
      "version" : "1.3.2",
      "build" : "dee175d",
      "http_address" : "inet[/192.168.133.131:9200]",
      "process" : {
        "refresh_interval_in_millis" : 1000,
        "id" : 1092,
        "max_file_descriptors" : 65535,
        "mlockall" : true
      }
    }
  }
}

I adjusted ES_HEAP_SIZE to 512mb. 

I'm using the following code to pull data from SQL Server and index it. 

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/f94f96d4-8c3f-462f-bdcf-df717cbc6269%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to