I set max_gram=20. It's better but at the end I have this many times :
[2014-06-20 11:42:14,201][WARN ][monitor.jvm ] [ik-test2]
[gc][young][528][263] duration [2s], collections [1]/[2.1s], total
[2s]/[43.9s], memory [536mb]->[580.2mb]/[1015.6mb], all_pools {[young]
[22.5mb]->[22.3mb]/[66.5mb]}{[survivor] [14.9kb]->[49.3kb]/[8.3mb]}{[old]
[513.4mb]->[557.8mb]/[940.8mb]}
I put ES_HEAP_SIZE : 2G. I think it's enough.
Something wrong ?
Le jeudi 19 juin 2014 17:57:46 UTC+2, Tanguy Bernard a écrit :
>
> Hello
> I have some issue, when I index a particular data "note_source" (sql
> longtext).
> I use the same analyzer for each fields (except date_source and id_source)
> but for "note_source", I have a "warn monitor.jvm".
> When I remove "note_source", everything fine. If I don't use analyzer on
> "note_source", everything fine, but if I use my analyzer on "note_source" I
> have some crash.
>
> I think I have enough memory, I have used ES_HEAP_SIZE.
> Maybe my problem it's with accent (ascii, utf-8)
>
> Can you help me with this ?
>
>
>
> *My Setting*
>
> public function createSetting($pf){
> $params = array('index' => $pf, 'body' => array(
> 'settings' => array(
> 'number_of_shards' => 5,
> 'number_of_replicas' => 0,
> 'analysis' => array(
> 'filter' => array(
> 'nGram' => array(
> "token_chars" =>array(),
> "type" => "nGram",
> "min_gram" => 3,
> "max_gram" => 250
> )
> ),
> 'analyzer' => array(
> 'reuters' => array(
> 'type' => 'custom',
> 'tokenizer' => 'standard',
> 'filter' => array('lowercase', 'asciifolding',
> 'nGram')
> )
> )
> )
> )
> ));
> $this->elasticsearchClient->indices()->create($params);
> return;
> }
>
>
> *My Indexing*
>
> public function indexTable($pf,$typeElement){
>
> $params =array(
> "index" =>'_river',
> "type" => $typeElement,
> "id" => "_meta",
> "body" =>array(
>
> "type" => "jdbc",
> "jdbc" => array(
> "url" => "jdbc:mysql://ip/name",
> "user" => 'root',
> "password" => 'mdp',
> "index" => $pf,
> "type" => $typeElement,
> "sql" => select id_source as _id, id_sous_theme,
> titre_source, desc_source, note_source, adresse_source, type_source,
> date_source from source,
> "max_bulk_requests" => 5,
> )
> )
>
> );
>
>
> $this->elasticsearchClient->index($params);
> }
>
> Thanks in advance.
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/154b8ca2-a130-4062-b5ce-0e0fa63d98fe%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
