Re: [GENERAL] Find similar records (compare tsvectors)

2015-03-06 Thread Oleg Bartunov
On Fri, Mar 6, 2015 at 5:05 PM, Patrick Dung wrote: > Resend. > > How to quickly compare the similarity of two tsvector? > check http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf > > On Monday, March 2, 2015 11:01 PM, Patrick Dung > wrote: > > > Hello, > > I had a database with artic

Re: [GENERAL] Grouping By Similarity (using pg_trgm)?

2015-05-22 Thread Oleg Bartunov
Have you seen http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf ? On Thu, May 14, 2015 at 9:58 PM, Cory Tucker wrote: > [pg version 9.3 or 9.4] > > Suppose I have a simple table: > > create table data ( > my_value TEXT NOT NULL > ); > CREATE INDEX idx_my_value ON data USING gin(my_v

Re: [GENERAL] [tsvector] to_tsvector called multiple times

2015-05-26 Thread Oleg Bartunov
You can ask http://snowball.tartarus.org/ for stemmer. Meanwhile, you can have small personal dictionary (before stemmer) with such exceptions, for example, use synonym template system system Oleg On Tue, May 26, 2015 at 11:18 AM, Sven R. Kunze wrote: > Hi everybody, > > the following stemmin

Re: [GENERAL] [to_tsvector] German Compound Words

2015-05-28 Thread Oleg Bartunov
ts_debug() ? =# select * from ts_debug('english', 'messages'); alias | description | token | dictionaries | dictionary | lexemes ---+-+--++--+-- asciiword | Word, all ASCII | messages | {english_stem} | english_st

Re: [GENERAL] How to speed up pg_trgm / gin index scan

2015-06-22 Thread Oleg Bartunov
Try 9.4 and you'll surprise. 1. GIN has compression 2. GIN has fast scan feature. Oleg On Mon, Jun 22, 2015 at 7:51 AM, Christian Ramseyer wrote: > Hi > > I have a pretty large table with syslog messages. > > It is already partitioned by month, and for a single month I have e.g. > > > DM=# \d+

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 10:04 PM, Karsten Hilbert wrote: >>> I submitted slides to pgcon site, but it usually takes awhile, so you can >>> download our presentation directly >>> http://www.sai.msu.su/~megera/postgres/talks/pgcon-2016-fts.pdf > > Looking at slide 39 (attached) I get the impression

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:59 AM, Oleg Bartunov wrote: > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: > >> Hi. >> >> Any news about when slides for $subject will be available? >> > > I submitted slides to pgcon site, but it us

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-31 Thread Oleg Bartunov
On Sun, May 29, 2016 at 8:53 PM, Andreas Joseph Krogh wrote: > På søndag 29. mai 2016 kl. 19:49:06, skrev Oleg Bartunov < > obartu...@gmail.com>: > > [snip] >> >> I want to run 9.6 beta in production right now because of this:-) >> > > wait-wait :) We&#

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 9:32 AM, Andreas Joseph Krogh wrote: > På torsdag 16. juni 2016 kl. 00:50:45, skrev Jeff Janes < > jeff.ja...@gmail.com>: > > On Wed, Jun 15, 2016 at 3:56 AM, Andreas Joseph Krogh > wrote: >> >> Hi. >> >> First; Is this the correct forum to ask questions about the Postgre

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov wrote: > > > On Fri, Jun 17, 2016 at 9:32 AM, Andreas Joseph Krogh > wrote: > >> På torsdag 16. juni 2016 kl. 00:50:45, skrev Jeff Janes < >> jeff.ja...@gmail.com>: >> >> On Wed, Jun 15, 2016 at 3:56 A

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 13:53:34, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov > wrote: >> >> >> >> On Fri, Jun

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 4:50 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 15:47:08, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh > wrote: >> >> På fredag 17. juni 2016 kl. 13

Re: [GENERAL] Updated RUM?

2016-06-27 Thread Oleg Bartunov
On Fri, Jun 24, 2016 at 2:36 PM, Andreas Joseph Krogh wrote: > Hi. > > @PostgresPro; Will there be any updates to the rum git-repo any time soon? > Sure. > > I understand you're working hard on this, care to share some > vision/roadmap? I'm specifically interested in if RUM will support the sa

Re: [GENERAL] questions about how to implement a gist index

2016-06-27 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 12:44 AM, Riccardo Vianello wrote: > Hi all, > > I'm trying to contribute some improvements to the implementation of a gist > index that is part of an open source project and it would be really nice if > anyone could help me answer some questions. > > I would like to use di

Re: [GENERAL] jsonb search

2016-06-28 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 5:15 PM, Armand Pirvu (home) wrote: > Hi > > In my quest of JSONB querying and searching without having to actually cast > into a text, I found JSQuery > > I do admit my JSONB knowledge shortcoming and I am not a developer but a > DBA. As such some examples would be greatly

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-06 Thread Oleg Bartunov
On Tue, Aug 2, 2016 at 9:08 PM, Andreas Joseph Krogh wrote: > Hi. > > I see the RUM-index is updated, which is great! > > I wonder, to be able to sort by timestamp one has to create the index like > this: > > > CREATE INDEX rumidx ON origo_email_delivery USING rum (fts_all > rum_tsvector_timesta

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-25 Thread Oleg Bartunov
Andreas, sorry for delay, it looks like a bug to me, could you please, share your dataset with me, so I could reproduce the behaviour. Regards, Oleg On Sun, Aug 7, 2016 at 11:05 AM, Andreas Joseph Krogh wrote: > På søndag 07. august 2016 kl. 08:27:06, skrev Oleg Bartunov < &g

[GENERAL] Fwd: [Snowball-discuss] Greek stemmer

2016-08-25 Thread Oleg Bartunov
This is a chance to add default configuration for Greek language if somebody with good knowledge could follow this development. Oleg -- Forwarded message -- From: Oleg Smirnov Date: Thu, Aug 25, 2016 at 5:26 PM Subject: [Snowball-discuss] Greek stemmer To: "snowball-discu." Hi

Re: [GENERAL] Predicting query runtime

2016-09-13 Thread Oleg Bartunov
On Tue, Sep 13, 2016 at 2:54 PM, Istvan Soos wrote: > On Tue, Sep 13, 2016 at 2:06 AM, Vinicius Segalin > wrote: >> 2016-09-12 18:22 GMT-03:00 Istvan Soos : >>> At Heap we have non-trivial complexity in our analytical queries, and >>> some of them can take a long time to complete. We did analyze

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: > Dear All, > > I have a ts_vector column in question table called weighted_tsv. > I am trying to search using ts_query as follows > > SELECT * > > FROM question > > WHERE weighted_tsv @@ to_tsquery('Hur ofta'); you should use to_tsquery('Hur & ofta')

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 4:19 AM, Oleg Bartunov wrote: > On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: >> Dear All, >> >> I have a ts_vector column in question table called weighted_tsv. >> I am trying to search using ts_query as follows >> >> SELECT * >&

Re: [GENERAL] ZSON, PostgreSQL extension for compressing JSONB

2016-10-04 Thread Oleg Bartunov
On Tue, Oct 4, 2016 at 4:20 PM, Simon Riggs wrote: > On 30 September 2016 at 16:58, Aleksander Alekseev > wrote: > > > I've just uploaded ZSON extension on GitHub: > > > > https://github.com/afiskon/zson > > > > ZSON learns on your common JSONB documents and creates a dictionary > > with strings

Re: [GENERAL] Gin indexes on intarray is fast when value in array does not exists, and slow, when value exists

2016-11-08 Thread Oleg Bartunov
On Tue, Nov 8, 2016 at 8:43 PM, otar shavadze wrote: > I have table with 500 000 rows, I have int[] column "my_array" in this > table, this array column contains minimum 1 and maximum 5 different values. > you didn't show us postgres version. > > I have GIN index on my_array column: > > * "CRE

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:54 PM, Aaron Lewis wrote: > I have a simple table with Trigram index, > > create table mytable(hash char(40), title text); > create index title_trgm_idx on mytable using gin(title gin_trgm_ops); > > When I run a query with 10m rows, it uses the Trigram index, but takes >

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:50 PM, Aaron Lewis wrote: > I have a simple table, and a gin index, > > create table mytable(hash char(40), title varchar(500)); > create index name_fts on mytable using gin(to_tsvector('english', > 'title')); > ^ > create unique i

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
using gin(to_tsvector('english', > >>>> 'title')); > > > > You created an index on the text 'title', not on the title column, so > > the index is useless. > > > > Drop the existing index and create this one instead: > >

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
.663..346.663 rows=1220793 loops=1) > Index Cond: (title ~~* 'x264'::text) > Planning time: 1.168 ms > Execution time: 1755.944 ms > > > On Sun, Nov 13, 2016 at 10:04 PM, Oleg Bartunov > wrote: > > > > > > On Sun, Nov 13, 2016 at 2:54 PM, Aaron

Re: [GENERAL] Incorrect information about GIN-index in RUM's docs

2016-11-14 Thread Oleg Bartunov
On Tue, Nov 15, 2016 at 10:37 AM, Andreas Joseph Krogh wrote: > This item isn't valid, is it? > > >- There isn't phrase search with GIN index. This problem relates with >previous problem. It is need position information to perform phrase search. > > RUM being an extention, and having inde

Re: [GENERAL] Searching array for multiple items

2017-01-25 Thread Oleg Bartunov
On Wed, Jan 25, 2017 at 11:29 AM, Alex Magnum wrote: > Hi, > I can search an array with 1 = ANY('{1,3,4,7}'::int[]) > > I need to check for one or multiple items in the array. > > e.g. '1,7,3' = ANY('{1,3,4,7}'::int[] > > I do need to check if > a) all items exist in the array > b) at least one

Re: [GENERAL] JSON path wild cards?

2015-11-24 Thread Oleg Bartunov
On Tue, Nov 24, 2015 at 12:39 PM, Dennis wrote: > Is there a way to specify a wild card in a json path? > > For example I have the following json doc: > > [ {“a”:1,”b”: [ { “x”: 7,”y”:8,”z”:9} ] }, {“a”:2,”b”: [ { “x”: > 4,”y”:5,”z”:6} ] }, … ] > > How do I write a select clause that can return

Re: [GENERAL] json indexing and data types

2015-12-12 Thread Oleg Bartunov
On Wed, Dec 2, 2015 at 11:48 AM, Kaare Rasmussen wrote: > Hi > > As json essentially only has three basic data types, string, int, and > boolean, I wonder how much of this - to index, search, and sort on > unstructured data - is possible. I guess part of the answer would be > 'jsquery and vodka'

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-05 Thread Oleg Bartunov
On Wed, Jan 6, 2016 at 7:41 AM, Jim Nasby wrote: > On 1/5/16 10:03 PM, John R Pierce wrote: > >> On 1/5/2016 5:31 PM, Jim Nasby wrote: >> >>> IMHO, the real problem here is not simply a CoC, it is that the >>> Postgres community doesn't focus on developing the community itself. >>> The closest we

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-10 Thread Oleg Bartunov
On Sun, Jan 10, 2016 at 9:44 PM, Regina Obe wrote: > > On 01/10/2016 08:07 AM, Bill Moran wrote: > > >> So, the purpose of a CoC is twofold: > >> > >> A) Define what "being excellent" means to this particular > >> community. > >> B) Provide a process for how to resolve things when "being > >>

Re: [GENERAL] WIP: CoC V4

2016-01-12 Thread Oleg Bartunov
On Tue, Jan 12, 2016 at 7:50 PM, Joshua D. Drake wrote: > Tl;dr; > > * Removed specific examples and reworded #3 to be more concise > > PostgreSQL Global Development Group (PGDG) Code of Conduct (CoC): > > 1. The CoC is to provide community guidelines for creating and enforcing a > safe, respectf

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-01-20 Thread Oleg Bartunov
On Wed, Jan 20, 2016 at 4:51 AM, Bruce Momjian wrote: > On Mon, Jan 11, 2016 at 09:01:03PM -0500, Tom Smith wrote: > > Hi, > > > > Congrats on the official release of 9.5 > > > > And I'd like bring up the issue again about if 9.6 would address the > jsonb > > performance issue > > with large numb

Re: [GENERAL] Using a german affix file for compound words

2016-01-28 Thread Oleg Bartunov
On Thu, Jan 28, 2016 at 6:04 PM, Wolfgang Winkler < wolfgang.wink...@digital-concepts.com> wrote: > Hi! > > We have a problem with importing a compound dictionary file for german. > > I downloaded the files here: > > > http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/dicts/ispell/ispell-germ

Re: [GENERAL] BSD initdb without ICU support and switch later

2016-01-29 Thread Oleg Bartunov
On Fri, Jan 29, 2016 at 5:46 PM, Maeldron T. wrote: > Hello, > > the ICU patch isn’t ready for PostgreSQL on FreeBSD. > > Is there any risk (more than 0) in executing the initdb without ICU > support and recompiling PostgreSQL later when the ICU patch is ready? I > mean any risk without m

Re: [GENERAL] fast refresh materialized view

2016-02-11 Thread Oleg Bartunov
Похоже на то, что вы понимаете по-русски ! Сообщество примет вашу работу только под лицензией BSD. Если что непонятно, пишите мне. С Уважением, Олег On Thu, Feb 11, 2016 at 7:56 PM, Nguyễn Trần Quốc Vinh wrote: > We would like to contribute to the PostgreSQL community. What can you > recommend

Re: [GENERAL] pgDay Asia / talks / lightning talks

2016-02-17 Thread Oleg Bartunov
It's pity I miss this conference, since I learned about it too late. On Wed, Feb 17, 2016 at 8:46 AM, Satoshi Nagayasu wrote: > Hi Dan, > > 2016-02-16 20:43 GMT+09:00 Daniel Pocock : > > Is this the place to ask questions about pgDay Asia[1] or is there > > another mailing list for it? The mail

Re: [GENERAL] Query plan not updated after dropped index

2016-02-18 Thread Oleg Bartunov
On Thu, Feb 18, 2016 at 11:17 AM, Victor Blomqvist wrote: > Hello! > > We just had a major issue on our databases, after a index was replaced a > user defined function didnt change its query plan to use the new index. At > least this is our theory, since the function in question became much slowe

Re: [GENERAL] Replacement for Oracle Text

2016-02-19 Thread Oleg Bartunov
On Fri, Feb 19, 2016 at 8:28 PM, Josh berkus wrote: > On 02/19/2016 05:49 AM, s d wrote: > >> On 19 February 2016 at 14:19, Bruce Momjian > > wrote: >> >> I wonder if PLPerl could be used to extract the words from a PDF >> document and create a tsvector column fro

Re: [GENERAL] MongoDB 3.2 beating Postgres 9.5.1?

2016-03-13 Thread Oleg Bartunov
On Mar 11, 2016 4:40 PM, "Paul Jones" wrote: > > I have been running the EDB benchmark that compares Postgres and MongoDB. > I believe EDB ran it against PG 9.4 and Mongo 2.6. I am running it > against PG 9.5.1 and Mongo 3.2 with WiredTiger storage using 10,000,000 > JSON records generated by the

Re: [GENERAL] Shrinking TSvectors

2016-04-05 Thread Oleg Bartunov
On Tue, Apr 5, 2016 at 2:37 PM, Howard News wrote: > Hi, > > does anyone have any pointers for shrinking tsvectors > > I have looked at the contents of some of these fields and they contain > many details that are not needed. For example... > > "'+1':935,942 '-0500':72 '-0578':932 '-0667':938 '-2

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-05-01 Thread Oleg Bartunov
On Sun, May 1, 2016 at 6:46 AM, Tom Smith wrote: > Hello: > > I'd like to bring this JSONB performance issue again. > Below is a link of MySQL way of storing/retrieving Json key/value > > https://dev.mysql.com/doc/refman/5.7/en/json.html > > Instead of providing column indexing(like GIN for JSONB

Re: [GENERAL] postgresql & Fulltext & ranking & my own functions

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 3:21 PM, Nicolas Paris wrote: > Hello, > > Documentation says : ( > http://www.postgresql.org/docs/9.5/static/textsearch-controls.html#TEXTSEARCH-RANKING > ) > "The built-in ranking functions are only examples. You can write your own > ranking functions and/or combine their

Re: [GENERAL] Insert only table and size of GIN index JSONB field.

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 1:35 PM, Maxim Boguk wrote: > > > On Tue, May 3, 2016 at 8:09 PM, Maxim Boguk wrote: > >> Hi, >> >> I started with empty table with index over >> custom_fields | jsonb >> field >> defined as: >> "idx_learners_custom_fields" gin (custom_fields) >> Globally gin_pending_

Re: [GENERAL] Ascii Elephant for text based protocols - Final

2016-05-16 Thread Oleg Bartunov
On Mon, May 16, 2016 at 2:47 PM, Charles Clavadetscher wrote: > SELECT row_dat FROM elephant ORDER BY row_num; Very good ! Thanks ! -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-28 Thread Oleg Bartunov
On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh wrote: > Hi. > > Any news about when slides for $subject will be available? > I submitted slides to pgcon site, but it usually takes awhile, so you can download our presentation directly http://www.sai.msu.su/~megera/postgres/talks/pgcon-201

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:29 PM, Andreas Joseph Krogh wrote: > På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: >> >> Hi. >> >> Any ne

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
Mdex :) We are open for suggestion. > > :Stefan, co-organizer of Swiss PGDay > > > 2016-05-29 11:29 GMT+02:00 Andreas Joseph Krogh : > >> På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < >> obartu...@gmail.com>: >> >> >> >> On Th

Re: [GENERAL] TSEARCH2: disable stemming in indexes and triggers

2007-05-31 Thread Oleg Bartunov
EW; END; $$ language plpgsql; btw, why do you don't use setweight() function to assign different weights to the different attributes ? Thanks for your time. Regards, Erwin Moller --- PS: This is my first posting to pgsql-general: if I screw something up

Re: [GENERAL] stem & tsearch2, want different stemmed words

2007-06-30 Thread Oleg Bartunov
command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical

Re: [GENERAL] tsearch2 questions

2007-07-04 Thread Oleg Bartunov
match rank so I would prefer a tsearch2 rank score between 0 and 1. Do I need to write my own rank function? what's about simple normalization formulae, like rank/(rank+1) ? Regards, Oleg _____ Oleg Bartunov, R

Re: [GENERAL] russian case-insensitive regexp search not working

2007-07-11 Thread Oleg Bartunov
# cat > textfile Зеленая Зеленодольская зеленая # grep -i зелен * textfile:Зеленая textfile:Зеленодольская textfile:зеленая So i think system is fine about unicode. Regards, Oleg _ Oleg Bartunov, Research Scientist, He

Re: [GENERAL] Big table with UNION ALL or partitioning with Tsearch2

2007-07-12 Thread Oleg Bartunov
Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495)939

Re: [GENERAL] help with tsearch2 stem compile

2007-07-21 Thread Oleg Bartunov
TIP 4: Have you searched our list archives? http://archives.postgresql.org/ Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institut

Re: [GENERAL] using Tsearch2 for chemical text

2007-07-25 Thread Oleg Bartunov
TIP 6: explain analyze is your friend Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTEC

Re: [GENERAL] using Tsearch2 for chemical text

2007-07-25 Thread Oleg Bartunov
--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match Regards, Oleg _____ Oleg Bartunov,

Re: [GENERAL] tsearch2 problems in postgres?

2007-07-28 Thread Oleg Bartunov
@@ in tsearch2 ---(end of broadcast)--- TIP 6: explain analyze is your friend Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.ast

Re: [GENERAL] Dealing with tsvector in fuctions for data split

2007-08-06 Thread Oleg Bartunov
create the tsvector for each record as I am insert the data. ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq Regards, Oleg ____

Re: [GENERAL] Dealing with tsvector in fuctions for data split

2007-08-08 Thread Oleg Bartunov
planner will ignore your desire to choose an index scan if your joining column's datatypes do not match Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University

Re: [GENERAL] tsearch2: plainto_tsquery() with OR?

2007-08-08 Thread Oleg Bartunov
rds, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83, +007(495)939-23-83 ---

Re: [GENERAL] tsearch2: plainto_tsquery() with OR?

2007-08-08 Thread Oleg Bartunov
On Thu, 9 Aug 2007, Tom Lane wrote: Oleg Bartunov <[EMAIL PROTECTED]> writes: On Wed, 8 Aug 2007, cluster wrote: Does anyone know where I can request an OR-version of plainto_tsquery()? plainto_tsquery expects plain text, use to_tsquery for boolean operators. Are either of

Re: [GENERAL] tsearch2: plainto_tsquery() with OR?

2007-08-08 Thread Oleg Bartunov
On Thu, 9 Aug 2007, Tom Lane wrote: Oleg Bartunov <[EMAIL PROTECTED]> writes: On Thu, 9 Aug 2007, Tom Lane wrote: Are either of these definitions really right? If I type "foo bar baz" into Google, for instance, it seems to produce some sort of weighted result, neither a

Re: [GENERAL] tsearch2: plainto_tsquery() with OR?

2007-08-08 Thread Oleg Bartunov
On Thu, 9 Aug 2007, Tom Lane wrote: Oleg Bartunov <[EMAIL PROTECTED]> writes: " neither a strict AND nor a strict OR" is not a good foundation for database text search API. Maybe not, but the Google boys have sure done well without telling anyone what their algorithms are

Re: [GENERAL] tsearch2: plainto_tsquery() with OR?

2007-08-08 Thread Oleg Bartunov
On Thu, 9 Aug 2007, Tom Lane wrote: Oleg Bartunov <[EMAIL PROTECTED]> writes: On Thu, 9 Aug 2007, Tom Lane wrote: ... behavior that people want is "here's some words, get me a weighted result", and if the weighting improves from time to time that's OK. We need to

Re: [GENERAL] How to switch off Snowball stemmer for tsearch2?

2007-08-22 Thread Oleg Bartunov
internal,integer)Example of synonym dictionary thesaurus_templatethesaurus_init(internal) thesaurus_lexize(internal,internal,integer,internal)Thesaurus template, must be pointed Dictionary and DictFile Regards, Oleg __

Re: [GENERAL] How to switch off Snowball stemmer for tsearch2?

2007-08-22 Thread Oleg Bartunov
, Oleg Bartunov <[EMAIL PROTECTED]> wrote: On Wed, 22 Aug 2007, Dmitry Koterov wrote: Hello. We use ispell dictionaries for tsearch2 (ru_ispell_cp1251).. Now Snowball stemmer is also configured. How to properly switch OFF Snowball stemmer for Russian without turning off ispell stemmer?

Re: [GENERAL] How to switch off Snowball stemmer for tsearch2?

2007-08-22 Thread Oleg Bartunov
($string) { $stem = lexize('ru_ispell_cp1251', $string); if ($stem in names_database) return $string; else return $stem; } Maybe tsearch2 implements this logic already? sure, it's how text search mapping works. Dmitry, seems your company could be my client :) On 8/22/07, Ol

Re: [GENERAL] How to switch off Snowball stemmer for tsearch2?

2007-08-23 Thread Oleg Bartunov
ate all word-forms of all Russian names using ispell and then - subtract this full list from Ispell dictionary (so I will remove "Ivan", "Ivanami" etc. from it). But possily tsearch2 has this subtraction algorythm already. don't do that ! Just go plain way.

Re: [GENERAL] Can tsearch do some basic text mining

2007-08-24 Thread Oleg Bartunov
l -9' the postmaster Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.ms

Re: [GENERAL] Restore v. Running COPY/INDEX seperatly

2007-08-26 Thread Oleg Bartunov
Benjamin ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq Regards, Oleg _ Oleg Bartunov, Research

Re: [GENERAL] tsearch2 anomoly?

2007-09-06 Thread Oleg Bartunov
but it does not appear to. ossdb=# select to_tsvector('httpd-2.2.3-5.src.rpm'); to_tsvector --- 'httpd-2.2.3-5.src.rpm':1 Why don't I get: 'httpd', 'src', 'rpm', 'httpd-2.2.3-5.src.rpm' ? Is this a bug or design? Tha

Re: [GENERAL] Checking is TSearch2 query is valid

2007-09-08 Thread Oleg Bartunov
et, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNe

Re: [GENERAL] processing urls with tsearch2

2007-09-13 Thread Oleg Bartunov
has anyone else dealt with this maybe in a different way? sure, preprocess text using prefered language before passing to ro_tsvector Thanks for any suggestions and help, Laimis Regards, Oleg _ Oleg Bartunov

Re: [GENERAL] tsearch2 and parsing host strings

2007-09-14 Thread Oleg Bartunov
at I could change the pg_ts_cfgmap to map it to that special dictionary? Is there any way I can accomplish this with tsearch2? Check my reply about pg_regex dictionary. Simple regex will save you. Thanks, Laimis Regards, Oleg ____

Re: [GENERAL] DAGs and recursive queries

2007-09-26 Thread Oleg Bartunov
Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495

Re: [GENERAL] Tsearch2 Dutch snowball stemmer in PG8.1

2007-10-03 Thread Oleg Bartunov
se commands are apparently not available on PG8.1. I also found the tables pg_ts_(cfg|cfgmap|dict|parser), but I have no idea how to add a Dutch stemmer to those. I did find some references to stem.[ch] files that were suggested to compile into the postgres sources, but I cannot believe t

Re: [GENERAL] Tsearch2 Dutch snowball stemmer in PG8.1

2007-10-03 Thread Oleg Bartunov
On Wed, 3 Oct 2007, Alban Hertroys wrote: Oleg Bartunov wrote: Alban, the documentation you're refereed on is for upcoming 8.3 release. For 8.1 and 8.2 you need to do all machinery by hand. It's not difficult, for example: Thanks Oleg. I think I managed to do this right, althoug

Re: [GENERAL] Tsearch2 Dutch snowball stemmer in PG8.1

2007-10-03 Thread Oleg Bartunov
ist, but at the current stage of our project this was the simplest to achieve. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROT

Re: [PERFORM] [GENERAL] Slow TSearch2 performance for table with 1 million documents.

2007-10-05 Thread Oleg Bartunov
eally slow? can you try rank_cd() instead ? regards, tom lane ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings Regards, Oleg ___

Re: [GENERAL] How to make LIKE to use index in "abc%" query?

2007-10-08 Thread Oleg Bartunov
ual time=0.066..0.066 rows=12 loops=1) Index Cond: ((lower(txt) ~>=~ '1000'::text) AND (lower(txt) ~<~ '1001'::text)) Total runtime: 0.283 ms Regards, Oleg _ Oleg Bartunov, Rese

Re: [GENERAL] speeding up CUBE queries

2007-10-08 Thread Oleg Bartunov
nt: 0CCA 8EE2 2EEB 25E2 AB04 06F7 1BB9 E634 9B87 56EE --- Accuracy, n.: The vice of being right ---(end of broadcast)--- TIP 6: explain analyze is your friend Regards, Oleg

Re: [GENERAL] TSearch chain dictionaries

2007-10-15 Thread Oleg Bartunov
t you want inside - call ispell and pass result to stemmer. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Int

Re: [GENERAL] I want to search my project source code

2007-10-27 Thread Oleg Bartunov
dcast)--- TIP 6: explain analyze is your friend Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [

Re: [GENERAL] Fragments in tsearch2 headline

2007-10-27 Thread Oleg Bartunov
postgres=# select ts_headline('this is a highlighted text','highlight'::tsquery, 'StartSel=...,StopSel=...') postgres-# ; ts_headline -- this is a ...highlighted... text Regards, Oleg __

Re: [GENERAL] Fragments in tsearch2 headline

2007-10-30 Thread Oleg Bartunov
abc ...2... 3 xyz Oleg On Tue, 30 Oct 2007, Catalin Marinas wrote: On 28/10/2007, Oleg Bartunov <[EMAIL PROTECTED]> wrote: On Sat, 27 Oct 2007, Tom Lane wrote: "Catalin Marinas" <[EMAIL PROTECTED]> writes: Is there an easy way to generate a headline from separate fra

Re: [GENERAL] Fragments in tsearch2 headline

2007-10-30 Thread Oleg Bartunov
On Tue, 30 Oct 2007, Catalin Marinas wrote: On 30/10/2007, Richard Huxton <[EMAIL PROTECTED]> wrote: Oleg Bartunov wrote: Catalin, what is your need ? What's wrong with this ? postgres=# select ts_headline('1 2 3 4 5 3 4 abc abc 2 3 xyz','2':

Re: [GENERAL] Fragments in tsearch2 headline

2007-10-30 Thread Oleg Bartunov
On Tue, 30 Oct 2007, Tom Lane wrote: On 10/30/07, Oleg Bartunov <[EMAIL PROTECTED]> wrote: ... In tsearch2 we have get_covers() function, which produces all excerpts like: I had not realized till just now that the 8.3 core version of tsearch omitted any material feature of contrib/ts

Re: [GENERAL] Improve Search

2007-11-02 Thread Oleg Bartunov
q Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83

Re: [GENERAL] [pgsql-advocacy] PostgreSQL Conference 08 East!

2007-11-20 Thread Oleg Bartunov
nd of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astron

Re: [GENERAL] EAV or not to EAV?

2007-11-22 Thread Oleg Bartunov
been solved by Joe Conways's crosstab contrib. Is there a better idea than mine? I hope so. We use contrib/hstore for this Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.ast

[GENERAL] hibernate + postgresql ?

2007-11-29 Thread Oleg Bartunov
Hello, any exprerience with Hibernate + PostgreSQL ? How does this combination is flexible and smart ? Is't possible to tune selected queries ? Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of Ast

Re: [GENERAL] hibernate + postgresql ?

2007-11-29 Thread Oleg Bartunov
On Thu, 29 Nov 2007, Joshua D. Drake wrote: Oleg Bartunov wrote: Hello, any exprerience with Hibernate + PostgreSQL ? How does this combination is flexible and smart ? Is't possible to tune selected queries ? In short, it sucks :). Long description: Hibernate is a mature ORM for Jav

Re: [GENERAL] thesaurus support in postgresql

2007-12-12 Thread Oleg Bartunov
there really no one here who knows anything about it? If there are plans for it? If there is someone currently working on it? Or if there is somebody else I could ask? Regards Florian Regards, Oleg _____ Oleg Bar

Re: [GENERAL] thesaurus support in postgresql

2007-12-12 Thread Oleg Bartunov
Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83, +007(495)939-

Re: [GENERAL] Prefix search, word completion, full text search

2007-12-29 Thread Oleg Bartunov
d such dictionary. Thanks. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007(495)939-1

Re: [GENERAL] tsearch2 headline options

2008-01-04 Thread Oleg Bartunov
-- TIP 2: Don't 'kill -9' the postmaster Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~mege

Re: [GENERAL] Segmentation fault with 8.3 FTS ISpell

2008-01-15 Thread Oleg Bartunov
ld postgres[14844]: [11-1] LOG: redo done at 8/EC59BEE0 Jan 15 11:32:55 brainchild postgres[14847]: [7-1] LOG: autovacuum launcher started Jan 15 11:32:55 brainchild postgres[14788]: [7-1] LOG: database system is ready to accept connections Regards, Oleg _

Re: [GENERAL] TSearch: CLUSTER using GIST, query using GIN?

2008-01-19 Thread Oleg Bartunov
. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: [EMAIL PROTECTED], http://www.sai.msu.su/~megera/ phone: +007

  1   2   3   4   5   >