[General] Webboard: Indexer not working for name-based https site

2017-06-27 Thread bar
Author: Stan Email: Message: Hi, I switched a development site to using https, using name-based host matching in apache (same IP, multiple sites) and the mnogosearch indexer no longer works: [10072]{01} URL: https://test.somesite.com/ [10072]{01} ROBOTS: https://test.somesite.com/robots.txt

[General] Webboard: index only new pages

2017-04-12 Thread bar
Author: Alexander Barkov Email: Message: > Unfortunately it did not work, but I found a working method. > > I added 'Period 30y' before my 'Server' command in config file and > did > indexer --drop > indexer --create > indexer -a > It ran forever. I killed it (ctrl-C) and it reported

[General] Webboard: index only new pages

2017-04-12 Thread bar
Author: Jeff Dwork Email: jeffdwor...@gmail.com Message: Unfortunately it did not work, but I found a working method. I added 'Period 30y' before my 'Server' command in config file and did indexer --drop indexer --create indexer -a It ran forever. I killed it (ctrl-C) and it reported crawling

[General] Webboard: index only new pages

2017-04-11 Thread bar
Author: Alexander Barkov Email: Message: > I'm indexing a mailing list archive. Pages never change. Every > week a few pages are added in a new directory. The archive is on > the same machine as the index, so my server directive is > > Server https://domain.com/msgs/

[General] Webboard: index only new pages

2017-04-10 Thread bar
Author: Jeff Dwork Email: jeffdwor...@gmail.com Message: I'm indexing a mailing list archive. Pages never change. Every week a few pages are added in a new directory. The archive is on the same machine as the index, so my server directive is Server https://domain.com/msgs/

[General] Webboard: Links without specific protocol

2017-02-06 Thread bar
Author: Alexander Barkov Email: Message: Hello Julien, > Hello Alexander, > > Thanks for the answer. > However, the problem occurs on the indexing phase : the crawler tries to > index > http://www.example.com/www.example.com/page-b.html (which does not exist) > instead of

[General] Webboard: Links without specific protocol

2017-02-05 Thread bar
Author: Alexander Barkov Email: Message: > > Hello Alexander, > > I currently use 3.4.1. > > Is there a new release I am not aware of ? > > Thank you for your quick answers ! No, 3.4.1 is the latest. Reply:

[General] Webboard: commands in search.htm

2017-02-05 Thread bar
Author: Alexander Barkov Email: Message: Hi Jeff, > Version 3.4.1, using search.cgi, Debian 8.6 > Where do I place commands in search.htm? > Specifically, I want to use 'Section' command. If I put > Section title 1 128 > inside , I get > 13: ERROR: Unknown identifier 'Section' > If it is

[General] Webboard: commands in search.htm

2017-02-01 Thread bar
Author: Jeff Dwork Email: jeffdwor...@gmail.com Message: Version 3.4.1, using search.cgi, Debian 8.6 Where do I place commands in search.htm? Specifically, I want to use 'Section' command. If I put Section title 1 128 inside , I get 13: ERROR: Unknown identifier 'Section' If it is outside, I

[General] Webboard: Links without specific protocol

2017-02-01 Thread bar
Author: Julien D. Email: jul...@clustaar.com Message: > Hello Julien, > > > > Hello, > > > > > > > Hello, > > > > > > > > I couldn't find any information on this subject. > > > > As people start using HTTPS, I get more and more problems when crawling > > with > > > > links that don't use a

[General] Webboard: Links without specific protocol

2017-01-31 Thread bar
Author: Julien D. Email: jul...@clustaar.com Message: > Hello, > > > Hello, > > > > I couldn't find any information on this subject. > > As people start using HTTPS, I get more and more problems when crawling with > > links that don't use a specific protocol. > > > > Let's take this example

[General] Webboard: Links without specific protocol

2017-01-25 Thread bar
Author: Alexander Barkov Email: Message: Hello, > Hello, > > I couldn't find any information on this subject. > As people start using HTTPS, I get more and more problems when crawling with > links that don't use a specific protocol. > > Let's take this example of a link from

[General] Webboard: Links without specific protocol

2017-01-23 Thread bar
Author: Julien D. Email: jul...@clustaar.com Message: Hello, I couldn't find any information on this subject. As people start using HTTPS, I get more and more problems when crawling with links that don't use a specific protocol. Let's take this example of a link from

[General] Webboard: Make error - proto.c

2016-12-02 Thread bar
Author: Alexander Barkov Email: Message: > The version of Make is 3.82-21. And i try to build mnogosearch 3.4.1. > > The configure command used is : ./configure --disable-mp3 --disable- > news --without-debug --with-pgsql=no --with-freetds=no --with- > oracle8=no --with-oracle8i=no

[General] Webboard: Make error - proto.c

2016-12-01 Thread bar
Author: tom Email: Message: The version of Make is 3.82-21. And i try to build mnogosearch 3.4.1. The configure command used is : ./configure --disable-mp3 --disable- news --without-debug --with-pgsql=no --with-freetds=no --with- oracle8=no --with-oracle8i=no --with-iodbc=no --with-unixODBC=no

[General] Webboard: Make error - proto.c

2016-11-30 Thread bar
Author: tom Email: Message: Hello, I have this error when I use the make command : proto.c: In function 'UdmFILEGet': proto.c:1502:3: error: unknown type name 'UDM_REQUEST_INFO' UDM_REQUEST_INFO Request; ^ proto.c:1693:16: error: request for member 'if_modified_since' in something not a

[General] Webboard: Crash of indexation process

2016-10-23 Thread bar
Author: Alexander Barkov Email: Message: Hi, > Hi, > This new topic is just for your information, Alexander. > As you said that it is now possible to set the number of threads when > indexing data, I did a few tests. > > indexer -N10 --index --> works > With 20, 30,... 64 threads --> works >

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > Thanks a lot for all your good advices. > When do you plan the delivering of the next release ? > I hope it should be available within two weeks. > > > > > 1. indexer can run parallel threads for crawling, and starting from > > > > 3.4.0 for

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Thanks a lot for all your good advices. When do you plan the delivering of the next release ? > > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 > > > for indexing: > > > > > > # Run 10 crawling threads > > >

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > > > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 > > for indexing: > > > > # Run 10 crawling threads > > indexer -N10 > > > > # Run 10 indexing threads > > indexer -N10 --index > > > > A related thing: > > 3.4.1 will

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: > > 1. indexer can run parallel threads for crawling, and starting from 3.4.0 for > indexing: > > # Run 10 crawling threads > indexer -N10 > > # Run 10 indexing threads > indexer -N10 --index > A related thing: 3.4.1 will use a modified database

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: Alexander Barkov Email: Message: Hi Fabien, > Hi all, > > Is it possible to parallelize the indexing work on multiple machines ? > I mean for example one global data server with the mnogosearch database, and > a few server instances all running the indexer process, pointing to the same

[General] Webboard: Horizontal scalability

2016-10-20 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Hi all, Is it possible to parallelize the indexing work on multiple machines ? I mean for example one global data server with the mnogosearch database, and a few server instances all running the indexer process, pointing to the same db

[General] Webboard: exclude mime types

2016-10-13 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Hi, I tried today the disallow statements, and it works like a charm ! :) I can now exclude typical useless urls before they get downloaded by the indexer. Thanks for your help and for your work ! Reply:

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: Alexander Barkov Email: Message: > And to be more precise, i finally want to index only html pages and not all > other types of data (css/js/pictures/pdf/rss/...) . > Something like this should do the trick: NoIndexIf NoMatch Content-Type text/html* Additionally, try to use the

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: Alexander Barkov Email: Message: > > Thanks for your quick answer. > > > > I tried to add the NoIndexIf but i cannot get it to work. > > > > I used the indexer.conf default file, and added the two following lines at > > the end of that file : > > Server

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: Alexander Barkov Email: Message: > Thanks for your quick answer. > > I tried to add the NoIndexIf but i cannot get it to work. > > I used the indexer.conf default file, and added the two following lines at > the end of that file : > Server http://www.wearethelous.com/feed/ > NoIndexIf

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: And to be more precise, i finally want to index only html pages and not all other types of data (css/js/pictures/pdf/rss/...) . Fabien. > Thanks for your quick answer. > > I tried to add the NoIndexIf but i cannot get it to work. > > I

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: Alexander Barkov Email: Message: Hi, > Hi all, > > Is it possible to exclude certain mime types such as rss feeds ? > This can be done using the NoIndexIf command: http://www.mnogosearch.org/doc34/msearch-cmdref-noindexif.html Put this command into indexer.conf to disallow a certain

[General] Webboard: exclude mime types

2016-10-12 Thread bar
Author: fabien Email: fabien.lahau...@gmail.com Message: Hi all, Is it possible to exclude certain mime types such as rss feeds ? Thanks in advance, Fabien. Reply: ___ General mailing list

[General] Webboard: MySQL driver: #1054

2016-09-20 Thread bar
Author: Alexander Barkov Email: Message: Hello, The database structure in 3.4.x is not compatible with 3.3.x. The easiest way is just to re-crawl all documents. Reply: ___ General mailing

[General] Webboard: MySQL driver: #1054

2016-09-15 Thread bar
Author: Martin Email: Message: I recreated the tables and it works but I have to reindex all my URLs, right? the URLs are stored binary so how could i get all my server urls and restart indexing? Reply:

[General] Webboard: MySQL driver: #1054

2016-09-13 Thread bar
Author: Martin Email: Message: I updated to 3.4.1 and get DB: MySQL driver: #1054: Unknown column 'coords' in 'field list' Reply: ___ General mailing list General@mnogosearch.org

[General] Webboard: Links table and seed value

2016-07-07 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hello, > Hello, > > I couldn't find any information on how the "seed" value in the links table is > calculated. Seed is calculated based on the normalized URL, as follows: indexer.c:udmhash32_t seed= UdmStrHash32(Href->url) &

[General] Webboard: Links table and seed value

2016-07-06 Thread bar
Author: Julien D. Email: jul...@1-clic.info Message: Hello, I couldn't find any information on how the "seed" value in the links table is calculated. How does it work ? Can we use our own rules ? Thanks ! Reply:

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-02 Thread bar
Author: Dmitriy Kulikov Email: Message: Thank you very much, it works! Words in Cyrillic are now correctly searched in the database. The first lines of each found results is also now in the correct encoding. That's fine! навигатор : 610 Results 1-10 of 89 ( 0.009 seconds)

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-02 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hmm. It seems your MySQL is client is not configured well. It's using latin1 as a connection character set, while the display is onviously utf8. So it prints garbage instead of Cyrillic letters. You can check this using "show variables

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-01 Thread bar
Author: Dmitriy Kulikov Email: Message: The results are the same for both bases. mysql> use mnogosearch_new; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed mysql> SELECT word, hex(word) FROM bdict

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-01 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Can you try this one: SELECT word, hex(word) FROM bdict WHERE word NOT RLIKE '^[a-z0-9?#_]*$' LIMIT 30; The idea is to get words with Cyrillic letters and see their HEX representation. > I got "Empty set" for both databases. > >

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-01 Thread bar
Author: Dmitriy Kulikov Email: Message: I got "Empty set" for both databases. mysql> use mnogosearch_new; Reading table information for completion of table and column names You can turn off this feature to get a quicker startup with -A Database changed mysql> SELECT word, hex(word) FROM bdict

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-06-01 Thread bar
Author: Dmitriy Kulikov Email: Message: Thank you! The problem with search.cgi was really because of the changed format search.htm But I have problems with encodings (e.g. Cyrillic windows-1251 or UTF-8). I installed both versions of mnogosearch with separate bases, but with the same settings.

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-05-31 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > I just tried unsuccessfully to install and configure the mnogosearch-3.4.1 on > FreeBSD 10.3 > I lost a lot of time, because it turned out that "search.cgi" fundamentally > does not work, and without any diagnostic information. > I

[General] Webboard: mnogosearch-3.4.1 on FreeBSD 10.3

2016-05-31 Thread bar
Author: Dmitriy Kulikov Email: Message: I just tried unsuccessfully to install and configure the mnogosearch-3.4.1 on FreeBSD 10.3 I lost a lot of time, because it turned out that "search.cgi" fundamentally does not work, and without any diagnostic information. I many times check it out by

[General] Webboard: Index full html code in DDB

2016-05-30 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hello, > Hello, > > I would like to crawl the whole html code for each url. Perhaps cached copy is what you're looking for. In 3.4.x cached copies are stored in a separate table "cachedcopy". Cached copies are compressed by default,

[General] Webboard: Index full html code in DDB

2016-05-30 Thread bar
Author: rafikCyc Email: rafikothm...@gmail.com Message: Hello, I would like to crawl the whole html code for each url. Is there anyway to do this ? I've tried this in the indexer.conf but it doesn't work : Section headhtml 25 2058 "]*)>(*.)" $2 Section bodyhtml

[General] Webboard: Indexer: unknown option '-E'

2016-05-26 Thread bar
Author: Dmitriy Kulikov Email: Message: Thanks for the quick response! It works! # indexer --index [22029]{--} Indexing [22029]{--} Loading URL list [22029]{--} URL list loaded: 250 documents, 0.01 sec [22029]{--} Indexing document contents [22029]{--} Freeing cache [22029]{--} Freeing cache

[General] Webboard: Indexer: unknown option '-E'

2016-05-26 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi, > Hi! > > I did a fresh install of mnogosearch-3.4.1 on FreeBSD 10.3 > Indexer run OK, but I have error: > # indexer -l -Eblob > /usr/local/bin/indexer: unknown option '-E' Please use "indexer --index" instead of "indexer

[General] Webboard: Indexer: unknown option '-E'

2016-05-26 Thread bar
Author: Dmitriy Kulikov Email: Message: Hi! I did a fresh install of mnogosearch-3.4.1 on FreeBSD 10.3 Indexer run OK, but I have error: # indexer -l -Eblob /usr/local/bin/indexer: unknown option '-E' As a result, the search base does not work. The database was created by: # indexer --create

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-14 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > I add those Disallow lines so that, both app can crawl the same > number of urls (approximatively 140), > > Disallow */basket-villeurbanne/author/* > Disallow *?p=* > Disallow */feed > > As it seems that Mnogosearch can manage a

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-09 Thread bar
Author: rafikCyc Email: Message: I add those Disallow lines so that, both app can crawl the same number of urls (approximatively 140), Disallow */basket-villeurbanne/author/* Disallow *?p=* Disallow */feed As it seems that Mnogosearch can manage a robots.txt, but not the meta robots

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-04 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > Here is the site : http://www.asbuers.com/ After crawling this site with mnoGoSearch, I did the following: # Extracted the list of all documents found (478 documents) mysql -uroot -N --database=tmp --execute="SELECT url FROM url"

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-04 Thread bar
Author: rafikCyc Email: Message: Thank you for the reply. Well, You're right... With -P0 it does not have a limit of 1s. But it remain very slow though. -- I just did a quick speed test on a small site (500 documents) Mnogosearch VS screaming frog. The results : Mnogosearch : 3.2 urls /

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-04 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > Hello, > > I've tried this : > > ./indexer -p 0 > > but it doesn't work :( > The indexer sleeps for at least one seconde after each URL. With -p0 it does not do any delays between URLs. I guess the bottleneck is in the connection,

[General] Webboard: Indexer : How to get all H2 tags on the page

2016-05-04 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > Hello, > > Section h2 23 256 "]*)>([^$3]+)()" $2 > > this work well, but the indexer only store the first he found in > database and ignore all the others H2. > > Is there a way to get all tags like the

[General] Webboard: How to speed up the crawl delay after each URL ?

2016-05-04 Thread bar
Author: rafikCyc Email: Message: Hello, I've tried this : ./indexer -p 0 but it doesn't work :( The indexer sleeps for at least one seconde after each URL. It seems impossible to index faster than 1s after each url. To index 300 000 document on my website for example, the crawl takes 2 full

[General] Webboard: Indexer : How to get all H2 tags on the page

2016-05-04 Thread bar
Author: rafikCyc Email: Message: Hello, Section h2 23 256 "]*)>([^$3]+)()" $2 this work well, but the indexer only store the first he found in database and ignore all the others H2. Is there a way to get all tags like the function preg_match_all does in PHP ?

[General] Webboard: running indexer in link validation mode

2016-04-18 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hello, > Hello, > > How would I go about running the indexer and not saving any URLs or > content or anything into the database, but only store/list/log > somewhere, somehow the links that are no longer working? HTTP status > code

[General] Webboard: running indexer in link validation mode

2016-04-13 Thread bar
Author: nick Email: nick.everl...@yahoo.com Message: Hello, How would I go about running the indexer and not saving any URLs or content or anything into the database, but only store/list/log somewhere, somehow the links that are no longer working? HTTP status code > 400. Currently I am

[General] Webboard: Section regex format

2016-03-19 Thread bar
Author: Julien D. Email: jul...@1-clic.info Message: Hello Alexander, Thanks for your answer, I got it working by adding the next tag : (the stuff i want).* However, how can I retrieve the HTML code from that Section, and not just the text ? I tried using "format" and "when" as explained here

[General] Webboard: Some section not indexed in DB

2016-02-12 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi Guillaume, title, body and meta.description are not really needed to be in urlinfo for search purposes in 3.4.x. Search and search result presentation should work fine. But you might of course need them for some other external

[General] Webboard: Some section not indexed in DB

2016-02-10 Thread bar
Author: Guillaume Email: inscript...@atlza.com Message: Hi Again, I'm having a problem with some Section lines in the indexer.conf wit mnogosearch 3.4.1 Here is an extract of my indexer.conf : Section ResponseTime0 32 # Standard sections: body, title Section body

[General] Webboard: Segmentation fault at running ./indexer with ServerTable

2016-02-06 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi, can you please send the entire indexer.conf file to b...@mnogosearch.org? Thanks. > Hi, > > I'm using Mnogosearch 3.3.15 and everything works fine while I'm indexing > website with a Server command in the indexer.conf file. >

[General] Webboard: my_server and server tables rec_id

2016-02-04 Thread bar
Author: Guillaume Email: inscript...@atlza.com Message: OK, note sure it is the purpose of tag field but I managed to do what I need with this field. Reply: ___ General mailing list

[General] Webboard: Segmentation fault at running ./indexer with ServerTable

2016-01-20 Thread bar
Author: Guillaume Email: inscript...@atlza.com Message: Hi, I'm using Mnogosearch 3.3.15 and everything works fine while I'm indexing website with a Server command in the indexer.conf file. When trying to switch to a ServerTable command I get a segmentation fault. Here is the line in my

[General] Webboard: Installing PHP 7.0 module fails with mnoGoSearch (3.4.1 and older )

2016-01-16 Thread bar
Author: Flözen Email: illenber...@visionstudio.de Message: Near future would be great! :) Webservers with Plesk now support PHP 7 and it seams to be really fast. Reply: ___ General mailing list

[General] Webboard: Installing PHP 7.0 module fails with mnoGoSearch (3.4.1 and older )

2016-01-13 Thread bar
Author: Flözen Email: Message: Hi, installier the PHP module for PHP 7.0.1 fails. When I run "make" I get following errors: /bin/sh /home/floezen/mnogosearch/mnogosearch-3.4.1/php/libtool --mode=compile cc -I. - I/home/floezen/mnogosearch/mnogosearch-3.4.1/php -DPHP_ATOM_INC -

[General] Webboard: Installing PHP 7.0 module fails with mnoGoSearch (3.4.1 and older )

2016-01-13 Thread bar
Author: Alexander Barkov Email: Message: Hi Flözen, > Hi, > > installier the PHP module for PHP 7.0.1 fails. > > When I run "make" I get following errors: > It compiles fine with PHP-5.6, which is currently the default version in the current Linux distributions. Unfortunately I haven't

[General] Webboard: Alt-Text in Map-Area-Tags

2015-11-09 Thread bar
Author: Mitja Orzeszko Email: mi...@orzeszko.de Message: Hello, will Alt-Text in Map-Area-Tags be indexed? Thanks Mitja Reply: ___ General mailing list General@mnogosearch.org

[General] Webboard: Alt-Text in Map-Area-Tags

2015-11-09 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hello, > Hello, > > will Alt-Text in Map-Area-Tags be indexed? > > > > You need to use this command to enable indexing of these attributes: Section attribute.alt ... See here for examples:

[General] Webboard: Set categories/tags via HTML tag attribute?

2015-10-21 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: > I would like to use different tags (or categories) for different > parts of a website and I would like to have a "Default" tag which > includes all pages that are not part of another category. I tried to > configure different tags

[General] Webboard: Set categories/tags via HTML tag attribute?

2015-10-12 Thread bar
Author: Felix Heller Email: felix.hel...@aimcom.de Message: I would like to use different tags (or categories) for different parts of a website and I would like to have a "Default" tag which includes all pages that are not part of another category. I tried to configure different tags for

[General] Webboard: indexing time

2015-02-18 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: We've used mnogosearch in the past and were happy with it. But when we installed it on that old site, it took several days to index the site and reduced site performance while that was going on. That was several versions ago

[General] Webboard: indexing time

2015-02-14 Thread bar
Author: Milton Griepp Email: mgri...@icv2.com Message: We've used mnogosearch in the past and were happy with it. But when we installed it on that old site, it took several days to index the site and reduced site performance while that was going on. That was several versions ago and on a

[General] Webboard: mnoGo 3.4.0, no results...

2015-01-27 Thread bar
Author: B3r3n Email: Message: mnogosearch 3.4.0 :-) MySQL is 5.6.16 Reply: http://www.mnogosearch.org/board/message.php?id=21686 ___ General mailing list General@mnogosearch.org http://lists.mnogosearch.org/listinfo/general

[General] Webboard: how to rss or xml output ?

2015-01-17 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: In order to avoid support to spend time ... I found it ! ... just in case other need it : -- look in cluster section, it's not made for that, but it does it Right, just use node.xml as an example of a template with XML output. You

[General] Webboard: max 3 results from each site

2015-01-17 Thread bar
Author: Fabrice Email: Message: Maybe I missed something in explanations ... In the search results, how can I limit the results from each same site to (for example) max 3 from each. The problem I have is that I have a mix of huge site+very small sites indexed, and it is a bit annoying to have

[General] Webboard: max 3 results from each site

2015-01-17 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Maybe I missed something in explanations ... In the search results, how can I limit the results from each same site to (for example) max 3 from each. The problem I have is that I have a mix of huge site+very small sites

[General] Webboard: how to rss or xml output ?

2015-01-15 Thread bar
Author: Fabrice Email: Message: In order to avoid support to spend time ... I found it ! ... just in case other need it : -- look in cluster section, it's not made for that, but it does it (mnogosearch has terrific possibilities ; thanks guys !) Reply:

[General] Webboard: how to rss or xml output ?

2015-01-14 Thread bar
Author: Fabrice Email: Message: Hi, I searched the board, but no discussion on that topic... So, how is it possible to query(like usual) the cgi engine, and have the result sent as an RSS feed ? (if not possible, then as xml) This would give many many possibilities abilities to create feeds as

[General] Webboard: mnoGo 3.4.0, no results...

2015-01-11 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi Alex, Some more inputs. I tested with the original search.cgi, just changing : DBAddr to mysql://USER:PASS@localhost/DATABASE/?dbmode=blobsoc ket=/tmp/mysql.sockQcache=yesps=yesDeflate=yescompression=on Query produced no

[General] Webboard: mnoGo 3.4.0, no results...

2015-01-11 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi Laurent, Sorry for delay. I was on New year holidays. Hi Alex, I moved to FreeBSD 10.1 x64, and this moved me to a mnoGo port v3.4.0. First I am surprised, you only only talk about 3.3.15. What's this 3.4.0 ? It's a new

[General] Webboard: mnoGo 3.4.0, no results...

2014-12-30 Thread bar
Author: B3r3n Email: bozo4312 Message: Hi Alex, Some more inputs. I tested with the original search.cgi, just changing : DBAddr to mysql://USER:PASS@localhost/DATABASE/?dbmode=blobsoc ket=/tmp/mysql.sockQcache=yesps=yesDeflate=yescompression=on Query produced no answer. I searched for 'test',

[General] Webboard: mnoGo 3.4.0, no results...

2014-12-28 Thread bar
Author: Laurent Email: Message: Hi Alex, I moved to FreeBSD 10.1 x64, and this moved me to a mnoGo port v3.4.0. First I am surprised, you only only talk about 3.3.15. What's this 3.4.0 ? Also, it was perfectly working in 3.3.1 version, but no longer. 1- When I was indexing 600 Kurls with

[General] Webboard: tagging or categorizing without crawling again

2014-12-12 Thread bar
Author: bruno Email: bruno.v...@gmail.com Message: Thank you alexander, that was exactly what i was looking for! Kind regards, Bruno Reply: http://www.mnogosearch.org/board/message.php?id=21670 ___ General mailing list General@mnogosearch.org

[General] Webboard: tagging or categorizing without crawling again

2014-12-11 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Actually, the way of using tag or categories is perfect but, i don't want to crawl again the whole site because i didn't write my tagging rule in the correct way the first time. This task consists of two parts: a. update what you

[General] Webboard: tagging or categorizing without crawling again

2014-12-08 Thread bar
Author: bruno Email: bruno.v...@gmail.com Message: Thanks for your reply, it would be by using documents properties. Actually, the way of using tag or categories is perfect but, i don't want to crawl again the whole site because i didn't write my tagging rule in the correct way the first time.

[General] Webboard: tagging or categorizing without crawling again

2014-12-06 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: Hi Bruno, Hi Alexander and big congrats for the amazing tool you've built. I intend to use it as a seo tool but i came to an issue : i would like to tag or categorize the urls after having already fetched the content but i can't

[General] Webboard: tagging or categorizing without crawling again

2014-12-05 Thread bar
Author: bruno Email: bruno.v...@gmail.com Message: Hi Alexander and big congrats for the amazing tool you've built. I intend to use it as a seo tool but i came to an issue : i would like to tag or categorize the urls after having already fetched the content but i can't figure how to do it. We

[General] Webboard: Sqlite 'UNIQUE constraint failed' problem

2014-08-17 Thread bar
Author: ivan Email: sss_...@inbox.ru Message: Iv install product with SQliht3 on SUSE from ppa, and on Debian manually buld from scratch. Same problem: indexer indexer[18503]: indexer from mnogosearch-3.3.15-sqlite3 started with '/etc/mnogosearch/indexer.conf' indexer[18503]: [18503]{01}

[General] Webboard: Creating custom sections from server headers

2014-08-06 Thread bar
Author: Oliver Email: Message: Hello, first, thank you for the great search engine you have created! For indexing a custom site, I want to create a custom section which should contain the filename extracted from the Content-Disposition HTTP header. This header is sent for downloadable files

[General] Webboard: Also problem with mysqld_stmt_execute

2014-05-29 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: indexer starts allright, but stops after 0-10 good hits. Incorrect arguments to mysqld_stmt_execute Tried a lot of stuff, but no luck... Which MySQL version are you using? Perhaps you hit this problem:

[General] Webboard: Also problem with mysqld_stmt_execute

2014-05-29 Thread bar
Author: Tom Paamand Email: Message: Thanx for answer. I think it is a very good guess, and have forwarded it to my host. My Mysql version is 5.0.90, and is covered in the bug report. I will return with more info, if this was the solution! Ubuntu server 10.04.1 x86_64 Mysql 14.12 Distrib

[General] Webboard: Still problem with mysqld_stmt_execute

2014-05-29 Thread bar
Author: Tom Paamand Email: Message: The actual MySQL base called is 5.1.61, though system MySQL is 5.0.90, so that bug is unfortunately not my answer. Problem is still, that indexer starts OK, but stops after 0-10 good hits - with this error: indexer[17341]: [17341]{01}

[General] Webboard: Still problem with mysqld_stmt_execute

2014-05-29 Thread bar
Author: Alexander Barkov Email: b...@mnogosearch.org Message: The actual MySQL base called is 5.1.61, though system MySQL is 5.0.90, so that bug is unfortunately not my answer. Problem is still, that indexer starts OK, but stops after 0-10 good hits - with this error:

[General] Webboard: No problem with mysqld_stmt_execute

2014-05-29 Thread bar
Author: Tom Paamand Email: Message: ps=none did the trick! I have put it like /?DBMode=blobps=none - and it works now. I have only changed Server and DBAddr to my own stuff in the conf-dist, so if ps=none does not have any bad site effects, I will use this. Your first command indexer

[General] Webboard: Also problem with mysqld_stmt_execute

2014-05-28 Thread bar
Author: Tom Paamand Email: Message: indexer starts allright, but stops after 0-10 good hits. Incorrect arguments to mysqld_stmt_execute Tried a lot of stuff, but no luck... - $ /mnogo/sbin/indexer -Eblob indexer[17151]: Converting to blob indexer[17151]: Loading URL list indexer[17151]:

[General] Webboard: mnoGoSearch 3.3 - 3.4 MySQL issue

2014-05-13 Thread bar
Author: Laurent Email: Message: Hi Guys, I moved my platform and recompiling mnoGoSearch also moved me from 3.3.15 to 3.4.0 When I launch, I got a MySQL erreur because of new/different fields (urlinfob for example). Is there a migration process to keep all the indexed data ? Thanks Brgrds

[General] Webboard: 1111111

2014-05-04 Thread bar
Author: Email: 111 Message: Reply: http://www.mnogosearch.org/board/message.php?id=21641 ___ General mailing list General@mnogosearch.org http://lists.mnogosearch.org/listinfo/general

[General] Webboard: Error: 'DB err: mysql_stmt_execute() failed:

2014-04-30 Thread bar
Author: mamadoo06 Email: fohoi...@gmail.com Message: Hi, When I start indexer, it stops immediately, displaying : indexer[2767] Error: [2767]{01} mysql_stmt_execute() failed: Incorrect string value: '\xE9gorie...' for column 'sval' at row 1 indexer[2767] Error: [2767]{01} Error: 'DB err:

[General] Webboard: Error: 'DB err: mysql_stmt_execute() failed:

2014-04-30 Thread bar
Author: mamadoo06 Email: fohoi...@gmail.com Message: Ok that was encoding error Reply: http://www.mnogosearch.org/board/message.php?id=21640 ___ General mailing list General@mnogosearch.org http://lists.mnogosearch.org/listinfo/general

  1   2   3   >