On 30 September 2015 at 15:12, Bernardo Gonzalez Kriegel < bgkrie...@gmail.com> wrote:
> On Wed, Sep 30, 2015 at 7:58 AM, Dwayne Bailey <dwa...@translate.org.za> > wrote: > >> >> If you are getting a traceback from a file that doesn't exist in 2.7.2 >> then the env is still dirty somehow. The only way to get that is stray >> .pyc files. It would be important to pyclean in the actual venv >> installation. It would help if you could confirm that the .py and indeed >> the .pyc files are not present in your venv. >> >> If you still get it then Pootle is pulling those in from some other >> installation somewhere. >> >> >>> >>> I did a clean install of 2.7.2 on a new virtualenv. >>> With that filetree I managed to get Pootle running again, >>> so perhaps the upgrade process does not remove some files !! >>> >> >> The .pyc's are usually the issue. >> > > I checked that pyclean removes all 'pyc' files, but what I found is that > there is no > models.py file, only a 'pyo' one > > ./env/lib/python2.7/site-packages/pootle/apps/pootle_profile/models.pyo > Then be the bad ones. Weird pyclean is meant to remove .pyc and .pyo files. rm $(find /env/lib/python2.7/site-packages/pootle -name "*.pyo") > > Pootle is only installed on the virtualenvs. > For testing I will keep for now the clean install, I'll try the update > procedure again > when a new version of 2.6.x is released > > >> >>> >>> I'm now struggling with elasticsearch and other issues :( >>> >> >> Feel free to post them here. Note that ES isn't critical, but you want >> it for local TM. Leandro has just setup ES for some work we want to do on >> improving local TM. So its a good time to ask. >> >> > > Issues I found: > > 1) Core dump when running calculate_checks or refresh_stats > Last time I tried my server crashed, it need a harware reset. > I did those jobs using something like > > for project in $( pootle list_projects ); do pootle calculate_checks > --no-rq -v 3 --traceback --project $project; done > > and something similar to refresh_stats. > Perhaps I have too many projects > Your server must be massive. I hit that with calculate_checks and thought also that it was my projects that where too big. I've never hit that with refresh_stats, in fact not sure how you did as those should just spawn jobs in RQ. > > 2) Local TM seems a nice feature, I have elasticsearch running > ( default install, I'm new to this and redis and RQ... ) > > curl http://localhost:9200 > { > "status" : 200, > "name" : "Lorelei II", > "cluster_name" : "elasticsearch", > "version" : { > "number" : "1.7.2", > "build_hash" : "e43676b1385b8125d647f593f7202acbd816e8ec", > "build_timestamp" : "2015-09-14T09:49:53Z", > "build_snapshot" : false, > "lucene_version" : "4.10.4" > }, > "tagline" : "You Know, for Search" > } > > but when trying update_tmserver I got > > $ pootle update_tmserver -v 3 --dry-run > Can you try by adding --rebuild which will rebuild the TM resources from scratch. The current command line will simply update an existing LocalTM and clearly you haven't got one yet. The command needs to be more robust and clearer. Will push your traceback into an issue to track this see https://github.com/translate/pootle/issues/4120 > 2015-09-30 10:55:33,485 INFO Loading custom settings from > '/root/.pootle/pootle.conf'... > 2015-09-30 13:55:33,704 INFO Using Python PO > System check identified some issues: > > WARNINGS: > ?: (pootle.W017) There are user accounts with duplicate emails. This will > not be allowed in Pootle 2.8. > HINT: Try using 'pootle find_duplicate_emails', and then update > user emails with 'pootle update_user_email username email'. You might also > want to consider using pootle merge_user or purge_user commands > Traceback (most recent call last): > File "/var/www/pootle/env/bin/pootle", line 11, in <module> > sys.exit(main()) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/runner.py", > line 309, in main > django_settings_module='pootle.settings') > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/runner.py", > line 289, in run_app > management.execute_from_command_line(command) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/__init__.py", > line 385, in execute_from_command_line > utility.execute() > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/__init__.py", > line 377, in execute > self.fetch_command(subcommand).run_from_argv(self.argv) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/base.py", > line 288, in run_from_argv > self.execute(*args, **options.__dict__) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/django/core/management/base.py", > line 338, in execute > output = self.handle(*args, **options) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/pootle/apps/pootle_app/management/commands/update_tmserver.py", > line 152, in handle > 'field': 'revision' > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/client/utils.py", > line 69, in _wrapped > return func(*args, params=params, **kwargs) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/client/__init__.py", > line 506, in search > params=params, body=body) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/transport.py", > line 307, in perform_request > status, headers, data = connection.perform_request(method, url, > params, body, ignore=ignore, timeout=timeout) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py", > line 89, in perform_request > self._raise_error(response.status, raw_data) > File > "/var/www/pootle/env/local/lib/python2.7/site-packages/elasticsearch/connection/base.py", > line 105, in _raise_error > raise HTTP_EXCEPTIONS.get(status_code, TransportError)(status_code, > error_message, additional_info) > elasticsearch.exceptions.RequestError: TransportError(400, > u'SearchPhaseExecutionException[Failed to execute phase [query], all shards > failed; shardFailures {[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][0]: > SearchParseException[[translations][0]: > query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse > source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical": > {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet > [stat1]: No mapping found for field [revision]]; > }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][1]: > SearchParseException[[translations][1]: > query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse > source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical": > {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet > [stat1]: No mapping found for field [revision]]; > }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][2]: > SearchParseException[[translations][2]: > query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse > source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical": > {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet > [stat1]: No mapping found for field [revision]]; > }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][3]: > SearchParseException[[translations][3]: > query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse > source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical": > {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet > [stat1]: No mapping found for field [revision]]; > }{[aQHk0CPtT1K_ZZ2YJG8rjQ][translations][4]: > SearchParseException[[translations][4]: > query[ConstantScore(*:*)],from[-1],size[-1]: Parse Failure [Failed to parse > source [{"query": {"match_all": {}}, "facets": {"stat1": {"statistical": > {"field": "revision"}}}}]]]; nested: FacetPhaseExecutionException[Facet > [stat1]: No mapping found for field [revision]]; }]') > > Don't know if I need to setup or run another thing > > Bernardo > > > -- Dwayne *Translate* +27 12 460 1095 (work) ------------------------------------------------------------------------------ _______________________________________________ Translate-pootle mailing list Translate-pootle@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/translate-pootle
