EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/406068 )
Change subject: Fixup xgboost training
..
Fixup xgboost training
* Use tree_method = hist when training on a single worker. This is
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/406067 )
Change subject: Pull make_cv_objective outside tuner
..
Pull make_cv_objective outside tuner
This really had no business in tuner,
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/406069 )
Change subject: add python interface to scala dbn
..
add python interface to scala dbn
It turns out only the driver has a py4j
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/406070 )
Change subject: Add end-to-end integration test
..
Add end-to-end integration test
A basic end to end run through of the training
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/405209 )
Change subject: Support LXC in Vagrantfile
..
Support LXC in Vagrantfile
LXC, from a linux host, can be significantly more responsive
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/405206 )
Change subject: Switch wiktionary sister search on enwiki to title only
..
Switch wiktionary sister search on enwiki to title only
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/404595 )
Change subject: Turn off cirrus AB test on hewiki
..
Turn off cirrus AB test on hewiki
Test has run it's course. Time to turn off and
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/404594 )
Change subject: Turn off cirrus AB test on hewiki
..
Turn off cirrus AB test on hewiki
Test has run it's course. Time to turn off and
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/404592 )
Change subject: Remove cirrus AB test config for hewiki
..
Remove cirrus AB test config for hewiki
This test is complete and the
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/404591 )
Change subject: Turn off hewiki AB test
..
Turn off hewiki AB test
Test has run it's course. Time to turn off and reset hewiki
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403869 )
Change subject: Generalize tuning pipeline
..
Generalize tuning pipeline
This pipeline was pretty convoluted. Push most of the
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403719 )
Change subject: Deprecate old interwiki search result widget
..
Deprecate old interwiki search result widget
Update the flag for new
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403546 )
Change subject: Repoint spark in example_train.yaml
..
Repoint spark in example_train.yaml
Mostly this makes it easier to push a
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403545 )
Change subject: JVM components to support file-based training
..
JVM components to support file-based training
An upcoming refactor
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403335 )
Change subject: Add lightgbm support
..
Add lightgbm support
Only support single-executor training at the moment. Distributed
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/40 )
Change subject: Simplify hyperparameter tuning
..
Simplify hyperparameter tuning
I tested letting all the tuning happen at once
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/403336 )
Change subject: [WIP] distributed training for lightgbm
..
[WIP] distributed training for lightgbm
untested. The daemon never closes
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/402114 )
Change subject: [WIP] Merge remote-tracking branch 'upstream/master'
..
[WIP] Merge remote-tracking branch 'upstream/master'
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/401795 )
Change subject: Revert "Add backend support for the new crossproject result
page A/B test"
..
Revert "Add backend support for the new
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/401794 )
Change subject: Remove old interwiki search result widget
..
Remove old interwiki search result widget
This code is no longer
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/401631 )
Change subject: Bring back human search relevance survey
..
Bring back human search relevance survey
This survey was temporarily
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/399312 )
Change subject: Push pagination decision for prefix search into SearchEngine
..
Push pagination decision for prefix search into
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/398394 )
Change subject: Dont discount file searches on commonswiki
..
Dont discount file searches on commonswiki
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/398192 )
Change subject: Silently drop unknown titles in completion search
..
Silently drop unknown titles in completion search
This mimics
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/398129 )
Change subject: Remove duplicate uploads in integration tests
..
Remove duplicate uploads in integration tests
The same files were
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/398124 )
Change subject: Resolve redirect namespaces from source docs in fancy title
results type
..
Resolve redirect namespaces from source
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/398093 )
Change subject: Enable Cirrus MLR for 4 more wikis
..
Enable Cirrus MLR for 4 more wikis
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397988 )
Change subject: Turn off a couple search ranking models that arnt ready
..
Turn off a couple search ranking models that arnt ready
It
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397985 )
Change subject: Turn on second mlr test for hewiki
..
Turn on second mlr test for hewiki
Re-uses the same sampling rates as last time
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397984 )
Change subject: Turn on second mlr test for hewiki
..
Turn on second mlr test for hewiki
Re-uses the same sampling rates as last time
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397973 )
Change subject: Turn on second mlr test for hewiki
..
Turn on second mlr test for hewiki
Resets enwiki to its default sampling of
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397970 )
Change subject: Turn on MLR for most wikis with >1% of search traffic
..
Turn on MLR for most wikis with >1% of search traffic
Based
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397968 )
Change subject: Add sanity checks for more languages
..
Add sanity checks for more languages
I'm not completely sure these are very
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397735 )
Change subject: [WIP] Additional integration test features for cindy
..
[WIP] Additional integration test features for cindy
WIP
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397582 )
Change subject: Setup MLR AB test for hewiki
..
Setup MLR AB test for hewiki
Last time around we trained the hewiki model on an
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/397569 )
Change subject: Simple hack to override mlr model from query string
..
Simple hack to override mlr model from query string
This is a
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396553 )
Change subject: Port remaining dump_* features to nodejs
..
Port remaining dump_* features to nodejs
I changed these up a bit to make
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396552 )
Change subject: Port update_weight_api.feature to nodejs
..
Port update_weight_api.feature to nodejs
Replace 'within ...' calls with
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396472 )
Change subject: port update_redirect_loop.feature to nodejs
..
port update_redirect_loop.feature to nodejs
Almost a straight copy
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396471 )
Change subject: Port update_redirect_api.feature to nodejs
..
Port update_redirect_api.feature to nodejs
Mostly a straight copy from
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396470 )
Change subject: port update_non_existent_api.feature to nodejs
..
port update_non_existent_api.feature to nodejs
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/396098 )
Change subject: Specialize single-node training
..
Specialize single-node training
XGBoost has a faster training method, tree_method
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395923 )
Change subject: Enable more accurate smaps based rss checking
..
Enable more accurate smaps based rss checking
Training xgboost
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395915 )
Change subject: [DNM] more debugging of RssFile explosion
..
[DNM] more debugging of RssFile explosion
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395856 )
Change subject: [DNM] Test xgboost4j-spark with fast hist tree maker
..
[DNM] Test xgboost4j-spark with fast hist tree maker
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395826 )
Change subject: Simple hack to override mlr model from query string
..
Simple hack to override mlr model from query string
This is a
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395617 )
Change subject: AtLeastNDistinct returns wrong value on merge
..
AtLeastNDistinct returns wrong value on merge
The merge operation
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395611 )
Change subject: Add unique tag to log instances in RabitTracker
..
Add unique tag to log instances in RabitTracker
We often have
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395592 )
Change subject: Add background resource monitor task to training
..
Add background resource monitor task to training
We have
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395062 )
Change subject: Add option to train using external memory
..
Add option to train using external memory
I'm not sure what exactly has
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/395063 )
Change subject: Allow spark to keep the full data pipeline in memory
..
Allow spark to keep the full data pipeline in memory
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394741 )
Change subject: [WIP] Bad ideas for improved DBN performance
..
[WIP] Bad ideas for improved DBN performance
I'm not sure this is a
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394509 )
Change subject: Port DBN from clickmodels to scala
..
Port DBN from clickmodels to scala
DBN takes quite some time when running
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394120 )
Change subject: Include highlight snippets when using search as api generator
..
Include highlight snippets when using search as api
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394117 )
Change subject: Copy spark config into place on deploy
..
Copy spark config into place on deploy
Putting this configuration into a
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394108 )
Change subject: Better error message if wiki missing in data_pipeline
..
Better error message if wiki missing in data_pipeline
Not
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394099 )
Change subject: Rename counter variables to i to make tox happy
..
Rename counter variables to i to make tox happy
Tox run by CI has
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394011 )
Change subject: Add basic pre-deployment sanity check for MLR
..
Add basic pre-deployment sanity check for MLR
Implements a very
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394003 )
Change subject: Add default path for spark utility config file
..
Add default path for spark utility config file
This defaults the
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/394002 )
Change subject: Revert "Revert "Deploy MjoLniR with new deploy repository""
..
Revert "Revert "Deploy MjoLniR with new deploy
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/393997 )
Change subject: bump mjolnir dependency to master
..
bump mjolnir dependency to master
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/393997 )
Change subject: bump mjolnir dependency to master
..
bump mjolnir dependency to master
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/393693 )
Change subject: Port prefer_recent_api.feature to nodejs
..
Port prefer_recent_api.feature to nodejs
* Remove @expect_failure tag
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/393694 )
Change subject: Port update_general_api.feature to nodejs
..
Port update_general_api.feature to nodejs
* Rework cirrusdoc api query
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392547 )
Change subject: port froezn_index_api.feature to nodejs
..
port froezn_index_api.feature to nodejs
* Deleted test marked
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392546 )
Change subject: port relevancy_api.feature to nodejs
..
port relevancy_api.feature to nodejs
* Removed 'within' steps. These are
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392538 )
Change subject: Port linksto and more_like tests to nodejs
..
Port linksto and more_like tests to nodejs
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392537 )
Change subject: Fixup unicode literals in feature files
..
Fixup unicode literals in feature files
And add all the tests that wern't
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392471 )
Change subject: [WIP] Add word ount statistic for articles
..
[WIP] Add word ount statistic for articles
The community survey asked
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392472 )
Change subject: Handle errors better in the tag tracker
..
Handle errors better in the tag tracker
When working on test sif you broke
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392469 )
Change subject: Add API action for dumping cirrus articles
..
Add API action for dumping cirrus articles
This is particularly
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/392470 )
Change subject: Get all nodejs tests passing from empty database
..
Get all nodejs tests passing from empty database
* Use the new
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391728 )
Change subject: Speed up DBN evaluation.
..
Speed up DBN evaluation.
The toDF() call in dbn.py causes us to evaluate one partition on
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391729 )
Change subject: Repair ability to collect data for undersized wikis
..
Repair ability to collect data for undersized wikis
When
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391622 )
Change subject: Replace custom array_contains with Column.isin
..
Replace custom array_contains with Column.isin
Not sure if this is
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391439 )
Change subject: Port exact_quotes_api.feature to nodejs
..
Port exact_quotes_api.feature to nodejs
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391441 )
Change subject: Port all cucumber hooks to nodejs
..
Port all cucumber hooks to nodejs
Port over all the hooks from ruby to nodejs
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391438 )
Change subject: Add did you mean api feature test to nodejs integ tests
..
Add did you mean api feature test to nodejs integ tests
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391442 )
Change subject: Port highlighting feature to nodejs
..
Port highlighting feature to nodejs
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391440 )
Change subject: Port filesearch_api.feature to nodejs
..
Port filesearch_api.feature to nodejs
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391437 )
Change subject: Add integration feature files that already pass
..
Add integration feature files that already pass
These feature
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391296 )
Change subject: Dont recreate virtualenv unless necessary
..
Dont recreate virtualenv unless necessary
It appears that while
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391296 )
Change subject: Dont recreate virtualenv unless necessary
..
Dont recreate virtualenv unless necessary
It appears that while the
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391294 )
Change subject: Bump mjolnir submodule
..
Bump mjolnir submodule
This brings in the patch that made working_dir configurable.
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391294 )
Change subject: Bump mjolnir submodule
..
Bump mjolnir submodule
This brings in the patch that made working_dir configurable. We
need
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391286 )
Change subject: Deploy pip and wheel packages for jessie
..
Deploy pip and wheel packages for jessie
Debian jessie based
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391286 )
Change subject: Deploy pip and wheel packages for jessie
..
Deploy pip and wheel packages for jessie
Debian jessie based hosts
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391268 )
Change subject: Remove --no-cache-dir from pip command
..
Remove --no-cache-dir from pip command
--no-cache-dir is not available for
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391268 )
Change subject: Remove --no-cache-dir from pip command
..
Remove --no-cache-dir from pip command
--no-cache-dir is not
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391266 )
Change subject: Fix typo in checks.yaml
..
Fix typo in checks.yaml
Change-Id: Ic261295a7ac7ff5bc155ea01928a08d4e49e7b2e
---
M
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391266 )
Change subject: Fix typo in checks.yaml
..
Fix typo in checks.yaml
Change-Id: Ic261295a7ac7ff5bc155ea01928a08d4e49e7b2e
---
M
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391265 )
Change subject: Setup scap checks for separate server groups
..
Setup scap checks for separate server groups
Doesn't look
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391265 )
Change subject: Setup scap checks for separate server groups
..
Setup scap checks for separate server groups
Doesn't look like the
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/391262 )
Change subject: scap.cfg: MjoLniR -> mjolnir
..
scap.cfg: MjoLniR -> mjolnir
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/391262 )
Change subject: scap.cfg: MjoLniR -> mjolnir
..
scap.cfg: MjoLniR -> mjolnir
Change-Id: I6b17fd077f7794fb3354496207cc9ec19c142d1e
---
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/390289 )
Change subject: Turn off AB test for DBN sizing on enwiki
..
Turn off AB test for DBN sizing on enwiki
Change-Id:
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/390286 )
Change subject: Turn off AB test for DBN sizing on enwiki
..
Turn off AB test for DBN sizing on enwiki
Change-Id:
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/384989 )
Change subject: Fetch inner hits and only the first page
..
Fetch inner hits and only the first page
Change-Id:
EBernhardson has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/317019 )
Change subject: Calculate click data for top queries
..
Calculate click data for top queries
Joins search request logs
EBernhardson has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/390162 )
Change subject: Try to unify phrase rescore with RescoreBuilder
..
Try to unify phrase rescore with RescoreBuilder
- kill
1 - 100 of 3031 matches
Mail list logo
