Re: [Wikitech-l] [reading-wmf] Fwd: Mobile Firendly

2015-05-30 Thread Bartosz Dziewoński
W dniu piątek, 29 maja 2015 Pine W wiki.p...@gmail.com napisał(a):

 Hmm. Why would we block robots there?



We don't. We disallowed /w/, because (quoting from doc comments) Friendly,
low-speed bots are welcome viewing article pages, but not
dynamically-generated pages please., and that accidentally caught
/w/load.php, which until recently was loaded from a different domain.


-- 
-- Matma Rex
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [reading-wmf] Fwd: Mobile Firendly

2015-05-29 Thread Jon Katz
+external mobile and wikitech

Shoot.  I meant to send this the external list.  For those of you just
joining us, we recently got an email from google letting us know that some
of our pages are now failing the mobile-friendly test, which has an adverse
impact on our search results.  It appears that most of our pages are also
blocking style info.

Google doesn't offer much insight into penalties, but if they're sending us
the email then it is or will have some impact.  I'd like to see if we can
better understand the other side of the equation- what is cost of fixing
it?  I think Jon's questions below are the ones to start with.

-J


On Fri, May 29, 2015 at 1:35 PM, Jon Robson jrob...@wikimedia.org wrote:

 It's all in the report. We block w/ in robots.txt always have.

 There have been a bunch of changes to improve performance of the site
 overall which might have led to that. Mailing this to the public mailing
 list wikitech would give you a better idea.

 Our site /is/ mobile friendly it's just we tell google not to load styles
 from w/load.php so no need to panic.

 The question is what is the penalty of us failing this tool? Does it
 impact our google search rankings?

 Fix is trivial.. Update robots.txt but first the question is why are we
 blocking scripts and styles on that url?
 On 29 May 2015 1:17 pm, Jon Katz jk...@wikimedia.org wrote:

 Hi Readership team and broader community,
 Any changes we might have recently made to cause this warning to appear
 about googlebot not being able to access our site?
 I consider this to be a very serious issue.
 The examples below are not mobile, but same issue applies when you try an
 en.m. version of the pages.

 Best,
 Jon


 -- Forwarded message --
 From: Wes Moran wmo...@wikimedia.org
 Date: Fri, May 29, 2015 at 12:47 PM
 Subject: Mobile Firendly
 To: Jon Katz jk...@wikimedia.org
 Cc: Adam Baso ab...@wikimedia.org


 Jon,

 Google notified us of the followin...

 We recently noticed that there was a change with how you embed CSS  JS
 which results in us not being able to use the CSS  JS to recognize what
 the page looks like. That's making some of your pages fail the
 mobile-friendly-test, for example. You used to load CSS  JS from
 bits.wikimedia.org, but now they're loaded through /w/load.php?...
 directly from the Wikipedia host, where that path is blocked by robots.txt.

 You can see how we render the pages with Fetch as Google in Webmaster
 Tools / Search Console, you can also see most of that with the test-page at:

 https://www.google.com/webmasters/tools/mobile-friendly/?url=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FBusot

 Some of the pages still pass the test there (example
 https://www.google.com/webmasters/tools/mobile-friendly/?url=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FZ%25C3%25BCrich),
 but the CSS is broken there too since it's blocked. 

 Any ideas what can be causing this?

 Regards,
 Wes


 ___
 reading-wmf mailing list
 reading-...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/reading-wmf


 ___
 reading-wmf mailing list
 reading-...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/reading-wmf


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] [reading-wmf] Fwd: Mobile Firendly

2015-05-29 Thread Jon Katz
Since Brandon's email a minute ago crossed mine in the ether and did not
make it to external lists, I am pasting it here:

On Fri, May 29, 2015 at 1:53 PM, Brandon Black bbl...@wikimedia.org wrote:
We've merged up https://gerrit.wikimedia.org/r/#/c/214705/1 to address
this, and I've purged the caches to ensure the update is fully live
already.  It should address the issue, assuming that the block on RL's
/w/load.php entry point was the only part of the problem.

On Fri, May 29, 2015 at 1:55 PM, Jon Katz jk...@wikimedia.org wrote:

 +external mobile and wikitech

 Shoot.  I meant to send this the external list.  For those of you just
 joining us, we recently got an email from google letting us know that some
 of our pages are now failing the mobile-friendly test, which has an adverse
 impact on our search results.  It appears that most of our pages are also
 blocking style info.

 Google doesn't offer much insight into penalties, but if they're sending
 us the email then it is or will have some impact.  I'd like to see if we
 can better understand the other side of the equation- what is cost of
 fixing it?  I think Jon's questions below are the ones to start with.

 -J


 On Fri, May 29, 2015 at 1:35 PM, Jon Robson jrob...@wikimedia.org wrote:

 It's all in the report. We block w/ in robots.txt always have.

 There have been a bunch of changes to improve performance of the site
 overall which might have led to that. Mailing this to the public mailing
 list wikitech would give you a better idea.

 Our site /is/ mobile friendly it's just we tell google not to load styles
 from w/load.php so no need to panic.

 The question is what is the penalty of us failing this tool? Does it
 impact our google search rankings?

 Fix is trivial.. Update robots.txt but first the question is why are we
 blocking scripts and styles on that url?
 On 29 May 2015 1:17 pm, Jon Katz jk...@wikimedia.org wrote:

 Hi Readership team and broader community,
 Any changes we might have recently made to cause this warning to appear
 about googlebot not being able to access our site?
 I consider this to be a very serious issue.
 The examples below are not mobile, but same issue applies when you try
 an en.m. version of the pages.

 Best,
 Jon


 -- Forwarded message --
 From: Wes Moran wmo...@wikimedia.org
 Date: Fri, May 29, 2015 at 12:47 PM
 Subject: Mobile Firendly
 To: Jon Katz jk...@wikimedia.org
 Cc: Adam Baso ab...@wikimedia.org


 Jon,

 Google notified us of the followin...

 We recently noticed that there was a change with how you embed CSS  JS
 which results in us not being able to use the CSS  JS to recognize what
 the page looks like. That's making some of your pages fail the
 mobile-friendly-test, for example. You used to load CSS  JS from
 bits.wikimedia.org, but now they're loaded through /w/load.php?...
 directly from the Wikipedia host, where that path is blocked by robots.txt.

 You can see how we render the pages with Fetch as Google in Webmaster
 Tools / Search Console, you can also see most of that with the test-page at:

 https://www.google.com/webmasters/tools/mobile-friendly/?url=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FBusot

 Some of the pages still pass the test there (example
 https://www.google.com/webmasters/tools/mobile-friendly/?url=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FZ%25C3%25BCrich),
 but the CSS is broken there too since it's blocked. 

 Any ideas what can be causing this?

 Regards,
 Wes


 ___
 reading-wmf mailing list
 reading-...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/reading-wmf


 ___
 reading-wmf mailing list
 reading-...@lists.wikimedia.org
 https://lists.wikimedia.org/mailman/listinfo/reading-wmf



___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l