The blocking "robots.txt" is now removed form the XALAN TLP website.
It will take several hours for the change to become effective.

Sincerely,
Steven J. Hathaway
Xalan Documentation Project

> +1. I rely on Javadocs being indexed as well. This is a great way to
> search the web or a given site for features and documentation for
> free. I often do searches like "some feature of java too bar" and
> "site:apache.org dom XSL feature foo bat" and have google give me some
> javadoc. I can't tell you how many times I do "java 6 pattern" to have
> google give me the Javadoc for the JRE Pattern class.
>
> Gary
>
> On Jul 12, 2012, at 3:49, Gareth Reakes <gar...@we7.com> wrote:
>
>> Hey Steven,
>>
>>    I often look for API docs by searching for a method name on google.
>> Don't think we are too worried about traffic levels so I would
>> suggest not doing this if it will stop the API docs being searchable
>> with my use case.
>>
>> Cheers,
>>
>> Gareth
>>
>> On 12 Jul 2012, at 05:14, Steve Hathaway wrote:
>>
>>> Hurray!
>>>
>>> The site is now published to the mirrors for XALAN TLP
>>> "http://xalan.apache.org";
>>>
>>> I am now preparing a "robots.txt" file to keep web crawlers out of the
>>> program
>>> generated api documentation.  This should limit some excessive traffic
>>> and still
>>> have the needed pages captured by internet webpage indexers.
>>>
>>> #
>>> # Xalan website control: robots.txt
>>> #
>>> # Keep web crawlers out of auto-generated api documentation pages
>>> #
>>> User-agent: *
>>> Disallow: /xalan-c/apiDocs/
>>> Disallow: /xalan-j/apidocs/
>>> Disallow: /old/xalan-c/apiDocs/
>>> Disallow: /old/xalan-j/apidocs/
>>>
>>> Sincerely,
>>> Steven J. Hathaway
>>>
>>>
>>> On 7/11/2012 8:56 AM, shath...@e-z.net wrote:
>>>> Greetings,
>>>>
>>>> I am keeping an eye on this issue!
>>>>
>>>> The new website is net yet available on the mirrors.  I will check
>>>> in a few hours, and again tomorrow.
>>>>
>>>> Sincerely,
>>>> Steven J. Hathaway
>>>> Xalan Documentation Project
>>>>
>>>>
>>>> ==========================================================================
>>>>     [
>>>> https://issues.apache.org/jira/browse/INFRA-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
>>>> ]
>>>>
>>>> Joe Schaefer closed INFRA-5037.
>>>> -------------------------------
>>>>
>>>>    Resolution: Fixed
>>>>
>>>> Done
>>>>
>>>>> XALAN TLP is ready for svnpubsub
>>>>> --------------------------------
>>>>>
>>>>>                Key: INFRA-5037
>>>>>                URL: https://issues.apache.org/jira/browse/INFRA-5037
>>>>>            Project: Infrastructure
>>>>>         Issue Type: Task
>>>>>     Security Level: public(Regular issues)
>>>>>         Components: SvnPubSub, Website
>>>>>           Reporter: Steven J. Hathaway
>>>>>
>>>>> The Apache XALAN project is ready for web site maintenance using
>>>>> svnpubsub.
>>>>> Top Level = http://xalan.apache.org
>>>>> Repository = http://svn.apache.org/repos/asf/xalan/site/docs/xalan/
>>>>> The web pages in the subversion repository have been reviewed.
>>>>> There has also been extensive planning and review on my committer's
>>>>> web page and comments discussed on the developer's mail list.
>>>>> Sincerely,
>>>>> Steven J. Hathaway
>>>>> Xalan Documentation Project
>>>>> <shatha...@apache.org>
>>>> --
>>>> This message is automatically generated by JIRA.
>>>> If you think it was sent incorrectly, please contact your JIRA
>>>> administrators:
>>>> https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
>>>> For more information on JIRA, see:
>>>> http://www.atlassian.com/software/jira
>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: xalan-dev-unsubscr...@xml.apache.org
>>>> For additional commands, e-mail: xalan-dev-h...@xml.apache.org
>>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: xalan-dev-unsubscr...@xml.apache.org
>>> For additional commands, e-mail: xalan-dev-h...@xml.apache.org
>>>
>>>
>>
>> --
>> Gareth Reakes, CTO         we7 - Great Free Music
>> +44-20-7117-0809                   http://www.we7.com
>>
>> "The music business is a cruel and shallow money trench, a long plastic
>> hallway where thieves and pimps run free, and good men die like dogs.
>> There's also a negative side." - Hunter S. Thompson
>>
>>
>>
>>
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: xalan-dev-unsubscr...@xml.apache.org
>> For additional commands, e-mail: xalan-dev-h...@xml.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: xalan-dev-unsubscr...@xml.apache.org
> For additional commands, e-mail: xalan-dev-h...@xml.apache.org
>
>



---------------------------------------------------------------------
To unsubscribe, e-mail: xalan-dev-unsubscr...@xml.apache.org
For additional commands, e-mail: xalan-dev-h...@xml.apache.org

Reply via email to