Displaying 3 results from an estimated 3 matches for "3b0e8851".
2010 Oct 14
0
[LLVMdev] llvm.org robots.txt prevents crawling by Google code search?
> indexing the llvm.org svn archive. This means that when you search for an
> LLVM-related symbol in code search, you get one of the many (possibly
> out-of-date) mirrors, rather than the up-to-date llvm.org version. This is
> sad.
This is intentional. The workload of the server was pretty huge w/o this.
--
With best regards, Anton Korobeynikov
Faculty of Mathematics and Mechanics,
2010 Oct 14
1
[LLVMdev] llvm.org robots.txt prevents crawling by Google code search?
...>
> --
> With best regards, Anton Korobeynikov
> Faculty of Mathematics and Mechanics, Saint Petersburg State University
>
--
-- Talin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20101014/3b0e8851/attachment.html>
2010 Oct 13
3
[LLVMdev] llvm.org robots.txt prevents crawling by Google code search?
One of the tools I use most frequently when coding is Google codesearch.
Unfortunately, llvm.org's robots.txt appears to block all crawlers from
indexing the llvm.org svn archive. This means that when you search for an
LLVM-related symbol in code search, you get one of the many (possibly
out-of-date) mirrors, rather than the up-to-date llvm.org version. This is
sad.
For more info, see the