similar to: robots.txt best practices

Displaying 20 results from an estimated 5000 matches similar to: "robots.txt best practices"

2009 Aug 06
2
robots.txt
Hi all, I have again noticed that the wiki does not really show up in search results and wonder if it has any impact that robots.txt on wiki.centos.org is empty. Perhaps it should at least contain User-agent: * ? Best Regards Marcus
2010 Jan 16
3
httpd and robots.txt
would anyone out there care to share their robots.txt experience using centos as a webserver and their robots.txt files? i realize this is a somewhat simple exercise, yet i am sure there are both large and small hosters out there and possibly those that have high traffic modify their robots.txt files differently that others ??? please share if you can or care to please? for years we have just
2001 Dec 30
1
WARNING: Your email is vulnerable to SPAM Robots!
Dear Email user, Your email address samba@samba.org was harvested by a SPAM robot. It got your address from the webpage http://us1.samba.org/samba/docs/man/smb.conf.5.html For mor information about SPAM Robots and how you can protect yourself, Click Here http://www.email-cloak.com/default.asp?ID=396631&T=35429 Sincerely, Champ Mitchell Anti-Spam Services http://www.email-cloak.com
2006 Feb 09
6
troubleshooting an observe_field
Hi, I''ve got a live_search field in a partial that is on several different pages. On all pages, except 1, it works fine. On the page it doesn''t work on, it seems it never executes it action. Here''s my observe_field code inside the partial: <h1><label for="searchtext">Live Search:</label></h1> <%= text_field_tag :searchtext
2009 Aug 28
4
favicon.ico and robots.txt
Hello, I'm running an apache 2.2 webserver on centos 5.3. I'm seeing frequent requests for robots.txt and favicon.ico from the logs those files should be in the document root area. What are these files, is this something the rpm installs, or do i have to retrieve or generate them? Thanks. Dave.
2006 Mar 24
4
validate if different?
Hi, I seem to remember seeing the equivalent of saving only if all attributes are different. I can''t seem to find that now in the API or the agile book. I''m using the acts_as_versioned and only want to save if the input is different. Thanks, Steve http://www.smarkets.net -------------- next part -------------- An HTML attachment was scrubbed... URL:
2006 Feb 20
46
Ruby + Apache Lucene using XMLRPC?
Please excuse me if this has been answered before. Is there a "how-to" guide or a walkthrough on integrating Lucene with ROR via XMLRPC? I got Ferret to work but I am worried that it''s not going to be as scalable. I highly appreciate your assistance. Thanks Frank --------------------------------- Relax. Yahoo! Mail virus
2006 Mar 31
4
javascript help
Hi list, I have a list of tags. I want to be able to click on a tag and have that tag name populate an input field. I think delicious used to allow you to click on existing links to tag your bookmark similar to this (moving instead to auto_complete). My guess is the code looks something like this.... <form> <input type="text" name="all" id="discover"
2005 Dec 19
1
New rails site. Beta testers need.
Hi Rails List, I need some beta testers for my new site: http://www.smarkets.net. This list is literally the first group to see it, so be gentle. Smarkets is a prediction market for Amazon products. It takes Amazon products and turns them into a stock. The price of these "stocks" move based on the movement of its Amazon sales rank. If the sales rank goes up 10%, the price of the stock
2005 Dec 22
3
help with unless
Hi, I need a fresh set of eyes to look at this bit of controller code and tell me why I might be getting an error message: lookup = Profit.find(:all, :conditions => [ "user_id = ? AND product_id = ?", uid, pid]) unless lookup.empty? if (lookup.updated_on > 360.minutes.ago) return end end If lookup is empty, then I
2006 Mar 15
7
Populating text_tag with serialized data
I am using a serialized attribute in one of my models The serialized data is in the form of an array. I want to have a text_tag for each element contained in my serialized attribute. How would I construct the text_tag? My model name is ''questions''. The serialized attribute is "answers" So I might have: <% form tag %> <% text_tag ''question'',
2006 Apr 17
3
help debugging an error
Hi, I''ve started getting an error I can''t debug. The error doesn''t generate anything in my development log. A breakpoint set right at the beggining of the controller method does not get triggered. It happens on a form submission. I can make changes to the object model from with the console, but not on this form submission. I thought maybe it was routing, because I have
2005 Dec 26
2
resorting a dataset
Quick question to see how I might re-sort an Activerecord data set. Let''s say I have this table: tablename: testscores | id | student | score | avg_for_year 1, steve, 85, 82 2, tom, 84, 92, 3, jim, 92, 95 In my controller, I have something like: t= Testscores.find(:all, :order => "score DESC", :limit => 2) ...where it would return the records for Jim and Steve.... My
2017 Jun 28
3
LLVM docs links broken
The docs found on google have been vastly out of date for quite a while. For that time, http://llvm.org/doxygen/ has been the correct home of the API docs. See also http://llvm.org/pr32412. The server move last weekend dropped the legacy files. It'll take the google index a bit to notice. robots.txt currently prevents indexing of /doxygen, because there was an issue with the robots, I've
2017 Jun 28
3
LLVM docs links broken
On 27 June 2017 at 19:11, George Burgess IV via llvm-dev <llvm-dev at lists.llvm.org> wrote: > There was some kind of server move that happened recently; I'm > assuming this is a side-effect of that. I'd vaguely understood the old links had been deprecated for a while. Unfortunately they're still the top Google results when you search for the relevant classes, which is
2006 May 11
9
acts_as_commentable plugin
I''ve just about finished up work on a plugin similar to acts_as_taggable, but for comments instead which would allow you to attach comments (possibly even a threaded discussion if conbined with acts_as_tree) to any object. Is there anyone that would be interested in it? I don''t want to go throug the trouble of finding some way to distribute it unless I know that there is a
2006 Apr 16
2
conditional updated_on update
Hi list, I''ve got some counter_caches in a model. When these get incremented - say on a page view - my updated_on column also gets updated. How can I conditionally not update updated_on if just these counter_cache columns change? The problem with that is that I am using acts_as_versioned which clones the record each time updated_on changes. I am successfully ignoring the counter_cache
2010 Oct 14
1
[LLVMdev] llvm.org robots.txt prevents crawling by Google code search?
On Wed, Oct 13, 2010 at 11:10 PM, Anton Korobeynikov < anton at korobeynikov.info> wrote: > > indexing the llvm.org svn archive. This means that when you search for > an > > LLVM-related symbol in code search, you get one of the many (possibly > > out-of-date) mirrors, rather than the up-to-date llvm.org version. This > is > > sad. > This is intentional. The
2006 Apr 02
3
updating the dom
Hi list, Say I''ve got a page that lists the students names and grades. Grades are clickable using a form_remote_tag that then renders a new partial on the right hand side of the page that then lists the individual test scores for the particularly student. So far so good. And lets say in the newly rendered right-hand section, I have another form_remote_tag that will allow me to input a
2006 Aug 03
9
Rails Cheatsheets!!!
Hey if you know any rails cheatsheet link add it inot the follwing list, lets make a long list on Rails cheatsheet.... ;) 1) 2) 3) 4) . . . -------------- next part -------------- An HTML attachment was scrubbed... URL: http://wrath.rubyonrails.org/pipermail/rails/attachments/20060103/a6eea2ac/attachment-0001.html