[APML] OT: Deterring Robots

["Matt BenDaniel" <matt@starmatt.com>]

Most of us who maintain astrophotography web sites include an ownership
notice which, among other restrictions, prohibits copying and rehosting of
images from your site to their site (without your permission).  In the
past, a number of postings on the APML (some of them from me) have
complained that Google.com re-hosts our content -- without our permission
-- in the form of downsized images.

FYI I just discovered that this can be prevented.  Apparently if you
include the following in every page, Googlebot will refrain from copying
your images.

<META NAME="ROBOTS" CONTENT="NOARCHIVE">

If you want to maximize exclusion of robots (e.g. Googlebot) you can do so
using robots.txt.  Note that some robots may not completely honor the
directives.

For more info see:
http://www.google.com/webmasters/faq.html
http://www.robotstxt.org/wc/norobots.html

I hope this is helpful.
-- 
Matt BenDaniel
http://starmatt.com



--  APML Archives at <http://astro.umsystem.edu/apml/>  ---
             Unsubscribe at <majordomo@seds.org>