Robot Food

How do users typically view your content?

  • Browsers:
    • IE
    • Chrome
    • Safari
    • Firefox
    • Opera
  • Devices
    • Desktops
    • Laptops
    • Tablets
    • Phones
    • Wearables

Viewport

Where else do users see your content?

  • RSS Readers
  • Email
  • Search Engine Results
  • Social Media

What is Robot Food?

Metadata that influences the presentation of your content in locations other than the viewport.

It helps you attract more visitors to your site by making the content more appealing to potential users regardless of where it's encountered.

What kinds of bots are there?

  • Search Crawlers
    • Google
      • News
      • Video
    • Bing
    • Yahoo
  • Social Media Bots
    • Facebook
    • Twitter
    • Google+
    • Pinterest
  • Browsers
  • Feed Readers
  • Email Apps
  • Siri/Cortana

REPLICANTS:

What do Robots Eat?

Types of Robot Food

  • robots.txt
  • sitemap.xml
  • XML RSS/ATOM Feeds
  • Opengraph metatags
  • oembed links
  • Embedded microdata/RDFa
  • JSON-LD

More Info on BotFood Formats

Social Media Botfood

Twitter Cards

[08/Oct/2014:15:53:48 -0400] "GET /post/top-5-things-that-prove-our-nonprofit-cred HTTP/1.1" 200 15869 "-" "Twitterbot/1.0"

https://dev.twitter.com/cards/overview

Types of Twitter cards

<meta name="twitter:card" content="summary">
<meta name="twitter:url" content="http://www.theonion.com/articles/man-only-has-himself-to-blame-for-whats-in-targete,37110/">
<meta name="twitter:title" content="Man Only Has Himself To Blame For What’s In Targeted Banner Ad">
<meta name="twitter:description" content="ITHACA, NY—Acknowledging that he must accept the consequences of his actions, local 37-year-old Christopher McGwire told reporters Monday that he has no one else to blame but himself for the targeted pool toy advertisements that have been regularly ...">
<meta name="twitter:image" content="http://o.onionstatic.com/images/27/27558/1x1-small/200.jpg?7921">

Example Twitter Card Tags

Facebook

[08/Oct/2014:15:18:05 -0400] "GET /post/tropes-vs-women-1-the-manic-pixie-dream-girl?fb_locale=en_GB 
  HTTP/1.1" 200 25885 "-" "facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)"

https://developers.facebook.com/docs/sharing/best-practices​

<meta property="og:title" content="Man Only Has Himself To Blame For What’s In Targeted Banner Ad" />
<meta property="og:type" content="article" />
<meta property="fb:app_id" content="367143819963933" />
<meta property="og:url" content="http://www.theonion.com/articles/man-only-has-himself-to-blame-for-whats-in-targete,37110/" />
<meta property="og:published_time" content="2014-10-06T15:10:00.008434-04:00" />
<meta property="og:section" content="" />
<meta property="og:description" content="ITHACA, NY—Acknowledging that he must accept the consequences of his actions,
  local 37-year-old Christopher McGwire told reporters Monday that he has no one else to blame but himself for the 
  targeted pool toy advertisements that have been regularly ..." />
<meta property="og:image" content="http://o.onionstatic.com/images/27/27558/2x1/1200.jpg?7921" />

Example Opengraph Tags

Google+

[08/Oct/2014:15:38:41 -0400] "GET /post/laverne-cox-and-bell-hooks-had-a-discussion-about-gender-and-pop-culture HTTP/1.1" 
  200 12318 "-" "Mozilla/5.0 (Windows NT 6.1; rv:6.0) 
  Gecko/20110814 Firefox/6.0 Google (+https://developers.google.com/+/web/snippet/)"

https://developers.google.com/+/web/snippet/article-rendering

<meta property="og:title" content="Man Only Has Himself To Blame For What’s In Targeted Banner Ad" />
<meta property="og:type" content="article" />
<meta property="fb:app_id" content="367143819963933" />
<meta property="og:url" content="http://www.theonion.com/articles/man-only-has-himself-to-blame-for-whats-in-targete,37110/" />
<meta property="og:published_time" content="2014-10-06T15:10:00.008434-04:00" />
<meta property="og:section" content="" />
<meta property="og:description" content="ITHACA, NY—Acknowledging that he must accept the consequences of his actions,
  local 37-year-old Christopher McGwire told reporters Monday that he has no one else to blame but himself for the 
  targeted pool toy advertisements that have been regularly ..." />
<meta property="og:image" content="http://o.onionstatic.com/images/27/27558/2x1/1200.jpg?7921" />

Example Google Plus Tags: same tags as Facebook.

Pinterest Rich Pins

[08/Oct/2014:16:31:10 -0400] "GET /post/five-great-college-campaigns-promoting-consent 
   HTTP/1.1" 200 13784 "-" "Pinterest/0.2 (+http://www.pinterest.com/)"

https://developers.pinterest.com/rich_pins/

http://openapi.etsy.com/svc/oembed/?url=https://www.etsy.com/listing/108758315/custom-map-necklace-you-select-location

Social Media Bot Debugging Tools

Gmail Botfood:

Inbox Actions

Github: https://github.com/blog/1891-view-issue-pull-request-buttons-for-gmail

<script type="application/ld+json">
{
  "@context":"http://schema.org",
  "@type":"EmailMessage",
  "description":"View this Pull Request on GitHub",
  "action":{  "@type" : "ViewAction",
              "url"   : "https://github.com/ricardoamaro/drupalci_testbot/pull/20",
              "name"  : "View Pull Request"
           }
  }
</script>

Potential Drupal Uses

  • One time Login emails
  • Reset Password Emails
  • Forum/Comment Response Emails
  • Order emails from Commerce etc.

Search Engine Botfood

Controling Googlebot

Robots.txt

Robots Metatag

Noindex Vs. Nofollow

Disallow doesn't remove something from their index, only a NOINDEX ROBOTS tag works.

Rich Snippets

http://www.google.com/webmasters/tools/richsnippets

http://www.bing.com/webmaster/help/marking-up-your-site-with-structured-data-3a93e731

Json-LD + microdata + RDFa

 

 

 

 

 

<span itemscope itemtype=”http://data-vocabulary.org/Breadcrumb”> 
<a href=”/c/san-diego/restaurants” itemprop=”url”> <span itemprop=”title”>Restaurants</span></a>
 <span itemscope itemprop=”child” itemtype=”http://data-vocabulary.org/Breadcrumb”> 
<a href=”/c/san-diego/hotdogs” itemprop=”url”> <span itemprop=”title”>Fast Food</span></a>

Bread crumbs

Sitelinks Search Box

https://developers.google.com/webmasters/richsnippets/sitelinkssearch

Other snippets

  • Reviews
  • Recipes
  • Events
  • People
  • Products
  • Music

schema.org powered

Video Sitemaps

https://developers.google.com/webmasters/videosearch/sitemaps

News Sitemaps

XML Sitemaps

 

Drupal Botfood Tools

Drupal Modules

 

  • https://drupal.org/project/oembed
  • https://drupal.org/project/schemaorg
  • https://drupal.org/project/xml-sitemaps
  • https://drupal.org/project/metatag
  • https://www.drupal.org/project/manualcrop
  • https://www.drupal.org/project/imagecache_token

Images: One Weird Trick

  • Twitter 4:3 Min:120x120px Max 750x560px
  • Facebook 1.918 ratio 200x200px, Max 1200x630px
  • Google Plus 5:3 min 120x120px, Max 506x303px
     

CCCOmbo

  • Define image styles for the various ratios
  • Use Manual crop on a single metadata Image
  • Use Imagecache tokens to set the default values in the metatag module based on the various ratios

Summaries/Descriptions

Twitter: 200 Characters

Google+: 150 Characters

Facebook: 150 Characters

Build Your Own Bots

Oembed or Metatag parsing

{
  html: '<iframe width="459" height="344" 
    src="http://www.youtube.com/embed/lZzKAZODy2c?feature=oembed" 
    frameborder="0" allowfullscreen></iframe>',
  thumbnail_height: 360,
  height: 344,
  provider_name: "YouTube",
  author_url: "http://www.youtube.com/user/np321",
  type: "video",
  thumbnail_url: "http://i.ytimg.com/vi/lZzKAZODy2c/hqdefault.jpg",
  author_name: "np321",
  provider_url: "http://www.youtube.com/",
  title: "The Animation Show (full)",
  version: "1.0",
  width: 459,
  thumbnail_width: 480
}

Oembed JSON Data Example

Other Notes