Akamai Integration Guide

Akamai works easily with a index-rendering service like index-render.io. Since search engines can only see Javascript tags when they crawl sites, a index-render service improves SEO by rendering your content in advance.

Overview

To integrate Index Render.io with Akamai, you’ll add rules to:

• Detect crawlers
• Forward requests to Index Render
• Modify the outgoing request path
• Avoid edge caching for crawler traffic

Detect Crawlers

Detect key crawlers using the User-Agent request header.

*Google-InspectionTool*
*googlebot*
*Yahoo! Slurp*
*bingbot*
*yandex*
*baiduspider*
*facebookexternalhit*
*twitterbot*
*rogerbot*
*linkedinbot*
*embedly*
*quora link preview*
*slackbot*
*Discordbot*
*ChatGPT*
*GPTBot*
*ClaudeBot*
*Amazonbot*

Ignore Static File Extensions

Exclude these file types from index-rendering:

js css xml less png jpg jpeg gif pdf doc txt ico rss zip mp3 rar exe wmv
avi ppt mpg mpeg tif wav mov psd ai xls mp4 m4a swf dat dmg iso flv
m4v torrent woff ttf svg webmanifest json

Forward Requests to Index Render

When crawler user-agents are detected, forward them to:

Origin Server Hostname: service.index-render.io
Forward Host Header: Origin Hostname
Cache Key Hostname: Origin Hostname

Add header:

Header Name: x-index-render-token
Value: YOUR_INDEX_RENDER_TOKEN

The Index Render token can be found under Security & Access → Index Render Token.

Modify Request Path

Rewrite the request path using Akamai property variables:

/{{builtin.AK_SCHEME}}://{{builtin.AK_HOST}}{{builtin.AK_ORIGINAL_URL}}

Remove all spaces before using.

Do Not Cache Bot Traffic

Crawler traffic changes rapidly. Avoid edge caching so bots always receive fresh content. Use SureRoute and persistent connections for optimal performance.

Verify Your Installation

Test using curl:

curl -v -A googlebot https://www.yourpage.com/

If you don’t see Index Render headers, the integration is not working correctly.

Getting an Error?

If you see “Index Render Integration Not Detected”, refer to the troubleshooting guide.

Expert Assistance