Using the Access Manager Gateway to disable search engines to show pages in a search result

  • Document ID:7024084
  • Creation Date:23-Aug-2019
  • Modified Date:23-Aug-2019
    • Micro Focus Products:
      Access Manager (NAM)

Environment

  • Access Manager 4.4
  • Access Manager 4.5

Situation

  • avoid pages protected by an Access Gateway to show up as a result with search engines

Resolution

  • Note: HTML meta tags are part of HTML pages served by a web server. If you have an Access Gateway protecting web application servers acting as HTTP reverse proxy these servers are responsible servicing the required meta tags. HTTP proxy services will not take care of any Meta Tags. NAM can rewrite content if required / configured. If you need to add meta tags you could use a word rewrite profile to replace a string in the original web page (need to match this string).

  • A  better options is to make changes in the HTTP response headers. You can use for example the "X-Robots-Tag" header either noindex or none value in your response. You can use the Proxy Service "Advanced Options" settings on a given to add the Apache directive "add Header set X-Robots-Tag" "noindex, nofollow" to either the global advanced options or on a given proxy service