En:Proxy

TODO: Translation is not yet complete. This article should base on De:Proxy

Indexing through Proxy

There are some rules to avoid, that the proxy indexes Webmailer and other privat websites.

The YaCy-Proxy only indexes websites, if the following is the case:

• no request parameters in request (like ?sid=12345678 in the url)
• no Set-Cookie-header in response headers
• no Cookie-header in request
• no pragma:no-cache-header in response headers
• no Cache-Control:private/no-cache/no-store-header in response headers
• no Authorization-header in the request
• no Content-Range-header in the response headers
• MIME-types that refer to images and media content

If there is already a copy of the page in the cache, yacy will decide on Last-Modified-Header, Exepired-Header and Cache-Control:max-age=[TTL]-Header if the page will be indexed a second time or not.