User-agent: * # Take into account both the default view and any non-default views # (hence two versions of each url) Crawl-delay: 1 Disallow: /AJAX/ Disallow: /*/AJAX/ Disallow: /Search/FacetList Disallow: /*/Search/FacetList # Block QRCodes: Disallow: /QRCode/ Disallow: /*/QRCode/ # Block any api version: Disallow: /*/api/ Disallow: /*/*/api/ Disallow: /MetaLib/ Disallow: /*/MetaLib/ Disallow: /Primo/ Disallow: /*/Primo/ Disallow: /PrimoRecord/ Disallow: /*/PrimoRecord/ Disallow: /Record/*/Holdings Disallow: /*/Record/*/Holdings Disallow: /SearchApi/ Disallow: /*/SearchApi/ Disallow: /EDS/ Disallow: /*/EDS/ Disallow: /EdsRecord/ Disallow: /*/EdsRecord/ Disallow: /Summon/ Disallow: /*/Summon/ Disallow: /SummonRecord/ Disallow: /*/SummonRecord/ Disallow: /Record/DownloadFile # Allow indexing of record pages by commenting out the following two lines: Disallow: /Record/ Disallow: /*/Record/ Sitemap: https://keski.finna.fi/sitemapIndex.xml.gz