Googlebot Stigma and Mastering Eleventy for Site Creation

posted by Roy Schestowitz on Nov 10, 2025

• Web Browsers/Web Servers

  • University of Toronto ☛ A HTTP User-Agent that claims to be Googlebot is now a bad idea

    This is now an increasingly bad idea on the web and if you're doing it, you should stop. The problem is that there are various malicious crawlers out there claiming to be Googlebot, and Google publishes their crawler IP address ranges. Anything claiming to be Googlebot that is not from a listed Google IP is extremely suspicious and in this day and age of increasing anti-crawler defenses, blocking all 'Googlebot' activity that isn't from one of their listed IP ranges is an obvious thing to do. Web sites may go even further and immediately taint the IP address or IP address range involved in impersonating Googlebot, blocking or degrading further requests regardless of the User-Agent.

• Content Management Systems (CMS) / Static Site Generators (SSG)

  • Gregory Hammond ☛ Mastering Eleventy: Display All Blog Posts from a Category on a Single Page

    Let’s say you’ve written a number of posts surrounding a topic. While you could have written it all into one big blog post, that may turn some readers away. Instead, you publish them over a period of time while including the same category in your front matter. I know some people may suggest using tags, or something else, but instead you chose category.

    There’s many blog posts such as one by John M. Wargo discussing how to have that list of all the blog posts displayed across multiple pages, also known as paginated, but what if you want them to be shown on one page? I’m going to tell you how I did it, and let you see an example currently on my site.