news
Web Browsers/Web Servers: How Google Sees Your Site, Firefox, and More
-
Miloslav Homer ☛ How Google Sees Your Site
I keep stumbling over different Google bots in my logs. So today I'm looking at each and every Googly eye that takes a look at my site. Because when you stare at me, I'll stare back.
You have the right and the means to define what Google is allowed to do on your site, whether the Google traffic you face is extensive or you'd like to opt-out of AI training (check Google Other). Sadly, using robots.txt is not enough, Google admits that some of their bots will not respect the rules.
Previous articles were about TLS fingerprinting JA3/JA4 and how to deploy it on HAProxy. In this article/marimo notebook (full source) I'll use the HAProxy logs containing IP addresses (plus ASNs), user agents and JA4 hashes to examine Google traffic. We'll see a couple of Google bots that are not mentioned in their docs.
Let's get into it.
-
Mozilla
-
Jonathan Almeida: Perf wins from relocating MOZ_OBJDIR have a dev experience cost
This is the opposite of what I wanted to write about: relocating your MOZ_OBJDIR outside of your source directory will make your IDE faster.
In mozilla-central (the firefox monorepo), a default object files directory is created within the same source directory. This is equivalent to the
build/directory you would typically see in other projects. -
Mozilla ☛ Firefox Nightly: The Need for Speed Controls – These Weeks in Firefox: Issue 208
-