Alright Robots, You Win, I Give You Permission To Read This Site

For the past 3 or so years this blog has had a robots.txt disallowing all robots to read this site. It's been so long that I don't really remember why I did that anymore, but I'm pretty sure at least a large part of why was because of AI scrapers. Though I doubt I ever believed a robots.txt would stop them, so I'm guessing it was mostly on principle.

I'm long overdue to look at this again as if you've read a few of my previous posts and notes, this seems a little hypocritical because I think I would probably be considered a "pro-AI booster" by any "anti-AI hater" now.

I had a little wake-up call after looking at this Codeberg repo "Open Slopware," which lists "Free/Open Source Software tainted by LLM developers/developed by genAI boosters."

And I gotta be honest guys, I'm looking at this list… and bros… I'm just looking a list of good software.

I mean consider that it includes cargo-nextest, jujutsu, facet, zed, ratatui, tailwindcss, Bitwarden, and the LINUX FUCKING KERNEL. And looking at the PRs there's more on the way too like ghostty and mise. This is a list of software I use extremely often (sometimes every day), and have always considered high quality.

Like if anything this makes me want to use AI coding tools more and be happy that I will be in such good company.

So yeah, I think I'm in the pro-AI camp. At least for code, I still kinda hate it for everything else, but that's more because of the "it doesn't really work or do what I want" line of reasoning than the actual ethical issues with genAI, and wowee zowee are there a lot of those.

And I know that sounds kinda bad when I say it like that, but… no it's just kinda bad.

Anyway, robots.txt is gone.

Bye.