Activity Log
hackers.town: 2025-01-04 Sat 08:07
@deafferret Yep, sure is!
There’s a whole lot of non-code stuff in scraping, and the sleep call accounts for one of them at least (not hammering a server). Nice touch.
hackers.town: 2025-01-04 Sat 08:12
@denis I think you’re right about Webby. I know Jekyll wasn’t first with YAML frontmatter, but they sure as heck popularized it.
And yah, makes most of these validation techniques easy enough to generalize. Much of the code in my post was originally Python for the Hugo iteration.
The stuff I’m on now is new to my workflow, though I’ve done pieces of this link checking approach in Perl. Again, it generalizes to “parse the HTML, find distinct links, politely check if the links still work.”
hackers.town: 2025-01-04 Sat 12:01
A little disappointed that Node’s URL.url constructor has to be given a base origin for path-only input or it throws an error (e.g. “/now/”).
Accustomed to Python, where urllib.parse.urlparse gives you back an object without a netloc (origin).
I mean tomayto potahto but it takes getting used to.
hackers.town: 2025-01-04 Sat 13:45
@trs yep yep.
I’m doing mine in the context of link checking, where there is a meaningful context I can add.
But I can see it being annoying as heck when you have to pretend there’s a context.
hackers.town: 2025-01-04 Sat 16:12
Differently disappointing how many servers out there are not configured to handle (or configured not to handle) HTTP HEAD.
I’m trying to save us all a little bandwidth here.
hackers.town: 2025-01-04 Sat 16:23
@kusuriya Alas. Well I do understand that. Fortunately, the majority of my links support HEAD, so I can just add some specific handling for HTTP 405.
hackers.town: 2025-01-04 Sat 18:04
All right fine I’ll check /robots.txt first.
All right fine I’ll respect the fact that those sites have Disallow: / for random-ass bots.
Probably should’ve done that first.
This link checker thing might be a little complicated for just one blog post.
hackers.town: 2025-01-04 Sat 18:48
Jumpy Dog would like it known that @IamMrsGeek and I do not give her all of our fries, and thus Jumpy Dog is horribly mistreated.
hackers.town: 2025-01-04 Sat 18:50
@IamMrsGeek “how come all the other neighborhood dogs get to look like furry bratwurst and we don’t? Cruelty! Savagery! Oh the suffering!”
hackers.town: 2025-01-04 Sat 18:52
https://hackers.town/users/ArtifexUmbra/statuses/113772166149416679
hackers.town: 2025-01-04 Sat 19:57
Overall it’s a tiny thing in life, but a persistent itchy frustration with all the Electron apps is my eyes just do not enjoy the Chrome / Chromium renderer.
No I don’t know why.
I just know that I load the apps because they’re there, and use a Chromium-based browser because compatibility, but then I load Safari or Firefox (or Zen just now) and I get mad because my eyes can relax until it’s time to go back to the Electron app or the Web sites built for IE Chrome.
hackers.town: 2025-01-04 Sat 22:38
@Wrewdison Chuck would know.