Posted Monday, January 14 at 9:28 PM (a day ago)
I ended up doing some more work on Pushl and have now released v0.1.7. The major changes:
- Did a bunch of refactoring to make the code a little cleaner and handle configuration more appropriately
- Added a configurable timeout for connections (which now defaults to 15)
- Added a
--version option on the command line arguments
Also, some suggested usage ideas below the cut!
Posted Sunday, January 13 at 8:48 PM (2 days ago)
It’s been a while since I’ve updated Pushl but today I released v0.1.6. It includes the following fixes:
- Now it supports Pingback as well as Webmention
- Improved the threading defaults and connection pooling
- Also checks entries for updates even if the feed didn’t change (in case something changed in the more text or page metadata or whatever)
Anyway, it should just be a
pip install --upgrade pushl (or
pipenv update) away.
Posted Tuesday, January 8 at 11:57 PM (7 days ago)
Version 0.3.14 of Publ is now released!
This update is mostly about image stuff:
- Fixed a subtle caching bug that affects sites accessible from multiple URLs
- Fixed the way that size-clamping (
max_width et al) work on remote and static images
- Enable JPEG optimization in the image renderer
- Add the ability to link to local rendered images in a Markdown link
Also, if you’re using Publ and hosting your repository on GitHub you may have gotten a security warning regarding the version of pyyaml that Publ depends on. Don’t worry, Publ doesn’t actually use the vulnerable code (it’s actually pulled in by one of the utility scripts from the watchdog library, and not used by watchdog itself). Watchdog has an open issue about this and they’re on track to fix it Real Soon Now.
In the future Publ may actually pull in pyyaml itself for the friends-only functionality, but when it does you can be sure it’ll be a current version. :)
Posted Saturday, December 22 at 1:35 AM (a month ago)
While I’m fixing random stuff in Publ, I figured I’d finally fix some problems with Pushl too. Nothing major here, just:
- Stability: Fixed a bug where feeds that don’t declare links caused the worker to die before entries got processed
- Performance: Now we use a global connection pool (so connections can be reused)
- Fixed a minor correctness issue with archive feeds (which actually doesn’t make any difference in the real world but whatever)
Posted Friday, December 21 at 11:29 PM (a month ago)
Happy solstice! I seem to be finding lots of stuff to fix and improve these days. Huh.
Changes since v0.3.12:
- Fixed a date display issue on databases other than SQLite
- Fixed an issue where markup was being emitted in the
<og:title> element for OpenGraph cards
- Fixed a bug which prevented entry files from being moved (a side-effect of the Windows compatibility fixes)
- Added the ability to override title sort
- Also added the ability to use anchors on resolved entry links
Posted Thursday, December 20 at 11:14 PM (a month ago)
Are you using webmention.io as your webmention endpoint? Want to get your incoming webmentions displayed on your website?
Well you’re in luck, I wrote a simple-ish script for that. (You’ll probably also want to see the accompanying stylesheet too.) And it doesn’t even require that you use Publ – it should work with any CMS, static or dynamic. The only requirement is that you use either webmention.io or something that has a similar enough retrieval API.
I wrote more about it on my blog, where you can also see it in use. For now, I’m just going to use the sample site repository to manage it (and issues against it).
It’s MIT-licensed, so feel free to use it wherever and however you want and to modify it for your needs. I might improve it down the road but for now it’s mostly just a quick itch-scratching hack that does things the way I want it to.
Posted Sunday, December 16 at 11:36 PM (a month ago)
Big news: I finally fixed a long-standing issue, where Publ wouldn’t work on Windows due to how Windows uses a different path separator from every other OS on the planet.
(Okay, to be fair, macOS technically does too; internally it has a path separator of
: instead of
/. But the POSIX API transparently hides that.)
Anyway, I’ve updated the getting started guide accordingly, and now it shouldn’t be any more inconvenient to build Publ sites from a Windows machine as from Linux or macOS.
Also a few other smol bug fixes, like
max_width now works correctly on remote images where
width isn’t specified.
I’ve also added a bunch more deployment HOWTOs although they’re in a very rough state right now. As always, I welcome assistance in this regard.
Below the cut, some more thoughts on federated identity.
Posted Saturday, December 15 at 1:08 AM (a month ago)
v0.3.11 is now released, with the following changes:
- A more complete fix for how to handle image sets and inline images with respect to paragraphs
- Better cleanup for spurious empty paragraphs
- Improved internal entry link handling
Detailed descriptions of the changes are below.
Posted Monday, December 10 at 8:37 PM (a month ago)
Just some bug fixes with view caching and image handling; in particular, remote and static images will now respect
max_height for the sizing, and I fixed the way that inline images work (insofar as now inline images can work).
Posted Wednesday, November 28 at 3:33 PM (2 months ago)
This entry marks the release of Publ v0.3.9. It has the following changes:
more_text and related functionality to image sets (an example being visible over here)
- Improved and simplified the caching behavior (fixing some fiddly cases around how ETags and last-modified worked, or rather didn’t)
I also made, and then soon reverted, a change around how entry IDs and publish dates were automatically assigned to non-published entries. I thought it was going to simplify some workflow things but it only complicated the code and added more corner cases to deal with, all for something that doesn’t actually address the use case I was worried about. So never mind on that.
(What happened to v0.3.8? I goofed and forgot to merge the completed
more_text et al changes into my build system first. Oops.)
See below for more on the caching changes.
Posted Wednesday, November 28 at 1:18 AM (2 months ago)
I just released Pushl v0.1.3, which adds some minor performance optimizations and a bug fix.
Originally I was hoping to have a major performance optimization, in the form of having rewritten Pushl from thread-per-connection to async operation, but unfortunately I ran into a bunch of problems with it. Mostly that I was running into a “too many open files” error and I couldn’t figure out what was causing a descriptor leak. I have the work-in-progress branch online if anyone wants to take a look at it.
Anyway, the reason I went down this route is because I added WebSub subscriber support to my fork of Feed-On-Feeds, which makes it so that WebSub-enabled RSS and Atom feeds will push their updates to your reader instead of having to wait for a polling interval.
You can read more about some of my other thoughts on a blog entry that quickly devolves into a rant, if you’re so inclined.
Posted Wednesday, October 24 at 12:59 PM (3 months ago)
I’ve released v0.3.7, which just fixes a few issues around transaction management and overall indexing performance. Namely:
- The indexer locks individual entries as it’s working on them
- If an entry is being worked on, watchdog will ignore it
- Cleaned up a couple of transaction failures that can occur due to PonyORM’s optimistic locking behavior
Posted Saturday, October 13 at 3:01 PM (3 months ago)
I just released v0.3.6 of Publ, which just allows it to work with databases other than SQLite. In particular this is part of testing more advanced heroku deployment options.
Right now I’m primarily focusing on improving the documentation, especially the quickstart guide, since people are finally showing interest in Publ but aren’t quite sure where to begin!
Posted Friday, October 12 at 3:01 PM (3 months ago)
I’ve now released v0.3.5 of Publ. Changelog:
- Add support for listing deleted entries (accessible via
- Improved how the last-modified/etag reference was determined (also fixing a nasty bug where a site might crash if a file is deleted)
- Fixed a minor shaping bug
I’ve also updated the sample site templates with all of the changes that have happened since, uh, June, and also included some sample content so it’s easier to get started with it.
Posted Wednesday, October 10 at 10:41 PM (3 months ago)
I’ve gotten Pushl to the point that I’m confident in releasing it as a full alpha and having a cron job run it every 15 minutes. Whew.
I’ve also added some
h-entry markup to the Publ site templates so that hopefully the notifications appear at least somewhat reasonably elsewhere.
I really need to redo these site templates now that I have a better idea of how they go together. Also the quickstart guide could be a lot better.
Posted Monday, October 8 at 11:53 PM (3 months ago)
I finally got around to releasing a very rough prototype of Pushl to pypi. It only sends out WebSub notifications for now (does anyone even use those?), but I’ll work on actually implementing WebMention soon.
Also, recently someone pointed out to me fed.brid.gy which makes it easy to turn a static site into an ActivityPub source. At some point I’ll experiment with setting up Publ for this; it looks like it’s just a matter of adding a couple of additional route rules to Publ, so that will probably go into an advanced configuration guide if I ever get around to making such a thing. (Or it could actually be added to Publ directly but there isn’t much of a reason for that, IMO.)
Posted Friday, October 5 at 1:28 AM (3 months ago)
Turns out I never actually tested the
If-Modified-Since handler, because if I had I’d have seen the glaring exception it threw.
Oh well, that’s fixed now. I think.
Posted Monday, October 1 at 11:16 PM (3 months ago)
I’ve started working on Pushl in earnest now, and one thing that was really bugging me about this is that anything which polls feeds and entries would really benefit from having client-side cache control working. Which was a big missing feature in Publ.
Well, I finally implemented it, and I’m pretty happy with how I did it.
The short version: for any given view it figures out (pessimistically) what’s the most recent file that would have affected the view (well, within reason; it only looks at the current template rather than any included templates, which is pretty difficult to do correctly) and uses that to generate an ETag (via metadata fingerprint) and a Last-Modified time (based either on the file modification time or the time the entry was actually published).
There’s probably a few corner cases this misses but in general this makes client-side caching of feeds and such work nicely.
Posted Saturday, September 29 at 9:00 PM (4 months ago)
So, for the last couple of days I’ve been playing with some of the IndieWeb concepts, in particular Webmention. Spurred on by a helpful thread with Kevin Marks, I took some time to actually do a rough implementation of outgoing Webmentions, and also did some of the work to set up the
h-entry microformats on my main site.
As far as I can tell, it works great, but I’m also not going to actually merge this to master or push it to production. Read on to see why!
Posted Tuesday, September 25 at 2:55 PM (4 months ago)
I found a few more annoying bugs that were shaken out from the whole PonyORM transition, as well as a couple of bugs in the new shape functionality. There’s probably a few more of these bugs lurking in the codebase (I mean, in addition to the existing bugs I know about), but here’s what’s changed:
- Image shape bugs:
- Fix some
FileNotFound handling on images (so
shape errors propagate correctly)
class work correctly per the documentation
- PonyORM bugs: