Posted Friday, March 15 at 11:00 PM (a month ago)
Yep, it’s another release. New stuff in this one:
Also, on an administrative note, if you would like to help fund the development of Publ, I have switched from Patreon to Liberapay, which provides a bunch of advantages over Patreon and is much better-suited to open-source development.
Posted Friday, March 15 at 5:29 PM (a month ago)
While trying to figure out some weird access patterns on the day-job site I had the realization Pushl wasn’t actually specifying a user-agent, so it was just coming through as the generic
aiohttp one, which isn’t very friendly.
Now it sends a reasonable user-agent by default, and this can be overridden by the
--user-agent flag if you want to for your own analytics or whatever.
Oh, and I had quietly released 0.2.3 a few days ago; there were just some minor internal changes to logging and also declaring Pushl as beta, rather than alpha, software.
Posted Sunday, March 10 at 6:25 PM (a month ago)
I’ve done a bunch more work on Pushl to try to get it more stable. In particular, I’ve made it so that it will only recurse into feeds that are on domains that were declared in the initial requests, and I seem to have cleared up some cases which were causing it to hang and also added a global timeout which will, hopefully, prevent it from hanging indefinitely.
I do wish I could figure out what is causing the hangs when they do happen though. Oh well. Some discussion of the issue below the cut.
Posted Thursday, March 7 at 10:27 PM (2 months ago)
I’ve been working on getting Pushl much more stable and reliable, particularly around a persistent “too many open files” error I was having, which turned out to be primarily due to a fd leak in the caching routines. Oops.
Anyway, there’s also seemingly a problem with how
aiohttp manages its connection pool, at least on macOS, so I’ve disabled connection keep-alive by default. However, if you still want to use keep-alive, there’s now a
--keepalive option to allow you to do that. I’m finding that it doesn’t really improve performance all that much anyway.
This is feeling beta-ready but I’ll give it a few days for other issues to shake out first.
Posted Thursday, March 7 at 12:05 AM (2 months ago)
So, I just released v0.2.0 of Pushl. It was a pretty big change, in that I pretty much rewrote all the networking stuff, and fixed some pretty ridiculous bugs with the caching implementation as well.
The main thing is now it’s using async I/O instead of thread-per-connection, so it’s way more efficient and also times out correctly.
And oh gosh, I had so many tiny but critical errors in the way caching was implemented – no wonder it kept on acting as if there was no cached state. Yeesh.
Anyway, I’ll let this run on my site for a few days and if I like what I see I’ll upgrade it to beta status on PyPI.
Posted Monday, March 4 at 3:47 PM (2 months ago)
I’ve released Publ v0.3.19, which now finally has a tagging system, which is only one of the oldest issues that was still open.
Here’s a list of what’s been added or changed since 0.3.18:
I want to thank Karina Antonio for implementing image cropping.
Posted Wednesday, February 27 at 9:38 PM (2 months ago)
I’ve just released v0.3.18, with the following changes:
- Add date grouping properties to entry
- Add a
pages property to
- Provide the current
category object to the error handler
- Support linking to non-image/non-entry local files
- Added, then removed, some performance micro-optimizations that only caused problems
More details about the major changes below!
Update: I released a hotfix as 0.3.18.1 because there was a last-minute bug that snuck in while I was trying to silence a new pylint error. Oops.
Posted Friday, February 22 at 5:01 PM (2 months ago)
Just some little fixes that I put in for the sake of the day job:
- Fixed the way that
get_view() et al parse the parameters, so now you can actually search for
- Fixed the sort order of recursive
Posted Wednesday, February 20 at 9:45 PM (2 months ago)
Just another minor release of Publ! Mostly bugfixes. Here’s what’s new:
- Fixed an issue with HTML
<img> rewriting with non-lowercase attribute names
- Fixed a bug with missing entries causing Publ to die when it tried to remove them from the index
- Some code cleanups, especially removing some unneeded backwards compatibility shims for unsupported versions of Python
Redirect-To will now resolve link targets
category.root, I’d neglected to add
category.breadcrumb to the manual when that functionality went in, and I’ve also added some usage examples, including something useful for fancy navigation bars.
Posted Wednesday, February 13 at 6:20 PM (2 months ago)
It’s been a while since I’ve had a chance to work on Publ, but the great thing is that I actually had a reason to work on it for my day job. Which is to say I’m finally being paid to work on Publ. ;)
Changes since 0.3.14:
- Add requirement for Arrow 0.13.0 (issue 41)
- Fix a dumb tpyo that was the cause of issue 158
- Don’t rewrite DRAFT files; fixes 137
- Move sample-site files back to the library repo rather than in the doc repo
- Fix the way we map malformed category URLs (issue 156)
- Update upstream library versions
- Move version number to publ module
- Allow empty slug-text in entry route (fixes 161)
- Process HTML entries, to finally handle issues 136 and 154.
Some more information about that last one under the cut!
Posted Tuesday, January 8 at 11:57 PM (3 months ago)
Version 0.3.14 of Publ is now released!
This update is mostly about image stuff:
- Fixed a subtle caching bug that affects sites accessible from multiple URLs
- Fixed the way that size-clamping (
max_width et al) work on remote and static images
- Enable JPEG optimization in the image renderer
- Add the ability to link to local rendered images in a Markdown link
Also, if you’re using Publ and hosting your repository on GitHub you may have gotten a security warning regarding the version of pyyaml that Publ depends on. Don’t worry, Publ doesn’t actually use the vulnerable code (it’s actually pulled in by one of the utility scripts from the watchdog library, and not used by watchdog itself). Watchdog has an open issue about this and they’re on track to fix it Real Soon Now.
In the future Publ may actually pull in pyyaml itself for the friends-only functionality, but when it does you can be sure it’ll be a current version. :)
Posted Friday, December 21 at 11:29 PM (4 months ago)
Happy solstice! I seem to be finding lots of stuff to fix and improve these days. Huh.
Changes since v0.3.12:
- Fixed a date display issue on databases other than SQLite
- Fixed an issue where markup was being emitted in the
<og:title> element for OpenGraph cards
- Fixed a bug which prevented entry files from being moved (a side-effect of the Windows compatibility fixes)
- Added the ability to override title sort
- Also added the ability to use anchors on resolved entry links
Posted Saturday, December 15 at 1:08 AM (4 months ago)
v0.3.11 is now released, with the following changes:
- A more complete fix for how to handle image sets and inline images with respect to paragraphs
- Better cleanup for spurious empty paragraphs
- Improved internal entry link handling
Detailed descriptions of the changes are below.
Posted Monday, December 10 at 8:37 PM (4 months ago)
Just some bug fixes with view caching and image handling; in particular, remote and static images will now respect
max_height for the sizing, and I fixed the way that inline images work (insofar as now inline images can work).
Posted Wednesday, November 28 at 3:33 PM (5 months ago)
This entry marks the release of Publ v0.3.9. It has the following changes:
more_text and related functionality to image sets (an example being visible over here)
- Improved and simplified the caching behavior (fixing some fiddly cases around how ETags and last-modified worked, or rather didn’t)
I also made, and then soon reverted, a change around how entry IDs and publish dates were automatically assigned to non-published entries. I thought it was going to simplify some workflow things but it only complicated the code and added more corner cases to deal with, all for something that doesn’t actually address the use case I was worried about. So never mind on that.
(What happened to v0.3.8? I goofed and forgot to merge the completed
more_text et al changes into my build system first. Oops.)
See below for more on the caching changes.
Posted Wednesday, October 24 at 12:59 PM (6 months ago)
I’ve released v0.3.7, which just fixes a few issues around transaction management and overall indexing performance. Namely:
- The indexer locks individual entries as it’s working on them
- If an entry is being worked on, watchdog will ignore it
- Cleaned up a couple of transaction failures that can occur due to PonyORM’s optimistic locking behavior
Posted Saturday, October 13 at 3:01 PM (6 months ago)
I just released v0.3.6 of Publ, which just allows it to work with databases other than SQLite. In particular this is part of testing more advanced heroku deployment options.
Right now I’m primarily focusing on improving the documentation, especially the quickstart guide, since people are finally showing interest in Publ but aren’t quite sure where to begin!
Posted Friday, October 12 at 3:01 PM (6 months ago)
I’ve now released v0.3.5 of Publ. Changelog:
- Add support for listing deleted entries (accessible via
- Improved how the last-modified/etag reference was determined (also fixing a nasty bug where a site might crash if a file is deleted)
- Fixed a minor shaping bug
I’ve also updated the sample site templates with all of the changes that have happened since, uh, June, and also included some sample content so it’s easier to get started with it.
Posted Friday, October 5 at 1:28 AM (6 months ago)
Turns out I never actually tested the
If-Modified-Since handler, because if I had I’d have seen the glaring exception it threw.
Oh well, that’s fixed now. I think.
Posted Monday, October 1 at 11:16 PM (6 months ago)
I’ve started working on Pushl in earnest now, and one thing that was really bugging me about this is that anything which polls feeds and entries would really benefit from having client-side cache control working. Which was a big missing feature in Publ.
Well, I finally implemented it, and I’m pretty happy with how I did it.
The short version: for any given view it figures out (pessimistically) what’s the most recent file that would have affected the view (well, within reason; it only looks at the current template rather than any included templates, which is pretty difficult to do correctly) and uses that to generate an ETag (via metadata fingerprint) and a Last-Modified time (based either on the file modification time or the time the entry was actually published).
There’s probably a few corner cases this misses but in general this makes client-side caching of feeds and such work nicely.