I am unable to receive any of my subscriptions this morning. I happened once a few weeks ago. @Dave is it time to reboot my server again?
Looking into it now, sorry about that! I’ve added some improvements to the supervision on that system, which should let it recover faster.
Hmm, things look up here at the moment, I’ll keep checking…
My subscriptions just started working in the last few minutes. Thanks for the help.
Thanks for keeping me looped in, I’m going to dig into this more and see what’s up. After some review this morning I have an idea that might help with the issue you’re seeing.
Okay, spent some time today digging through commit logs in some of the dependencies we pull in and writing unit tests to see if they have the impact I suspected. They do! In particular, I’m seeing resumed subscriptions only partially recovering in an old version of a library we use, but fortunately my tests show this is fixed in the most recent release.
We’ve scheduled some maintenance this sprint to upgrade a number of libraries we use to the more recent stable versions, and I’m hoping it’ll help resolve this issue. I’ll try to post here when we do that upgrade.