@mint We should be able to capture the domain in the json and ip it's being sent from and have two Hammer rate limit queues or something similar in a Plug filter on the inbox, right? We don't have to do any validation or anything at this step. If either hits a threshold we can start erroring there and come up with a way to exfiltrate useful metadata so people can automate firewalls or something too. Lots of options here
@mint Ahh that sounds correct, dang. I'll keep thinking about this. There has to be a way we can stop people from being able to fill the database with entries. This is a bug and will be treated as such
@mint However, this means that if there are any side effects of the failure we need to keep in the database like tracking reachability of the instance we would need to change that side effect to a process we can message so that database work doesn't get rolled back. This is super easy to do and I'll help with it.
@mint I don't know how much work it would be to refactor things but you could wrap a stage in a Repo.Transaction and then you could error and rollback would happen automatically
@lain I mean okay, I get Rock The Vote and other "use pop culture to engage voters" strategies, but I don't know why we're turning the DNC into a giant entertainment event. It's just weird to me.
Are they gonna bring Lil Jon out to the Senate Floor when they're voting for the next major funding bill?
@mint@splitshockvirus btw on any of your servers that did the Oban downgrade in feld/debugging branch will need to run the latest feld/debugging branch from when I re-upgraded it or else when you go back to stable releases it will still have the Oban v12 schema reverted. It can be fixed manually but running latest feld/debugging (a4293a8e) will fix it
and on that note I'm going to push my telemetry/logging changes into that branch which will help people monitor the health better just by looking at the logs
You do not know how baby is formed. They need to do way instain mother> who kill thier babbys, becuse these babby cant fright back? It was on the news this mroing a mother in ar who had kill her three kids, they are taking the three babby back to new york too lady to rest. my pary are with the father who lost his chrilden ; i am truley sorry for your lots
@mike I wrote a script using openssl at previous job that used a combination of hostname, service tag, and some salt known by the team to generate a long password for full disk encryption so it couldn't really be "lost" and anyone who needed to reboot a server could get it but it's still major yikes territory. These things are hard to do at scale without involving more technology that can't be offline at the wrong time
@phnt@lanodan this is essentially what I was thinking about too. You can do it two ways:
Logger.error("message here", reason: error)
or simply
# attach this error metadata to ALL logs emitted by this process Logger.metadata([reason: error]) Logger.error("message here")
the nice part about using Logger.metadata is that we could probably write a helper function that will just keep appending errors to a list so we can accumulate them