Conversation
Notices
-
Embed this notice
ok so im working on an ebooks bot and i'm writing it myself because im ganster as shit but unfortunately im retarded and the best way i could think to not accidentally ddos ryona.agency every time i want to update the list of posts is this. this seems stupid i think.
-
Embed this notice
@Flanker You could maybe record the date of the last post and fetch posts (with reasonable intervals, like 1-2 req/s) until you hit one with a created_at earlier than recorded date. Shouldn't be a problem unless there happen to be some posts out of order. Or do the same with flake IDs like AskGA7mLKPPzGh6uK8 (which while semi-random are still generally sequential).
-
Embed this notice
that would require me to know what programming is, unfortunately.
That said, with the way mastodon.py deals with fetching statuses (20 item "pages" all the time every time (unless theres a way to reduce the size or something i haven't seen)), comparing it to like the 40 newest lines in the corpus should hopefully be enough to reduce un-necessary fetches to at most like 2 in the worst case scenario. fwiw i'm only planning to update it like once a month and im def gonna do it manually least i fucked something up lol
-
Embed this notice
@Flanker I also advice you to make it post unlisted so that it won't clog up the public timeline too much.