Conversation

Notices

1. Embed this notice
   Luci for Chai Tea (zens@merveilles.town)'s status on Sunday, 03-Nov-2024 14:46:02 JST Luci for Chai Tea

   writing a userscript that detects where an infinite scroll is happening in a page and eats the elements that pop into the scroll pane and saves them to a big html file.

   • Embed this notice
     Luci for Chai Tea (zens@merveilles.town)'s status on Sunday, 03-Nov-2024 14:46:59 JST Luci for Chai Tea

     in reply to

     someone wanted a way of capturing a page that has “infinite scroll” on it and… there just isn’t an easy way I know of that exists

   • Embed this notice
     Luci for Chai Tea (zens@merveilles.town)'s status on Sunday, 03-Nov-2024 17:15:26 JST Luci for Chai Tea

     in reply to

     • fabiosantoscode

     @fabiosantoscode i have tried this kind of thing before. what happens is the CSP rules of the page will then refuse to fetch anything using the monkey patched fetch

   • Embed this notice
     fabiosantoscode (fabiosantoscode@mastodon.social)'s status on Sunday, 03-Nov-2024 17:15:27 JST fabiosantoscode

     in reply to

     @zens I would override fetch and XHR. Then listen to the scroll event in capture mode, and set a variable to true, then wait one tick, then set to false.

     That variable would let my fetch/xhr know if we're fetching data as a consequence of a scroll event.

   • Embed this notice
     makeworld (makeworld@merveilles.town)'s status on Monday, 04-Nov-2024 05:19:29 JST makeworld

     in reply to

     • Webrecorder

     @zens there is @webrecorder but it depends what kind of output you're looking for