Conversation

Notices

1. Embed this notice
   Linux Renaissance (darth@silversword.online)'s status on Saturday, 28-Sep-2024 23:16:10 JST Linux Renaissance

   Anyone uses #OPNsense at home? What's your hardware configuration for it?

   #FreeBSD

   • Embed this notice
     feld (feld@friedcheese.us)'s status on Saturday, 28-Sep-2024 23:16:09 JST feld

     in reply to
     @darth This hardware is incredible, and you support the project
     
     https://shop.opnsense.com/product/dec840-opnsense-desktop-security-appliance/
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Sunday, 29-Sep-2024 03:09:45 JST feld

     in reply to

     • #/usr/sbin/rtheren
     @RTheren @darth This has been a problem for so many years it's silly. Is there anyone with a test environment and skills we can just throw a little money at to fix it?
   • Embed this notice
     #/usr/sbin/rtheren (rtheren@social.linux.pizza)'s status on Sunday, 29-Sep-2024 03:09:46 JST #/usr/sbin/rtheren

     in reply to

     @darth I got this badboy, as *BSD can't do gigabit over PPPoE on slow CPUs.
     https://teklager.se/en/products/routers/tlsense-N5105L4

   • Embed this notice
     feld (feld@friedcheese.us)'s status on Sunday, 29-Sep-2024 06:21:41 JST feld

     in reply to

     • John-Mark Gurney
     • #/usr/sbin/rtheren
     • feld
     @RTheren @darth
     
     Hey @encthenet how much work would this take? Can we fund it? I'd donate
   • Embed this notice
     John-Mark Gurney (encthenet@flyovercountry.social)'s status on Sunday, 29-Sep-2024 13:21:19 JST John-Mark Gurney

     in reply to

     • #/usr/sbin/rtheren
     • feld

     @feld @darth @RTheren

     What specifically? That PPPoE is slow? Are people really running PPPoE at gigabit speeds? Are there actual fiber installs using PPPoE? or is this for VPN usage?

     It does look like pppoed is using netgraph, so it should be resonably fast. I think it's more of a problem of networking/firewall just being slow on lower end arm boards, and why I switched to a SFF PC for my internet router:
     https://flyovercountry.social/@encthenet/110895206283732462

   • Embed this notice
     feld (feld@friedcheese.us)'s status on Sunday, 29-Sep-2024 13:21:41 JST feld

     in reply to

     • John-Mark Gurney
     • #/usr/sbin/rtheren
     @encthenet @darth @RTheren It's a long standing issue that it's limited to a single queue
     
     https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=203856
     
     PPPoE fiber in Europe is actually quite popular.
     
     https://community.ui.com/questions/PPPoE-bandwidth-issue-with-higher-than-gigabit-connections/40e94362-c15e-4a32-8f89-49429b1a4db6
   • Embed this notice
     John-Mark Gurney (encthenet@flyovercountry.social)'s status on Sunday, 29-Sep-2024 13:41:42 JST John-Mark Gurney

     in reply to

     • #/usr/sbin/rtheren
     • feld

     @feld @darth @RTheren
     Also, I was surprised at the CPU decrease by switching from a dual Intel gige nic to a Chelsio T520 10gige w/ a 1000base-t SFP module.

     Really, it's likely a combination of those ethernet drivers being slow, the ethernet hardware itself being slow, and that there aren't "cheap" arm boards that have half decent CPU performance. (10gig cards can do multiple queues, which very few gige nics can do, or if they can, drivers don't support it, or support it poorly).

     feld likes this.
   • Embed this notice
     John-Mark Gurney (encthenet@flyovercountry.social)'s status on Sunday, 29-Sep-2024 13:42:08 JST John-Mark Gurney

     in reply to

     • #/usr/sbin/rtheren
     • feld

     @feld @darth @RTheren
     I think that specific problem w/ Intel nics has since been fixed (the patch in the page doesn't apply as driver has changed dramatically since). At least the driver appears to support it, and my igb nic uses 4 RX and 4 TX queues. I think it does require MSI-X interrupt support, which may be a problem for lower end hardware.

     And looking ng_pppoe doesn't set NG_NODE_FORCE_WRITER (confirmed looking at code) so it's multithreaded.

     feld likes this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Sunday, 29-Sep-2024 13:42:53 JST feld

     in reply to

     • John-Mark Gurney
     • #/usr/sbin/rtheren
     @encthenet @darth @RTheren oh this is great to hear, I thought we still had this issue. FreeBSD routers have been avoided for a lot of people because of this
   • Embed this notice
     John-Mark Gurney (encthenet@flyovercountry.social)'s status on Sunday, 29-Sep-2024 13:46:03 JST John-Mark Gurney

     in reply to

     • #/usr/sbin/rtheren
     • feld

     @feld @darth @RTheren BUT, I'm not sure that the nic can properly hash the pppoe packets to make it multithreaded.

     The first step would be for someone who has a PPPoE setup w/ slow performance to generate a flame graph to help identify the parts that need work.

     something like:
     https://www.brendangregg.com/blog/2015-03-10/freebsd-flame-graphs.html or looking at the flame graph readme.

     But specing price would be hard (or expensive) w/o understanding what likely needs work.

     feld likes this.