Notices by Mauricio Teixeira 🇧🇷🇺🇲 (badnetmask@hachyderm.io)

@rachel
Go go go!

(To the anti-AI people: please feel free to ignore/skip this post.)

Ohh! ollama was recently updated to add support for Vulkan, and is now running at a very acceptable speed of 87.14 tokens/second on my Framework Desktop running Talos Linux. In comparison, on a previous test it was running at 66 tokens/second. This is still slower than llama.cpp with Vulkan, which is generating 94.57 tokens/s in the exact same cluster, but for sure it's some very good progress in the right direction.

#HomeLab #HomeAssistant #TalosLinux #ollama #Framework #llamacpp @homelab

@justingarrison.com
Sadly I bumped into you twice, but both times you were charging. 😄

@kbm0 @BrideOfLinux
Oh, I haven't thought about that. I'm sorry. I use the mouse on the right hand, so I guess I don't count as a left-handed computer user. 😄

@BrideOfLinux
I'm left-handed and have never heard about these shortcuts before. I can't even see how that's helpful. 🤷

@troed
I bet you can do that with Home Assistant. 😄

@justingarrison.com
I still need to go through my notes, but one that comes to mind is KubeFleet.

@justingarrison.com
Multi-cluster management tools, and GPU slicing with DRA.

@jwildeboer
This is the way. 👍

@poleguy @homelab
This is a vendor locked-in device which I don't control, and it requires a functional DNS, even though it's dumb.

@nicr9 @rachel @mmeier @homelab
Also that conversation gave me an idea. I've been having some weird issues with Cilium HTTP routes. I'll try Traefik just to see how it goes.

@rachel
This is a fascinating study.

@autobrain @naoEhAlexa
Mas você não tem certeza se sim...

@mmeier @rachel @nicr9 @homelab
I honestly don't care if a chart supports gateway or not. I have a shell script that lands my templated gateway configs, so I simply disable ingress in the chart and run the script.

@rachel @nicr9 @mmeier
You folks need to keep in mind that the development of the Ingress API itself is frozen at this point, even though there is no date for retirement yet. You can use Traefik ingress for the time being, but there's already an NGINX Gateway API controller, so you can do that as well.

When I built my most recent k8s cluster at home I started with the Cilium Gateway API right from day one. It is a bit more complicated than an ingress controller, but for good reasons. I think switching now on a home/corp lab environment is worth the trouble for learning about it, before you get cornered into migrating your production clusters "urgently".

@jorge @ChrisShort
Slap an AirTag on them. 😄

@carbontwelve @jwildeboer
This.

@zrail @loop0
I need to put some thoughts on what kind of solution I might have. I could do multicast, or VRRP or BGP. It's on my (never ending) TODO list.

@rachel @saiarcot895
Ah, my firewall blocks outgoing TCP/UDP DNS and email. No devices can override that.

@fuzzychef
So far so good here. But the cold/hot air change might have been the culprit. For whatever reason they cranked the heat in some rooms more than others.