Conversation

Notices

1. Embed this notice
   feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 08:49:53 JST feld
   Helm charts literally don't work right, k8s is a giant piece of trash. Stuff constantly gets stuck and doesn't come back correctly with the simplest config changes.
   
   Everyone who says that this is used for production workloads is a liar
   • Haelwenn /элвэн/ :triskell: and Doughnut Lollipop 【記録係】:blobfoxgooglymlem: like this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 09:00:35 JST feld

     in reply to

     • Thomas Magnum
     @Leyonhjelm I've wasted 5 hours today on the stupidest problem because every attempt to change something takes like 10 minutes for things to complete if it doesn't horribly fail and then I have to just resort to shooting it in the head and redeploying it all from scratch which takes another 20 minutes
     
     If I had production data on here I would be screaming
     Pissed Hippo likes this.
   • Embed this notice
     Thomas Magnum (leyonhjelm@shitposter.world)'s status on Friday, 21-Feb-2025 09:00:36 JST Thomas Magnum

     in reply to
     @feld
     
     The horrifying thing is people do use this in production
   • Embed this notice
     Thomas Magnum (leyonhjelm@shitposter.world)'s status on Friday, 21-Feb-2025 09:03:58 JST Thomas Magnum

     in reply to
     @feld
     
     I quit a job once because they wanted me oncall supporting it in production.
     feld likes this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 09:16:31 JST feld

     in reply to

     • Thomas Magnum
     @Leyonhjelm you know, I don't blame you. This software is trash and everyone using it should be ashamed of themselves.
     
     There are several parts of the design that are quite well thought out and solves important issues, but it's completlely unreliable. You're still better off managing your infrastructure with other tooling. Plus there's less "mystery meat" involved. Servers and services are far more inspectable and debuggable without all the K8s abstractions.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 10:54:01 JST feld

     in reply to

     • Thomas Magnum
     @Leyonhjelm it's crazy how opaque everything is. Yeah I can pull logs and maybe get a shell on a pod but I can't access what I want
   • Embed this notice
     Thomas Magnum (leyonhjelm@shitposter.world)'s status on Friday, 21-Feb-2025 10:54:02 JST Thomas Magnum

     in reply to
     @feld
     
     The debugging obstacles were a major factor in my decision
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 11:13:25 JST gentoobro

     in reply to

     But but but one more level of containers will solve all our problems!

     ✙ dcc :pedomustdie: :phear_slackware: likes this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 11:29:18 JST feld

     in reply to

     • gentoobro
     @gentoobro If we just put kubernetes into a container and then the container onto a VM on VMWare ESXi with HA it will solve all our problems obviously
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 11:29:30 JST gentoobro

     in reply to

     • Thomas Magnum

     On-call developers is a symptom of incompetent managers.

     feld likes this.
   • Embed this notice
     Thomas Magnum (leyonhjelm@shitposter.world)'s status on Friday, 21-Feb-2025 11:35:38 JST Thomas Magnum

     in reply to
     @feld it’s only getting worse. The longer everything is automated, the more the experience retires without the young fellas getting real experience.
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 11:35:38 JST gentoobro

     in reply to

     • Thomas Magnum

     And experienced guys like me increasingly won't touch this junk for all the money in China.

     feld likes this.
   • Embed this notice
     PalePimp (palepimp@poa.st)'s status on Friday, 21-Feb-2025 12:08:26 JST PalePimp

     in reply to

     • gentoobro
     • Thomas Magnum
     @gentoobro @feld @Leyonhjelm This is one of these "THING" that is happening because everybody says it has to happen lets you not be cool like "insert big corporation name".
     
     Next, the janitor will operate your peritonitis saar, it is all automated, there is nothing to fear.
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 12:08:26 JST gentoobro

     in reply to

     • PalePimp
     • Thomas Magnum

     I have worked for two companies in my career that ran Gentoo on production. There are some decent folks out there if you look around.

     feld likes this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 12:12:25 JST feld

     in reply to

     • gentoobro
     @gentoobro I worked at a small ISP/datacenter in the Midwest and our most technically impressive client ran Gentoo. They scraped all of Facebook and Twitter around 2012 and did impressive analytics with it. They were also early adopters of those PCI-E flash storage devices. Can't remember the name of them but this was when SSDs were kinda slow. They also used to run their VMWare cluster on RAID-0 because they needed the IOPS haha
     
     They sold their little startup and the senior engineer moved to SF to become CTO of Etsy
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 12:18:12 JST feld

     in reply to

     • gentoobro
     @gentoobro 1U pizza boxes, couldn't fit more drives
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 12:18:13 JST gentoobro

     in reply to

     RAID-0 and not 5 or 1-0? Ballsy.

   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 12:21:16 JST feld

     in reply to

     • gentoobro
     @gentoobro I had several on-call emergencies where I had to throw in new drives and start the reinstall for them because they killed the 10k rpm spinners. Their rack was super hot because we let them have two 30A circuits too. God the custom ventilation we had to do for them sucked too
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 12:30:07 JST feld

     in reply to

     • gentoobro
     @gentoobro It was a bold operation and they made out like bandits so I won't judge. They gambled and won. Jealous I didn't get their millions haha
   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 12:30:08 JST gentoobro

     in reply to

     Not running a RAID with hot spares? An extra drive or two is cheap compared to on-call labor.

   • Embed this notice
     gentoobro (gentoobro@shitpost.cloud)'s status on Friday, 21-Feb-2025 12:30:34 JST gentoobro

     in reply to

     • gentoobro

     Oops, just read back in the thread and this comment was dumb, just like using 1U pizza boxes with raptors.

     feld likes this.
   • Embed this notice
     🌮 Dave Millar 🌮 (dave@puz.fun)'s status on Friday, 21-Feb-2025 13:00:52 JST 🌮 Dave Millar 🌮

     in reply to

     @feld you’re not wrong, yet somehow the apps I work on use them 🫠 I grimace every time I have to make a change. It’s like playing Jenga.

     feld likes this.
   • Embed this notice
     🌮 Dave Millar 🌮 (dave@puz.fun)'s status on Friday, 21-Feb-2025 13:06:44 JST 🌮 Dave Millar 🌮

     in reply to

     • Thomas Magnum

     @Leyonhjelm @feld my job keeps me too exhausted to even look for another one. Started eleven years ago as a front-end guy in a team of 23. Now we’re down to 2 and I’m struggling to manage 7 apps/services and devops for an 8th, and routinely get yelled at by infosec from my job’s newest parent company because they installed monitoring software on our cluster and get alerts about routine Linux operations. They even chewed me out over Teams in a hotel room on bereavement leave after my dad died.

     feld likes this.
   • Embed this notice
     feld (feld@friedcheese.us)'s status on Friday, 21-Feb-2025 13:06:50 JST feld

     in reply to

     • 🌮 Dave Millar 🌮
     • Thomas Magnum
     @dave @Leyonhjelm That's fucked up man I'm so sorry