Conversation

Notices

1. Embed this notice
   Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 14:50:55 JST Miakoda

   Ok, I'm baffled!
   My #Linux server is broken due to a partial upgrade. needs 275MB more space on the /usr/lib/modules filesystem.
   df- h says it's not full. ls on that folder shows it's empty.
   How do I fix this?

   • Embed this notice
     Philip S. 🐧 (psoutham@infosec.exchange)'s status on Wednesday, 21-May-2025 15:02:30 JST Philip S. 🐧

     in reply to

     @hellomiakoda What filesystem are you running? If you are using ZFS or BTRFS make sure that you don't have any old snapshots that are taking up space (won't show up in df -h). I had a similar mysterious out of space issue a while ago and the cause was because I wasn't clearing old btrfs snapshots, once I cleaned those up the problem was solved.

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:02:30 JST Miakoda

     in reply to

     • Philip S. 🐧

     @psoutham btrfs, and I did delete a bunch of unneeded snapshots

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:12:36 JST Miakoda

     in reply to

     df - h showed me /usr/lib/modules is a tmpfs, but /usr/lib is on sdf2
     I can't find anything in fstab that would clue me in to what partition it's on about, and none of them are full. I am so confused.

     It's OpenSuse

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:17:07 JST Miakoda

     in reply to

     • Fred
     • Philip S. 🐧

     @fredds @psoutham
     # df -h /usr/lib/modules
     indicates this folder it wants space in is a tmpfs... but I have no fucking idea what tmpfs it's talking about

   • Embed this notice
     Fred (fredds@mamot.fr)'s status on Wednesday, 21-May-2025 15:17:08 JST Fred

     in reply to

     • Philip S. 🐧

     @hellomiakoda @psoutham maybe you should do a "btrfs balance" to force reclaim free space?

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:26:48 JST Miakoda

     in reply to

     • Fred
     • Philip S. 🐧

     @psoutham @fredds Attempting to unmount insists it's busy and thus cannot

   • Embed this notice
     Philip S. 🐧 (psoutham@infosec.exchange)'s status on Wednesday, 21-May-2025 15:26:49 JST Philip S. 🐧

     in reply to

     • Fred

     @hellomiakoda @fredds Can you umount /usr/lib/modules and see if your kernel modules are in there once the tmpfs is unmounted and then resume your broken update?

     As to why a tmpfs filesystem is mounted on that dir is another mystery that is hopefully resolved once your upgrade completes and a reboot is successful.

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:37:22 JST Miakoda

     in reply to

     • Fred
     • Philip S. 🐧

     @psoutham @fredds Force command didn't help

     Looks to be kernel modules for the running kernel keeping it from unmounting

   • Embed this notice
     Philip S. 🐧 (psoutham@infosec.exchange)'s status on Wednesday, 21-May-2025 15:37:23 JST Philip S. 🐧

     in reply to

     • Fred

     @hellomiakoda @fredds Assuming you do not have an active shell session in that directory which is keeping you from umounting can you see if there are any processes holding any files hostage via sudo lsof | grep /usr/lib/modules. If you are not familiar, the first two columns of any output will be the process name and pid of process that has open files in that dir potentially keeping it from unmounting. If you stop/kill those you can try unmounting, you can also try adding the --force flag to you umount command.

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 15:53:23 JST Miakoda

     in reply to

     • Fred
     • Philip S. 🐧

     @psoutham @fredds I thought about old kernels... fought my way through figuring out how to remove one... no change. Not one tiny bit of change. Not one tiny thing is different with this error

   • Embed this notice
     Philip S. 🐧 (psoutham@infosec.exchange)'s status on Wednesday, 21-May-2025 15:53:24 JST Philip S. 🐧

     in reply to

     • Fred

     @hellomiakoda @fredds ok... well going back to a more simple approach. Do you have any old kernels still installed whose modules could be taking up needless space in the /usr/lib/modules directory? Maybe try cleaning those out? I'm assuming the contents of that directory, even as a tmpfs mount, still contains the kernel modules.

     I see in another post your are running Suse, last I used that distro was about 20 years ago so i'm not sure if the /usr/lib/modules as a tmpfs mount is deliberate or some strange race condition due to your failed upgrade.

   • Embed this notice
     Miakoda (hellomiakoda@pdx.social)'s status on Wednesday, 21-May-2025 16:51:58 JST Miakoda

     in reply to

     • Fred
     • Marcos Dione
     • Philip S. 🐧

     @mdione @psoutham @fredds So far... a room full of people aren't helpful. One said / is full, I said it's not, they asked I pastebin the results of df -h, I did so, and.... no response. None at all.

   • Embed this notice
     Marcos Dione (mdione@en.osm.town)'s status on Wednesday, 21-May-2025 16:51:59 JST Marcos Dione

     in reply to

     • Fred
     • Philip S. 🐧

     @hellomiakoda @psoutham @fredds my suggestion is to get into an #OpenSuse IRC channel. The libera.chat network surely has one. Try https://web.libera.chat/#opensuse .