Conversation

Notices

1. Embed this notice
   Gianni Rosato (gianni@disobey.net)'s status on Monday, 18-Nov-2024 06:18:12 JST Gianni Rosato

   in reply to

   • aeva

   @aeva I’m not super sure how much AI image generation models struggle with noise, but modern video & image compression algorithms struggle quite a bit which may be part of why the noiseless look has become so desirable. I’m certainly in the camp that thinks noise can be pretty, and in modern films, it is often added in post.

   Subjectively, I think *chroma* noise is what makes noise look bad. Try denoising only the chroma planes of your render with some wavelet denoiser and see if you agree.

   • Embed this notice
     aeva (aeva@mastodon.gamedev.place)'s status on Monday, 18-Nov-2024 06:18:13 JST aeva

     in reply to

     But this also got me thinking, do "ai" image generators struggle at all with generating noisy / eccentric high frequency textures? My understanding is they're meant to take noise and munge it into recgonizable patterns so more different generating fine grain noise is probably contrary to how they're trained?

     Maybe leaving the denoiser off on raytraced renders is a feature if you can afford the extra convergence time.

   • Embed this notice
     aeva (aeva@mastodon.gamedev.place)'s status on Monday, 18-Nov-2024 06:18:14 JST aeva

     in reply to

     I feel like I'm in the minority here but in general I'd rather have ray tracing grain over the weird thing that denoising does to low light images specifically.

     This sort of thing is interesting to me though, because the harsh constraints imposed by technical fads create room for people to stand out. State of the art realtime ray tracing renderers also often struggle with low light scenes and tend to have similarly ugly telltale artifacts.

   • Embed this notice
     aeva (aeva@mastodon.gamedev.place)'s status on Monday, 18-Nov-2024 06:18:15 JST aeva

     Regarding this image I posted yesterday: https://mastodon.gamedev.place/@aeva/113497645822172397

     I experimented with blender's options for "ai" denoising and ultimately decide it was unsalvageable and left it off. I'm sure it probably looks fine for some things, but for this particular scene it just made my image look like it was shat out by stable diffusion. It was really bad - it muddied up the edges and made all of the small transmissive lights look splotchy and bad.