Each iteration of processing of input from another layer can increase the effect distance and thus the padding needed when requesting the data.
https://cdn.masto.host/mastodongamedevplace/media_attachments/files/112/491/416/054/859/507/original/0fecf186495e5502.png