i haven't compiled a kernel in about 15 years, but as I recall, you can compile a few drivers right in .. and then put the others in initrd.
also as i dimly recall -- you need to compile gzip, a disk driver, and squish-fs driver into your custom kernel so it can read initrd. don't quote me on that