Beware when compiling a custom kernel, do not forget to include any driver!
I tried once to compile a really lightweight and fast kernel.
There's that tool that I forgot the name that probes for modules when you connect all your devices and at the end prepares the kernel with only those.
Don't do that, it's a pain.