I've found display managers tend to be finicky about a lot of window managers - I spent far too long trying to get gdm to play ball with dwm before deciding that actually, I didn't need one. What does a DM do? Setting up X to autostart after you log on in a tty is very easy, just do that.