I was using the generic crappy alsa drivers that came with ubuntu but now that I have installed the nvidia drivers which require OSS I want to know how to make it so music players, games, and the like use OSS instead of ALSA for playing audio?

they have to support it... But very few applications actually use ALSA directly, most of them have OSS support (which is in turn emulated by alsa)