Neanderthal Extinction?

I have read a theory that Neanderthals were not as fertile as sapiens - we may have simply replaced them because we could breed faster and more numerously.