Have you tried to reboot the router - unplug the power, wait and replug it in?
You could try to reset the router to default settings. With cable, there's not likely any setting changes you made that you need to keep. If so, put them back in after you try the reset.
Sure sounds like it's in the router if you can connect fine directly through the modem.