Hello, i having problems with my internet

Hello, i having problems with my internet connection. I have the charter 5mb service. I am using a Motorola surfboard modem and a Belkin router. Most of the time the connection is fine, however many times throughout the day, especially first thing in the morning, the online light on the modem is not solid therefor no connection. Other times the modem is fine, but the connection light on the router is off, therefor no connection to our wireless notebooks. It happens if we are on the internet and all of a sudden we can surf the net, i go and check the connections, and one or both of the router/modem is disconnected. And also when we are not using the computers, i will walk into the room and notice that the connection light isnt solid on either the modem or router. IN order to fix this i am having to unplug both and plug in modem first til it gets all solid lights, then plug in the router then it usually comes back on, but its annoying and i am getting disatisfied with not knowing whether or not i am going to have a connection from one moment to the next, any help you could offer would be greatly appreciated.