Problem with hot water flowing from col...

Just moved into my house and found that when you turn the cold water on (at any cold water outlet such as faucets, tubs, outdoor water hose and even the toilet), the water comes out hot for approx 10 second and then turn to cold. There isn't a hot water circulating pump or crossed piping connections that I can find. I haven't had a plumber look at it yet but I can't find anyone handy that has ever heard of such a problem. Is this something common or does it sound like a serious problem. Please let me know what you think.