XD6320 cd player power cycle itself often

I purchased a XD6320 cd/radio and installed into my toyota previa. The problem I am having is that the unit would reset( power cycle) every now and than. Sometime, I can listen to two or three songs an then shut itself off. Sometime I didn't even get to finish one song, then shut itself off. Every time shut itself off, I can power it back on. I need help to troubleshoot this problem.

I installed the unit with a wire adapter kit. I also consulted with the stereo diagram from a book which is for the vehicle and it indicates that my ground and power are correctly wired.

FYI: I did tried and reversed the RED accessory wire and the YELLOW memory wire from the XD6320 wiring diagram but they did not make any different. The blue wires are insulated. Thanks.