Looks like a certain toolbar feature was included with the AVG that wants to keep starting. Go to Start button, then Control Panel. In the control panel, click Classic View on the left, open up Internet Options and click the Programs Tab on the top of the Internet Options Box that opens up.
Then click the Manage Add-Ons button. Beside the word "Show:", check under each option from the dropdown menu (Add-ons that have been used, Add-ons currently loaded, etc) and in the box below the Show menu, left click to highlight anything that says AVG, then click the round button near the botton to Disable that add-on.
Also check your Control Panel > Programs And Features for anything that mentions an AVG Toolbar as it was possibly separately installed and has it's own Uninstall Listing in the Programs and Features.
If those don't help, you can try this:
You can try to download and install the Microsoft Installer Cleanup Utility. http://support.microsoft.com/kb/290301
Download and install the Cleanup Utility, then start the program from your Programs list.
***Be careful with this tool...you do not want to remove the wrong things or use the Remove All button, or no/most programs will not work anymore***
After you start the program, browse down the list and anything you see listed with AVG, left click to highlight the item then click the Remove Selected button at the bottom.
Hopefully this removes any traces of the installed AVG.