Madonna won artist of the year and returned to the VMAs stage for the first time since her 2003 kiss with Britney Spears and Christina Aguilera, while Nirvana received the video vanguard award.