The lack of a reasonable porting tool and the fact that it didn't really have any advantages over C# in .net land, it made sense for most people to jump to C# instead of VB.net.
MS had to know this was going to happen. They left the door open for someone to actually create something to fill the VB niche, but all the focus on web technologies has meant that nothing really stepped up.