Don't matrix organisations put you in the stressful position of having two or more bosses, who may disagree about what they are looking to see from you, especially when it comes to evaluating your performance and promotion/fire recommendations?
It sounds pretty good to be able to move around in an organisation, but knowing who determines your fate in the short term, and who doesn't, is really important too.