IR35 is explicitly contract by contract based... In theory (and in practice) you could be working at 3 places at the same time and 2 of them would be outside IR35 and 1 would be inside it...
There are a lot of old wives tales and myths around IR35 http://www.contractoruk.com/ir35/top_ten_ir35_myths_debunked... shows a few of them. And sorry for posting links to the same two sites but that is where the real information is from people who have operated this way for years...