No. Well, unless you're talking about murderers, racists, rapists, thieves or other dastardly characters, you can work with anyone. Otherwise you could be flagged as someone who's picky and difficult if you say, "I can't work with anyone who's a Bronco's fan. Sorry."