You can see the pattern, right? If you think you sound obnoxious or obstinate by not answering the question, think of how he feels asking the question more than once.

Also, by the time the interviewer has asked two or three times, the interviewer will know that hiring you means having a tough negotiator on his team is another reason to make you a good salary offer.