You have to get compensation right, as best you can, all the time. These days, anyone good is going to get a raise to move and maybe a signing bonus on top of that.

The thing is you can not counter. It is too late by that point. Once they tell you they have another offer they are already out the door. A raise will not do it at this point, at least not for the good ones.