What are some cons of affirmative action?

Affirmative action is meant to promote equal opportunity which is inherently good, however the means of affirmative action to achieve equal opportunity must in some way violate rights, i.e. you can't steal from Bill Gates no matter how much good the money could do in the pursuit of equality, but how is it harming any rights by installing a ramp for a disabled person?