to annoy or frustrate someone
"The loud noise from the construction site began to vex the residents nearby."
