They will probably keep trying to do it again and again, even if they quit for a little while, sooner or later one will wander over that way, especially if you don't see them every single time they go over and they get away with it enough to make it worth the trouble for them. You generally have to fence chickens in or out of where you do or don't want them. If they only go the driveway (is it fenced on the sides or something?) something like a motion activated sprinkler may work.
Electric poultry netting works quite well also, it is movable.