OK, it sounds like a visit to either an attorney or the police, or both, is probably in order. If they are in fact harassing you, then they have crossed a line. See Daphne's earlier post regarding harrassment and wiretapping.
Also, I hereby retract my comment about the spouse-mistress issue. Even if that is true, harassment is not warranted.