The loss of lymphocytes of a particular specificity due to contact with either "self" or artificially introduced antigen.