I do remember the term phosgene being associated with brake parts cleaner now that you mention it. I could be led to believe a concentrated whiff of the stuff could do damage. It's an awful smell.
This stuff affects everyone differently. It's like getting shocked. Some people are really sensitive to it, and others rarely feel a thing.