A small survey for the charity Changing Faces also found half of those with a disfigurement feel vulnerable on public transport.
The report looked at how people's lives are affected on a day-to-day basis.
Newsbeat's been talking to Louise Quarmby who was born with a cleft lip and palate.
"The first 20 years of my life were basically spent going in and out of hospital," says Louise.