Condoms can be damaged by contact with any oil-based products like lipstick, suntan lotion, moisturiser and baby oil. If you want to use lubrication make sure it is water-based (available from pharmacies).
Source: Sex myth buster @ NHS Choices
image by Anqa under CC0 license