Colored diamonds are caused by impurities such as nitrogen (yellow), boron (blue). With red diamonds being due to deformities in the structure of the stone, and green ones being the result of irradiation.