Your gums bleed as a result of inflammation caused by the presence of bacteria in your mouth. This inflammation is called gingivitis. Gingivitis causes red, puffy and bleeding gums. Gone untreated, it can progress into periodontal disease.