Most people's immune systems keep the fungus under control. But if your immune system is weak, the fungus can make you very sick.