All hiccups start with the diaphragm. The diaphragm is a dome-shaped muscle that sits below the lungs.