Hardware is the name we give to the physical parts of a computer system.
The hardware inside the computer case are often referred to as components. The devices that connect to the outside of the case are known as peripherals.
Image from http://learncomputershome.com/computer-hardware.html