Why do internal combustion engines, either 4-stroke or 2-stroke, even need exhaust systems?

Internal combustion engines need exhaust systems mainly for the following reasons:

• to improve power and torque delivery characteristics
• to lead hot combusted exhaust gases away
• to muffle the sound, i.e. reduce noise emissions (where the intended use of the engine has to be taken into consideration)