Why do Mac applications that are downloaded from the internet come in .dmg files, but not an .app file?

Whenever I download an application from the internet and not the Mac App Store, the app comes in a .dmg file, why not just an app if you don't have to install those apps that come in .dmgs?