Installing LAMP (easy way)
I previously wrote about how to install WordPress on Ubuntu with some information on how to setup Apache, mySQL, PHP.
A faster way (if you do not care about selecting and configuring manually)
sudo tasksel install lamp-server