Remove your old LibreOffice:
sudo apt-get remove libreoffice*
You probably also want to get rid of the dead PPAs you might have installed for LibreOffice 4.x:
If you want to upgrade to LibreOffice 5.0 (available on 12.04):
sudo add-apt-repository ppa:libreoffice/libreoffice-5-0
If you want to upgrade to LibreOffice 5.1 (not available on 12.04):
sudo add-apt-repository ppa:libreoffice/libreoffice-5-1
Now install the new version:
sudo apt-get update
sudo apt-get install libreoffice
For a localized interface, install the corresponding language package. Example:
sudo apt-get install libreoffice-l10n-de
If LibreOffice looks like Windows 95 on your machine, also add:
sudo apt-get install libreoffice-gtk