First, select the building. Then click the edit button in its selection popup. It opens a new popup where you now have access to the remove button. Click the button to remove the building from your city.
Please note that removed buildings are accessible in your building inventory (in the build menu). You can build them again, but you will have to pay the building cost again.