Police and ambulance crews were called to the site just before 4.30pm yesterday.
The man was arrested on suspicion of criminal damage with intent to endanger life and was taken to hospital.
As a precaution, nearby properties were evacuated and a number of road closures were put into place, including busy Nine Elms.