Meadow Partners wanted to build two blocks of 15 and 19 storeys at the original Tolworth Tower site.
Councillors gave 10 reasons for tuning the proposals down.
These included a lack of affordable housing, a lack of 3 bed flats, the height of the towers and lack of car-parking.