Approving plans for South Bristol’s tallest ever building would be a ‘slap in the face’, according to a former city mayor.