Party finds itself isolated after opposition figures – and some Tories – say they would back Labour plan