The party's chief whip says it has not ruled out triggering a no confidence vote in Huw Irranca-Davies.