'You can't use 'we've had a vote' as an argument against independence'