As the prime minister attempts to stave off a far-right challenger, a small minority of Muslims are being targeted.