Yes Boris Johnson is a bigot but he’s not the real problem