Yep, the OP seems to be saying that non-Jews have no business commenting on anti-Semitism. My experience is these comments are really saying, “conservatives have no business commenting on anti-Semitism”. Comments by Liberal gentiles are fine, and leftist anti-Semitism is ignored.
Ben Shapiro points out that the anti-Semitism not just from neo-Nazis:
Ironically, some on the left have accused Shapiro, who is an Orthodox Jew, of being part of KKK or neo-Nazi groups. In fact he as received multiple death threats from people associated with these groups.
For background here is an thread on the growing problem of anti-Semitism from the left: