I think that rhetorically, the hybrid symbol is more egregious than it seems at first glance. This is not the combination of two ideologically different symbols (which Ye's disingenuous claim that he loves Jews and he loves Nazis pretends to assert).
The horizontal axes of the two triangles of the star of David are torn and twisted to form the swastika, but the swastika itself is unbroken. Although the swastika has been described as fitting inside of the Jewish symbol, it has taken control, snaking in and out of the star of David like an insidious vine.
The design replaces order and balance with disorder and domination, which is of course a central feature of antisemitism.