Turns out I prefer the other church in the Montmartre area.
Spare yourself the throngs of tourists and spend a little time in Sainte Jean de Montmartre instead. The mosaic work is wonderful and there was just enough stuff crumbling or peeling to make me appreciate it all the more.