And it turns out that their religion is Orthodox Shintoism.
That's where you leave food at shrines for spirits. Buck has misunderstood and thought spirits were to leave him food. Poor Mike Mills would put out cornbread and whisky every night, which Buck would have as a midnight snack and then drunkenly scrawl things on little bits of paper and leave them on the shrine. Mills was amazed that the spirits consumed it all so voraciously, and Stipe turned the drunken koans into lyrics.
So don't blame Stipe for songs about clubs being called the two-headed cow, blame Buck.