Known as "Lady Antebellum" for their first 14 years, on June 11, 2020, the trio changed their name to "Lady A" as part of a movement to renounce imagery associated with slavery (a day earlier, NASCAR banned Confederate flags at races). They explained in a statement: "When we set out together almost 14 years ago, we named our band after the southern 'antebellum' style home where we took our first photos. As musicians, it reminded us of all the music born in the south that influenced us... Southern Rock, Blues, R&B, Gospel and of course Country. But we are regretful and embarrassed to say that we did not take into account the associations that weigh down this word referring to the period of history before The Civil War, which includes slavery." — By Songfacts

According to David Byrne, who is the only writer credited on the track, this was written about a girl he knew who used to take LSD in a field next to the Yoo-Hoo drink factory in Baltimore. "Somehow that image seemed fitting, the junk food factory and this young girl tripping her brains out gazing at the sky," he told Q magazine in 1992. "But it wasn't a drugs song at all and I don't think people took it that way. I think it gives the impression of a spiritual or emotional experience, instantaneous and unprovoked. The sublime can come out of the ridiculous." — By Songfacts