"Delete Forever" is lifted from Grimes' forthcoming Miss Anthropocene album, and arrives after previous singles "4ÆM", "My Name is Dark", "So Heavy I Fell Through The Earth", and "Violence".

Speaking about the new single with Zane Lowe on his Apple Music Beats 1 show, Grimes says, "I mean, the song is pretty, it's a pretty bummer song. Oh my God, I'm so bad at talking about this song. I guess it's kind of about the opioid epidemic and that kinda thing 'cause I've had quite a few friends actually pass away in particular one friend when I was like 18 passed away, from complications related to opioid addiction. It's just like artists keep dying and stuff so, I wrote this song on the night Lil Peep died or whatever 'cause I just got super-super triggered by that."

Miss Anthropocene will be Grimes' first album since 2015's Art Angels.

In November 2019 Grimes and Zola Jesus had a lengthy discussion on Twitter about AI and the future of music.