"When I Wasn't Watching" is Moore's first new song since her 2009 album Amanda Leigh.

In 2017 she covered Little Feat's "Willin'" for the This Is Us soundtrack.

Moore's new song is also her first release since opening up about her relationship with ex-husband Ryan Adams to the New York Times in February. Speaking about Adams having an impact on her music career, Moore stated, "His controlling behavior essentially did block my ability to make new connections in the industry during a very pivotal and potentially lucrative time - my entire mid-to-late 20s."

Discussing her new music on Marc Maron's WTF podcast in February, Moore explained, "They're very personal. I mean, I feel like I've lived a life in the last 10 years. I have got plenty to say."