Fans might not remember, or may have forgotten, but back in the early 2010s, Katy Perry and John Mayer were a hot item in Hollywood. The two first sparked dating rumors in 2012 after Katy’s divorce from Russell Brand. They were first seen together in August, before making more appearances together in October of that year, when they celebrated John’s birthday in New York City.

The two remained together through the rest of 2012, but seemingly went on a break in 2013. However, they reconciled and reconnected, debuting their duet ‘Who You Love’ in August 2013. Although there were rumors of an engagement, John and Katy’s relationship took a turn and the two broke up by early 2014.

Here Kacey Musgraves joins a photo with John Mayer and Katy Perry at Universal Music Group’s 2014 Post-Grammy Party in Los Angeles. To see more photos of the couple throughout their relationship, check out the rest of the gallery!