The ballad was released as the lead single from Lady A's third LP, Own the Night, which debuted at No. 1 on Top Country Albums and the all-genre Billboard 200. Follow-up single "We Owned the Night" led Hot Country Songs for two weeks in December 2011.
"Just a Kiss" also debuted and peaked at No. 7 on the all-genre Billboard Hot 100, Lady A's only song to enter in the top 10. It became the act's second top 10, after "Need You Now" (No. 2, 2010), and led the Adult Contemporary chart for six weeks beginning in February 2012.
Lady A boasts six Hot Country Songs No. 1s, among 15 top 10s, and five Top Country Albums leaders, among top 10 10s. The group has scored 11 No. 1s on Country Airplay and three on the Billboard 200.
On July 10, Lady A was forced to cancel its scheduled performance at the Lakefront Music Festival in Prior Lake, Minn., as Kelley underwent an emergency appendectomy. The threesome has since resumed touring.
Lady A's current single "Like a Lady" ranks at No. 18 on the Country Airplay chart dated Aug. 21 and No. 26 on Hot Country Songs. The track is from the group's eighth studio album, What a Song Can Do, due Oct. 22.