"That I Would Be Good" is a song by Canadian singer-songwriter Alanis Morissette that was first included on her fourth studio album, Supposed Former Infatuation Junkie (1998). An acoustic live version of the song was recorded during a session for MTV Unplugged on September 18, 1999. The live version was released as a single in Europe in 1999 and in Canada on February 8, 2000.

MTV Unplugged is the first live album by Canadian singer-songwriter Alanis Morissette, released by Maverick Records in the United States on November 9, 1999. It comprises songs performed by Morissette on the television program MTV Unplugged. Twelve tracks were included on the album, but Morissette also performed "Baba", "Thank U" and "Your House" during the live taping. These were later released as B-sides on the "King of Pain" single release. The first single, "That I Would Be Good", was moderately successful, and two other tracks, "King of Pain" and "You Learn" were released as singles outside North America. As of March 2012, the album has sold 673,000 copies in the U.S.