The singer also closed out Billie Eilish’s New Jersey show earlier this week with a duet to “Happier Than Ever”