“I was crying at a certain point because I felt that I had hurt him,” says Garfunkel, who has not performed with Simon since 2010