Participants in the event expressed frustration with the former president in interviews with Rolling Stone