“I am not the man they have painted me to be,” the country singer said on Thursday