What if all of Tevruden’s mortal friends abandoned him or left out of fear? Would that have any real impact on him?

It would probably have more of an impact then he’d think it was having. Protecting his mortal friends gives him a bit of a purpose.