"But it's not just Dr. Shulman's patients that are leaving."