I’d be more worried about social development. Of the small sample size of gifted people who didn’t want to be with their peers, how many have formed last relationships, friendships etc.
We had obviously gifted kids in my school and they came across as arrogant and entitled. 15 years later, most of them went on to get graduate degrees but don’t seem to be progressing socially (i.e. absent from reunions, weddings, small town bar run-ins)
I'm not sure attending traditional school with chronological peers does all that much to improve that situation. I know very few people who are still friends with anyone from high school, for example. I only have two friends from high school that I even talk to anymore, and only one that I'm close with. I don't feel like attending a traditional school did much of anything to help me develop social skills, as I still struggle with those quite a bit even now.
We had obviously gifted kids in my school and they came across as arrogant and entitled. 15 years later, most of them went on to get graduate degrees but don’t seem to be progressing socially (i.e. absent from reunions, weddings, small town bar run-ins)