The benefits are obvious, but the drawbacks are seldom talked about. The biggest problem I would say is the feeling of being alone and alienated from everyone. It becomes very difficult to relate to people and have meaningful, valuable conversations and exchanges with people. Your mind is restless and constantly seeks data and stimulation that most people are unable to provide in most social contexts. It becomes very easy to be bored with novel things because you easily absorb the info and move on if there's nothing interesting to think about and explore there. This can easily come off as anti-social or unfriendly.
A side effect - and this is disputable - is that you also become acutely aware of other people's intelligence (or lack thereof). You can quickly spot who is intelligent, who is average, and who is levels above/below you from speaking with them. But never underestimate anyone, as even the average person can say or teach you something profound. Above all, remember that intelligence is a trait that is determined by genetics. So the next time you get mad at somebody for saying or doing something so unbelievably stupid, remember that they probably couldn't help it and try to see it as a test of your patience.