My fellow faculty members ask how I can possibly have taken the time to learn to fly. As doing so has had, if anything, a salient effect on my career, the question leaves me non-plussed. The only possible answer is, "I made the time." That is the key to being successful and still living one's dreams, or having a family, or whatever else you need to do to become a whole person and not just a brain.
Of course, if your ambitions are to be the acknowledged very best at what you do, to be on the Time 100-people-to-watch list, to be a "widely cited expert", or whatever you consider to be the pinnacle of success, by all means go for it. But then again, you might not make it, and then where will you be? Do well, work hard, and have fun, and you never know where you'll end up. You might be surprised.