Learning keeps your mind fresh. It forces you to use your brain and utilize your potential. You might hate learning if you aren't a nerd and you, like many others, mistakenly relate learning to studies only. Learning is to learn and you can learn pretty much anything. The speed of learning would be super fast if you're passionate about that subject while the speed is relatively low if you hate that subject.
Giving up shouldn't be the choice for those who learn with the desire to increase their knowledge. If you're passionate about Medicine then pursue it with all the hard work you can put, but don't pursue it to earn big bucks because that depends upon your luck. While many people die to get into Ivy League universities in order to finish a degree that guarantees lucrative packages but the passionate ones like Mark Zuckerberg don't even complete their degrees and yet are now employing Ivy League graduates who consider Facebook as the one of the best employers to work for. The fact is that Zuckerberg was himself part of an Ivy League university eliminates the possibility that he wouldn't have done so, if he was in a top notch university.
In short, he pursued his passion and based on the availability of sources to learn, there shouldn't be any excuse regarding your progress because you can learn pretty much everything in the Internet. If you like singing there are plenty of guides available, same goes for Sports, Programming, Writing, etc. It might sound too easy and a complete opposite of what life has to offer. Majority of the people want to settle down because at the end of the day, earning "bread and butter" for oneself and family is the bigger goal and I completely agree with it. However, keeping your passion on one side isn't hard to do, especially because it is what you love doing.