One of the reasons fans want to watch athletes "play a sport" is because those athletes are much, much better than average at it. The reason those athletes are better is partially genetic (height, weight, etc.), but, more importantly (in my opinion), they train extremely hard. Hours are spent in the gym, on the practice field, and watching tape (all of this with team coaches, private coaches, and on their own). The top athletes obsess over details most of us don't notice in attempts to refine their skills.
Would the majority of people be willing to go through all of that for a slim chance at a scholarship (and even slimmer chance at a payday)?
I know I wasn't.