Grad school is a great thing to do if it suits you. If structuring your own time leads to side projects and deep diving in a technical area, then you've probably got the right drive and self determinism to do decently in grad school.

Just avoid dreaming too much about tenure track jobs and you'll have a great time. (Well, so long as the program doesn't suck. Do your research...)