@jasonw22 it is worth mentioning that I am not currently in the music technology business, but rather working on web / cloud technology as a maintainer of Node.js and a Developer Advocate for Google Cloud Platform.
I do have some friends doing the Music Tech thing independently. Generally it seems to be quite rewarding for people on the ground level, it is amazing dedicating yourself to your passion. The one thing I will mention is the $$$ as an eng in that space. Part of the reason I'm not working full time in music tech is because on average I see people having to take about a 15 - 25 % pay cut in order to work in music tech.
This is not always the case, but most companies only need a handful of DSP wizards, the rest of the eng staff tend to be focused on general eng duties. As I'm not a super DSP / Mathy wizard I decided to put my focus on Open Source communities / software... specifically node. I <3 node very very much, in fact it is the first server platform I ever worked with... trying to get OSC to work (I now maintain node-osc).
Anyways.. TLDR, go with your heart and work on things you love... but my impression is that Music Tech is a grind that you only do if you truly love it, not for the $$$