Update for any others who may have similar issues with their batteries:
The old battery had leaked, for whatever reason.
This problem was easily fixed with a replacement battery that Brian sent over, which is pretty straightforward to swap out.
My norns is now running off its new battery with no problems at all!
Thanks to Brian and monome for amazing customer service!