I just had this exact same issue. It would repeat indefinitely my last key pressed. I turned my keyboard upside and tapped it lightly. It must have dislodged whatever was holding the key down?
EDIT: This was the “J” key on the keyboard that came with teletype