@oneworld,
Adding and removing axis using addTo() and remove() respectively seems to be working fine. Please take a look at this jsfiddle.
If you are still facing any issue, kindly create a jsfiddle reproducing the issue so that we can look into it and help you out.
—
Vishwas R