I found a fix.
When the x axis values were in a format that could be interpreted as numerical, such as 1850 or even just 50, and the assignment was X: 91.25, X axis values are interpreted to be numerical.
By changing the assignment to label: 91.25, it was no longer interpreted as numerical input and auto populating of the X axis for which there was no data no longer occurs.