Michel,
When its date-time axis, the date-time values of JavaScript will be in milliseconds starting from 1 Jan 1970. You can convert it to date-time and set it to viewportMinimum.
Here is an example.
If this doesn’t resolve the issue, kindly create a jsfiddle with your case.