optimizer not robust against outliers
When optimizing the dataset with outliers the process becomes unstable.
Investigate robust optimizer by replacing rmse with another type of error metric.
e.g., Huber’s PSI-function, see 1.1.4.2 Occasional outliers in CTSMR math guide