Learning Rate Multiplier Values

[_j]

You are not “safe” as it is not 1 by default. You might get 2 or 0.2 depending on the model, training file, or other hyperparameters specified.

Finetuning -- hyperparameter conversions, learning_rate_multiplier values

Ideal hyperparmeters will change from model to model, even when your input data might be the same. In general, the default we set are values that our research team has validated work good in many use cases. There are of course outliers but the general approach to find the new ideal parameters is to go and try and train the model iteratively to see how different values effect the loss.