On the Budget page, the budget preset "Last period's budgeted" always sets the budgeted amount in the primary currency. If last period's budgeted was €500, but your primary currency is USD, it will convert the €500 to USD and set the amount in USD. Instead, it should not do any conversions, and just the the budgeted amount as it was in the previous period (i.e. €500).