Usually as long as your TextField is a NumericField Type in the object field properties, only numeric characters can be entered...
if you can type in letters and the object type property is still NumericField, you probably should delete the object and recreate it...
Otherwise, if the object type property is not a NumericField, change it to NumericField...
If non of these options is your solution, try changing the validation pattern...
Hope this help!