Can I sort within a Grouping by its *value*, but not by its *label"?

So, we have a field whose value is numerical but its label is not. Ideally, when we have a grouping, we'd like to sort via the value and not by the label. Is there some sort of text setting which is required to enter in order for this to occur?

I'm hoping that, by asking this question among my fellow Workfronters, that the answer will come to mind right away. Here goes nothing. :D