"All Visits" in the upper left corner is all the visits using the constraints of your panel (date range, any applied segments, etc).
The Visits listed on the first step are the visits that match your first step criteria.
Even though you removed the "All Visits" first step, that value will still show in the legend (top left). Since you can compare multiple segments in the same fallout, the "total" visits for each group will be shown here, then your step will show the reduced number based on your step: