I think this is the issue - our Task Templates are not built as Reports.
They live under Templates -- Main Menu > Templates.
Is there a way to customize rows within a Template?
https://experienceleague.adobe.com/docs/workfront/using/manage-work/projects/create-and-manage-project-templates/create-template.html?lang=en
You would have to use a Task report view, which is how you see a task list in a project. When you open a project and go to "tasks", that's just a task report. You can create or edit a view by selecting the "View" menu while in a project, and selecting a view to edit, then follow the 3 steps below.
Select any column (preferably the Task "Name" column)
Select "Advanced Options"
Select "Add a Rule For this Column"