Regardless of the task details, you can always control visibility at the individual document level through the document's Details>Sharing, which is how we've handled this situation in the past. As you pointed out though, by default the document inherits the sharing of the project/task, so you have t...