There is no avatar/person icon when there is just one person assigned (yourself), but when there are two people, you see yourself plus the other person. A consistent UX would be to display either: only assignments for others (so if you are the only assignee, no avatar), or always include yourself whether its just you or you+one. My preference is the latter - always show yourself, plus others.
