If you want to restore the deleted tasks, there is a Recycle Bin in Setup that will let you put them back where they were before. I get requests for that from my team pretty regularly.
Also I would like to add one sentence in addition to Katherine, that deleted items is saved for 30 days only. Else, may be a creating a report in this regard would be helpful with notification.