With it being an Analytics segment, it's relying on targeting based on ECIDs within that AA segment membership. If customers aren't visiting regularly, use a different browser, use incognito mode etc then they will have a new ECID, which would mean you could lose a lot of the historical segment membership and they need to re-qualify again.
I think it would be better to create this segment in Target directly, so that it will be evaluated in real-time based on the page view events sent to Target.