I think we all have those concerns, especially the older we get. Society expects we're going to lose it, so we come to expect it, too.
The Alzheimer Association hated that commercial where the husband found his wife's keys in the fridge and decided she had a major problem. That's when they came out with this simple test:
If you're forgetting times and dates and where you've put things, you're probably all right. If you forget where YOU are and how you got there, check with a doctor.
So, so far it looks like you're just part of our club!