A neurologist is the specialist most commonly associated with diagnosing and treating memory loss, but your first stop is typically your primary care doctor. Several types of specialists may get involved depending on your age, symptoms, and what initial testing reveals. Understanding which doctor does what can save you time and get you to the right care faster.
Start With Your Primary Care Doctor
Your primary care physician is the best first contact for memory concerns. They can run quick screening tests right in the office, some taking as little as 10 minutes. The most widely used is the Montreal Cognitive Assessment (MoCA), which checks your ability to recall words, draw shapes, and follow instructions. Shorter versions like the Mini-Cog, which asks you to remember three words and draw a clock face, can flag problems even faster.
Beyond cognitive screening, your primary care doctor will order blood work to check for reversible causes of memory trouble. Low vitamin B-12, thyroid problems, electrolyte imbalances, and even medication side effects can all mimic or worsen cognitive decline. Certain drug classes are known offenders: sleep medications, muscle relaxants, opiates, and some older antidepressants can cloud thinking, especially in older adults. Your doctor can identify whether something on your medication list is contributing to the problem and adjust it before referring you elsewhere.
If screening suggests something more than normal aging, your primary care doctor will refer you to the appropriate specialist based on what they find. Focal neurological symptoms like tremors, gait problems, or one-sided weakness point toward a neurologist. Behavioral changes like agitation or paranoia may warrant a psychiatry referral. And if you’re over 65 with multiple health conditions, a geriatrician may be the best fit.
Neurologists: The Core Memory Specialist
Neurologists are the doctors most people think of when it comes to memory loss, and for good reason. They specialize in diseases of the brain and nervous system, including Alzheimer’s disease, vascular dementia, Parkinson’s disease, and other conditions that damage memory. A neurologist’s evaluation goes well beyond a screening quiz.
During your visit, a neurologist will perform a detailed neurological exam testing your reflexes, eye movements, coordination, and sensation. These physical findings help distinguish between different causes of cognitive decline. A person whose memory problems stem from small strokes, for example, will show different neurological signs than someone with early Alzheimer’s.
Neurologists also order and interpret brain imaging. An MRI can reveal structural changes like shrinkage in the hippocampus (the brain’s memory center), evidence of past strokes, tumors, or a condition called normal pressure hydrocephalus, where fluid buildup in the brain causes memory loss, walking difficulty, and bladder problems. That last one is important because it can be treated surgically. PET scans go a step further by measuring brain activity and detecting abnormal protein buildup associated with Alzheimer’s disease. A hallmark PET finding in Alzheimer’s is reduced activity in the temporal and parietal regions of the brain with the back of the brain (the occipital lobe) still functioning normally.
The FDA has also cleared the first blood test to help diagnose Alzheimer’s disease. The test, made by Fujirebio Diagnostics, measures the ratio of two proteins in blood plasma and is approved for adults 55 and older who are already showing symptoms. This is a newer option your neurologist may use alongside imaging to confirm or rule out Alzheimer’s as the cause.
Geriatricians: Memory Loss in the Context of Aging
Geriatricians are internists with additional training in the health of older adults. They’re especially valuable when memory loss shows up alongside other age-related conditions like diabetes, heart disease, depression, or hearing loss. Rather than zeroing in on the brain alone, a geriatrician performs what’s called a comprehensive geriatric assessment, evaluating your medical, functional, psychological, and even financial status to build a full picture of what’s going on.
This broader view matters because so many causes of memory trouble in older adults are treatable or even reversible. Depression and anxiety can cause significant cognitive impairment that improves dramatically with proper treatment. Untreated sleep apnea starves the brain of oxygen at night. Hearing loss forces the brain to work harder to process conversation, leaving fewer resources for memory. A geriatrician looks at all of these factors together and can coordinate changes across your entire care plan, from adjusting medications to recommending hearing aids or corrective lenses that improve day-to-day cognitive function.
Neuropsychologists: Mapping Your Cognitive Strengths and Weaknesses
A neuropsychologist is not a medical doctor but a PhD-trained specialist who administers in-depth cognitive testing. While a screening test in your doctor’s office takes 10 minutes, a full neuropsychological evaluation involves hours of standardized tests covering memory, attention, language, reasoning, processing speed, and problem-solving. Your results are then compared against people of similar age and education level.
This testing serves two purposes. First, it can pinpoint exactly which types of memory are affected, and to what degree. Someone who struggles with delayed recall (remembering a word list after 20 minutes) but does fine with recognition (picking the right word from a list) has a different pattern than someone who fails at both. These patterns help distinguish between Alzheimer’s, other dementias, and non-dementia causes like depression. Second, the detailed baseline makes it possible to track changes over time and measure whether treatments are helping. Results typically take a couple of weeks to score and interpret. Neuropsychological testing is normally covered by insurance.
Psychiatrists: When Mood and Memory Overlap
Memory loss doesn’t always mean dementia. Depression, particularly in older adults, can cause what’s sometimes called pseudodementia, a pattern of cognitive problems that looks like dementia but is actually driven by a mood disorder. Distinguishing between the two is critical because depression is highly treatable, while neurodegenerative dementia currently is not.
Psychiatrists, especially geriatric psychiatrists (geropsychiatrists), are trained to tease apart these overlapping symptoms. The clues are often subtle. A person with depression-related memory problems tends to lose points on verbal fluency tasks (generating words that start with a certain letter, for example) but can still manage delayed recall, where you repeat back a word list after a delay. In Alzheimer’s, it’s the opposite: delayed recall drops early. People with depression also tend to struggle with the clock drawing test less than those with Alzheimer’s, because the spatial reasoning involved is typically preserved in depression.
A psychiatrist referral is also useful when memory loss comes with behavioral symptoms like agitation, paranoia, hallucinations, or significant personality changes. These can occur in certain types of dementia and benefit from psychiatric management alongside neurological care.
How to Prepare for Your First Appointment
Whichever doctor you see first, you’ll get more out of the visit if you come prepared. Bring a written timeline of when you first noticed changes and how they’ve progressed. Note whether the problems involve memory specifically (forgetting conversations, repeating questions) or other thinking skills like planning, word-finding, or navigating familiar routes. Include changes in mood, behavior, or personality.
Bring a complete list of every medication you take, including supplements and over-the-counter products. If possible, bring a family member or close friend who can describe changes they’ve observed. Some screening tools are specifically designed for a companion to fill out when the patient can’t reliably complete testing themselves due to illness, hearing loss, or other barriers. Your doctor will also want to know your family history of dementia or Alzheimer’s disease, any history of head injuries, and whether you have conditions like high blood pressure, diabetes, or sleep apnea that raise the risk of cognitive decline.