Symptoms such as amnesia, agnosia, apraxia, and aphasia may lead to a fragmented experience and actions among people with moderate and severe dementia. The aim of this study was to explore the interactions where fragmentation occurred and how caregivers counteract fragmentation. The observation notes from participant observations were analyzed using interpretive content analysis. Fragmentation was noted if the patients showed that they did not recognize what was going on, the people involved, the things used in the action, or did not recognize themselves in the situation. Care providers could counteract fragmentation by a caring based on attentive interest in the interaction, valuing the person behind the dementia disease, using an individual perspective considering the impact of the dementia disease, and striving for mutual interpretation of the shared situation. Caring based on these assumptions could help the patients to keep their world together.