Damage Not being dealt

Franz is sometimes just completely unable to keep track of damage dealt, even though he’s the one telling the story and showing me how much damage is dealt. I’ll attack, hit, roll for damage, but the enemy’s HP won’t decrease, and when I tell Franz to keep track, he’ll ask me how much damage to add to the enemy, even it seems he should be more than able to look at that info himself. The half the time when I say something like “I dealt 4 slashing damage” he will restore the enemy’s health to full, and take 4 from that number instead of remembering where the enemy’s damage was already and subtracting from that number. It make combat a pain, nearly impossible, and definitely sucks the fun out of it completely.