Character knowledge records

Something I find very difficult when there's multiple characters in a scene, or transitioning from one scene to another (Ex. At POI #1 with A and B, then you move to POI #2 with C) that it seems like characters are omniscient.

It really takes you out of the experience when you're trying to do something but some characters just magically know things they have no way of knowing. It's not like a huge problem but would make interactions feel more natural and less forced/omniscient.

I have no idea how you would tackle this problem in practice. Maybe if there's a record of events (maybe based on Memories/context blocks) you could have either inclusive (only A B and C know this) or exclusive (everyone but A B and C know this) awareness? Some things might make sense for one way or another, depending on what the information is.