Getting transformations from camera to world looking at the same point with head movement

[juseonghan]

Hello,

I would like to get the transformations between the eye camera and a world point at various head positions. I'm willing to perform multiple calibrations to achieve this, but wasn't sure what the best way to do it is.

I have binocular glasses (one camera for each eye), and I'd like to figure out a way where the user can stare at a point, get the 3D transformation between the camera and their gaze point, move their head, and get another 3D transformation between the camera and the same gaze point. I was looking at the eye_camera_to_world_matrix, but I'm unsure if this would be representative of the "same point" between calibrations.

Any guidance would be appreciated. Thank you.