Motion Stabilisation of Left and Right Eye Views

Motion Stabilisation of Left and Right Eye Views
Example Frame Showing Motion Compensation for Right Eye View Compared to Left (Scaled Down)

This post describes a significant enhancement to the 2D to 3D algorithm in order to further reduce risk of discomfort. This enhancement includes:

  • Introduction of a new element that performs full frame motion compensation on the right eye view so that it always aligns precisely with the left eye view.
  • Increase in the default frame stretch factor from 5% to 8%, to adjust for the increased precision in frame alignment from the new motion compensation step.
  • Reduction of the default threshold at which the algorithm rejects a frame for 2D to 3D processing, as the result of too much frame to frame motion, from about 20% to 10% of the frame.

Examples:

I have again used the "Avatar: The Way of Water" trailer in these examples:

See Half Top/Bottom video format examples below (for playing directly in headset via a browser):

Half TB Format (MKV)

Full TB Format (MKV)

You can also download the Avatar 2: Trailer example video in Full 3D SBS format from the link below and in other formats here:

Motion Compensated, Avatar 2: Trailer in 3D Full SBS Format - FS8 (207 MB)

Sample Frames:

Motion Compensated Example Frame 1 - FS8 - in 3D Full SBS formatMotion Compensated Example Frame 2 - FS8 - in 3D Full SBS formatMotion Compensated Example Frame 3 - FS8 - in 3D Full SBS formatMotion Compensated Example Frame 4 - FS8 - in 3D Full SBS format