Top Description Fields Constructors Methods
org.lwjgl.openxr

public Class FBFaceTracking

extends Object
Class Inheritance
Imports
org.lwjgl.*, org.lwjgl.system.*
The XR_FB_face_tracking extension.

This extension enables applications to get weights of blend shapes. It also enables applications to render facial expressions in XR experiences.

Face tracking data is sensitive personal information and is closely linked to personal privacy and integrity. It is strongly recommended that applications storing or transferring face tracking data always ask the user for active and specific acceptance to do so.

If a runtime supports a permission system to control application access to the face tracker, then the runtime must set the isValid field to FALSE on the supplied XrFaceExpressionStatusFB structure until the user allows the application to access the face tracker. When the application access has been allowed, the runtime may set isValid on the supplied XrFaceExpressionStatusFB structure to TRUE.

Some permission systems may control access to the eye tracking separately from access to the face tracking, even though the eyes are part of the face. In case the user denied tracking of the eyes, yet, allowed tracking of the face, then the runtime must set the isEyeFollowingBlendshapesValid field to FALSE on the supplied XrFaceExpressionStatusFB for indicating that eye tracking data is not available, but at the same time may set the isValid field to TRUE on the supplied XrFaceExpressionStatusFB for indicating that another part of the face is tracked properly.

Field Summary

Modifier and TypeField and Description
public static final int
XR_FACE_CONFIDENCE_COUNT_FB

XrFaceConfidenceFB - The name of face areas where confidence is known Description

The "upper face" area represents everything above the upper lip, including eye, eyebrows + cheek, and nose.

public static final int
XR_FACE_CONFIDENCE_LOWER_FACE_FB

XrFaceConfidenceFB - The name of face areas where confidence is known Description

The "upper face" area represents everything above the upper lip, including eye, eyebrows + cheek, and nose.

public static final int
XR_FACE_CONFIDENCE_UPPER_FACE_FB

XrFaceConfidenceFB - The name of face areas where confidence is known Description

The "upper face" area represents everything above the upper lip, including eye, eyebrows + cheek, and nose.

public static final int
XR_FACE_EXPRESSION_BROW_LOWERER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_BROW_LOWERER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_PUFF_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_PUFF_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_RAISER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_RAISER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_SUCK_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHEEK_SUCK_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHIN_RAISER_B_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_CHIN_RAISER_T_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_COUNT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_DIMPLER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_DIMPLER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_CLOSED_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_CLOSED_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_DOWN_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_DOWN_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_LEFT_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_LEFT_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_RIGHT_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_RIGHT_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_UP_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_EYES_LOOK_UP_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_INNER_BROW_RAISER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_INNER_BROW_RAISER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_JAW_DROP_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_JAW_SIDEWAYS_LEFT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_JAW_SIDEWAYS_RIGHT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_JAW_THRUST_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LID_TIGHTENER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LID_TIGHTENER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_CORNER_DEPRESSOR_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_CORNER_DEPRESSOR_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_CORNER_PULLER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_CORNER_PULLER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_FUNNELER_LB_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_FUNNELER_LT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_FUNNELER_RB_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_FUNNELER_RT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_PRESSOR_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_PRESSOR_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_PUCKER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_PUCKER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_STRETCHER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_STRETCHER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_SUCK_LB_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_SUCK_LT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_SUCK_RB_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_SUCK_RT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_TIGHTENER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIP_TIGHTENER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LIPS_TOWARD_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LOWER_LIP_DEPRESSOR_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_LOWER_LIP_DEPRESSOR_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_MOUTH_LEFT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_MOUTH_RIGHT_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_NOSE_WRINKLER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_NOSE_WRINKLER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_OUTER_BROW_RAISER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_OUTER_BROW_RAISER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_SET_DEFAULT_FB

XrFaceExpressionSetFB - The set of blend shapes of a facial expression to track.

public static final int
XR_FACE_EXPRESSION_UPPER_LID_RAISER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_UPPER_LID_RAISER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_UPPER_LIP_RAISER_L_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final int
XR_FACE_EXPRESSION_UPPER_LIP_RAISER_R_FB

XrFaceExpressionFB - The name of blend shapes that can be tracked Enum values:

public static final String
XR_FB_FACE_TRACKING_EXTENSION_NAME

The extension name.

public static final int
XR_FB_face_tracking_SPEC_VERSION

The extension specification version.

public static final int
XR_OBJECT_TYPE_FACE_TRACKER_FB

Extends XrObjectType.

public static final int
XR_TYPE_FACE_EXPRESSION_INFO_FB

Extends XrStructureType.

public static final int
XR_TYPE_FACE_EXPRESSION_WEIGHTS_FB

Extends XrStructureType.

public static final int
XR_TYPE_FACE_TRACKER_CREATE_INFO_FB

Extends XrStructureType.

public static final int
XR_TYPE_SYSTEM_FACE_TRACKING_PROPERTIES_FB

Extends XrStructureType.

Constructor Summary

AccessConstructor and Description
protected
FBFaceTracking()

Method Summary

Modifier and TypeMethod and Description
public static int
nxrCreateFaceTrackerFB(XrSession session, long createInfo, long faceTracker)

Unsafe version of: CreateFaceTrackerFB

public static int
nxrGetFaceExpressionWeightsFB(XrFaceTrackerFB faceTracker, long expressionInfo, long expressionWeights)

Unsafe version of: GetFaceExpressionWeightsFB

public static int
xrCreateFaceTrackerFB(XrSession
an XrSession in which the face tracker will be active.
session, XrFaceTrackerCreateInfoFB
the XrFaceTrackerCreateInfoFB used to specify the face tracker.
createInfo, PointerBuffer
the returned XrFaceTrackerFB handle.
faceTracker)

Create a face tracking handle.

public static int
xrDestroyFaceTrackerFB(XrFaceTrackerFB
an XrFaceTrackerFB previously created by CreateFaceTrackerFB.
faceTracker)

Destroy a facial expressions handle.

public static int
xrGetFaceExpressionWeightsFB(XrFaceTrackerFB
an XrFaceTrackerFB previously created by CreateFaceTrackerFB.
faceTracker, XrFaceExpressionInfoFB
a pointer to XrFaceExpressionInfoFB describing information to obtain face expression.
expressionInfo, XrFaceExpressionWeightsFB
a pointer to XrFaceExpressionWeightsFB receiving the returned facial expression weights.
expressionWeights)

Obtain blend shapes of facial expression.

Inherited from java.lang.Object:
cloneequalsfinalizegetClasshashCodenotifynotifyAlltoStringwaitwaitwait