Skip to content

frames

frames #

posed_frame — one decoded frame written the way every dataset builder writes it.

A dataset builder decodes a frame from its source (a keyframe, a video, a panorama sweep) and hands it here to become a PosedImage: shrunk so its longest side is at most max_dimension (never enlarged), re-encoded as a JPEG in the recipe workspace, with the pose's intrinsics re-expressed at the written size so every pixel stays a ray.

posed_frame(picture, pose, depth, max_dimension) #

picture as a posed image at most max_dimension pixels along its longest side.

Parameters:

Name Type Description Default
picture Image

The decoded frame.

required
pose Pose

The camera, its intrinsics expressed at picture's size.

required
depth Depth

The depth the frame measured, Missing when none.

required
max_dimension int

The longest image side, in pixels, as written.

required

Raises:

Type Description
ValueError

If pose carries no intrinsics.

Source code in capturegraph-recipes/capturegraph_recipes/splats/datasets/frames.py
def posed_frame(
    picture: PILImage.Image,
    pose: cg.Pose,
    depth: cg.Depth,
    max_dimension: int,
) -> PosedImage:
    """``picture`` as a posed image at most ``max_dimension`` pixels along its longest side.

    Args:
        picture: The decoded frame.
        pose: The camera, its intrinsics expressed at ``picture``'s size.
        depth: The depth the frame measured, ``Missing`` when none.
        max_dimension: The longest image side, in pixels, as written.

    Raises:
        ValueError: If ``pose`` carries no intrinsics.
    """
    if max(picture.size) > max_dimension:
        picture = ImageOps.contain(picture, (max_dimension, max_dimension))
    image = cg.Image.new("jpeg")
    picture.convert("RGB").save(image, quality=JPEG_QUALITY)
    return PosedImage(image=image, pose=at_size(pose, *picture.size), depth=depth)