gravitino.dto.rel.partitioning.bucket_partitioning_dto.BucketPartitioningDTO

class gravitino.dto.rel.partitioning.bucket_partitioning_dto.BucketPartitioningDTO(num_buckets: int, /, *field_names: List[str])

Bases: Partitioning

Data transfer object representing bucket partitioning.

__init__(num_buckets: int, /, *field_names: List[str])

Methods

__init__(num_buckets, /, *field_names)
arguments()	Gets the arguments of the partitioning strategy.
assignments()	Gets the preassigned partitions in the partitioning.
children()	Returns a list of the children of this node.
field_names()	Returns the field names.
get_by_name(name)	Gets the partitioning strategy by name.
name()	Gets the transform function name.
num_buckets()	Returns the number of buckets.
references()	Returns a list of fields or columns that are referenced by this expression.
strategy()	Returns the name of the partitioning strategy.
validate(columns)	Validates the partitioning columns.

Attributes

EMPTY_EXPRESSION	EMPTY_EXPRESSION is only used as an input when the default children method builds the result.
EMPTY_NAMED_REFERENCE	EMPTY_NAMED_REFERENCE is only used as an input when the default references method builds the result array to avoid repeatedly allocating an empty array.
EMPTY_PARTITIONING	An empty array of partitioning.

EMPTY_EXPRESSION: List[Expression] = []

EMPTY_EXPRESSION is only used as an input when the default children method builds the result.

EMPTY_NAMED_REFERENCE: List[NamedReference] = []

EMPTY_NAMED_REFERENCE is only used as an input when the default references method builds the result array to avoid repeatedly allocating an empty array.

EMPTY_PARTITIONING: Final[List[Partitioning]] = []

An empty array of partitioning.

class Strategy(value)

Bases: str, Enum

Represents a partitioning strategy.

BUCKET = 'bucket'

The bucket partitioning strategy.

DAY = 'day'

The day partitioning strategy.

FUNCTION = 'function'

The function partitioning strategy.

HOUR = 'hour'

The hour partitioning strategy.

IDENTITY = 'identity'

The identity partitioning strategy.

LIST = 'list'

The list partitioning strategy.

MONTH = 'month'

The month partitioning strategy.

RANGE = 'range'

The range partitioning strategy.

TRUNCATE = 'truncate'

The truncate partitioning strategy.

YEAR = 'year'

The year partitioning strategy.

arguments() → List[Expression]

Gets the arguments of the partitioning strategy.

Returns:

List[Expression]: The arguments of the partitioning strategy.

assignments() → List[Partition]

Gets the preassigned partitions in the partitioning.

Currently, only Transforms.ListTransform and Transforms.RangeTransform need to deal with assignments

Returns:

List[Partition]: The preassigned partitions in the partitioning.

children() → List[Expression]

Returns a list of the children of this node. Children should not change.

field_names() → List[List[str]]

Returns the field names.

Returns:

List[List[str]]: The field names.

static get_by_name(name: str) → Strategy

Gets the partitioning strategy by name.

Args:

name (str): The name of the partitioning strategy.

Returns:

Strategy: The partitioning strategy.

Raises:

IllegalArgumentException: If the name is invalid, this exception is thrown.

name() → str

Gets the transform function name.

Returns:

str: The transform function name.

num_buckets() → int

Returns the number of buckets.

Returns:

int: The number of buckets.

references() → List[NamedReference]

Returns a list of fields or columns that are referenced by this expression.

strategy() → Strategy

Returns the name of the partitioning strategy.

Returns:

Strategy: The name of the partitioning strategy.

validate(columns: List[ColumnDTO]) → None

Validates the partitioning columns.

Args:

columns (List[ColumnDTO]): The columns to be validated.

Raises:

IllegalArgumentException: If the columns are invalid, this exception is thrown.