gravitino.dto.job.spark_job_template_dto.SparkJobTemplateDTO¶

class gravitino.dto.job.spark_job_template_dto.SparkJobTemplateDTO(_job_type: JobType, _name: str, _executable: str, _comment: str | None = None, _arguments: List[str] | None = None, _environments: Dict[str, str] | None = None, _custom_fields: Dict[str, str] | None = None, _audit: AuditDTO | None = None, _class_name: str | None = None, _jars: List[str] | None = None, _files: List[str] | None = None, _archives: List[str] | None = None, _configs: Dict[str, str] | None = None)¶

Bases: JobTemplateDTO

Represents a Spark Job Template Data Transfer Object (DTO).

__init__(_job_type: JobType, _name: str, _executable: str, _comment: str | None = None, _arguments: List[str] | None = None, _environments: Dict[str, str] | None = None, _custom_fields: Dict[str, str] | None = None, _audit: AuditDTO | None = None, _class_name: str | None = None, _jars: List[str] | None = None, _files: List[str] | None = None, _archives: List[str] | None = None, _configs: Dict[str, str] | None = None) → None¶

Methods

`__init__`(_job_type, _name, _executable[, ...])
`archives`()	Returns the list of archives associated with this Spark job template.
`arguments`()	Returns the list of arguments for the job template.
`audit_info`()	Returns the audit information for the job template.
`class_name`()	Returns the class name of the Spark job.
`comment`()	Returns the comment associated with the job template.
`configs`()	Returns the configuration properties for the Spark job.
`custom_fields`()	Returns custom fields for the job template.
`environments`()	Returns the environment variables for the job template.
`executable`()	Returns the executable associated with the job template.
`files`()	Returns the list of files associated with this Spark job template.
`from_dict`(kvs, *[, infer_missing])
`from_json`(s[, infer_missing])	Creates a JobTemplateDTO from a JSON string.
`jars`()	Returns the list of JAR files associated with this Spark job template.
`job_type`()	Returns the type of the job.
`name`()	Returns the name of the job template.
`schema`(*[, infer_missing, only, exclude, ...])
`to_dict`([encode_json])
`to_json`(*[, skipkeys, ensure_ascii, ...])
`validate`()	Validates the SparkJobTemplateDTO.

Attributes

dataclass_json_config

archives() → List[str] | None¶: Returns the list of archives associated with this Spark job template.

arguments() → List[str] | None¶: Returns the list of arguments for the job template.

audit_info() → AuditDTO | None¶: Returns the audit information for the job template.

class_name() → str¶: Returns the class name of the Spark job.

comment() → str | None¶: Returns the comment associated with the job template.

configs() → Dict[str, str] | None¶: Returns the configuration properties for the Spark job.

custom_fields() → Dict[str, str] | None¶: Returns custom fields for the job template.

environments() → Dict[str, str] | None¶: Returns the environment variables for the job template.

executable() → str¶: Returns the executable associated with the job template.

files() → List[str] | None¶: Returns the list of files associated with this Spark job template.

classmethod from_json(s: str, infer_missing: bool = False, **kwargs) → JobTemplateDTO¶: Creates a JobTemplateDTO from a JSON string.

jars() → List[str] | None¶: Returns the list of JAR files associated with this Spark job template.

job_type() → JobType¶: Returns the type of the job.

name() → str¶: Returns the name of the job template.

validate() → None¶: Validates the SparkJobTemplateDTO. Ensures that required fields are not null or empty.