justinmclean commented on code in PR #8066: URL: https://github.com/apache/gravitino/pull/8066#discussion_r2281163705
########## docs/manage-jobs-in-gravitino.md: ########## @@ -0,0 +1,585 @@ +--- +title: "Manage jobs in Gravitino" +slug: /manage-jobs-in-gravitino +date: 2025-08-13 +keywords: job, job template, gravitino +license: "This software is licensed under the Apache License version 2." +--- + +import Tabs from '@theme/Tabs'; +import TabItem from '@theme/TabItem'; + +## Introduction + +Starting from 1.0.0, Apache Gravitino introduces a new submodule called job system for users to +register, run, and manage jobs. This job system collaborates with the existing metadata +management, brings users the ability to execute the jobs or actions based on the metadata, which +we call metadata-driven actions, for example, running a job to compact some Iceberg tables, +running a job to clean old data based on the TTL properties, etc. + +The aim of the job system is to provide a unified way to manage job templates and jobs, +including registering job templates, running jobs based on the job templates, etc. The job +system itself is a unified job submitter, allowing users to run jobs through the job system +itself, but it doesn't provide the actual job execution capabilities. Instead, it relies on the +existing job executors (schedulers) like Apache Airflow, Apache Livy to execute the jobs. +Gravitino's job system provides an extensible way to connect to different job executors. + Review Comment: Improved paragraph: The aim of the job system is to provide a unified way to manage job templates and jobs, including registering job templates, running jobs based on the job templates, and other related tasks. The job system itself is a unified job submitter that allows users to run jobs through it, but it doesn't provide the actual job execution capabilities. Instead, it relies on existing job executors (schedulers), such as Apache Airflow and Apache Livy, to execute the jobs. Gravitino's job system provides an extensible way to connect to different job executors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
