Managing Jobs

You create and schedule jobs to harvest your data assets.

Job
A task that runs the harvest process. You create a job to be run immediately, schedule it to run at a specified frequency, or when needed.
Schedule
An automated job that can run hourly, daily, weekly, or monthly.

Viewing All Jobs

You view all jobs from the Jobs page.

Accessing the Jobs Tab

You access the Jobs page by clicking Jobs on the Home page. You can also click + from tabs and select Jobs.

About Jobs Statuses

A job can be in one of the following statuses:

Created
The job is successfully created but not yet run.
Queued
Job is inactive due to resource contention. Job status changes to In Progress when the resources become available.
In Progress
The job is now running.
Succeeded
The job completed successfully.
Canceled
A job is in canceled state when you cancel it or when it is canceled by an internal process.
Failed
The job failed either during creation or execution.
About the Jobs List

The Jobs tab lists the last run details for all jobs in your data catalog. The Type column indicates if a job was run as part of a schedule. Use the Actions icon (three dots) for a job to View Details, Re-run, Schedule, or Delete the job.

Use the Search within jobs box to quickly look up a job by its name. Enter a complete or partial job name and then press enter. The list refreshes to displays all the jobs that match your search string.

Filtering the Jobs List by Job Status

Use the Status filter from the Filters section to refine the jobs list. For example, if you want to view all created jobs, select Created as the filter. The list refreshes to display all jobs with a Created status.

Re-running a Job

You can harvest data entities from a data asset again by re-running the job you created previously. To re-run a job, access the Jobs tab, click the Actions icon (three dots) for the job you want to re-rerun, and select Re-run. The selected job runs immediately using the same connection defined previously.

Refreshing the Jobs List

Click Refresh Data on the Jobs tab to refresh the jobs list.

Viewing Job Details

Data Catalog saves detailed information for every job you run.

Here’s how you view complete details for a job:

  1. Access the Jobs tab by clicking Jobs on the Home tab, or by clicking + from tabs and selecting Jobs.
  2. In the Jobs list, locate and select the job you want to view.

The job's details opens in a new tab.

From the job details tab, you can view the:

  • Details of the data asset that was harvested, such as the connection used, if incremental harvest was enabled, and the data entities selected for harvest. Click the number link for Data Entities Selected to view all the data entities selected.
  • A list of all Job Runs for the selected job. You can locate a specific job by the date and timestamp used to display the job runs. Click each timestamp to view details specific to that run.
  • Details for each job run, which is listed in three different sections:

    • Summary: Displays general job information such as job status and the date and time the job was created, started, and completed. You also view the job statistics such as Data Entities Harvested, Harvest Errors, and Time to Harvest (seconds).

    • Schedule: Displays scheduling information for the job. The Schedule section displays only if you have created a schedule for a job.

    • Log Messages: Displays all timestamped logs for the job. The Message column displays the log message. Some log messages are long. To view the complete log message, click the Actions icon (three dots) for the job log and select View Details. The complete log message opens in a Log Message panel as an overlay.

Additionally, from the job details tab, you can run, schedule, or delete the job.

Viewing Log Messages

Here’s how you view complete log messages for a job run:

  1. Access the Jobs tab by clicking Jobs on the Home tab, or by clicking + from tabs and selecting Jobs.
  2. In the Jobs list, locate and select the job you want to view.
  3. In the Job Runs section, select the job whose log messages you want to view.
  4. Expand the Log Messages section.
  5. Click the Actions icon (three dots) for the log message you want to view and select View Details.

The Log Message panel opens as an overlay.

Deleting a Job

You delete a job from the Jobs tab.

To delete a job, access the Jobs tab, click the Actions icon (three dots) for the job you want to delete, and then select Delete. The job deletes successfully and a notification displays.

Creating a Job Schedule

You create job schedules to automate the harvesting jobs in Data Catalog.

Here’s how you create a job schedule:

  1. Access the Schedules tab by clicking Schedules on the Home tab, or by clicking + from tabs and selecting Schedules.
  2. In the Schedules tab, click Create Schedule. Alternatively, in the Jobstab, click the Actions icon (three dots) for the job you want to schedule and select Schedule.
    The Create Schedule panel opens as an overlay.
  3. Complete the General Information section:
    1. In the Job drop-down list, select the job you want to schedule.
      If you are creating a schedule by selecting Schedule from menu options for a job listed on the Jobs tab, then Job is auto-filled for you.
    2. In the Name field, enter a unique name for the schedule.
    3. Optionally, in the Description field, enter the purpose of creating this schedule.
  4. Complete the Schedule Information section:
    1. From the frequency drop-down list, select Hourly, Daily, Weekly, or Monthly.
    2. For the Local Start Time field, select a date and time to start the harvesting job.
    3. For the Local End Time field, select a date and time to end the harvesting job.
  5. Click Schedule.
A notification displays indicating that the schedule is created successfully and then you return to the Schedules tab.

Viewing Job Schedules

You view all the job schedules created to automate your harvest jobs from the Schedules tab.

Accessing the Schedules Tab

To view all the scheduled jobs, click Schedules on the Home tab. Alternatively, click + from tabs and select Schedules.

About the Schedules List

The Schedules tab lists details of all job schedules created in your data catalog. Use the Actions icon (three dots) for a schedule to Edit or Delete the schedule.

Use the Search within schedules box to quickly look up a schedule by its name. Enter a complete or partial schedule name and then press enter. The list refreshes and displays all the schedules that match your search string.

Filtering the Schedules List by Start Date

Use the Schedule Start filter from the Filters section to refine the Schedules list. Using the calendar icon for the Schedule Start filter, select the start date for the schedule. The jobs list refreshes to display all schedules with specified start date.

To reset the list, clear the date from the Schedule Start filter and then press enter. The jobs list refreshes to display all schedules.

Refreshing the Schedules List

Use Refresh Data to refresh the Schedules list.

Editing a Job Schedule

You edit a job schedule to change its schedule information such as frequency, start time, or end time.

Here’s how you edit a schedule:

  1. Access the Schedules tab by clicking Schedules on the Home tab, or by clicking + from tabs and selecting Schedules.
  2. Click the Actions icon (three dots) for the schedule you want to edit and select Edit. The Edit Schedule panel opens as an overlay.
  3. Edit the frequency, start time, or end time for the schedule and then click Save Changes.
A notification displays indicating that the schedule is updated successfully and you are returned to the Schedules tab.

Deleting a Job Schedule

You delete a job schedule from the Schedules page.

To delete a schedule, access the Schedules page, click the Actions icon (three dots) for the schedule you want to delete, and then select Delete.