MA Administration: Job Activity

IN THIS ARTICLE:

The Job Activity feature in MA Administration provides advanced users with visibility into the status and progress of jobs related to cross-workspace settings and activities. This user guide is designed to help users effectively utilize the Job Activity page, focusing on the Monitor, History, and Exceptions tabs.

WHO CAN PERFORM:

To access the Job Activity page, users must have the "MA Administration" permission. This permission is granted to the LH_Internal group and system administrators by default.

Job Activity Page

The Job Activity Page displays the following tabs:

  • Monitor: Displays real-time information on jobs that are currently running, queued, or waiting-to-be-queued.
  • History: Displays completed and cancelled sets over the previous 7 days.
  • Exceptions: Displays sets or overlays with exception status.

All tab pages can display both Analytic Sets jobs as well as Indexing set jobs.

Monitor Tab

The Monitor tab displays real-time information on jobs that are currently running, queued, or waiting-to-be-queued. Each row represents a set, and multiple jobs for a set can run in parallel.

The Monitor tab displays job information in the following columns:

Order Order of jobs, which you can adjust.
Set Name Link to the page for an MA set in its respective workspace.
Workspace Name of the workspace.
Set Submitted Date Time and date of a set submission.
Analysis Started Date Time and date when the analysis started (or when the displayed status started).
Status Current state of the job process.
Progress Overall progress of the set displayed as a progress bar.

Monitor Tab Details Panel

Click the MORE button at the end of a set row to open the details for that set.

The details tab for the Monitor tab displays the following additional information:

Analysis Progress Overall progress of the set displayed as a progress bar.
Overlay Progress Current status of the Overlay process of the set. If auto-overlay is not enabled, progress unavailable until the overlay starts.
Status Current status of the job process.
Phase Current phase of the job (for running jobs).
Tasks (Completed/Total) Completed tasks are the tasks that are completed referring to all the running jobs in the status. The total tasks are the total tasks referring to the running jobs in the status.
Agents Total number of agents and pods currently picked for running jobs. Expands to list out agents in use.
Submitted By Username of the person who initiated the set.
Set Submitted Date Time and date of set submission.
Analysis Started Date Time and date when the analysis started.
Workspace Name Name of the workspace or project.
Workspace ID ID of the workspace or project.
VIEW SET button Clicking on the name of the set or the "View Set" button leads to the MA Sets page for the workspace where the selected set is running.

Reorder a Job

Users can change the order of currently running and upcoming jobs on the Monitor page of the Job Activity via the MA Administration Page.

The following limitations apply when reordering jobs:

  • Only set-related analytic and overlay jobs can be reordered.
  • Only one job in each workspace can run at a time.
  • When two jobs exist in one workspace, the second job is always in the "Waiting to be queued" status and cannot be reordered.
  • Prioritizing a running job over a new one is not allowed within a workspace.
  • Some time might elapse between an analytics job running and the next job waiting for an agent (showing the "Running" status).
  • Changes in set job priority might require a few seconds for agents to finish tasks from the current job.

TO REORDER A JOB:

  1. Click Job Activity on the left side of the Admin Settings page.

    The Job Activity page opens with Monitor, History, and Exceptions tabs displayed.

  2. Click the Monitor tab.

  3. Click and drag a job to the desired position in the list.

History Tab

The History tab displays completed and cancelled sets, which includes sets with auto-import turned on and sets triggered manually after completion.

The History tab displays job information in the following columns:

Set ID Unique identifier that Matter Analytics assigns to a set.
Set Name Name of the set that a user specifies.
Set Type Type of the set (Analytic or Indexing).
Workspace ID Identifier for the workspace.
Workspace Name of the workspace.
Status Current status of the set (Completed or Cancelled).
Submitted By User who submitted the set.

History Tab Details Panel

Click the MORE button at the end of a set row to open the details for that set.

The details for the History tab displays the following additional information:

Status Current status of the job process.
Phase Current phase of the job (for running jobs).
Tasks (Completed/Total) Completed tasks are the tasks that are completed referring to all the running jobs in the status. The total tasks are the total tasks referring to the running jobs in the status.
Submitted By Username of the person who initiated the set.
Set Submitted Time and date of set submission.
Analysis Started Time and date when the analysis started.
Completed Time and date the analysis completed.
Workspace Name Name of the workspace or project.
Workspace ID ID of the workspace or project.

Exceptions Tab

The Exceptions tab includes sets or overlays (import) with an exception status (status 40) and displays essential information without showing tasks, agents, and job statuses.

The Exceptions tab displays job information in the following columns:

Set ID Unique identifier that Matter Analytics assigns to a set.
Set Name Name of the set that a user specifies.
Set Type Type of the set (Analytic or Indexing).
Workspace ID Identifier for the workspace.
Workspace Name of the workspace.
Submitted By User who submitted the set.

Exceptions Tab Details Panel

Click the MORE button at the end of a set row to open the details for that set.

The details for the Exceptions tab displays the following additional information:

Analysis Progress Overall progress of the set displayed as a progress bar.
Overlay Progress Current status of the Overlay process of the set. If auto-overlay is not enabled, progress unavailable until the overlay starts.
Analysis Progress Current status of the job process.
Status Current status of the job process.
Submitted By Username of the person who initiated the set.
Set Submitted Time and date of set submission.
Analysis Started Time and date when the analysis started.
Workspace Name Name of the workspace or project.
Workspace ID ID of the workspace or project.
VIEW SET button Clicking on the name of the set or the VIEW SET button leads to the MA Sets page for the workspace where the selected set is running.

Algorithm Statuses, Phases, and Completion Percentages


  • Scope Identification: (Relativity)
    • Status: Scope Identification
    • Phases:
      • Get Sample Size
      • Get Control Number FieldIDs
      • Get Field Names
      • Delete Set Details
      • Fetch and Insert Documents with their etails
      • Get Scope Not Processed Documents
      • Get New Partitions
      • BulkCopy to Azure
      • Update Family Count and Audit Flags
      • Update Set Document Details
  • Data Push: (both: Relativity and Azure) 
    • Status: Perform Data Push
    • Phases:
      • Perform Data Push
  • Indexing: (Azure)
    • Status: Indexing
    • Phases: Perform Indexing
  • Indexing Summary: (Azure)
    • Status: Indexing Summary
    • Phases: Perform Indexing Summary
  • Text Duplicates: (Azure)
    • Status: Process Text Duplicate
    • Phases: Prepare Text Duplicate Output
  • Text Duplicates Report: (Azure)
    • Status: Perform Text Duplicates Summary
    • Phases:
      • Create and Populate Text Duplicate Charts
      • Prepare Summary Json
  • Near Duplicates Preprocessing: (Azure)
    • Status: Perform Near Duplicate Preprocessing
    • Phases:
      • Get Document VDDHash and Write NDD Document File
  • Near Duplicates Document Comparison: (Azure)
    • Status: Perform Near Duplicate Document Comparison
    • Phases: Perform Near Duplicate Left Right Document Comparison
  • Near Duplicates Report: (Azure)
    • Status: Perform Near Duplicate Summary
    • Phases:
      • Create and Populate Near Duplicate Charts
      • Prepare Summary Json
  • Name Normalization: (Azure)
    • Status: Process Name
    • Phases:
      • Prepare NN Input
      • Get Domain Pattern Details
      • Process Name
      • Process Second Phase
      • BulkCopy to Azure
      • Update Count and Time Frame
      • Load Data in Transaction and Make Distribution
      • BulkCopy Function Designation
      • Update Organization Type
  • Name Normalization Initialization: (Azure) 
    • Status: Initialize
    • Phases:
      • Initialize
      • Identify Mentions 
      • Note: does not do anything as mentions is not supported, but still shows as a phase to not disrupt workflow
      • Prepare NN Input
      • Get NextIds for Names and Domains
  • Name Normalization Report: (Azure)
    • Status: Perform Name Normalization Summary
    • Phases:
      • Create and Populate Name Normalization Charts
      • Prepare Summary Json
  • Email Threading: (Azure)
    • Status: Perform Email Threading
    • Phases:
      • Initialization and Prepare Groups
      • Process Group Hashes
  • Email Threading Report: (Azure)
    • Status: Perform Email Threading Summary
    • Phases:
      • Create and Populate Email Threading Charts
      • Prepare Summary Json
  • Indexing Import: (Both: Relativity and Azure)
    • Status: Process Index Chart
    • Phases:
      • Process Index Chart
      • Update Fields
      • Populate Index Fields and Counts
      • Update Detected Email
      • Update Statistics
  • Import Data: (Both: Relativity and Azure)
    • Status: Perform Import
    • Phases:
      • Initialize and Read File
      • Delta Identification
      • Update Flags
      • Update Statistics
  • Import Data Initialization: (Both: Relativity and Azure)
    • Status: Pre-Initialization
    • Phases:
      • Pre-Initialization
  • Import Data Full Run: (Both: Relativity and Azure)
    • Status: Import Initialize and Read File
    • Phases:
      • Import Initialize and Read File
      • Delete Previous Results
      • Load NDD Data
      • Update IsImported Flag
      • Update Statistics
  • Import Data NDD: (Both: Relativity and Azure)
    • Status: Write Files and Import Mentions
    • Phases:
      • Write Files and Import Mentions
      • Populate Data to Database
      • Write Email Document Details File
      • Write Binary Files
      • Organizations Import on Azure
      • Write Files for Sort
      • Initialize Actions
      • Pull People File Data from Azure
      • Organization Import on Relativity
      • Read Files
      • Update Algorithm Flags and Statistics