To help you understand the information displayed on the Data Processing page and the relationship between the states and statuses of the job streams, three possible job stream scenarios are provided.
Consider the following sample job stream.
This job stream contains nine job steps. All of the job steps completed successfully, as indicated by the green color. In the Step Status (Completed/Total) column, the value for this stream will be 9/9 because there were nine steps and all the steps completed execution. The Step Status column displays the indicator because all the job steps completed successfully. Therefore, the job stream status is OK.
To know the state and status of the particular job step, such as DataLoad_FileSystem, you must click the job step icon. This opens a pop-up window, which displays the job step details including the state and status of the step. For the DataLoad_FileSystem job step, the state of the job step will be FINISHED, while the status will be SUCCESS. This job stream will no longer be active and gets moved the Historical Stream section of the page. Now, let's look at another scenario.
Consider the following sample job stream.
This job stream contains 13 job steps. In the Step Status (Completed/Total) column, the value for this stream will be 9/13 because only nine steps are complete. The tenth step, Aggregate_Daily_Kernel, is currently running, as indicated by the blue color. However, the Step Status column displays the indicator. This is because all the job steps till the Aggregate_Daily_Kernel step completed successfully.
The job stream status is calculated based on the status of all job steps till the step that is currently running; in this case, the Aggregate_Daily_Kernel step. Therefore, the overall status of the job stream is OK because all job steps till Aggregate_Daily_Kernel completed successfully.
The state of the Aggregate_Daily_Kernel step will be RUNNING, while its status will be WAITING. The state and status of the remaining three job steps that are in gray color will be WAITING because these job steps will only start after Aggregate_Daily_Kernel completes.
Consider the following sample job stream.
This job stream contains seven job steps. In the Step Status (Completed/Total) column, the value for this stream will be 4/7. However, the Step Status column displays the indicator because the DataLoad_Software job step failed to complete. A failed job step continues to block the execution of the remaining steps until it is resolved. Therefore, only four job steps are complete in this stream.
The workflow framework will retry running the failed job step based on the number of retries defined for this job stream. Once all the retries are exhausted, the job stream will be blocked. The status of this job stream will be error. The state of the DataLoad_Software job step will be FINISHED, while the status will be ERROR or MAX_EXEC_TIME_EXCEEDED.
If you observe the Reconcile_Data icon, it has a yellow color. This indicates that Reconcile_Data job step completed but with warnings. However, this does not block the job stream and, as you can see, the Stage_Data job step completed successfully. The state of the Reconcile_Data job step will be FINISHED, while the status will be WARNING.