|
Collapse All | Expand All | Show Default |
| SeqQaCompleteness
DataStage Job Report Generated 2005-02-15 08:26:49pm |
| - Job Design |
|
|---|
| - Job Information |
| - Job Properties (7) |
| Property | Value |
| Object Type | sequencer |
| Short Description | kduke 2004-06-03 created |
| Full Description | Job: SeqQaCompleteness
================================================================= Description: Sequence to load calculate and email completeness. ================================================================= Parameters: 1. FilePath 2. SourceDSN 3. SourceUser 4. SourcePwd 5. TargetDSN 6. TargetPwd 7. TargetUser ================================================================= Jobs: ================================================================= Modification History ================================================================= Developer Date Modification description ======== ========= ============================================== kduke 2004-06-03 created ======== ========= ============================================== |
| Category | EtlStats |
| Multiple Instance | False |
| Job Version Number | 40.0.0 |
| Hash File Cache Sharing | False |
| - Parameters (7) |
| Parameter Name | Prompt | Default Value | Help Text |
| SourceDSN | SourceDSN | kduke | |
| SourceUser | SourceUser | etluser | |
| SourcePwd | SourcePwd | LDH@9:VA=93L0O5I<;J| |
|
| TargetDSN | TargetDSN | kduke | |
| TargetUser | TargetUser | etluser | |
| TargetPwd | TargetPwd | LDH@9:VA=93L0O5I<;J| |
|
| FilePath | FilePath | ./ |
| - Stages (9) |
| - Source Stages (2) |
| BuildEtlQaSqlHash (job) |
| SeqExceptionHandler (exception) |
| - Processing Stages (5) |
| GetEtlQaSqlStatDriver (job) |
| GenHtmlFromSqlDriver (job) |
| WaitAll (sequencer) |
| FailureNotification (notification) |
| DSJobReportDbDriver (job) |
| - Target Stages (2) |
| Done (sequencer) |
| SeqAbortedtoLog (routine) |
| - Source Stages (2) |
| - BuildEtlQaSqlHash (job) |
| - Stage Properties (3) |
| Property | Value |
| Job Name | BuildEtlQaSqlHash |
| Short Description | Last Changed: 07-29-2004 |
| Full Description | Job: LoadEtlJob
------------------------------------------------------------------------------------- Non-technical description: This copies records from ETL_QA_SQL to a hash file. This allows job GetEtlQaSqlStatDriver to process the SQL to calculate row counts or whatever measures to validate the data warehouse tables. ------------------------------------------------------------------------------------- Business rules: tbd ------------------------------------------------------------------------------------- Rules for restarting this job: Just rerun. ------------------------------------------------------------------------------------- Parameters: 1. TargetDSN 2. TargetUser 3. TargetPwd ------------------------------------------------------------------------------------- Sources: ETL_QA_SQL ------------------------------------------------------------------------------------- Targets: EtlQaSqlHash ------------------------------------------------------------------------------------- Modification History: ------------------------------------------------------------------------------------- UserId Date Version Modification Description ------------------------------------------------------------------------------------- kduke 07-29-2004 1 Created job. ------------------------------------------------------------------------------------- |
| - Parameters (3) |
| Parameter Name | Value |
| TargetDSN | TargetDSN |
| TargetUser | TargetUser |
| TargetPwd | TargetPwd |
| - Output Links (1) |
| OkQa1 triggers GetEtlQaSqlStatDriver unconditionally |
| - SeqExceptionHandler (exception) |
| - Processing Stages (5) |
| - GetEtlQaSqlStatDriver (job) |
| - Stage Properties (3) |
| Property | Value |
| Job Name | GetEtlQaSqlStatDriver |
| Short Description | Last Changed: 11-01-2004 |
| Full Description | Job: GetEtlQaSqlStatDriver
------------------------------------------------------------------------------------- Non-technical description: This job will get QA stats for QaCategory. ------------------------------------------------------------------------------------- Business rules: Need to manually load ETL_QA_RESULT. ------------------------------------------------------------------------------------- Rules for restarting this job: Just rerun. ------------------------------------------------------------------------------------- Parameters: 1. TargetDSN 2. TargetUser 3. TargetPwd 4. QaCategory ------------------------------------------------------------------------------------- Sources: tbd ------------------------------------------------------------------------------------- Targets: tbd ------------------------------------------------------------------------------------- Modification History: ------------------------------------------------------------------------------------- UserId Date Version Modification Description ------------------------------------------------------------------------------------- kduke 11-01-2004 1 Created job. ------------------------------------------------------------------------------------- |
| - Parameters (4) |
| Parameter Name | Value |
| TargetDSN | TargetDSN |
| TargetUser | TargetUser |
| TargetPwd | TargetPwd |
| QaCategory | "All" |
| - Input Links (1) |
| OkQa1 triggered by BuildEtlQaSqlHash |
| - Output Links (1) |
| OkCompleteCalc triggers GenHtmlFromSqlDriver when the job finishes OK |
| - GenHtmlFromSqlDriver (job) |
| - Stage Properties (3) |
| Property | Value |
| Job Name | GenHtmlFromSqlDriver |
| Short Description | Last Changed: 02-02-2005 |
| Full Description | Job: GenHtmlFromSqlDriver
------------------------------------------------------------------------------------- Non-technical description: Generate Sql from a SQL statement. Stores results in Sql2Html/FileName.html ------------------------------------------------------------------------------------- Business rules: tbd ------------------------------------------------------------------------------------- Rules for restarting this job: Just rerun. ------------------------------------------------------------------------------------- Parameters: 1. FilePath 2. LogoPath 3. SqlScriptsId 4. SqlDsn 5. SqlUser 6. SqlPwd 7. DebugSw 8. EmailFlag 9. EmailTo 10. MsgJobName 11. Replacements 12. RepSeparator 13. FileName ------------------------------------------------------------------------------------- Sources: tbd ------------------------------------------------------------------------------------- Targets: tbd ------------------------------------------------------------------------------------- Modification History: ------------------------------------------------------------------------------------- UserId Date Version Modification Description ------------------------------------------------------------------------------------- kduke 02-02-2005 1 Created job. ------------------------------------------------------------------------------------- |
| - Parameters (13) |
| Parameter Name | Value |
| FilePath | "./" |
| LogoPath | "OurLogo.jpg" |
| SqlScriptsId | "EtlResultCompleteness.sql" |
| SqlDsn | TargetDSN |
| SqlUser | TargetUser |
| SqlPwd | TargetPwd |
| DebugSw | "0" |
| EmailFlag | "1" |
| EmailTo | "All" |
| MsgJobName | "SeqQaCompleteness" |
| Replacements | "na" |
| RepSeparator | "~" |
| FileName | "EtlCompletenessRpt" |
| - Input Links (1) |
| OkCompleteCalc triggered by GetEtlQaSqlStatDriver |
| - Output Links (1) |
| OkCompRpt triggers WaitAll when the job finishes OK |
| - WaitAll (sequencer) |
| - Stage Properties (1) |
| Property | Value |
| Wait for | All |
| - Input Links (1) |
| OkCompRpt triggered by GenHtmlFromSqlDriver |
| - Output Links (1) |
| OkAll triggers DSJobReportDbDriver unconditionally |
| - FailureNotification (notification) |
| - Stage Properties (4) |
| Property | Value |
| Server | localhost |
| To | kim_duke-cw@discovery.com |
| From | kim_duke-cw@discovery.com |
| Subject | SeqQaCompleteness Sequence failed |
| - Input Links (1) |
| ToFailureNotification triggered by SeqExceptionHandler |
| - Output Links (1) |
| ToSeqAborted triggers SeqAbortedtoLog unconditionally |
| - DSJobReportDbDriver (job) |
| - Stage Properties (3) |
| Property | Value |
| Job Name | DSJobReportDbDriver |
| Short Description | kduke 2004-06-03 created |
| Full Description | Job: DSJobReportDbDriver
================================================================= Description: This job will get row counts for all jobs in a sequence. ================================================================= Parameters: 1. TargetDSN 2. TargetPwd 3. TargetUser 4. SeqName - Job sequence 5. EmailFlag 6. CheckParentFlag 7. EmailTo 8. DebugSw ================================================================= Sources: none ================================================================= Targets: none ================================================================= To use in next job: DSJobReportDbDriver ================================================================= Modification History ================================================================= Developer Date Modification description ======== ========= ============================================== kduke 2004-06-03 created ======== ========= ============================================== |
| - Parameters (10) |
| Parameter Name | Value |
| TargetDSN | TargetDSN |
| TargetUser | TargetUser |
| TargetPwd | TargetPwd |
| SeqName | "SeqQaCompleteness" |
| EmailFlag | "1" |
| CheckParentFlag | "0" |
| EmailTo | "Kim" |
| DebugSw | "0" |
| FilePath | "./" |
| LogoPath | "OurLogo.jpg" |
| - Input Links (1) |
| OkAll triggered by WaitAll |
| - Output Links (1) |
| Ok3 triggers Done unconditionally |
| - Target Stages (2) |
| - Done (sequencer) |
| - Stage Properties (1) |
| Property | Value |
| Wait for | All |
| - Input Links (1) |
| Ok3 triggered by DSJobReportDbDriver |
| - SeqAbortedtoLog (routine) |
| - Stage Properties (3) |
| Property | Value |
| Routine Name | UtilityAbortToLog |
| Short Description | Abort the job with a user-supplied log message |
| Full Description | This routine takes a user defined message and displays it in the log as a fatal error message.
The routine should not be used in production. It should be used as a means to stop processing in job development, based on error conditions such as a threshold violation. The return value of this function is always -1. Note that DSGetJobInfo, DSGetLinkInfo and DSGetStageInfo are called as macros (defined in Jobcontrol.h) to get the names of the job, name and link calling this function. This is used to further quallify the message string in the log. |
| - Parameters (1) |
| Parameter Name | Value |
| Arg1 | "SeqQaCompleteness Aborted." |
| - Input Links (1) |
| ToSeqAborted triggered by FailureNotification |
