View Test Case Results (ATV)


From this screen you can view your test case results, view a history for this test case, see expanded information about the last test case run, assign a status, see a reason for test case failure, and designate a specific test case as a baseline against which you will compare other test case results.

  1. On the Test Case screen, type RES (Results) on the Command line and press Enter. The Test Case Run Results screen is displayed in the following figure.
    Test Case Run Results screen

      ---------------------------- Test Case Run Results ---------------- Row 1 of 7
      Command ===>                                                  Scroll ===> CSR

      Primary commands: Assign status, History, Run details

      Line commands:. . (V)iew, (P)romote to Baseline

      Test Case BATREPL  Test Case Status Incomplete
      Last Run Date  02/03/23  Time 10:19:40  Result PASS
      Failure Reason

      S Data Type     Dataset name
      - ------------  --------------------------------------------
        Result        VP.ATV.ATVMDOC1.BATREPL.ASTOUT
        Result        VP.ATV.ATVMDOC1.BATREPL.DUBLIB
        Result        VP.ATV.ATVMDOC1.BATREPL.JCL
        Result        VP.ATV.ATVMDOC1.BATREPL.MISMATCH
        Result        VP.ATV.ATVMDOC1.BATREPL.OUTPUT
        Result        VP.ATV.ATVMDOC1.BATREPL.SYSPRINT
        Asset-Work    VP.ATV.ATVMDOC1.GLGLRCRD.ATV.MASTER.INDEX
      ******************************* Bottom of data ********************************


    Important

    The result datasets you see on your screen will differ depending on the type of vehicle you ran — regression or performance. Also, individual test case run requests will run the test case regardless of its current status.

  2. Select what you want to do:
    • Type A (assign status) on the Command line and press Enter. The Assign Status screen is displayed in the following figure.

Assign Status screen

 ---------------------------- Test Case Run Results ---------------- Row 1 of 7
  C +---------------------------------------------------------------------+ CSR
    | -------------------------- Assign Status -------------------------- |
  P |                                                                     |
    |  Select appropriate status:                                         |
  L |  1 1.Application problem - Bug                                      |
    |    2.Test case error     - Repair                                   |
  T |                                                                     |
  L |                                                                     |
  F |  Press ENTER to set status, use END to cancel.                      |
    |                                                                     |
  S |                                                                     |
  - |                                                                     |
    +---------------------------------------------------------------------+
    Result        VP.ATV.ATVMDOC1.BATREPL.DUBLIB
    Result        VP.ATV.ATVMDOC1.BATREPL.JCL
    Result        VP.ATV.ATVMDOC1.BATREPL.MISMATCH
    Result        VP.ATV.ATVMDOC1.BATREPL.OUTPUT
    Result        VP.ATV.ATVMDOC1.BATREPL.SYSPRINT
    Asset-Work    VP.ATV.ATVMDOC1.GLGLRCRD.ATV.MASTER.INDEX
  ******************************* Bottom of data ********************************

When selecting the appropriate status, there are two options from which to choose: 1. Application problem and 2. Test case error.

If you select 1Bug will appear on the Test Case Status field for those screens that contain this field. If you select 2Repair will appear in this field.


    • Type H (History) on the Command line. The Run History screen is displayed in the following figure.

Run History Screen

  --------------------------------- Run History --------------------- Row 1 of 4
  Command ===>                                                  Scroll ===> CSR

  Line commands:. . (R)un Details

  Test Case BATREPL  Test Case Status Incomplete
  Description . VALIDATE SYSIN CONTROL CARD PROCESSING FOR BATCH REPLAY JOB

  S Date     Time     Req Result Reason
  - -------- -------- --- ------ ---------------------------------------------
    02/03/23 10:19:40  T  Pass
    02/03/23 09:24:45  T  Pass
    02/03/23 09:21:41  T  Fail   rc = 8 on S254228 - FAIL test range is 8 to 9999
    02/03/23 09:19:01  T  Fail   rc = 8 on S254228 - FAIL test range is 8 to 9999
  ******************************* Bottom of data ********************************

This screen displays a list of test run results for the selected test case. The list is limited to approximately the last 180 runs of the test case.

Issue the (R)un details line command to display expanded information about the selected run of this test case.

The Req field shows whether a vehicle (V), test case (T), or playlist (P) was run.


    • Type R (Run details) next to the desired run. The Test Case Run Result Detail screen is displayed in the following figure.

Test Case Run Result Detail Screen

 ------------------------- Test Case Run Result Detail -------------------------
  Command ===>


  Test Case Name . BATREPL
  Test Case Status Incomplete

  Run Details:
   Run Requested. TEST CASE
   Run Requestor. VPTST13
   Function . . . BATCHRPL
   Start Date . . 02/03/23  Start Time 09:21:41
   End Date . . . 02/03/23  End   Time 09:22:03
   Prior status . INCOMPLETE
   Result . . . . FAIL
   Failure Reason:
    RC = 8 ON S254228 - FAIL TEST RANGE IS 8 TO 9999

  Enter END command to return to the previous panel.

The Test Case Run Result Detail screen  shows all of the details of this test case run: The name, status, what was run, user who requested the run, the function, start and end dates and times, prior status, result, and—if it failed—the reason for failure.


    • Type V (view) next to the results you want to view. Following figure is an example of one type of results screen.

View Screen

    File  Edit  Edit_Settings  Menu  Utilities  Compilers  Test  Help
  -------------------------------------------------------------------------------
  VIEW       VP.ATV.ATVMDOC1.BATREPL.JCL                     Columns 00001 00072
  Command ===>                                                  Scroll ===> CSR
  ****** ***************************** Top of Data ******************************
  ==MSG> -Warning- The UNDO command is not available until you change
  ==MSG>           your edit profile using the command RECOVERY ON.
  000001 //HSATV175 JOB ('OVPBAS7.7.0DEV',5M-2123),'DEMO VEHICLE',
  000002 //         CLASS=L,MSGCLASS=R,TIME=1440
  000004 /*JOBPARM  LINES=999,TIME=550
  000005 //*
  000006 /*JOBPARM S=CW13
  000007 //*
  000008 //*  HIPERSTATION ATV REPLAY EXECUTION
  000009 //*
  000010 //*  INITIATED TEST EXECUTION
  000011 //REPLAY1  EXEC PGM=EHSBATCH,REGION=0M
  000012 //SYSUDUMP DD SYSOUT=*
  000013 //PMQF00   DD DUMMY
  000014 //STEPLIB  DD DISP=SHR,DSN=VP.DPLY.R170000.REGR.LOAD
  000015 //SYSLIB   DD DISP=SHR,DSN=VP.ATV.ATVMDOC1.SCRIPTS
  000016 //         DD DISP=SHR,DSN=VP.DPLY.R170000.REGR.SCRP
  000017 //         DD DISP=SHR,DSN=VP.ATV.ATVMDOC1.EXEC

After reviewing your results, use END to return to the Test Case Run Results screen.


    • Type P (Promote to Baseline) to designate that individual test case result datasets will be used for comparison by other test case datasets, if desired. For example, you might want to set pass/fail conditions for another test case dataset by comparing it against this test case dataset.


 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*