MTest Assessment Catalog: MTest Demo EV3Control_ec Batch Project

MTest Project: MTest Demo EV3Control_ec Batch Project
MTest User: MTest Demo User
Generated at: 2019-10-29 09:48

Contents   [Requirement Catalog]   [Test Sequence Catalog]   [Signal Comparison Catalog]   [Assessment Catalog]   [Assessment Result Matrices]


  1. Test Model: EV3Control_demo_ec
    1. Test Object: EV3Control
      1.  Passed  mars_REQ_EV3CTRL_011
       
      2.  Passed  mars_REQ_EV3CTRL_012
       
      3.  Passed  mars_REQ_EV3CTRL_021
         
      4.  Passed  mars_REQ_EV3CTRL_022
         
      5.  Passed  mars_REQ_EV3CTRL_031
         
      6.  Passed  mars_REQ_EV3CTRL_032
         
      7.  Passed  mars_REQ_EV3CTRL_041
       
      8.  Passed  mars_REQ_EV3CTRL_042
       
      9.  Passed  mars_REQ_EV3CTRL_05
       
  2. Test Model: GlobalPosition_demo_ec
    1. Test Object: GlobalPosition
      1.  Passed  mars_REQ_GLB_POS_011
       
      2.  Passed  mars_REQ_GLB_POS_012
       
      3.  Passed  mars_REQ_GLB_POS_021
       
      4.  Passed  mars_REQ_GLB_POS_022
       
      5.  Passed  mars_REQ_GLB_POS_03
       
  3. Test Model: ManageVehicleStates_demo_ec
    1. Test Object: ManageVehicleStates
      1.  Passed  mars_REQ_MVS_01
         
      2.  Passed  mars_REQ_MVS_02
         
      3.  Passed  mars_REQ_MVS_031
         
      4.  Passed  mars_REQ_MVS_032
         
      5.  Passed  mars_REQ_MVS_04
         
      6.  Passed  mars_REQ_MVS_051
         
      7.  Passed  mars_REQ_MVS_052
         
      8.  Passed  mars_REQ_MVS_06
         
      9.  Passed  mars_REQ_MVS_07
         
      10.  Passed  mars_REQ_MVS_08
       
  4. Test Model: ObstacleDetection_demo_ec
    1. Test Object: ObstacleDetection
      1.  Passed  mars_REQ_OBST_DET_01
       
      2.  Passed  mars_REQ_OBST_DET_02
       
      3.  Passed  mars_REQ_OBST_DET_03
         

Assessment Evaluation of Entire Project    [Contents]

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 36.7%
100% 27 - -
Reviewed Assessments 29.6%
100% 27 8 19
Assessments Compliance 100.0%
100% 27 27 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
Test Project
 
27000

1. Test Model: EV3Control_demo_ec    [Contents]

Validation Mode: Embedded Coder

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 10.0%
100% 9 - -
Reviewed Assessments 0.0%
100% 9 0 9
Assessments Compliance 100.0%
100% 9 9 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
EV3Control_demo_ec
 
9000

1.1 Test Object: EV3Control    [Contents]

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 10.0%
100% 9 - -
Reviewed Assessments 0.0%
100% 9 0 9
Assessments Compliance 100.0%
100% 9 9 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
EV3Control
 
9000

AssessmentLinked ItemsAssessment Description Test Sequence Results
mars_REQ_EV3CTRL_011 :    Passed 
(EV3Control)


 

Passed:  6  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_01

Test Sequences
1: TS_EV3Control_001
Systemstart 1
WHILE from when the system starts
until signal sensorRaw_RemoteControl becomes equal to parameter REMOTE_START
THE signal driveMotor
SHALL be 0
Test Sequences:  Passed 

mars_REQ_EV3CTRL_012 :    Passed 
(EV3Control)


 

Passed:  6  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_01

Test Sequences
1: TS_EV3Control_001
Systemstart 2
WHILE from when the system starts
until signal sensorRaw_RemoteControl becomes equal to parameter REMOTE_START
THE signal steeringMotor
SHALL be 0
Test Sequences:  Passed 

mars_REQ_EV3CTRL_021 :    Passed 
(EV3Control)


   

Passed:  2  NotTriggered:  4  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_02

Test Sequences
2: TS_EV3Control_002
3: TS_EV3Control_003
Emergeny stop - stop or rev
WHILE signal sensorRaw_UltrasoundFront <= parameter DIST_OBSTACLE_STOP
THE signal driveMotor
SHALL be less than or equal to 0 within 0.1 s
Test Sequences:  Passed 

Integration test - EV3Control (Test001) 
   2: TS_EV3Control_002 - Emergency stop:  OK.
   3: TS_EV3Control_003 - No Emergency stop - drive rev:  OK.

mars_REQ_EV3CTRL_022 :    Passed 
(EV3Control)


   

Passed:  1  NotTriggered:  5  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_02

Test Sequences
2: TS_EV3Control_002
3: TS_EV3Control_003
Emergeny stop - no steering
WHILE signal sensorRaw_UltrasoundFront <= parameter DIST_OBSTACLE_STOP
and signal driveMotor < 0
THE signal steeringMotor
SHALL be equal to 0 within 0.1 s
Test Sequences:  Passed 

Integration test - EV3Control (Test001) 
   3: TS_EV3Control_003 - No Emergency stop - drive rev:  OK.

mars_REQ_EV3CTRL_031 :    Passed 
(EV3Control)


   

Passed:  3  NotTriggered:  3  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_03

Test Sequences
4: TS_EV3Control_004
Stop vehicle
WHEN signal sensorRaw_RemoteControl becomes equal to parameter REMOTE_STOP
THE signal driveMotor
SHALL be equal to 0
Test Sequences:  Passed 

mars_REQ_EV3CTRL_032 :    Passed 
(EV3Control)


   

Passed:  3  NotTriggered:  3  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_03

Test Sequences
4: TS_EV3Control_004
Stop vehicle
WHEN signal sensorRaw_RemoteControl becomes equal to parameter REMOTE_STOP
THE signal steeringMotor
SHALL be equal to 0
Test Sequences:  Passed 

mars_REQ_EV3CTRL_041 :    Passed 
(EV3Control)


 

Passed:  6  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_04

Test Sequences
5: TS_EV3Control_005
x-Position no driving
WHILE signal sensorRaw_DriveMotor == 0
THE signal posGlobal_1
SHALL be constant
Test Sequences:  Passed 

mars_REQ_EV3CTRL_042 :    Passed 
(EV3Control)


 

Passed:  6  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_04

Test Sequences
5: TS_EV3Control_005
y-Position no driving
WHILE signal sensorRaw_DriveMotor == 0
THE signal posGlobal_2
SHALL be constant
Test Sequences:  Passed 

mars_REQ_EV3CTRL_05 :    Passed 
(EV3Control)


 

Passed:  6  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_EV3CTRL_05

Test Sequences
6: TS_EV3Control_006
y-Position no driving
WHILE signal sensorRaw_Gyro == 0
THE signal posGlobal_2
SHALL be constant
Test Sequences:  Passed 

 

2. Test Model: GlobalPosition_demo_ec    [Contents]

Validation Mode: Embedded Coder

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 100.0%
100% 5 - -
Reviewed Assessments 100.0%
100% 5 5 0
Assessments Compliance 100.0%
100% 5 5 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
GlobalPosition_demo_ec
 
5000

2.1 Test Object: GlobalPosition    [Contents]

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 100.0%
100% 5 - -
Reviewed Assessments 100.0%
100% 5 5 0
Assessments Compliance 100.0%
100% 5 5 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
GlobalPosition
 
5000

AssessmentLinked ItemsAssessment Description Test Sequence Results
mars_REQ_GLB_POS_011 :    Passed 
(GlobalPosition)


 

Passed:  3  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_GLB_POS_01

Test Sequences
1: TS_GLB_POS_001
2: TS_GLB_POS_002
3: TS_GLB_POS_003
position calculation - 4
THE signal posGlobal_1
SHALL always be equal to signal prevXPosGlobal + signal x_k
Test Sequences:  Passed 

Testing calculation of global position using MTCD (Test001) 
   1: TS_GLB_POS_001 - straight fwd and rev:  OK.
   2: TS_GLB_POS_002 - curved fwd :  OK.
   3: TS_GLB_POS_003 - curved rev:  OK.

mars_REQ_GLB_POS_012 :    Passed 
(GlobalPosition)


 

Passed:  3  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_GLB_POS_01

Test Sequences
1: TS_GLB_POS_001
2: TS_GLB_POS_002
3: TS_GLB_POS_003
position calculation - 3
THE signal x_k
SHALL always be equal to signal s_k * cos (signal gyroAngleRad)
Test Sequences:  Passed 

Testing calculation of global position using MTCD (Test001) 
   1: TS_GLB_POS_001 - straight fwd and rev:  OK.
   2: TS_GLB_POS_002 - curved fwd :  OK.
   3: TS_GLB_POS_003 - curved rev:  OK.

mars_REQ_GLB_POS_021 :    Passed 
(GlobalPosition)


 

Passed:  3  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_GLB_POS_02

Test Sequences
1: TS_GLB_POS_001
2: TS_GLB_POS_002
3: TS_GLB_POS_003
position calculation - 1
THE signal posGlobal_2
SHALL always be equal to signal prevYPosGlobal + signal y_k
Test Sequences:  Passed 

Testing calculation of global position using MTCD (Test001) 
   1: TS_GLB_POS_001 - straight fwd and rev:  OK.
   2: TS_GLB_POS_002 - curved fwd :  OK.
   3: TS_GLB_POS_003 - curved rev:  OK.

mars_REQ_GLB_POS_022 :    Passed 
(GlobalPosition)


 

Passed:  3  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_GLB_POS_02

Test Sequences
1: TS_GLB_POS_001
2: TS_GLB_POS_002
3: TS_GLB_POS_003
position calculation - 2
THE signal y_k
SHALL always be equal to signal s_k * sin (signal gyroAngleRad)
Test Sequences:  Passed 

Testing calculation of global position using MTCD (Test001) 
   1: TS_GLB_POS_001 - straight fwd and rev:  OK.
   2: TS_GLB_POS_002 - curved fwd :  OK.
   3: TS_GLB_POS_003 - curved rev:  OK.

mars_REQ_GLB_POS_03 :    Passed 
(GlobalPosition)


 

Passed:  3  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_GLB_POS_03

Test Sequences
1: TS_GLB_POS_001
2: TS_GLB_POS_002
3: TS_GLB_POS_003
position calculation - 5
THE signal s_k
SHALL always be equal to signal driveEncoder * parameter WHEEL_SIZE_DEG * parameter MOTOR_DRIVE_TRANSMISSION_RATIO
Test Sequences:  Passed 

Testing calculation of global position using MTCD (Test001) 
   1: TS_GLB_POS_001 - straight fwd and rev:  OK.
   2: TS_GLB_POS_002 - curved fwd :  OK.
   3: TS_GLB_POS_003 - curved rev:  OK.

 

3. Test Model: ManageVehicleStates_demo_ec    [Contents]

Validation Mode: Embedded Coder

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 10.0%
100% 10 - -
Reviewed Assessments 0.0%
100% 10 0 10
Assessments Compliance 100.0%
100% 10 10 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
ManageVehicleStates_demo_ec
 
10000

3.1 Test Object: ManageVehicleStates    [Contents]

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 10.0%
100% 10 - -
Reviewed Assessments 0.0%
100% 10 0 10
Assessments Compliance 100.0%
100% 10 10 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
ManageVehicleStates
 
10000

AssessmentLinked ItemsAssessment Description Test Sequence Results
mars_REQ_MVS_01 :    Passed 
(ManageVehicleStates)


   

Passed:  2  NotTriggered:  5  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_01

Test Sequences
1: TS_MVS_001
2: TS_MVS_002
7: TS_MVS_007
Active state - VehicleControlOn
WHILE signal gyroReady == true and delay((signal VehicleControlOff == 1 or signal VehicleIdle == 1),1)
WHEN signal remoteCtrlCmd == parameter REMOTE_START becomes true
THE signal VehicleControlOn
SHALL change to true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   1: TS_MVS_001 - Enter VehicleControlOn from VehicleControlOff:  OK.
   7: TS_MVS_007 - Enter VehicleOff from manual steering:  OK.

mars_REQ_MVS_02 :    Passed 
(ManageVehicleStates)


   

Passed:  1  NotTriggered:  6  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_02

Test Sequences
3: TS_MVS_003
Active state - VehicleControlOff
WHILE delay(signal VehicleControlOn == true or signal EmergencyStop == true, 1)
WHEN signal remoteCtrlCmd becomes parameter REMOTE_STOP
THE signal VehicleControlOff
SHALL change to true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   3: TS_MVS_003 - Enter VehicleCtrlOff:  OK.

mars_REQ_MVS_031 :    Passed 
(ManageVehicleStates)


   

Passed:  2  NotTriggered:  5  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_03

Test Sequences
2: TS_MVS_002
3: TS_MVS_003
7: TS_MVS_007
Active state - VehicleIdle
WHILE delay(signal gyroReady is equal to false and signal remoteCtrlCmd == parameter REMOTE_STOP, 1)
THE signal VehicleControlOff
SHALL always be true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   1: TS_MVS_001 - Enter VehicleControlOn from VehicleControlOff:  OK.
   6: TS_MVS_006 - gear zero:  OK.

mars_REQ_MVS_032 :    Passed 
(ManageVehicleStates)


   

Passed:  3  NotTriggered:  4  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_03

Test Sequences
2: TS_MVS_002
3: TS_MVS_003
7: TS_MVS_007
Active state - VehicleIdle
WHILE delay(signal remoteCtrlCmd ~= parameter REMOTE_STOP and signal remoteCtrlCmd ~= parameter REMOTE_START, 1)
WHEN (signal gyroReady is equal to true) becomes true
THE signal VehicleIdle
SHALL change to true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   2: TS_MVS_002 - Enter VehicleControlOn from VehicleIdle:  OK.
   6: TS_MVS_006 - gear zero:  OK.
   7: TS_MVS_007 - Enter VehicleOff from manual steering:  OK.

mars_REQ_MVS_04 :    Passed 
(ManageVehicleStates)


   

Passed:  2  NotTriggered:  5  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_04

Test Sequences
4: TS_MVS_004
Active state - EmergencyStop
WHILE signal remoteCtrlCmd ~= parameter REMOTE_DRIVE_REV and delay(signal VehicleControlOn == true, 1)
WHEN signal emergencyStopObstacle becomes true
THE signal EmergencyStop
SHALL change to true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   4: TS_MVS_004 - Enter EmergencyStop:  OK.
   7: TS_MVS_007 - Enter VehicleOff from manual steering:  OK.

mars_REQ_MVS_051 :    Passed 
(ManageVehicleStates)


   

Passed:  1  NotTriggered:  6  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_05

Test Sequences
5: TS_MVS_005
Autopilot activation/deactivation
WHILE delay(signal VehicleControlOn is equal to true, 1)
WHEN signal remoteCtrlCmd == parameter REMOTE_DRIVE_AUTO_ON becomes true
THE signal autopilot
SHALL be true
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   5: TS_MVS_005 - Enter ControlledDrive:  OK.

mars_REQ_MVS_052 :    Passed 
(ManageVehicleStates)


   

Passed:  1  NotTriggered:  6  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_05

Test Sequences
5: TS_MVS_005
Autopilot activation/deactivation
WHILE delay(signal VehicleControlOn is equal to true, 1)
WHEN signal remoteCtrlCmd == parameter REMOTE_DRIVE_AUTO_OFF becomes true
THE signal autopilot
SHALL be false
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   5: TS_MVS_005 - Enter ControlledDrive:  OK.

mars_REQ_MVS_06 :    Passed 
(ManageVehicleStates)


   

Passed:  1  NotTriggered:  6  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_06

Test Sequences
3: TS_MVS_003
4: TS_MVS_004
5: TS_MVS_005
Forward movement
WHILE delay(signal VehicleControlOn and signal autopilot == false, 1)
WHEN signal remoteCtrlCmd == parameter REMOTE_DRIVE_REV becomes true
THE signal gear
SHALL change to -1
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   3: TS_MVS_003 - Enter VehicleCtrlOff:  OK.

mars_REQ_MVS_07 :    Passed 
(ManageVehicleStates)


   

Passed:  1  NotTriggered:  6  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_07

Test Sequences
3: TS_MVS_003
4: TS_MVS_004
Reverse movement
WHILE delay(signal VehicleControlOn, 1) and signal autopilot == false
WHEN signal remoteCtrlCmd == parameter REMOTE_DRIVE_FWD or signal remoteCtrlCmd == parameter REMOTE_DRIVE_AUTO_ON becomes true
THE signal gear
SHALL be 1
Test Sequences:  Passed 

Vehicle manager functionality testing using MTCD (Test001) 
   4: TS_MVS_004 - Enter EmergencyStop:  OK.

mars_REQ_MVS_08 :    Passed 
(ManageVehicleStates)


 

Passed:  7  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  created
 
Requirements
REQ_MVS_08

Test Sequences
6: TS_MVS_006
No movement
WHILE signal VehicleControlOff or signal EmergencyStop or signal VehicleIdle is equal to true
THE signal gear
SHALL always be equal to 0
Test Sequences:  Passed 

 

4. Test Model: ObstacleDetection_demo_ec    [Contents]

Validation Mode: Embedded Coder

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 100.0%
100% 3 - -
Reviewed Assessments 100.0%
100% 3 3 0
Assessments Compliance 100.0%
100% 3 3 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
ObstacleDetection_demo_ec
 
3000

4.1 Test Object: ObstacleDetection    [Contents]

Assessment State
MetricPercentageTargetTotalReachedUnreached
Assessment Work Progress 100.0%
100% 3 - -
Reviewed Assessments 100.0%
100% 3 3 0
Assessments Compliance 100.0%
100% 3 3 0
Result Distribution
Assessment Result DistributionPercentagePassedNotTriggeredFailedError
ObstacleDetection
 
3000

AssessmentLinked ItemsAssessment Description Test Sequence Results
mars_REQ_OBST_DET_01 :    Passed 
(ObstacleDetection)


 

Passed:  2  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_OBST_DET_01

Test Sequences
1: TS_OBST_DET_001
Obstacle detection
WHILE signal usSensorFront <= parameter DIST_OBSTACLE_EVADE
THE signal obstacleDetection
SHALL be true
Test Sequences:  Passed 

mars_REQ_OBST_DET_02 :    Passed 
(ObstacleDetection)


 

Passed:  2  NotTriggered:  0  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_OBST_DET_02

Test Sequences
1: TS_OBST_DET_001
Emergency stop
WHILE signal usSensorFront <= parameter DIST_OBSTACLE_STOP
and signal remoteCtrlCmd ~= parameter REMOTE_DRIVE_REV
THE signal emergencyStopObstacle
SHALL be true
Test Sequences:  Passed 

mars_REQ_OBST_DET_03 :    Passed 
(ObstacleDetection)


   

Passed:  1  NotTriggered:  1  Failed:  0  Error:  0 


Scope: global

Work Status:  reviewed
 
Requirements
REQ_OBST_DET_03

Test Sequences
2: TS_OBST_DET_002
emergency stop - drive rev
WHILE from signal usSensorFront <= parameter DIST_OBSTACLE_STOP becomes true
until signal usSensorFront > parameter DIST_OBSTACLE_STOP becomes true
WHEN signal remoteCtrlCmd becomes equal to parameter REMOTE_DRIVE_REV
THE signal emergencyStopObstacle
SHALL change to false
Test Sequences:  Passed 

Testing obstacle detection using MTCD (Test001) 
   2: TS_OBST_DET_002 - Down-ramp of front ultrasound sensor signal with reverse drive command:  OK.