MTest Sequence Catalog: MTest Demo EV3Control_ec Batch Project

MTest Project: MTest Demo EV3Control_ec Batch Project
MTest User: MTest Demo User
Generated at: 2019-10-29 09:48

Contents   [Requirement Catalog]   [Test Sequence Catalog]   [Signal Comparison Catalog]   [Assessment Catalog]   [Assessment Result Matrices]


  1. Test Model: EV3Control_demo_ec
    1. Test Object: EV3Control
      1. Test Group: Test001 - Integration test - EV3Control
  2. Test Model: GlobalPosition_demo_ec
    1. Test Object: GlobalPosition
      1. Test Group: Test001 - Testing calculation of global position using MTCD
  3. Test Model: ManageVehicleStates_demo_ec
    1. Test Object: ManageVehicleStates
      1. Test Group: Test001 - Vehicle manager functionality testing using MTCD
  4. Test Model: ObstacleDetection_demo_ec
    1. Test Object: ObstacleDetection
      1. Test Group: Test001 - Testing obstacle detection using MTCD

Sequence Evaluation of Entire Project    [Contents]

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 18 - -
Reviewed Test Sequences 100.0%
100% 18 18 0
Test Sequences Compliance 100.0%
100% 18 18 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
Test Project
 
18000000
Structural Coverage
Test Model Test Object Model Coverage  Achieved
per Test
Object
Condition (Target: 80%)Decision (Target: 80%)Lookup (Target: 100%)
EV3Control_demo_ec EV3Control
91.1%
78.7%
20.0% 1/3
GlobalPosition_demo_ec GlobalPosition not measured not measured not measured 0/0
ManageVehicleStates_demo_ec ManageVehicleStates
100.0%
94.4% not measured 2/2
ObstacleDetection_demo_ec ObstacleDetection
100.0%
75.0% not measured 1/2
Achieved Target Coverages (Test Objects: 4) 3/3 1/3 0/1 4/7

1. Test Model: EV3Control_demo_ec    [Contents]

Validation Mode: Embedded Coder

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 6 - -
Reviewed Test Sequences 100.0%
100% 6 6 0
Test Sequences Compliance 100.0%
100% 6 6 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
EV3Control_demo_ec
 
6000000

1.1 Test Object: EV3Control    [Contents]

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 6 - -
Reviewed Test Sequences 100.0%
100% 6 6 0
Test Sequences Compliance 100.0%
100% 6 6 0
Structural Coverage
ToolMetricPercentageTargetTotalReachedUnreached
Model Coverage Condition 91.1%
80% 56 51 5
Decision 78.7%
80% 108 85 23
Lookup 20.0%
100% 5 1 4
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
EV3Control
 
6000000

1.1.1 Test Group: Test001 - Integration test - EV3Control    [Contents]

Description Test of the whole integratet model Ev3Control
Author MTest Demo User

Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
Test001 - Integration test - EV3Control
 
6000000

Test SequenceLinked ItemsTest Sequence DescriptionEvaluation Results
1: TS_EV3Control_001 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_01

Assessments
mars_REQ_EV3CTRL_011
mars_REQ_EV3CTRL_012

 start Vehicle control
Motivation
Test if the drive motor starts when the user starts the vehicle via remote control

Test description
Try to start while gyro is not initialized. Set gyro to ready. Set remote to start.

Expected Result
The drive motor shall be 0 until the remote control is set to start the second time and then change to 1.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:15)
2: TS_EV3Control_002 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_02

Assessments
mars_REQ_EV3CTRL_021
mars_REQ_EV3CTRL_022

 Emergency stop
Motivation
Test if the drive motor stops when the vehicle drives fwd and the us sensor detects an obstacle that is too close

Test description
Set gyro to ready and remote to start. Then ramp us sensor down.

Expected Result
The drive motor shall stop when the distance to the obstacle is smaller then DIST_OBSTACLE_STOP
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:19)
3: TS_EV3Control_003 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_02

Assessments
mars_REQ_EV3CTRL_021
mars_REQ_EV3CTRL_022

 No Emergency stop - drive rev
Motivation
Test if the drive motor does not stop when the vehicle drives rev and the us sensor detects an obstacle that is too close

Test description
Set gyro to ready and remote to start.
Set remote to drive rev.
Set us sensor to detect close obstacle. ramp us sensor up again

Expected Result
The drive motor shall not stop when the distance to the obstacle is smaller then DIST_OBSTACLE_STOP
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:23)
4: TS_EV3Control_004 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_03

Assessments
mars_REQ_EV3CTRL_031
mars_REQ_EV3CTRL_032

 Stop vehicle
Motivation
Test if the vehicle stops when th user wants to stop it via remote control

Test description
Set gyro to ready and remote to start.
Set remote to drive rev.
Set remote to autopilot
Set remote to stop

Expected Result
When remote is set to stop oth motors shall stop
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:26)
5: TS_EV3Control_005 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_04

Assessments
mars_REQ_EV3CTRL_041
mars_REQ_EV3CTRL_042

Position calculation
Motivation
Test if the position changes only with nonzero input from drive motor

Test description
Set gyro to ready and remote to start.
Set drive motor encoder to positiv and negative values.

Expected Result
While the encoder is zero the positions shall not change
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:30)
6: TS_EV3Control_006 Passed 
EV3Control_demo_ec /
EV3Control /
Test001


Work Status:  reviewed
Requirements
REQ_EV3CTRL_05

Assessments
mars_REQ_EV3CTRL_05

Position calculation - drive curved
Motivation
Test if the y position changes only with nonzero input from drive motor and gyro sensor

Test description
Set gyro to ready and remote to start.
Set drive motor encoder to positiv and negative values. Ramp values for gyro sensor

Expected Result
While the encoder and gyro sensoris zero the ypositions shall not change
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:45:33)

 

2. Test Model: GlobalPosition_demo_ec    [Contents]

Validation Mode: Embedded Coder

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 3 - -
Reviewed Test Sequences 100.0%
100% 3 3 0
Test Sequences Compliance 100.0%
100% 3 3 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
GlobalPosition_demo_ec
 
3000000

2.1 Test Object: GlobalPosition    [Contents]

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 3 - -
Reviewed Test Sequences 100.0%
100% 3 3 0
Test Sequences Compliance 100.0%
100% 3 3 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
GlobalPosition
 
3000000

2.1.1 Test Group: Test001 - Testing calculation of global position using MTCD    [Contents]

Description Test of the subsystem that calculates the global position of the vehicle
Author MTest Demo User

Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
Test001 - Testing calculation of global position using MTCD
 
3000000

Test SequenceLinked ItemsTest Sequence DescriptionEvaluation Results
1: TS_GLB_POS_001 Passed 
GlobalPosition_demo_ec /
GlobalPosition /
Test001


Work Status:  reviewed
Requirements
REQ_GLB_POS_01
REQ_GLB_POS_02
REQ_GLB_POS_03

Assessments
mars_REQ_GLB_POS_011
mars_REQ_GLB_POS_012
mars_REQ_GLB_POS_021
mars_REQ_GLB_POS_022
mars_REQ_GLB_POS_03

straight fwd and rev
Motivation
Test the claculation for driving straight (gyroAngleRad = 0).

Test description
For constant velocity the encoder value is set to a positive constant, then wait a short time. To change direction it is set to a negative constant.

Expected Result
The global X position should ramp up and down. The y position shall stay 0.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:41:44)
2: TS_GLB_POS_002 Passed 
GlobalPosition_demo_ec /
GlobalPosition /
Test001


Work Status:  reviewed
Requirements
REQ_GLB_POS_01
REQ_GLB_POS_02
REQ_GLB_POS_03

Assessments
mars_REQ_GLB_POS_011
mars_REQ_GLB_POS_012
mars_REQ_GLB_POS_021
mars_REQ_GLB_POS_022
mars_REQ_GLB_POS_03

curved fwd
Motivation
Test the claculation for driving a curvy way fwd (gyroAngleRad ~= 0).

Test description
For constant velocity the encoder value is set to a positive constant, then wait a short time. Addidtionly the gyro input is ramped up and down.

Expected Result
The global x position should ramp up and down. The y position shall change now too.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:41:45)
3: TS_GLB_POS_003 Passed 
GlobalPosition_demo_ec /
GlobalPosition /
Test001


Work Status:  reviewed
Requirements
REQ_GLB_POS_01
REQ_GLB_POS_02
REQ_GLB_POS_03

Assessments
mars_REQ_GLB_POS_011
mars_REQ_GLB_POS_012
mars_REQ_GLB_POS_021
mars_REQ_GLB_POS_022
mars_REQ_GLB_POS_03

curved rev
Motivation
Test the claculation for driving a curvy way rev (gyroAngleRad ~= 0).

Test description
For constant velocity the encoder value is set to a negative constant, then wait a short time. Addidtionly the gyro input is ramped up and down.

Expected Result
The global x position should ramp down. The y position shall change now too.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:41:47)

 

3. Test Model: ManageVehicleStates_demo_ec    [Contents]

Validation Mode: Embedded Coder

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 7 - -
Reviewed Test Sequences 100.0%
100% 7 7 0
Test Sequences Compliance 100.0%
100% 7 7 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
ManageVehicleStates_demo_ec
 
7000000

3.1 Test Object: ManageVehicleStates    [Contents]

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 7 - -
Reviewed Test Sequences 100.0%
100% 7 7 0
Test Sequences Compliance 100.0%
100% 7 7 0
Structural Coverage
ToolMetricPercentageTargetTotalReachedUnreached
Model Coverage Condition 100.0%
80% 8 8 0
Decision 94.4%
80% 36 34 2
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
ManageVehicleStates
 
7000000

3.1.1 Test Group: Test001 - Vehicle manager functionality testing using MTCD    [Contents]

Description Test of the Stateflow chart that manages vehicle states
Author MTest Demo User

Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
Test001 - Vehicle manager functionality testing using MTCD
 
7000000

Test SequenceLinked ItemsTest Sequence DescriptionEvaluation Results
1: TS_MVS_001 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_01

Assessments
mars_REQ_MVS_01

Enter VehicleControlOn from VehicleControlOff
Motivation
Test, if state VehicleControlOn is reached from state VehicleControlOff

Test description
Set gyroReady to true. And remoteCtrlCmd to REMOTE_STOP. Then set remoteCtrlCmd to REMOTE_START

Expected Result
State VehicleControlOn shall be entered directly from state VehiclecontrolOff.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:13)
2: TS_MVS_002 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_01
REQ_MVS_03

Assessments
mars_REQ_MVS_01
mars_REQ_MVS_031
mars_REQ_MVS_032

Enter VehicleControlOn from VehicleIdle
Motivation
Test, if state VehicleControlOn is reached from state VehicleIdle

Test description
Set gyroReady to true.
Set emergencyStop to true. VehicleControlOff shall be entered again.

Expected Result
State VehicleControlIdle shall be entered.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:16)
3: TS_MVS_003 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_02
REQ_MVS_03
REQ_MVS_06
REQ_MVS_07

Assessments
mars_REQ_MVS_02
mars_REQ_MVS_031
mars_REQ_MVS_032
mars_REQ_MVS_06
mars_REQ_MVS_07

Enter VehicleCtrlOff
Motivation
Test, if setting remote to REMOTE_STOP leads to VehicleControlOff from VehicleControlOn or EmergencyStop.

Test description
Intitialize and set remote to REMOTE_START to enter VehicleCtrlOn. Then wait and set remote to REMOTE_STOP. Enter VehicleControlOn again and set emergencyStopObstacle to true. Then set remote to STOP again.

Expected Result
State VehicleControlOff shall be entered from stae VehicleControllOn and then from state EmergencyStop
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:19)
4: TS_MVS_004 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_04
REQ_MVS_06
REQ_MVS_07

Assessments
mars_REQ_MVS_04
mars_REQ_MVS_06
mars_REQ_MVS_07

Enter EmergencyStop
Motivation
Test if EmergencyStop is entered in all cases when emergencyStopObstacle becomes true accept for the moment, when the vehicle is in mode ManualDrive/REV

Test description
Enter VehicleControlOn by initialization.
Then wait and set emergencyStopObstacle to true. Set remote to DRIVE_REV and enter state REV, change to mode FWD and emergencyStopObstacle to true again. Do the same again without leaving mode REV.

Expected Result
EmergencyStop shall be entered 2 times when emergencyStopObstacle becomes true. The third time the state shall stay state manualDrive/REV
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:22)
5: TS_MVS_005 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_05
REQ_MVS_06

Assessments
mars_REQ_MVS_051
mars_REQ_MVS_052
mars_REQ_MVS_06

Enter ControlledDrive
Motivation
Test change between controlled drive in state autopilot and manual drive

Test description
Enter VehiclecontrolOn by initialization.
Set remote to REMOTE_DRIVE_AUTO_ON to enter state ControlledDrive. Wait a little and setremote to REMOTE_DRIVE_AUTO_OFF to enter state manualDrive.

Expected Result
State shall change from manualDrive to controlledDrive and back.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:26)
6: TS_MVS_006 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_08

Assessments
mars_REQ_MVS_08

gear zero
Motivation
Test if gear is always 0 while vehicle is in one of the stop-modes like vehicleControlOff or EmergencyStop

Test description
In init state VehicleControlOff with gyroReady = 0 set remote to some other values than REMOTE_START. Then enter state EmergencyStop and some values for remote other than REMOTE_DRIVE_REV.

Expected Result
In states VehicleControlOff and state EmergencyStop the signal gear shall be 0.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:28)
7: TS_MVS_007 Passed 
ManageVehicleStates_demo_ec /
ManageVehicleStates /
Test001


Work Status:  reviewed
Requirements
REQ_MVS_01
REQ_MVS_03

Assessments
mars_REQ_MVS_01
mars_REQ_MVS_031
mars_REQ_MVS_032

Enter VehicleOff from manual steering
Motivation
Test, if state VehicleControlOn is reached from state VehicleIdle

Test description
Set gyroReady to true.
Set emergencyStop to true. VehicleControlOff shall be entered again.

Expected Result
State VehicleControlIdle shall be entered.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:39:31)

 

4. Test Model: ObstacleDetection_demo_ec    [Contents]

Validation Mode: Embedded Coder

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 2 - -
Reviewed Test Sequences 100.0%
100% 2 2 0
Test Sequences Compliance 100.0%
100% 2 2 0
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
ObstacleDetection_demo_ec
 
2000000

4.1 Test Object: ObstacleDetection    [Contents]

Test Sequence State
MetricPercentageTargetTotalReachedUnreached
Test Sequence Work Progress 100.0%
100% 2 - -
Reviewed Test Sequences 100.0%
100% 2 2 0
Test Sequences Compliance 100.0%
100% 2 2 0
Structural Coverage
ToolMetricPercentageTargetTotalReachedUnreached
Model Coverage Condition 100.0%
80% 18 18 0
Decision 75.0%
80% 8 6 2
Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
ObstacleDetection
 
2000000

4.1.1 Test Group: Test001 - Testing obstacle detection using MTCD    [Contents]

Description Test the subsystem that shall detect obstacles
Author MTest Demo User

Result Distribution
Test Sequence Result DistributionPercentagePassedNotTriggeredUnknownReviewFailedErrorNone
Test001 - Testing obstacle detection using MTCD
 
2000000

Test SequenceLinked ItemsTest Sequence DescriptionEvaluation Results
1: TS_OBST_DET_001 Passed 
ObstacleDetection_demo_ec /
ObstacleDetection /
Test001


Work Status:  reviewed
Requirements
REQ_OBST_DET_01
REQ_OBST_DET_02

Assessments
mars_REQ_OBST_DET_01
mars_REQ_OBST_DET_02

Down-ramp of front ultrasound sensor signal
Test description
We ramp down the ultrasound sensor signal value.

Expected Result
Once sensor signal value falls below DIST_OBSTACLE_EVADE the output obstacleDetected should be true.

Once sensor signal value falls below DIST_OBSTACLE_STOP the output emergencyStopObstacle should be true.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:48:06)
2: TS_OBST_DET_002 Passed 
ObstacleDetection_demo_ec /
ObstacleDetection /
Test001


Work Status:  reviewed
Requirements
REQ_OBST_DET_03

Assessments
mars_REQ_OBST_DET_03

Down-ramp of front ultrasound sensor signal with reverse drive command
Test description
We ramp down the ultrasound sensor signal value. Later we command reverse drive.

Expected Result
Once sensor signal value falls below DIST_OBSTACLE_EVADE the output obstacleDetected should be true.

Once sensor signal value falls below DIST_OBSTACLE_STOP the output emergencyStopObstacle should be true.

Once reverse drive is comanded, the output emergencyStopObstacle should be false.
Assessment:  Passed 
Regression:  None 
Back2Back:  Passed 
evaluated by:
MTest Demo User (29-Oct-2019 09:48:08)