Test Case

Show / Hide direct link   <MAIN> 4999PA: W8/W10: FFRT: GPS Function Test - PP-80472



Version 1.2
Created on 04/10/2012 11:52:34  by PSI_PA_NW_Japan
Last modified on  09/03/2016 18:25:54  by y_amenomiya
Summary
Preconditions
Status:   Review Complete
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:a
CRITERIA

a

EUT QUANTITY

a

EQUIPMENT

a

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 Wireless WAN / Sensor Device behavior in Device Manager and PM Scenario AAAA
2 Satellite Fix [TTF] AAAA
3 GPS Navigation Test AAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Points to Remember before performing GPS Test:

If the system supports on board GPS, test only on board related test items

If the system supports WWAN GPS, test all supported WWAN cards

WL hotkey and PM keys are different for each products. Refer the supported keys based on the product support and perform the function accordingly.

WL Hotkey : FnF5 or /F8 /F9

PM : S3 : Fn+F4 or Fn+4

GPS Test

Wireless WAN / Sensor Device behavior in Device Manager and PM Scenario

Test Item
Criteria
Result
Win 8 32
Win 8 64
With WWAN

- Device Manager entry

- Check Basic WWAN connectivity

- Suspend and Resume

- Check Basic WWAN connectivity

- Launch Google/Bing Maps and click My Location

- Suspend and Resume

- Check Basic WWAN connectivity

- Check Device Manager entry

Repeat the above steps 5 times

With Sensors

- Device Manager entry

- Suspend and Resume

- Launch Google/Bing Maps and click My Location

- Suspend and Resume

- Check Device Manager entry

Repeat the above steps 5 times

- No system and application hang after resume from suspend.

- WWAN adapter / Sensors should be visible in Device Manager after resume from suspend.

- WWAN adapter / Sensors should be visible in Device Manager when Google/Bing Maps is launched after resume from suspend.

With WWAN

- Device Manager entry

- Check Basic WWAN connectivity

- Hibernate and Resume

- Check Basic WWAN connectivity

- Launch Google/Bing Maps and click My Location

- Hibernate and Resume

- Check Basic WWAN connectivity

- Check Device Manager entry

Repeat the above steps 5 times

With Sensors

- Device Manager entry

- Hibernate and Resume

- Launch Google/Bing Maps and click My Location

- Hibernate and Resume

- Check Device Manager entry

Repeat the above steps 5 times

- No system and application hang after resume from hibernate.

- WWAN adapter / Sensors should be visible in Device Manager after resume from hibernate.

- WWAN adapter / Sensors should be visible in Device Manager when Google/Bing Maps is launched after resume from hibernate.

With WWAN

- Device Manager entry

- Check Basic WWAN connectivity

- Warm boot [system restart]

- Check Basic WWAN connectivity

- Launch Google/Bing Maps and click My Location

- Warm boot [system restart]

- Check Basic WWAN connectivity

- Check Device Manager entry

Repeat the above steps 5 times

With Sensors

- Device Manager entry

- Warm boot [system restart]

- Launch Google/Bing Maps and click My Location

- Warm boot [system restart]

- Check Device Manager entry

Repeat the above steps 5 times

- No system and application hang after system restart.

- WWAN adapter / Sensors should be visible in Device Manager after system restart.

With WWAN

- Device Manager entry

- Check Basic WWAN connectivity

- Shutdown and Restart

- Check Basic WWAN connectivity

- Launch Google/Bing Maps and click My Location

- Shutdown and Restart

- Check Basic WWAN connectivity

- Check Device Manager entry

Repeat the above steps 5 times

With Sensors

- Device Manager entry

- Shutdown and Restart

- Launch Google/Bing Maps and click My Location

- Shutdown and Restart

- Check Device Manager entry

Repeat the above steps 5 times

- No system and application hang after shutdown and restart.

- WWAN adapter / Sensors should be visible in Device Manager after shutdown and restart.

Satellite Fix [TTF]

Note:

- Perform this under open-sky signal condition.

- This testing is for Sensors only.

Trial on Day : 1

FOR BROADCOM DRIVERS:

- Run batchfiles as per the build letter. (Batch files are included in the driver package)

- Batch files will take long time to process as indicated below.

- Observe GLMap Tool and confirm no hang up and bluescreen.

- GLMap will show the last fix after batch file processing completed.

- Screencapture Stats tab and Statistics tab and post in the table below.

- Post also logfile from C:\BcmGnssLog\SyslogArchive.

Collect Almanac (15mins) Cold Starts (25mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Warm Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Hot Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots below)

Attachment "collectalmanacstatistics.jpg"can be seen at the bottom of the page.

Post Screenshot here (refer to sample screenshots below)

Attachment "coldstartssats.jpg"can be seen at the bottom of the page.

Attachment "coldstartsstatistics.jpg"can be seen at the bottom of the page.

Post Screenshot here (refer to sample screenshots below)

Attachment "warmstartssats.jpg"can be seen at the bottom of the page.

Attachment "warmstartsstatistics.jpg"can be seen at the bottom of the page.

Post Screenshot here (refer to sample screenshots below)

Attachment "hotstartssats.jpg"can be seen at the bottom of the page.

Attachment "hotstartsstatistics.jpg"can be seen at the bottom of the page.

Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000 DRIVERS:

D3Cold Fix : (Supported on Windows 8.1)

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Trial on Day : 2

FOR BROADCOM DRIVERS:

- Same tests as Trial on Day 1

Collect Almanac (15 mins) Cold Starts (25 mins) Warm Starts (10-15 mins) Hot Starts (10-15 mins)
Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above)
Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000 DRIVERS:

D3Cold Fix : (Supported on Windows 8.1)

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Power Management

Test Item Check Item / Criteria Results / Remarks
1. Suspend the system - System should enter suspend mode (please enter Check Item / Criteria results here)
2. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
3. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
4. Repeat steps 1-3 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
Steps 5-8 is for Thinkpad notebooks

5. Suspend system by LID close

- System should enter suspend mode (please enter Check Item / Criteria results here)
6. LID open the system after 1 minute - System should resume

-Confirm no application error appears after system resume

(please enter Check Item / Criteria results here)
7. GPS should launch and start tracking automatically - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
8. Repeat steps 5-7 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
9. Hibernate the system - System should enter hibernation mode (please enter Check Item / Criteria results here)
10. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
11. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
12. Repeat steps 9-11 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
13. Restart the system - System should restart (please enter Check Item / Criteria results here)
14. Boot to OS and launch Broadcom GLMap application / Sensor Diagnostic Tool and click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
15. Repeat steps 13-14 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
16. Shutdown the system - System should shutdown properly without any error (please enter Check Item / Criteria results here)
17. Turn on the system after 1 minute - System should boot without any error

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
18. Launch Broadcom GLMap application / Sensor Diagnostic Tool. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
19. Repeat steps 16-18 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)

GPS Navigation Test

- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix and Navigation test to be performed on 2 different days.-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item
Check Item / Criteria
Result
Win8 32
Win8 64
GPS - Navigation with WWAN Adapters

Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.

Step 2 > Launch application and click to start the tracking.

Step 3> Ensure that the satellite fix is obtained as per the criteria mentioned above.

Step 4> Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving in a car / train with the speed of 50Km or above.

Step 5 > Real time tracking started, make sure no jump is seen.

Navigation needs to be monitored for 20minutes.

Need to test this function using :

1. Bing Maps

2. Google Maps

If you find any Navigation application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

This navigation test needs to be tested by using car / high speed train.

IMPORTANT :

If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team's advise.

  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticable jump.
A
A

GPS Geofencing Test (Supported on Windows 8.1)

- Need to test outside within a designated area for Geofencing test.

- No application crash to be noted throughout the testing

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix, Navigation and Geofencing test to be performed on 2 different days.

-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item

Attachment "collectalmanacsats.jpg"can be seen at the bottom of the page.

Check Item / Criteria

Win8.1 32
Win8.1 64
GPS - Geofencing with WWAN Adapters

Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.

Step 2 > Launch application and click to start the Geofencing.

Step 3 > Generate Geofence (particular area (perimeter) / boundary). (eg. within a shopping area, within a street/block, within train station, within a city)

Step 4 > Ensure that the satellite fix is obtained as per the criteria mentioned above.

Step 5 > Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving away from Geofence.

>> This step can be done by:

- Walking

- Moving in a car / train with the speed of 50km or above.

Step 6 > Real time tracking started, make sure no jump is seen while .

Step 7 > Confirm user will be notified that the device was already out of the particular area (perimeter) / boundary generated above.

Step 8 > By performing again Step 5, this time going back to the generated particular area (perimeter) / boundary.

Step 9 > Confirm user will be notified that the device was already inside the particular area (perimeter) / boundary generated above.

Navigation still needs to be monitored for 20 minutes. To check Geoference co-existence.

Need to test this function using:

1. Bing Maps

2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Geofence application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

Note: The navigation test still needs to be tested by using car / high speed train.

IMPORTANT :

If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team's advise.

  • Generating particular area (perimeter) / boundary for Geofencing should work properly.
  • Should notify correctly when the device presumably leaves / enters Geofence.
  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticeable jump.

OTHER DETAILS

EUT Quantity : a 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled) Tools for GPS TEST using Sensor adapters

ERICSSON / GOBI 3000 / GOBI 4000 BROADCOM
Bing Maps and Google Maps (GMaps) can get satellite fix.

If the above are not possible, please use Sensor Diagnostic Tool and report to MMC NW Team.

1. Run CollectAlmanac.bat ( %Driver%\Win32\Tests)

2. It will terminate in about 15 minutes.

3. Run Hot_Starts.bat ( %Driver%\Win32\Tests)

4. It will terminate in about 10 minutes.

5. Run Warm_Starts.bat ( %Driver%\Win32\Tests)

6. It will terminate in about 10 minutes.

7. Run Cold_Starts.bat ( %Driver%\Win32\Tests)

6. It will terminate in about 30-45 minutes.

8. Check logfile created in C:\BcmGnssLog\**"C:\BcmGnssLog\SyslogArchive\<SystemDate>"

Tools:

Attachment "Broadcom.GLMap.2012.10.13.9081.zip"can be seen at the bottom of the page.

Attachment "Coltrane GPS Test using GLMap.doc"can be seen at the bottom of the page.

GPS Test

Windows 8
Wireless WAN / Sensor Device behavior in Device Manager and PM Scenario
A
Satellite Fix [TTF]
A
GPS Navigation Test
A
TEMS Reviewer Log:
Review Logs
Created last 2016-06-13 13:42:38 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Attached files :
Coltrane GPS Test using GLMap.doc - Coltrane GPS Test using GLMap.doc (1498112 bytes, ) 07/03/2015
Broadcom.GLMap.2012.10.13.9081.zip - Broadcom.GLMap.2012.10.13.9081.zip (13308669 bytes, ) 07/03/2015
hotstartsstatistics.jpg - hotstartsstatistics.jpg (186019 bytes, ) 07/03/2015
hotstartssats.jpg - hotstartssats.jpg (262179 bytes, ) 07/03/2015
warmstartsstatistics.jpg - warmstartsstatistics.jpg (206217 bytes, ) 07/03/2015
warmstartssats.jpg - warmstartssats.jpg (208237 bytes, ) 07/03/2015
coldstartsstatistics.jpg - coldstartsstatistics.jpg (282652 bytes, ) 07/03/2015
coldstartssats.jpg - coldstartssats.jpg (264541 bytes, ) 07/03/2015
collectalmanacstatistics.jpg - collectalmanacstatistics.jpg (276829 bytes, ) 07/03/2015
collectalmanacsats.jpg - collectalmanacsats.jpg (272441 bytes, ) 07/03/2015

Update History:
Modified last: 2016-03-09 18:25:54.946, by Yoshihiro Amenomiya