Test Case

Show / Hide direct link   <ROOT> 4683PA: Win 8 / 10 : GPS Location & Sensor API Verification - PP-80459



Version 1.4
Created on 02/03/2012 10:27:54  by Yoshihiro Amenomiya
Last modified on  03/08/2016 14:40:17  by e_ogata_nw
Summary
Preconditions
Status:   New
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:FVT, SIV (BBFV), SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To confirm Network connections in Location & Sensor API Verification on Windows8
CRITERIA

Refer the criteria in procedure section

EUT QUANTITY

Two systems

EQUIPMENT

PA Networking facilities

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE

3. Sensor Diagnostic Tool can only be used when Bing Maps and Google Maps cannot get satellite fix.

STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 Installation and Uninstallation AAAA
2 GPS Test using Sensors AAAA
3 GPS Geofencing Test (Supported on Windows 8.1) NANANANA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Known Limitations
Restriction

[UR-03464SG]

Location sensor cannot get fix on Map

Reference:

ECR131513 Win 8:Gobi 3K Location Sensor cant get location fix on Map

Reason: It is not driver issue

Update Sensitivity data not available in Sensor diagnostic tool

Reference:

ECR131512 Win8:Gobi 4K:No fields to update sensitivity data in Sensor Diag Tool

ECR131511 Win8:Gobi 3K:No fields to update sensitivity data in Sensor Diag Tool

Reason: Microsoft design

[UR-03488SG]

Exception error when disable sensor in device manager with WWAN

Reference:

ECR131693 W8:Unhandled Exception Error Occurs whn Disable Sensor in DM w/Ericssn

ECR131694 W8:Unhandled exception error occurs whn disable Sensor in DM w/Gobi3k

ECR131695 W8:Unhandled exception error occurs whn disable Sensor in DM w/Gobi4K

Reason: Limitation approved. Helpcentre info

Information

TVT GPS Not Supported

Tools for GPS TEST using Sensor adapters

ERICSSON / GOBI 3000 / GOBI 4000 BROADCOM
Bing Maps and Google Maps (GMaps) can get satellite fix.

If the above are not possible, please use Sensor Diagnostic Tool and report to MMC NW Team.

1. Run CollectAlmanac.bat ( %Driver%Win32Tests)

2. It will terminate in about 15 minutes.

3. Run Hot_Starts.bat ( %Driver%Win32Tests)

4. It will terminate in about 10 minutes.

5. Run Warm_Starts.bat ( %Driver%Win32Tests)

6. It will terminate in about 10 minutes.

7. Run Cold_Starts.bat ( %Driver%Win32Tests)

6. It will terminate in about 30-45 minutes.

8. Check logfile created in C:BcmGnssLog**"C:BcmGnssLogSyslogArchive<SystemDate>"

Tools:

Attachment "Broadcom.GLMap.2012.10.13.9081.zip" is available below under Attached files section.

Attachment"Coltrane GPS Test using GLMap.doc" is available below under Attached files section

Initial Setup

Test Item Check Item / Criteria Results / Remarks
Installation - UR4115AP

Note: Applicable only for GPS WWAN module

- Before driver installation, update the firmware of the card by following the procedure mention in the firmware release notice.

For GPS WWAN module:

1. Install WWAN Driver as per the build letter instructions.

2. Do this for all supported WWAN adapters.

3. Restart when prompted.

For on-board GPS:

1. Install GPS driver as per the build letter instructions.

2. Restart when prompted.

- All drivers should install successfully without any errors and yellow bang.

- Check the device manager for the GPS adapter entries under any of the following:

- Sensors

- USB controllers

(please enter Check Item / Criteria results here)
Power Management Operations

  • Should Suspend, hibernate and resume succussfully with out any error
  • Make sure no errors
  • Yellow Mark should not appear in Device Manager
  • Components should not disappear in Device Manager after PM operations.
UninstallationUninstall following applications and drivers as per the build letters.

1. WWAN driver

2. Geolocation Sensor

- All drivers should uninstall successfully without any errors and yellow bang.

Test Item Check Item / Criteria Results / Remarks
For Broadcom drivers

1. Install Broadcom GPS as per the build letter and restart when prompted.

2. Go to Device Manager > Sensors.

3. Broadcom GNSS Geolocation Sensor should be displayed.

4. Go to USB controllers

5. Broadcom GNSS Bus Driver should be displayed.

For Ericsson drivers

1. Install Ericsson driver as per the build letter and restart when prompted.

2. Go to Device Manager > Sensors.

3. H5321 gw Mobile Broadband Geolocation Sensor should be displayed.

4. Go to USB controllers

5. H5321 gw Mobile Broadband Device should be displayed.

For Gobi 3000 / 4000 drivers

1. Install Gobi 3000/4000 driver as per the build letter and restart when prompted.

2. Go to Device Manager > Sensors.

3. Sierra Wireless Location Sensor should be displayed.

4. Go to USB controllers

5. USB Composite Device

- Sierra is still waiting for Lenovo on what particular name should be shown.

- All drivers should install successfully without any errors and yellow bang. (please enter Check Item / Criteria results here)
Power Management Operations

  • Should Suspend, hibernate and resume succussfully with out any error
  • Make sure no errors
  • Yellow Mark should not appear in Device Manager

GPS Test using Sensors

Satellite Fix [TTF]

Note:

- Perform this under open-sky signal condition.

Note :

Satellite Fix timings vary from country to country, depending on weather. The value given here are around expected value and if we get the value of +/- 20% intermittently, then it can be considered as PASS since it depends on various external paratmers

Trial on Day : 1

FOR BROADCOM DRIVERS:

- Run batchfiles as per the build letter. (Batch files are included in the driver package)

- Batch files will take long time to process as indicated below.

- Observe GLMap Tool and confirm no hang up and bluescreen.

- GLMap will show the last fix after batch file processing completed.

- Screencapture Stats tab and Statistics tab and post in the table below.

- Post also logfile from C:BcmGnssLogSyslogArchive.

TTF

Cold Fix

spec<15min

Hot Fix

spec<5s

Warm Fix <4h

spec<5s

Warm Fix >4h

spec<5min

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Warm fix > 4 hour means fix data will be got again [similar to cold but better than that due to already fix obtained earlier]

Collect Almanac (15mins) Cold Starts (25mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Warm Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Hot Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots below)

Attachment "collectalmanacsats.jpg" and "collectalmanacstatistics.jpg" is available below under Attached files section.

Post Screenshot here (refer to sample screenshots below)

Attachment "coldstarts.jpg" and "coldstartsstatistics.jpg" is available below under Attached files section.

Post Screenshot here (refer to sample screenshots below)

Attachment "warmstartsats.jpg" and "warmstartsstatistics.jpg" is available below under Attached files section.

Post Screenshot here (refer to sample screenshots below)

Attachment "hotstartsats.jpg" and "hotstartsstatistics.jpg" is available below under Attached files section.

Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000/5000 DRIVERS:

Cold Fix :

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Trial on Day : 2

FOR BROADCOM DRIVERS:

- Same tests as Trial on Day 1

Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above)
Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000 DRIVERS:

Cold Fix : (Supported on Windows 8.1)

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Power Management

Test Item Check Item / Criteria Results / Remarks
1. Suspend the system - System should enter suspend mode (please enter Check Item / Criteria results here)
2. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
3. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
4. Repeat steps 1-3 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
Steps 5-8 is for Thinkpad notebooks

5. Suspend system by LID close

- System should enter suspend mode (please enter Check Item / Criteria results here)
6. LID open the system after 1 minute - System should resume

-Confirm no application error appears after system resume

(please enter Check Item / Criteria results here)
7. GPS should launch and start tracking automatically - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
8. Repeat steps 5-7 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
9. Hibernate the system - System should enter hibernation mode (please enter Check Item / Criteria results here)
10. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
11. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
12. Repeat steps 9-11 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
13. Restart the system - System should restart (please enter Check Item / Criteria results here)
14. Boot to OS and launch Broadcom GLMap application / Sensor Diagnostic Tool and click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
15. Repeat steps 13-14 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
16. Shutdown the system - System should shutdown properly without any error (please enter Check Item / Criteria results here)
17. Turn on the system after 1 minute - System should boot without any error

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
18. Launch Broadcom GLMap application / Sensor Diagnostic Tool. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
19. Repeat steps 16-18 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)

GPS Navigation Test

- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix and Navigation test to be performed on 2 different days.-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item
Check Item / Criteria
Result
Win8 32
Win8 64
GPS - Navigation with WWAN Adapters

Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.

Step 2 > Launch application and click to start the tracking.

Step 3> Ensure that the satellite fix is obtained as per the criteria mentioned above.

Step 4> Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving in a car / train with the speed of 50Km or above.

Step 5 > Real time tracking started, make sure no jump is seen.

Navigation needs to be monitored for 20minutes.

Need to test this function using :

1. Bing Maps

2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Navigation application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

This navigation test needs to be tested by using car / high speed train.

IMPORTANT :

If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team"s advise.

  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticable jump.
A
A

GPS Geofencing Test (Supported on Windows 8.1)

- Need to test outside within a designated area for Geofencing test.

- No application crash to be noted throughout the testing

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix, Navigation and Geofencing test to be performed on 2 different days.

-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item Check Item / Criteria
Win8.1 32
Win8.1 64
GPS - Geofencing with WWAN Adapters

Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.

Step 2 > Launch application and click to start the Geofencing.

Step 3 > Generate Geofence (particular area (perimeter) / boundary). (eg. within a shopping area, within a street/block, within train station, within a city)

Step 4 > Ensure that the satellite fix is obtained as per the criteria mentioned above.

Step 5 > Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving away from Geofence.

>> This step can be done by:

- Walking

- Moving in a car / train with the speed of 50km or above.

Step 6 > Real time tracking started, make sure no jump is seen while .

Step 7 > Confirm user will be notified that the device was already out of the particular area (perimeter) / boundary generated above.

Step 8 > By performing again Step 5, this time going back to the generated particular area (perimeter) / boundary.

Step 9 > Confirm user will be notified that the device was already inside the particular area (perimeter) / boundary generated above.

Navigation still needs to be monitored for 20 minutes. To check Geoference co-existence.

Need to test this function using:

1. Bing Maps

2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Geofence application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

Note: The navigation test still needs to be tested by using car / high speed train.

IMPORTANT :

If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team"s advise.

  • Generating particular area (perimeter) / boundary for Geofencing should work properly.
  • Should notify correctly when the device presumably leaves / enters Geofence.
  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticeable jump.

OTHER DETAILS

EUT Quantity : Two systems 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"

3. Sensor Diagnostic Tool can only be used when Bing Maps and Google Maps cannot get satellite fix. (All Test Activity should be performed with AMT Enabled)

TEMS Reviewer Log:
Review Logs
Created last 2016-06-13 14:12:42 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Attached files :
hotstartsstatistics.jpg - hotstartsstatistics.jpg (186019 bytes, ) 07/03/2015
hotstartssats.jpg - hotstartssats.jpg (262179 bytes, ) 07/03/2015
warmstartsstatistics.jpg - warmstartsstatistics.jpg (206217 bytes, ) 07/03/2015
warmstartssats.jpg - warmstartssats.jpg (208237 bytes, ) 07/03/2015
coldstartsstatistics.jpg - coldstartsstatistics.jpg (282652 bytes, ) 07/03/2015
coldstartssats.jpg - coldstartssats.jpg (264541 bytes, ) 07/03/2015
collectalmanacstatistics.jpg - collectalmanacstatistics.jpg (276829 bytes, ) 07/03/2015
collectalmanacsats.jpg - collectalmanacsats.jpg (272441 bytes, ) 07/03/2015
Coltrane GPS Test using GLMap.doc - Coltrane GPS Test using GLMap.doc (1498112 bytes, ) 07/03/2015
Broadcom.GLMap.2012.10.13.9081.zip - Broadcom.GLMap.2012.10.13.9081.zip (13308669 bytes, ) 07/03/2015

Update History:
Modified last: 2016-08-03 14:40:17.59, by Eiji Ogata_nw, GPS spec