Test Case

Show / Hide direct link   <ROOT> 4863PA: Win 8 / 10 : Wireless WAN Field Test - PP-80464



Version 1.7
Created on 11/06/2012 18:16:06  by PSI_PA_NW_Japan
Last modified on  17/04/2017 12:00:41  by m_komatsu
Summary
Preconditions
Status:   Review Complete
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:FVT, Post GA, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To qualify WWAN on actual supported carrier
CRITERIA

All functions to work correctlyl

EUT QUANTITY

2 systems

EQUIPMENT

Networking facilities.

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE

3. Sensor Diagnostic Tool can only be used when Bing Maps and Google Maps cannot get satellite fix.

STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 WWAN - FT covering all function Test: Installation and Uninstallation AAAA
2 WWAN - FT covering all function Test: Installing Geolocation Sensor AAAA
3 WWAN - FT covering all function Test: WWAN Connectivity Native Test AAAA
4 WWAN - FT covering all function Test: GPS Test AAAA
5 WWAN International Roaming Scenario Test WWAN FT AAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Test all the supported SIM / providers.

Test both 32bit / 64 bit versions unless the test plan specifies the version to test.

Applications may have other functions/GUI not mentioned in this test case. Please verify all the available functions and GUI that comes with the supported version. Any updation required to the test case, Please inform Yamato Lenovo Engineer.

If any country specific scenario is needed but not mentioned in the test case, inform Lenovo Engineer for test case update.

Test both in Admin and User Mode

Known Limitations
Restrictions

1

Information

1. ACM is only applicable in US with AT&T SIM card using Tablet machines.

2. Incorrect logo appears for Swisscom [UR-03465SG]

Reference:

ECR138882 FT:W8: Swisscom shows incorrect logo at the Networks pane

Reason:

Vodafone and Swisscom being partners, Vodafone logo appearing in place of Swisscom is considered acceptable.

3. Metered Connection is a way of setting a connection as limited in Windows so that it’s not used as a leisure resource. You can set a connection as Metered Connection using the right-click menu after the connection is established. After a connection is marked metered, Windows will not use the connection to update itself or any of the devices attached to your computer.

http://www.guidingtech.com/13405/windows-8-metered-connection-airplane-mode/

Prior to Windows 8, we maintained consistent behavior on all types of networks relative to bandwidth usage. With Windows 8, we now take the cost of the network into consideration: we assume that mobile broadband networks have restrictive data caps with higher overage costs (vs. Wi-Fi), and adjust networking behavior with these metered networks accordingly.

http://blogs.msdn.com/b/b8/archive/2012/01/20/engineering-windows-8-for-mobility.aspx

Reference:

ECR143922/ECR143919/ECR143920, FT W8:Set as non-metered connection state is different from PC setting.

4. Sprint disconnects from EVDO and reconnects to LTE within 30 secs but VANUI shows cannot connect.

Reference: ECR194677 FT:Sprint:W8:SIM pin enabled does not connect to network successfully

Approved as a permanent Limitation

WWAN Performance Test Result:

Attachment "WWAN Performance sheet.xlsx" is available below under attached file section.

Note: Attach the completed sheet to the test report.

Tools for GPS TEST using Sensor adapters

ERICSSON / GOBI 3000 / GOBI 4000 BROADCOM
Bing Maps and Google Maps (GMaps) can get satellite fix.

If the above are not possible, please use Sensor Diagnostic Tool and report to MMC NW Team.

1. Run CollectAlmanac.bat ( %Driver%Win32Tests)

2. It will terminate in about 15 minutes.

3. Run Hot_Starts.bat ( %Driver%Win32Tests)

4. It will terminate in about 10 minutes.

5. Run Warm_Starts.bat ( %Driver%Win32Tests)

6. It will terminate in about 10 minutes.

7. Run Cold_Starts.bat ( %Driver%Win32Tests)

6. It will terminate in about 30-45 minutes.

8. Check logfile created in C:BcmGnssLog**"C:BcmGnssLogSyslogArchive<SystemDate>"

Tools:

Attachment "Broadcom.GLMap.2012.10.13.9081.zip" is available below under attached file section.

Attachment "Coltrane GPS Test using GLMap.doc" is available below under attached file section.

OOBE Scenario

Test Item Check Item / Criteria Results / Remarks
Windows 8.1

  1. Upon OOBE, click "I accept" button in License Terms.
  2. Enter PC name under Personalize window.
  3. Click Next.
  4. Pick a network and go online to finish setting up your PC under Connect window.
  5. Wireless profile will ask for Security key if needed. Enter incorrect Security key.
  6. Do this also in Mobile Broadband with available carrier network
  7. Click Connect.
  8. "The network security key isn"t correct. Please try again" will show.
  9. Enter correct Security key, then click Connect.
  10. If wireless profile is not broadcasted, click Connect to a hidden wireless network.
  11. Enter information for the hidden wireless network by filling up Network name and choosing the correct Security and Encryption type.
  12. Click OK.
  13. Click the hidden wireless profile created, click Connect.
  14. Wireless profile will ask for Security key if needed. Enter incorrect Security key.
  15. Click Connect.
  16. "The network password didn"t work. Please check it and try again" will show.
  17. Enter correct Security key, then click Connect.
  18. Connection is successful if Settings window will show with Use express settings and Customize buttons.
  19. Follow the instructions after clicking any of Use express settings and Customize buttons and confirm no problem happens.
  20. During First Customer Boot, try connecting WLAN, WWAN (if not performed Steps 6 to 17).
Should be no error messages during OOBE

Should be no system hang up, bluescreen and other unnecessary error messages after connecting to available networks.

Confirm the successful sign up and connectivity.

Confirm successful connectivity in WLAN, WWAN after performing OOBE.

(please enter Check Item / Criteria results here)

Reference:

ECR223369 FT:WL2:Commercial level module (IMEI:013937000166114) Verizon FW v1415.06 display no Service after fresh preload .

Installation and Uninstallation

Test Item Check Item / Criteria Results / Remarks
Installation

Install following applications and drivers as per the build letters.

1. WWAN driver

2. Geolocation Sensor

3. WWAN adapter Firmware

All applications and drivers should install successfully without any errors.

Ensure all the device information before and after firmware update is correct.

(please enter Check Item / Criteria results here)

Reference:

ECR219563 FT:WL2:IMEI on EM7345 reset to 004999010640000 and module fails to connect to network with AT&T firmware in GTWP09WW.

Uninstallation

Uninstall following applications and drivers as per the build letters.

1. WWAN driver

2. Geolocation Sensor

All applications and drivers should uninstall successfully without any errors. (please enter Check Item / Criteria results here)

Installing Geolocation Sensor

Test Item Check Item / Criteria Results / Remarks
For Broadcom drivers

  1. Install Broadcom GPS as per the build letter and restart when prompted.
  2. Go to Device Manager > Sensors.
  3. Broadcom GNSS Geolocation Sensor should be displayed.
  4. Go to USB controllers
  5. Broadcom GNSS Bus Driver should be displayed.

For Ericsson drivers

  1. Install Ericsson driver as per the build letter and restart when prompted.
  2. Go to Device Manager > Sensors.
  3. N5321 gw Mobile Broadband Geolocation Sensor should be displayed.
  4. Go to USB controllers
  5. N5321 gw Mobile Broadband Device should be displayed.

For Gobi 3000 / 4000 drivers

  1. Install Gobi 3000/4000 driver as per the build letter and restart when prompted.
  2. Go to Device Manager > Sensors.
  3. Sierra Wireless Location Sensor should be displayed.
  4. Go to USB controllers, USB Mobile Broadband Network
- All drivers should install successfully without any errors and yellow bang. (please enter Check Item / Criteria results here)
WWAN device Enable/Disable after PM operations
  1. Open device manager, Under network adapters right click and disable the WWAN adapter.
  2. Enter Suspend and resume after 60 seconds.
  3. Right click the WWAN device and enable the device.
  4. Enter Suspend and resume after 60 seconds.
  5. Perform the above steps for 3 trials.
  6. Open device manager, Under network adapters right click and disable the WWAN adapter.
  7. Enter Hibernate and resume after 60 seconds.
  8. Right click the WWAN device and enable the device.
  9. Enter Hibernate and resume after 60 seconds.
  10. Perform the above steps for 3 trials.
  11. Open device manager, Under network adapters right click and disable the WWAN adapter.
  12. Restart the system .
  13. Right click the WWAN device and enable the device.
  14. Restart the system.
  15. Perform the above steps for 3 trials.
  16. Shut down the system and power on.
  17. Open device manager, Under network adapters right click and disable the WWAN adapter.
  18. Shutdown the system and Power on after 60 seconds.
  19. Right click the WWAN device and enable the device.
  20. Shutdown the system and Power on after 60 seconds.
  21. Perform the above steps for 3 trials.

  • WWAN should be available in device manager and be disabled.
  • WWAN should be available in device manager and be enabled and be able to connect successfully to the carrier network
  • Make sure no errors
  • Yellow Mark should not appear in Device Manager

WWAN Connectivity Native Test

WWAN Profile Creation / Connection

Test Item Check Item / Criteria Results / Remarks / Logfile
Note: Before testing, insert working / activated SIM.

1. From Start GUI, go to All Apps > Windows System > Control Panel

2. It will direct to Desktop > with Control Panel window viewed.

3. From Control Panel, go to Network and Internet.

4. Under Network and Sharing Center, click Connect to a network link.

5. Networks window pane will show in the right side of the desktop.

or

1. From Start GUI, click Desktop

2. It will direct to Desktop.

3. From Desktop, taskbar > left click Connect to a network icon.

4. Networks window pane will show in the right side of the desktop.

- OS / Windows Native should show / launch properly.
1. Under Mobile Broadband section, default WWAN profile with connectivity state is shown. (depends on the SIM card inserted)

The following should also be shown:

- Estimated usage and Reset link

- Connect automatically checkbox

- Allow data roaming checkbox (if roaming SIM card was inserted)

2. Connect the default WWAN profile.

- Select the default profile and click Connect button.

3. Right click default WWAN profile. The following options should show:

  • Hide/Show estimated data usage
  • Set as non-metered connection
  • Forget this network
  • View connection properties

4. Select View Connection properties. Mobile Broadband properties window will show:

- In Subscription tab, provider details and subscriber information should correctly show

- In Profile tab, Access point, APN, and other details shows correctly

- In Roaming tab (if roaming SIM was inserted), scanning and correct roaming carrier partners should show after.

- In Security tab, SIM PIN enabling is shown.

5. With Ericsson Adapter connect to both GSM and 3G/4G mode in live network:

Note: Make sure to connect to a carrier which supports GSM/3G/4G.

- Switch between GSM profile and 3G/4G profile for 10 trials

- Browse internet when connected to 3G/4G profile.

6. With Qualcomm Adapter connect to both EVDO and HSPA mode in live network

Gobi 3000:

- Switch between Verizon/Sprint (EVDO) profile and AT&T (HSPA) profile for 10 trials

- Browse internet in both the modes.

Gobi 3000 and 4000 MC7750:

- Switch between Verizon/Sprint (EVDO) profile using Gobi 3000 and Verizon LTE (HSPA) profile using Gobi 4000 MC7750 for 10 trials.

- Browse internet in both the modes.

Gobi 5000:

- Switch between Verizon/Sprint (EVDO) profile and AT&T (HSPA) profile for 10 trials

- Browse internet in both the modes.

- Switch between Verizon/Sprint (EVDO) profile and Sprint (LTE) profile for 10 trials

- Browse internet in both the modes.

- Switch between Sprint (LTE) profile and AT&T (HSPA) profile for 10 trials

- Browse internet in both the modes.

- Confirm that connectivity state is shown in the right portion of default WWAN profile. (i.e. Roaming, Home, Locked - if SIM has PIN enabled)

- Confirm the default WWAN profile was automatically created.

- Confirm profile was successfully connected.

- Confirm that connection type shows when mouse hover connected profile. (i.e. HSPA, UMTS, EVDO, GPRS)

- Confirm that the following information shows correctly in WWAN properties.

- Confirm that GSM and 3G/4G switching profiles are working properly.

- Confirm that EVDO and HSPA switching profiles are working properly.

- Confirm Sprint LTE and AT&T HSPA switching profiles are working properly.

(Supported on Windows 8.1) - UR4059SG

Wireless WWAN Properties

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. The currently connected WWAN profile page should show with correct SSID name on top with following:

Share this connection

4. Confirm Share this connection Turn ON/OFF radio is present

5. Confirm correct sentence is shown: "Share your mobile broadband internet connection with other people. They"ll need the network name and password to connect.

6. To test this item please refer to Mobile Broadband Connection Sharing / Tethering Test Case (5163PA).

Properties

7. The following description should show while WWAN profile is currently connected.

- Manufacturer

- Model

- Firmware

- Network type

- Data class

- IMEI

- Mobile Number

- IMSI

- SIM ICCID

8. Make sure the above descriptions shows correct information.

Security

9. Use a PIN to help protect your SIM shows with "Use a PIN" button

10. To Enable PIN, click "Use a PIN" button

11. Use a PIN prompt will show with the following:

11.1 First, enter the current PIN. A default PIN is provided by your mobile operator.

11.2 Enter the Current PIN and click OK.

12. Once SIM PIN was enabled, the following should show:

12.1 You"re using a PIN to help protect your SIM with "Change PIN" button

12.2 Removing the PIN will make your device less secure with "Remove PIN" button

Note:

- On this part, the WWAN SSID will prompt SIM PIN when trying to connect. Once the SIM PIN prompted, enter correct PIN and confirm connectivity success.

- If entered wrong PIN up to 3 times, SIM will be blocked. Once SIM was blocked/if SIM is blocked, go to step 25 onwards to Unblock SIM.

13. To Change PIN, click "Change PIN" button

14. Change your PIN prompt will show with the following:

14.1 You"ll be asked for the new PIN the next time you connect after your mobile broadband device is turned on.

14.2 Enter the Current PIN

14.3 Enter new PIN

14.4 Enter to Confirm New PIN

14.5 Click OK

15. To Remove / Disable PIN, click "Remove PIN" button

16. Remove your PIN prompt will show with the following:

16.1 Confirm your current PIN. You"ll need this PIN if you devide to use a PIN again.

16.2 Enter Current PIN and click OK.

17. Confirm SIM PIN was disabled.

18. With PUK/Blocked SIM card.

19. Click "Use a PIN" button

20. Use a PIN prompt will show with the following:

20.1 First, enter the current PIN. A default PIN is provided by your mobile operator.

21.2 Enter a wrong PIN and click OK.

21.3 "The PIN isn"t correct. Please try again" message should show for first trial.

21.4 Enter again a wrong PIN and click OK.

21.5 "The PIN isn"t correct. Your SIM will be blocked if one more incorrect PIN is entered" message should show for second trial.

22. Click again "Use a PIN" button

23. Enter the correct PIN and click OK

24. The following will show under Security section:

24.1 Your SIM is blocked because an incorrect PIN was entered too many times with "Unblock PIN" button.

Note: On this part, the WWAN SSID is disabled in Desktop > Network Charms bar.

25. Unblocking SIM

26. Click "Unblock PIN" button

27. Unblock your PIN prompt will show with the following:

27.1 You"ll be asked for the new PIN the next time you connect after your mobile broadband device is turned on.

27.2 Enter PUK

27.3 Enter New PIN

27.4 Enter to Confirm new PIN

27.5 Click OK

28. Confirm SIM was unblocked and SIM is enabled.

29. Unlock Code

30. Unlock this device for use with a different network provider with textbox and Unlock button.

31. Enter unlocking code in the textbox and press Unlock button.

Notes:

- Try to connect to non-ASCII (with Japanese / Chinese / etc. characters or symbols) SSID profile and confirm again the above procedures.

- If WWAN profile is not connected, only Properties section will show.

- Confirm correct and no garbage for SSID name shown under Mobile Broadband section and SSID page.

- Confirm Share this connection radio should be able to Turn ON/OFF

Note: Mobile Broadband tethering is not support for AT&T Carrier.

- Confirm WWAN Properties shows correct information and no blank.

- Confirm SIM PIN works properly

- Confirm changing SIM PIN works properly

- Confirm removing/disabling SIM PIN works properly

- Confirm unblocking SIM works properly

Note: Only 3 tries of SIM PIN should be allowed. Confirm

SIM PIN Behavior:

Notebooks and Ultrabooks:

  1. After resuming from Suspend (S3) SIM will be locked with SIM PIN.
  2. After resuming from Hibernate (S4) SIM will be locked with SIM PIN.
  3. After restart SIM will not be locked and can connect without entering SIM PIN. Since the module is not reset during restart.

Tablets:

  1. After resuming from Suspend (S3) SIM will be locked with SIM PIN.
  2. After restarting the tablet SIM will be locked with SIM PIN.
  3. After resuming from S0i3 (Connected standby) SIM will not be locked and can connect without entering SIM PIN. Since the module is not reset during connected standby state.

Intel Atom processors support Connected standby state and does not support Hibernate (S4). To check if the system supports Connects Connected standby run the following in command prompt with Administrator privileges.

powercfg /a

International Roaming Scenario

1. Connect to WAN profile with Windows Native in USA / Europe with AT&T / Verizon roaming SIM.

2. Hibernate/suspend the system.

3. Travel to some other country i.e USA ---> Europe , USA ---> Japan / Singapore, Europe ---> Japan / Singapore, etc.

4. Resume the system and leave the system idle for 5 minutes to detect the roaming signal.

5. The system should detect the roaming carrier WAN signals.

6. Connect to WAN profile. Connection should be successful.

- WAN connection should be successful after International roaming after Hibernate / suspend - resume.
Default Profile Switching Tests - For US Test Only

CDMA to 3G <-> 3G to CDMA Profile Switching

Make sure Gobi3000 card and activated SIM card was inserted.

SIM Cards to be used: AT&T SIM

CDMA to 3G:

1. Click network icon in taskbar to launch Networks charms bar.

2. Connect CDMA profile (eg. AT&T)

3. Confirm success connectivity.

4. Switch to 3G by clicking "Find more" option under Mobile broadband.

5. Select location (country) from the dropdown list and press ok.

6. Select the 3G network provider from the list of networks available. (eg. AT&T).

7. Connect the network provider and confirm connectivity success.

3G to CDMA:

1. Click network icon in taskbar to launch Networks charms bar.

2. Connect 3G profile (eg. AT&T)

3. Confirm success connectivity.

4. Switch to CDMA by clicking "Find more" option under Mobile broadband.

5. Select location (country) from the dropdown list and press ok.

6. Select the CDMA network provider from the list of networks available (eg. AT&T).

7. Connect the network provider and confirm connectivity success.

Note: Upon selecting the country name that supports CDMA/3G will show both the CDMA & 3G network providers.

CDMA to LTE <-> LTE to CDMA Profile Switching

Make sure Gobi5000 card and activated SIM card was inserted.

SIM Cards to be used: Sprint LTE SIM

CDMA to LTE:

1. Click network icon in taskbar to launch Networks charms bar.

2. Connect CDMA profile (eg. Sprint)

3. Confirm success connectivity.

4. Switch to LTE by clicking "Find more" option under Mobile broadband.

5. Select location (country) from the dropdown list and press ok.

6. Select the LTE network provider from the list of networks available. (eg. Sprint).

7. Connect the network provider and confirm connectivity success.

LTE to CDMA:

1. Click network icon in taskbar to launch Networks charms bar.

2. Connect LTE profile (eg. Sprint)

3. Confirm success connectivity.

4. Switch to CDMA by clicking "Find more" option under Mobile broadband.

5. Select location (country) from the dropdown list and press ok.

6. Select the CDMA network provider from the list of networks available (eg. Sprint).

7. Connect the network provider and confirm connectivity success.

Note: Upon selecting the country name that supports CDMA/LTE will show both the CDMA & LTE network providers.

- Confirm WWAN connection should be successful when switching from CDMA to 3G

- Confirm WWAN connection should be successful when switching from 3G to CDMA

- Confirm WWAN connection should be successful when switching from CDMA to LTE

- Confirm WWAN connection should be successful when switching from LTE to CDMA

Power Management

Note: To enable Hibernate option, left click the Battery icon in tasktray > choose Power Options > click Choose what the power buttons do

> click Change settings that are currently unavailable > under Shutdown settings, check Hibernate check box.

Test Item Check Item / Criteria Results / Remarks
1. Connect to the service provider. - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or no signal is available

(please enter Check Item / Criteria results here)
3. Suspend the system by pressing Fn+F4 key - System should enter suspend mode (please enter Check Item / Criteria results here)
4. Wakeup the system after 1 minute - System should resume/wake-up and no bluescreen / hang up will occur (please enter Check Item / Criteria results here)
5. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
6. Repeat steps 3-5 for 20 times - No bluescreen / hang up should occur

- No error message should occur

(please enter Check Item / Criteria results here)
7. Suspend system by LID close - System should enter suspend mode (please enter Check Item / Criteria results here)
8. LID open the system after 1 minute - System should resume/wake-up and no bluescreen / hang up will occur (please enter Check Item / Criteria results here)
9. Connect to the service - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
10. Repeat steps 7-9 for 20 times - No bluescreen / hang up should occur

- No error message should occur

(please enter Check Item / Criteria results here)
7. Hibernate the system by pressing Fn+F12 key - System should enter hibernation mode (please enter Check Item / Criteria results here)
8. Wakeup the system after 1 minute - System should resume/wake-up and no bluescreen / hang up will occur (please enter Check Item / Criteria results here)
9. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
10. Repeat steps 7-9 for 20 times - No bluescreen / hang up should occur

- No error message should occur

(please enter Check Item / Criteria results here)
11. Restart the system - System should restart and no bluescreen / hang up will occur (please enter Check Item / Criteria results here)
12. Boot to OS and connect to service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
13. Repeat steps 11-12 for 20 times - No bluescreen / hang up should occur

- No error message should occur

(please enter Check Item / Criteria results here)
14. Shutdown the system - System should shutdown properly without any error (please enter Check Item / Criteria results here)
15. Turn on the system after 1 minute - System should boot without any error (please enter Check Item / Criteria results here)
16. Connect to the service provider - Connection should be established

- Connection should not be disconnected without pressing the disconnect button/or signal is available

(please enter Check Item / Criteria results here)
17. Repeat steps 14-16 for 20 times - No bluescreen / hang up should occur

- No error message should occur

(please enter Check Item / Criteria results here)

Power Management using ATS

Test Item Check Item / Criteria Results / remarks
  1. Download the IPConfigAfterPM.zip from ATS admin console.
  2. Disable all PM timers in Power options.
  3. Launch Charms --> Settings --> Network, Click on the Network under mobile broad band. Ensure Connect Automatically is checked.
  4. Unzip IPConfigAfterPM.zip, Navigate to IPConfigAfterPM --> ATS Sys Files and Right click the file Set Execution Policy_Bypass.bat and select Run as Administrator.
  5. Navigate to IPConfigAfterPM folder and right click the file IPConfigAfterPM.ps1 and select Run with powershell.
  6. Select test mode as Silent, Click S3,S4 and R button.
  7. Enter the input as Loop Count: 100, S3 resume time: 60, S3 resume time: 60, S4 resume time: 60, S4 resume time: 60 and R elapse time: 120. and click Ok.
  8. Click no for changing Power plan.
  9. Wait for the Script to run through and Script end message to appear.
  • Once test is completed, Open the IPConfigAfterPM_DevLog.htm file and check for any network connectivity failures.
  • If the status of the WWAN device changed from Ok to Error, then the device had an Yellow bang.
  • If the Network connection failed appears in the log then the Auto-connectivity functionality failed.

Attach IPConfigAfterPM_DevLog.htm file for all carriers in the Test report.

Reference:

ECR224153 FT:WL1:Win8.1: Gobi5000 yellow mark on Device Manager after S4/Resume

ECR212309 FT:WL2:Verizon network auto disconnects after resuming from S3/S4 with ATS FR: 70%

Profile Connectivity with Hardware Switch

Test Item Check Item / Criteria Results / Remarks
Profile Connection with Global Switch

Confirm the WWAN connection to service provider

Turn Off Wireless Radio using Hardware switch present in your system.

Confirm the WWAN profile is disconnected

Turn ON the wireless radio using Hardware switch present in your system.

From Windows Native, Select WAN profile and press Connect

Confirm that the profile is successfully connected.

- Radio ON/OFF should work correctly

- Profile to be connected successfully after Turn ON/OFF.

(please enter Check Item / Criteria results here)

Profile Connectivity with Software Switch

Test Item Check Item / Criteria Results / Remarks
Profile Connection with Software Switch

Confirm the WWAN connection to service provider

Turn Off Airplane Mode in PC Settings > Wireless

Confirm the WWAN profile is disconnected

Turn ON the Airplane Mode in PC Settings > Wireless

From Windows Native, Select WAN profile and press Connect

Confirm that the profile is successfully connected.

- Radio ON/OFF should work correctly

- Profile to be connected successfully after Turn ON/OFF.

(please enter Check Item / Criteria results here)

Profile Connectivity with WWAN Radio ON/OFF

Test Item Check Item / Criteria Results / Remarks
Profile Connection with WWAN Radio ON/OFF

Confirm the WWAN connection to service provider

Turn Off Mobile Broadband radio in PC Settings > Wireless

(Do also in Desktop > click wireless icon in tasktray > Mobile broadband radio)

Confirm the WWAN profile is disconnected

Turn ON Mobile Broadband radio in PC Settings > Wireless

(Do also in Desktop > click wireless icon in tasktray > Mobile broadband radio)

From Windows Native, Select WAN profile and press Connect

Confirm that the profile is successfully connected.

- Radio ON/OFF should work correctly

- Profile to be connected successfully after Turn ON/OFF.

(please enter Check Item / Criteria results here)

Profile Switching

Test Item Check Item / Criteria Results / Remarks
1. Using Windows Native

- Make sure, WLAN profile is available

- Connect WWAN profile

- Confirm WWAN is connected successfully,

- Attach Ethernet cable and confirm Ethernet profile is connected successfully

Press Fn+F4 to enter into suspend

Press Fn key to resume after one minute.

On resuming from suspend Ethernet profile will be automatically connected

From Connect to the Internet panel, select WWAN profile and press Connect button.

Confirm the WWAN profile is connected successfully.

From Connect to the Internet panel, select Wireless LAN profile and press connect button

Confirm that the Wireless LAN is connected successfully.

LID close the system to enter suspend

LID open to resume after one minute.

On resuming from suspend Ethernet profile will be automatically connected

From Connect to the Internet panel, select WWAN profile and press Connect button.

Confirm the WWAN profile is connected successfully.

From Connect to the Internet panel, select Wireless LAN profile and press connect button

Confirm that the Wireless LAN is connected successfully.

Press Fn+F12 to enter into Hibernation mode

Wait for one minute

Press power button to resume from Hibernation

After resuming from Hibernation, system will connect to Wireless LAN profile automatically.

From Connect to the Internet panel, select WWAN profile and press Connect button.

Confirm the WWAN profile is connected successfully.

- No error while connecting the profiles

- Profiles should be switched successfully

- No bluescreen / hang up should occur

- No error message should occur

- Adapters should be still visible after resuming from S3/S4/Lid Close.

(please enter Check Item / Criteria results here)

Airplane Mode test after PM Operations

Test Item Check Item / Criteria Results / Remarks
Enabling Auto-connectivity feature
  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier, Select "Connect Automatically" and Click connect.

Suspend using Power options

  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier and Click connect.
  4. Turn ON the Airplane mode in Charms -->Settings--> Networks.
  5. Put the system into Suspend state, (charms --> Settings --> Power --> Sleep)
  6. After 60 seconds, Press the Fn key or Power button to resume the system.
  7. Turn OFF the Airplane mode in Charms -->Settings--> Networks.
  8. Perform steps 4 to 7 for 3 trials.

Suspend using LID Close

  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier and Click connect.
  4. Turn ON the Airplane mode in Charms -->Settings--> Networks.
  5. Put the system into Suspend state by closing the lid.
  6. After 60 seconds, Open the lid to resume the system.
  7. Turn OFF the Airplane mode in Charms -->Settings--> Networks.
  8. Perform steps 4 to 7 for 3 trials.
Hibernate

  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier and Click connect.
  4. Turn ON the Airplane mode in Charms -->Settings--> Networks.
  5. Put the system into Suspend state, (charms --> Settings --> Power --> Hibernate)
  6. After 60 seconds, Press the Power button to resume the system.
  7. Turn OFF the Airplane mode in Charms -->Settings--> Networks.
  8. Perform steps 4 to 7 for 3 trials.

Restart

  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier and Click connect.
  4. Turn ON the Airplane mode in Charms -->Settings--> Networks.
  5. Restart the system, (charms --> Settings --> Power --> Restart)
  6. Turn OFF the Airplane mode in Charms -->Settings--> Networks.
  7. Perform steps 4 to 6 for 3 trials.

Shutdown

  1. Launch charms --> Settings --> Networks,
  2. Under Mobile Broadband "Carrier name" is displayed.
  3. Click on the carrier and Click connect.
  4. Turn ON the Airplane mode in Charms -->Settings--> Networks.
  5. Shutdown the system, (charms --> Settings --> Power -->Shutdown)
  6. After 60 seconds, Press the Power button to power on the system.
  7. Turn OFF the Airplane mode in Charms -->Settings--> Networks.
  8. Perform steps 4 to 5 for 3 trials.
No error should appear during connection.

System should connect to the Mobile Broadband network automatically.

System should connect to the Mobile Broadband network automatically.

System should connect to the Mobile Broadband network automatically.

System should connect to the Mobile Broadband network automatically.

System should connect to the Mobile Broadband network automatically.

(please enter Check Item / Criteria results here)

Reference:

ECR218814 FT:WL2:Verizon auto disconnects in few secs after toggle Airplane mode ON/OFF.

Firmware Switching for Intel Sierra EM7345

Test item Check item Results / Remarks
  1. Prepare the test system with EM7345 WWAN module.
  2. Insert AT&T LTE SIM and power on the test system.
  3. Launch M.2 WWAN firmware Updater application and check the Firmware details under device information.
  4. Power on the test system with AT&T LTE SIM inserted
  5. Confirm the system can be connected to AT&T LTE network successfully.
  6. Shutdown the system and replace with Verizon LTE SIM.
  7. Power on the test system and Launch M.2 WWAN firmware Updater application, check the Firmware details under device information.
  8. Confirm the system can be connected to Verizon LTE network successfully.
  9. Perform steps 1 to 8 for 10 trials.
  • Correct firmware should be loaded successfully.
  • If Firmware failed message appears try to update the firmware again.
Note: Sprint LTE is not currently supported with Intel Sierra EM7345 WWAN adapter.

refreecn

Firmware Switching for Gobi 5000 EM7355

Test item Check item Results/Remarks
  1. Power on the test system with Gobi 5000 EM7355 WWAN adapter and AT&T LTE SIM inserted.
  2. Notice the firmware updates automatically and the progress is displayed in the bottom right hand corner of the screen.
  3. Once Success message appears.
  4. Launch Charms --> Settings --> Networks, Under Mobile broadband Connect to AT&T LTE network.
  5. Shutdown and replace AT&T LTE SIM with Verizon LTE SIM.
  6. Power on the test system.
  7. Notice the firmware updates automatically and the progress is displayed in the bottom right hand corner of the screen.
  8. Once Success message appears.
  9. Launch Charms --> Settings --> Networks, Under Mobile broadband Connect to AT&T LTE network.
  10. Perform the switching between AT&T, Verizon and Sprint profile.

Note: Sprint Carrier requires Sprint activated SIM paired to a module by the carrier. Sprint LTE SIM should not connect to LTE network with non paired module even though you are in LTE coverage area.

Confirm firmware updates successfully and all WWAN devices are available.

Reference:

ECR206749 FT:STG:W7:Verizon LTE SIM not detected intermittently w/ FW update fail error 67

ECR209551 FT:STG:W8.1:Gobi 5K module HW fails with Verizon firmware update fail with error 67 w/GHWO04WW

AT&T and Verizon testing in Sprint paired EM7355 module

Test item Check item Results / Remarks
  1. Prepare a System with Gobi 5000 Sprint paired module. Insert AT&T LTE SIM.
  2. Power on the system.
  3. Connect to the AT&T network.
  4. Shutdown the system.
  5. Replace AT&T SIM with Verizon LTE SIM.
  6. Power on the system.
  7. Connect to the Verizon LTE network.
  8. Perform the above testing for 3 trials.
  • AT&T firmware loading should start and complete successfully.
  • Connection should be successful
  • AT&T firmware loading should start and complete successfully.
  • Connection should be successful
  • Firmware update and connection update should be successful.

GPS Test using Sensors

Satellite Fix [TTF]

Note:

- Perform this under open-sky signal condition.

- This testing is for Sensors only.

Trial on Day : 1

FOR BROADCOM DRIVERS:

- Run batchfiles as per the build letter. (Batch files are included in the driver package)

- Batch files will take long time to process as indicated below.

- Observe GLMap Tool and confirm no hang up and bluescreen.

- GLMap will show the last fix after batch file processing completed.

- Screencapture Stats tab and Statistics tab and post in the table below.

- Post also logfile from C:BcmGnssLogSyslogArchive.

Collect Almanac (15mins) Cold Starts (25mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Warm Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Hot Starts (10-15mins)

-98-99 counts (refer to Statistics tab > Fixes > TTF portion)

Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots below)

Attachment "collectalmanacsats.jpg" and "collectalmanacstatistics.jpg" is available below under attached file section.

Post Screenshot here (refer to sample screenshots below)

Attachment "coldstartssats.jpg" and "coldstartsstatistics.jpg" is available below under attached file section.

Post Screenshot here (refer to sample screenshots below)

Attachment "warmstartssats.jpg" and "warmstartsstatistics.jpg" is available below under attached file section.

Post Screenshot here (refer to sample screenshots below)

Attachment "hotstartssats.jpg" and "hotstartsstatistics.jpg" is available below under attached file section.

Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000 DRIVERS:

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Trial on Day : 2

FOR BROADCOM DRIVERS:

- Same tests as Trial on Day 1

Collect Almanac (15 mins) Cold Starts (25 mins) Warm Starts (10-15 mins) Hot Starts (10-15 mins)
Satellites
Satellites
Satellites
Satellites
Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 17 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 15.51 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.8 seconds>

Post TTF average here (refer to Statistics tab > Fixes > TTF portion)

<sample result: 4.32 seconds>

Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above) Post Screenshot here (refer to sample screenshots above)
Post Logfile here Post Logfile here Post Logfile here Post Logfile here

FOR ERICSSON and GOBI 3000/4000 DRIVERS:

Cold Fix :

Warm Fix

- Already got fix once and now trying for the second

Hot Fix

- Already got fix once

- Trying to fix second time quickly.

Mention the time here within 4 hours -> Mention the time here

more than 4 hours -> Mention the time here

Mention the time here
Mention the time here Mention the time here

Power Management

Test Item Check Item / Criteria Results / Remarks
1. Suspend the system - System should enter suspend mode (please enter Check Item / Criteria results here)
2. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
3. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
4. Repeat steps 1-3 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
Steps 5-8 is for Thinkpad notebooks

5. Suspend system by LID close

- System should enter suspend mode (please enter Check Item / Criteria results here)
6. LID open the system after 1 minute - System should resume

-Confirm no application error appears after system resume

(please enter Check Item / Criteria results here)
7. GPS should launch and start tracking automatically - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
8. Repeat steps 5-7 for 20 times - No application crash.

- No error message should occur.

(please enter Check Item / Criteria results here)
9. Hibernate the system - System should enter hibernation mode (please enter Check Item / Criteria results here)
10. Wakeup the system after 1 minute - System should resume/wake-up

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
11. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection.

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
12. Repeat steps 9-11 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
13. Restart the system - System should restart (please enter Check Item / Criteria results here)
14. Boot to OS and launch Broadcom GLMap application / Sensor Diagnostic Tool and click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
15. Repeat steps 13-14 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)
16. Shutdown the system - System should shutdown properly without any error (please enter Check Item / Criteria results here)
17. Turn on the system after 1 minute - System should boot without any error

- Confirm no application error appears after system resume/wake-up.

(please enter Check Item / Criteria results here)
18. Launch Broadcom GLMap application / Sensor Diagnostic Tool. Click [Connect] button to obtain satellite fix. - Connection should be established and no disconnection

- Confirm User’s location on Bing Maps is shown correctly.

(please enter Check Item / Criteria results here)
19. Repeat steps 16-18 for 20 times - No application crash

- No error message should occur

(please enter Check Item / Criteria results here)

GPS Navigation Test

- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix and Navigation test to be performed on 2 different days.-Test to be performed for 2 days in the same location to get the data for comparison.

Test Item
Check Item / Criteria
Result
Win8 32
Win8 64
GPS - Navigation with WWAN Adapters

Step 1 > Flash Image to system with Ericsson / Gobi - wwan adapters + SIM

>> Ensure that Internet connection is established using the SIM.

Step 2 > Launch application and click to start the tracking.

Step 3> Ensure that the satellite fix is obtained as per the criteria mentioned above.

Step 4> Once we get the smooth satellite fix, confirm the current location is in Google Map, and then start moving in a car / train with the speed of 50Km or above.

Step 5 > Real time tracking started, make sure no jump is seen.

Navigation needs to be monitored for 20minutes.

Need to test this function using :

1. Bing Maps

2. Google Maps (GMaps, can be downloaded to Store Metro App)

If you find any Navigation application from web, it may also be used. Also inform YMT NW team if you will use any such reliable application to be able to add in this test case.

This navigation test needs to be tested by using car / high speed train.

IMPORTANT :

If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team"s advise.

  • Tracking on the map should be smooth, and no jump on the map.
  • The navigation pointer should move smoothly without any stuck or no noticable jump.
A
A

Long Runs

Test Item Check Item / Criteria Results / Remarks
Windows Native

1. With connection established, leave the system idle for few hours (5 -10 hours) overnight.

2. After long runs perform Suspend/Hibernate/Restart.

3. Resume the system and connect again to WAN profile.

4. Download data from web (around 50 - 100 MB)

5. Check the speed and throughput of the WAN connection at www.speedtest.net

6. To check the speed and throughput click on the location arrow at www.speedtest.net

7. Perform speed test at two different locations and complete the attached "WWAN Throughput template.

8. To calculate RSSI, Signal strength run "netsh mbn show interface" in command prompt.

9. Upon completion of Field test, attach the completed Excel document in test report.

- OS or WAN softwares should not crash or give error while long runs

- Connection should not drop during long hours connection

- Windows Native should connect successfully to WAN profile successfully after PM operations after long runs

-Confirm that data can be downloaded successfully

-The connection speed and throughput should be under acceptable limits depending on the Service Type

(please enter Check Item / Criteria results here)

Please complete the Throughput test results in two different locations and add the test result to the WWAN Performance sheet attached.

Sensor Diagnostic Tool (mentioned above in Tools for GPS Test)

1. Launch Sensor Diagnostic Tool and start satellite tracking

2. With satellite fix, leave the system idle for few hours (5 -10 hours) overnight.

3. After long runs perform Suspend/Hibernate/Restart.

4. Resume the system.

- Sensor Diagnostic Tool should not crash or give error while long runs

- Satellite fix should not drop during long hours connection

- Sensor Diagnostic Tool should get satellite fix successfully after PM operations after long runs

WLAN/WWAN co-existence [UR-03624AP]

1.Create and connect to a WLAN profile

2.Create and connect to a WWAN profile.

3.Ping to google and Play videos on youtube.

4.Leave it idle for 4-5 hours

-WLAN / WWAN profiles should not be disconnected while idle
Mobile Hotspot Test

1.Connect to WWAN profile

2.Open Lenovo Mobile Hotspot Metro App

3.Input the password for Lenovo Mobile Hotspot

4.Start Mobile Hotspot Application.

5.Connect a client pc.

6.On Host and Client pc, Play a youtube video and ping to google.

7.Leave it idle for 4-5 hours.

Note: Some carriers may not support Tethering (e.g. AT&T)

-Client PC should connect to Host PC with WWAN carrier

-Client PC should not be disconnected while idling.

Mobile Hotspot Test using OS native.

  1. Connect to WWAN profile
  2. Launch Charms --> Settings --> Network.
  3. Click on View Connection settings.
  4. Click on the Carrier Network under Mobile Broadband
  5. Under Share this connection, turn on the radio switch.
  6. Click on the Edit button to change the Network name and network password.
Note: Some carriers may not support Tethering (e.g. AT&T)
-Client PC should connect to Host PC with WWAN carrier

-Client PC should not be disconnected while idling.

- Network name with PC name, Network password are auto generated.

- Network name requires minimum of 1 character and Network password requires minimum of 8 characters.

- Network icon should change to

FTP server Download/ Upload test

Test Item Check Item / Criteria Results / Remarks
  1. Connect the test system to the Mobile broadband network.
  2. Download files from ftp server and note down the file size and time taken to download.
  3. Perform this test for 5 trials.
  4. Upload files to the ftp server and note down the file size and time taken to upload.
  5. Perform this test for 5 trials
  • Confirm there is no drop in connection or hang up during upload / download.
(please enter Check Item / Criteria results here)

Please complete the FTP Download/Upload test and add the test result to the WWAN Performance sheet attached.

Web data Download test

Test Item Check Item / Criteria Results / Remarks
  1. Connect the test system to the Mobile broadband network.
  2. Download files from web and note down the file size and time taken to download.
  3. Perform this test for 5 trials.
  • Confirm all files are downloaded successfully and no hang up or failures.
  • Please refer to the attached reference document for download timings for different file sizes.
(please enter Check Item / Criteria results here)

Please complete the Web Data Download test results in two different locations and add the test result to the WWAN Performance sheet attached.

Test files Download link:

http://www.thinkbroadband.com/download.html

APN Testing

Test Item Check Item / Criteria Results / Remarks
  1. Launch Charms --> Change PC Settings --> Network --> Mobile Broadband (carrier) --> Access point.
  2. Click on the name, select Custom and click Edit.
  3. Enter the Access point name (APN), User name, Password and Type of sign-in info. Click Save.
  4. Launch Charms --> Settings --> Network, Select the carrier network under Mobile broadband and Click connect.
  5. Perform the above steps for different APN"s.
  • Confirm connection is successful with different APN"s
(please enter Check Item / Criteria results here)

Reference:

ECR191594 EM7345 W7: EM7345 need type APN of SIM card for OS native connect

Idle testing

Test Item Check Item / Criteria Results / Remarks
  1. Download the NetworkAdapterSpeedtest.zip from ATS admin console.
  2. Disable all PM timers in Power options.
  3. Launch Charms --> Settings --> Network, Click on the Network under mobile broad band. Ensure Connect Automatically is checked.
  4. Unzip NetworkAdapterSpeedtest.zip, Navigate to NetworkAdapterSpeedtest --> ATS Sys Files and Right click the file Set Execution Policy_Bypass.bat and select Run as Administrator.
  5. Navigate to NetworkAdapterSpeedtest folder and right click the file NetworkAdapterSpeedtest.ps1 and select Run with powershell.
  6. Enter the lower Speed (in Mbps) as 100 Mbps (for Gobi 5000 EM7355 and Intel Sierra EM7345 WWAN) and 21 Mbps (for ericsson N5321gw WWAN).
  7. Enter the time to test as 120 minutes.
  8. Once Script is Completed, Open NetworkAdapterSpeedTest_DevLog.htm and check for failures.
  • Check the NetworkAdapterSpeedtest_DevLog for device disappearence and drop in connectivity.
(please enter Check Item / Criteria results here)

Attach NetworkAdapterSpeedtest_devLog.htm file for all carriers in the Test report.

Reference: ECR181911 FT:STG:ALL: Gobi 5K device disappears from device manager while connected with AT&T

Carrier Supported bands Verification

Test Item Check Item / Criteria Results / Remarks
Gobi 5000 EM7355 WWAN Adapter
  1. Ensure the modem port is exposed. If not use the USB Composition tool to show the ports.
  2. Launch Teraterm or the attached Terminal application in the test system. and connect to the modem.
  3. Enter the following AT Commands,
  4. AT!ENTERCND="A710"
  5. AT!GOBIIMPREF? This command returns the current firmware loaded on the system.
  6. AT!BAND=?
  7. AT!BAND?
  8. Test the above steps for AT&T and Verizon.

Intel Sierra EM7345 WWAN Adapter

  1. Install System Trace Tool and latest Java.
  2. Ensure the Trace and AT port are exposed. If not use EM7345_Expose_AT_Port application to expose the ports.
  3. launch STT applications and connect to UE.
  4. Navigate to and lauch AT view.
  5. Type the following commands,
  6. AT
  7. AT+XACT=?
  8. AT+XACT?
  • Ensure all the supported bands are listed.
(please enter Check Item / Criteria results here)

USB Composition Tool:

Attachment "SetUSBComp Build3819.zip" is available below under attached file section.

Terminal Application :

Attachment "Terminal.exe" is available below under attached file section.

Reference:

ECR222349 FT:STG:AT&T LTE SIM can connect to LTE Band 2 and 5 with SDK 4143 & SDK 4150

Please contact MMC team for supported bands for different carriers in US region.

Test Result :

Adapter
Hibernate
Suspend
Gobi-3000
Ericsson
Gobi-4000 - MC7750
Gobi-4000 - MC7700

FOR EUROPE : PERFORM THE SAME OPERATION FROM BASE COUNTRY (Singapore / Philippines / Taiwan ) to each of the country visited => then back to the base.

Preparation :

Two systems of Windows-8 (same configuration)

International roaming SIM (PIN Disabled)

VERY IMPORTANT : TAKE FULLY CHARGED BATTERY. DURING TRANSIT TIME YOU CAN CHARGE USING THE ADAPTERS.

Install and configure all the devices, latest driver and applications

Disable WLAN adapter in BIOS and also DO NOT create WLAN profile.

Enable firmware log file

With Ericsson cards:

Please use G7WR02WW to get FW log.

HOW TO INSTALL EMBLA LOGGING TOOL

1. Uninstall old EMBLA Logger from the system, if any.

2. Unzip the package.

3. Run EMBLALogger.exe as Administrator.

4. Follow the instructions in the setup wizard.

HOW TO CONFIRM INSTALLATION

1. Go to Programs and find Ericsson -> EMBLA -> EMBLA Logger. OR

2. In Programs and Features, find EMBLA Logger.

HOW TO USE EMBLA LOGGING TOOL

1. Launch EMBLALogger as admin through desktop shortcut or from

Programs -> Ericsson -> EMBLA folder.

2. Check "Select All" in the GUI>

3. You may uncheck "Screen Capture" in the list if you think the test

procedure is clear enough. Checking the "Screen Capture" option will

create a video of the activities done on the system while the tool is running.

Recommended: Check "Screen Capture".

4. Click red record button to start logging.

5. Replicate the issue.

6. Once issue is replicated, click blue stop button to stop logging.

7. Click Yes when a message prompts to ask you if you want to zip the log files.

Important:

The tool can run through S3 and S4, but will stop during restart/shutdown.

With Gobi 3000 / Gobi 4000 / Gobi 5000 cards:

Procedure for SWILog:

1. Install SwiLog Plus by running latest swilog.msi.

2. Copy the attached filter file into the test machine.

3. Launch SwiLog Plus.

4. Check the Sierra Wireless Diagnostics Port number from the Device Manager.

5. Input this port number into the "Custom Port Number:" field.

6. Select the filter file.

7. Select the location of the output file.

8. Perform the test to recreate the issue.

9. Stop logging once the issue is recreated.

as of 2012/07/03

Attachment "SwiLogPlus11022.msi" is available below under attached file section.

Attachment "swilog11017.msi" and "SwiLogPlus_generic_filter_6.3+QBI+LTEOTA_WHCK.sqf" is available below under attached file section.

Procedure for SWI Diag Util:

1. Install the latest drivers.

2. Launch SwiDiagUtil (run as administrator if using Vista or newer)

3. Select appropriate information to collect (select all)

4. Repeat test

5. Click the "Collect" button on the SwiDiagUtil window

6. Logs are saved to the specified "Output file path"

Note: SwiDiagUtil requires .NET Framework 2.0.

as of 2012/10/04

Attachment "SwiDiagUtil_Build3543.zip" is available below under attached file section.

With EM7700

NOTE: For MC7700, steps 1-5 for FW update. And steps 8-11 to hide ports. Steps 6 do not apply as the drivers do need to be uninstalled in MC7700

PROCEDURE

1. Install EM7700/MC7700 driver G7W404WW. (Required to update the FW)

2. Shutdown/boot-up the system. (Restart fails to boot-up the system, so shutdown is performed.)

3. Update to EM7700 FW to 3.5.19.04.

4. Confirm that FW is correctly updated through Modem -> Diagnostics.

5. Shutdown/boot-up the system.

6. Uninstall the EM7700/MC7700 drivers.

7. Shutdown/boot-up the system.

8. Run USBComp_MBIM ports hidden (9).bat

"SetUsbComp succeeded. Press any key to exit" will be displayed.

9. Confirm that DM/NMEA/Modem/Location Sensor ports are hidden.

a. Launch Device Manager

b. Check that Sierra modem is not available under Modems

c. Check that Sierra Dignostics and NMEA are not available under Ports

d. Check that Sierra Wireless Location Sensor is not available under Sensors.

e. Check that "EM7700" device is available under Network adapters.

10. Shutdown/boot-up the system.

11. Double-check that ports are hidden.

In the screenshot, because Sierra ports are hidden, Modem and Ports category are not available at all.

And, under sensors, Sierra Wireless Location Sensor is not available.

SetUsbComp Tool

Attachment "SetUSBComp Build3578.zip" is available below under attached file section.

For reporting :

1. Measure the connectivity time in all the occasion.

2. Collect all the log files.

3. Please measure the time and update the report with the full details.

For US :Travel should be (Singapore / Phillipines / Taiwan) =>China => US => Japan => (Singapore / Phillipines / Taiwan).

For Europe : Singapore / Phillipines / Taiwan => Europe country => Singapore / Phillipines / Taiwan [TEST MUST BE PERFORMED DURING TRANSIT LOCATION ALSO]

System in Suspend (S3)

(Ensure that you have fully charged battery)

Windows 8 -32 bit

System in Suspend (S3)

(Ensure that you have fully charged battery)

Windows 8 - 64 bit

First Location : Singapore / Philippines / Taiwan Confirm the basic WAN connectivity in Singapore / Philippines / Taiwan

Suspend the system before entering into plane.

If Airline staff insists to turn off the power, then instead of suspend enter into Hibernation (follow this for travel to each country).

Turn OFF the Global switch

Travel to next country

Confirm the basic WAN connectivity in Singapore / Philippines / Taiwan

Suspend the system before entering into plane.

If Airline staff insists to turn off the power, then instead of suspend enter into Hibernation (follow this for travel to each country).

Turn OFF the Global switch

Travel to next country

On arrival at China =========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in China

Hibernate the system before entering into plane

Turn OFF the global switch

Travel to next country

Suspend the system before entering into plane

Travel to next country

=========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in China

Hibernate the system before entering into plane

Turn OFF the global switch

Travel to next country

Suspend the system before entering into plane

Travel to next country

On arrival at US / Europe =========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in US / Europe

Hibernate the system before entering into plane

Turn OFF the global switch

Travel to next country

=========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in US / Europe

Suspend the system before entering into plane

Turn OFF the global switch

Travel to next country

On arrival at Japan =========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in Japan

Hibernate the system before entering into plane

Turn OFF the global switch

Travel to next country

=========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Before moving to next country :

Enable log file again.

Confirm the basic WAN connectivity in Japan

Suspend the system before entering into plane

Turn OFF the global switch

Travel to next country

On arrival at Singapore / Philippines / Taiwan =========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

=========== if the system is in hibernate then follow ====

Resume from Hibernate

Enter S3

==============================================

Turn ON the radio

Idle 5min.

Resume from Suspend

Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).

Continue your testing in that system.

Take the log file and attach it here

Firmware log file

Take the log file and attach it here

Firmware Log file

OTHER DETAILS

EUT Quantity : 2 systems 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"

3. Sensor Diagnostic Tool can only be used when Bing Maps and Google Maps cannot get satellite fix. (All Test Activity should be performed with AMT Enabled)

TEMS Reviewer Log:
Review Logs
Created last 2016-06-13 14:15:15 by Eiji Ogata. Review Comments(Review Complete): review completed.
Created last 2017-04-17 13:08:20 by Eiji Ogata. Review Comments(Review Complete): Review completed.
Keywords:   None
Requirements :   None
Attached files :
SetUSBComp Build3578.zip - SetUSBComp Build3578.zip (455896 bytes, ) 07/03/2015
SwiDiagUtil_Build3543.zip - SwiDiagUtil_Build3543.zip (543473 bytes, ) 07/03/2015
SwiLogPlus_generic_filter_6.3+QBI+LTEOTA_WHCK.sqf - SwiLogPlus_generic_filter_6.3+QBI+LTEOTA_WHCK.sqf (12645 bytes, ) 07/03/2015
swilog11017.msi - swilog11017.msi (956416 bytes, ) 07/03/2015
SwiLogPlus11022.msi - SwiLogPlus11022.msi (1694208 bytes, ) 07/03/2015
Terminal.exe - Terminal.exe (212992 bytes, ) 07/03/2015
SetUSBComp Build3819.zip - SetUSBComp Build3819.zip (2855278 bytes, ) 07/03/2015
hotstartsstatistics.jpg - hotstartsstatistics.jpg (186019 bytes, ) 07/03/2015
hotstartssats.jpg - hotstartssats.jpg (262179 bytes, ) 07/03/2015
warmstartsstatistics.jpg - warmstartsstatistics.jpg (206217 bytes, ) 07/03/2015
warmstartssats.jpg - warmstartssats.jpg (208237 bytes, ) 07/03/2015
coldstartsstatistics.jpg - coldstartsstatistics.jpg (282652 bytes, ) 07/03/2015
coldstartssats.jpg - coldstartssats.jpg (264541 bytes, ) 07/03/2015
collectalmanacstatistics.jpg - collectalmanacstatistics.jpg (276829 bytes, ) 07/03/2015
collectalmanacsats.jpg - collectalmanacsats.jpg (272441 bytes, ) 07/03/2015
Coltrane GPS Test using GLMap.doc - Coltrane GPS Test using GLMap.doc (1498112 bytes, ) 07/03/2015
Broadcom.GLMap.2012.10.13.9081.zip - Broadcom.GLMap.2012.10.13.9081.zip (13308669 bytes, ) 07/03/2015
WWAN Performance sheet.xlsx - WWAN Performance sheet.xlsx (24292 bytes, ) 07/03/2015

Update History:
Modified last: 2017-04-17 12:00:41.011, by Miyuki Komatsu
Modified last: 2017-04-17 11:59:43.073, by Miyuki Komatsu, Test Phase corrected to pick FVT and PostGA