Test Case

Show / Hide direct link   <ROOT> 4638PA: WWAN International Roaming Scenerio Test [WWAN Field Test] - PP-80386



Version 1.1
Created on 02/02/2012 17:39:56  by PSI_PA_NW_Japan
Summary
Preconditions
Status:   New
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:SIT, SIT-R
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To verify the international roaming scenerio
CRITERIA
-Quick connectivity in the roaming country

EUT QUANTITY
Two or more systems (Refer the detail section for other requirements)
EQUIPMENT
Network facilities for WAN connectivity
Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 International Roaming Connectivity AAAAAA
2 Quick Connect function with WWAN AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Field test starting 02/09 from Singapore->China->US. (2.5 weeks of field test in US) -> Narita -> Singapore.
[China and Naria => Transit locations and test will be done in the airport with M1 SIM (vodafone roaming partner SIM).

For now US : Gobi-3000 only be covered and Europe (starting 02/20) - Ericsson will be covered.
No need to cover Gobi-4000 for now.

Test Result :
Adapter
Hibernate
Suspend
Gobi-3000
Ericsson
Gobi-4000 - MC7750
Gobi-4000 - MC7700


FOR EUROPE : PERFORM THE SAME OPERATION FROM BASE COUNTRY (Singapore / Philippines / Taiwan ) to each of the country visited => then back to the base.


Preparation :

Two systems of Windows-7 (same configuration)
International roaming SIM (PIN Disabled)

VERY IMPORTANT : TAKE FULLY CHARGED BATTERY. DURING TRANSIT TIME YOU CAN CHARGE USING THE ADAPTERS.

Install and configure all the devices, latest driver and applications

Disable WLAN adapter in BIOS and also DO NOT create WLAN profile.
Enable log file in Access Connections and create WAN profile ONLY
Enable firmware log file


With Ericsson cards:

Please use G1WR01WW to get FW log.

How to Install EMBLA Logging Tool:
1. Unzip the package.
2. Run EMBLALogger.exe as Administrator.
3. Follow the instructions in the setup wizard.

How to confirm installation:
1. Go to Programs and find Ericsson > EMBLA > EMBLA Logger or go to Control Panel > Programs and Features > find EMBLA Logger.

How to use EMBLA Logging Tool:
1. Launch EMBLALogger as admin through Programs > Ericsson > EMBLA folder.
2. Check "Select All" in the GUI.
3. You may uncheck "Screen Capture" in the list if you think the test procedure is clear enough.
Checking the "Screen Capture" option will create a video of the activities done on the system while the tool is running.
4. Click red record button to start logging.
5. Replicate the issue.
6. Once issue is replicated, click blue stop button to stop logging.
7. Click Yes when a message prompts to ask you if you want to zip the log files.

Important: The tool can run through S3 and S4, but will stop during restart/shutdown.

With Gobi 3000/Gobi 4000/Gobi 5000 cards:

Procedure for SWILog:
1. Install SwiLog Plus by running latest swilog.msi.
2. Copy the attached filter file into the test machine.
3. Launch SwiLog Plus.
4. Check the Sierra Wireless Diagnostics Port number from the Device Manager.
5. Input this port number into the "Custom Port Number:" field.
6. Select the filter file.
7. Select the location of the output file.
8. Perform the test to recreate the issue.
9. Stop logging once the issue is recreated.

as of 2012/07/03


Attachment "SwiLogPlus11022.msi"can be seen at the bottom of the page.

Attachment "swilog11017.msi"can be seen at the bottom of the page.

Attachment "SwiLogPlus_generic_incQMI_filter_6.2.sqf"can be seen at the bottom of the page.

Procedure for SWI Diag Util:

1. Install the latest drivers.
2. Launch SwiDiagUtil (run as administrator if using Vista or newer)
3. Select appropriate information to collect (select all)
4. Repeat test
5. Click the "Collect" button on the SwiDiagUtil window
6. Logs are saved to the specified "Output file path"

Note: SwiDiagUtil requires .NET Framework 2.0.
as of 2012/10/24:

Attachment "SwiDiagUtil_Build3543.zip"can be seen at the bottom of the page.


Enable Quick Connect ON [instant internet] in Power Manager.
Set Access Connections "debugLevel" registry is set to "1".
HKEY_LOCAL_MACHINE\SOFTWARE\Lenovo\Access Connections
DWORD DebugLevel => change the value to 1

Also enable AC logging from AC diagnostic menu.


For reporting :
1. Measure the connectivity time in all the occasion.
2. Collect all the log files.
3. Please measure the time and update the report with the full details.

For US :Travel should be (Singapore / Phillipines / Taiwan) =>China => US => Japan => (Singapore / Phillipines / Taiwan).

For Europe : Singapore / Phillipines / Taiwan => Europe country => Singapore / Phillipines / Taiwan [TEST MUST BE PERFORMED DURING TRANSIT LOCATION ALSO]



System in Suspend (S3)
(Ensure that you have fully charged battery)
Windows 7 -32 bit
System in Suspend (S3)
(Ensure that you have fully charged battery)

Windows 7 - 64 bit
First Location : Singapore / Philippines / Taiwan Confirm the basic WAN connectivity in Singapore / Philippines / Taiwan
Suspend the system before entering into plane
.
If Airline staff insists to turn off the power, then instead of suspend enter into Hibernation (follow this for travel to each country).
Turn OFF the Global switch

Travel to next country

Confirm the basic WAN connectivity in Singapore / Philippines / Taiwan
Suspend the system before entering into plane
.
If Airline staff insists to turn off the power, then instead of suspend enter into Hibernation (follow this for travel to each country).
Turn OFF the Global switch

Travel to next country
On arrival at China =========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend

Connect to available roaming WAN network

Measure the connection time


Suspend the system
Resume after one minute

Connect to WWAN (measure the connectivity time)



(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in China

Hibernate the system before entering into plane

Turn OFF the global switch
Travel to next country


Suspend the system
before entering into plane
Travel to next country
=========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend

Connect to available roaming WAN network

Measure the connection time

Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)



(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in China

Hibernate the system before entering into plane

Turn OFF the global switch
Travel to next country


Suspend the system
before entering into plane
Travel to next country
On arrival at US / Europe =========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend


Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).



Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in US
/ Europe
Hibernate the system before entering into plane

Turn OFF the global switch
Travel to next country
=========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend


Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).


Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in US
/ Europe
Suspend the system before entering into plane

Turn OFF the global switch
Travel to next country
On arrival at Japan =========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend


Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).



Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in Japan

Hibernate the system before entering into plane

Turn OFF the global switch
Travel to next country
=========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend


Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).


Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.



Before moving to next country :


Enable log file again.

Confirm the basic WAN connectivity in Japan

Suspend the system before entering into plane

Turn OFF the global switch
Travel to next country
On arrival at Singapore / Philippines / Taiwan =========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend

Connect to available roaming WAN network
Measure the connection time [should not take more than 60 seconds).


Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.
=========== if the system is in hibernate then follow ====
Resume from Hibernate
Enter S3
==============================================
Turn ON the radio
Idle 5min.
Resume from Suspend


Connect to available roaming WAN network

Measure the connection time [should not take more than 60 seconds).


Suspend the system

Resume after one minute

Connect to WWAN (measure the connectivity time)

(Should not take more than 25 seconds).


(if the system will be used for further testing, disable AC log) and attach the logfile obtained so far here =>

Continue your testing in that system.
Take the log file and attach it here
AC log file / Firmware log file
Take the log file and attach it here
(AC log file) / Firmware Log file


OTHER DETAILS
EUT Quantity : Two or more systems (Refer the detail section for other requirements) 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."
2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"
(All Test Activity should be performed with AMT Enabled)
TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :
SwiDiagUtil_Build3543.zip - SwiDiagUtil_Build3543.zip (543473 bytes, ) 07/03/2015
SwiLogPlus_generic_incQMI_filter_6.2.sqf - SwiLogPlus_generic_incQMI_filter_6.2.sqf (8597 bytes, ) 07/03/2015
swilog11017.msi - swilog11017.msi (956416 bytes, ) 07/03/2015
SwiLogPlus11022.msi - SwiLogPlus11022.msi (1694208 bytes, ) 07/03/2015

Update History:
This document is not yet modified.