Test Case

Show / Hide direct link   <MAIN> 4339PA: Android - Wireless WAN function test - PP-80436



Version 1.3
Created on 08/04/2011 16:52:50  by PSI_PA_NW_Japan
Summary
Preconditions
Status:   New
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Basic Function
Lessons Learned:No Phase:FVT, SIV (BBFV), SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective: To verify the WWAN function in Android 3.0
CRITERIA
- Successful WAN connection
EUT QUANTITY
One
EQUIPMENT

Necessary SIM
Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Android 3.0 Total
Test Points
Duration
Workload
# Step actions Android 3.0
1 WWAN Basic Verification Test A
2 File Upload / Download using WAN Network A
3 Android Mobile Broadband Activation A
4 GPS Functionality A
5 Google Maps A
6 GPS Navigation Test A
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Known Limitations / Design Considerations [UR-03401SG]
ECR117073 FT:TS:ICS:Doesnot create correct APN for Orange SIM
Reason: Lenovo can't support wide variety of prepaid SIM carrier. Once we manually put the APN. SIM can access the internet.
Eg: Orange SIM card



Supported WWAN adapters :
WWAN Adapter WWAN Carrier Countries Remarks
Ericsson Vodafone Europe
Sierra Gobi 3000 Verizon, Sprint, AT&T USA



WWAN Basic Verification Test
Test Item Config *1
Result
Android
Airplane Mode On/OFF Test
1. Insert SIM Card ad turn ON Android system
2.a. In Honeycomb: Turn ON Airplane Mode in Apps > Settings > Wireless & networks
2.b. In ICS: Turn ON Airplane Mode in Apps >Settings > Wireless & Networks > More..
2. Confirm that the WWAN works well.
3. Turn OFF Airplane Mode
4. Confirm that the WWAN turned OFF and grayed out

- Repeat steps 1-4 for 5 times
Stand alone
A
Android - Mobile Broadband ON [UR-03089SG]
1. Insert SIM Card and turn ON Android system
2. Tap system tray
3. Turn Mobile Broadband ON

4. Turn Wi-Fi OFF
5. Confirm that Mobile Broadband connect automatically
Stand alone
A
Android - Mobile Broadband OFF
1. Tap system tray again
2. Turn Mobile Broadband OFF
3. Confirm Mobile Broadband disconnect.

4. Turn Wi-Fi ON
5. Confirm Wi-Fi connects automatically if there's a profile saved
Stand alone
A
Airplane Mode ON
1. Press Home, Press Menu , and tap Settings.
2. Tap Wireless & networks
3. In Wireless & Network Settings, check Airplane Mode to enable

4. Confirm Mobile Broadband on system bar is grayed out
5. Go to Settings-->Wireless & networks
6. Confirm Mobile Networks is grayed out

Airplane Mode - OFF
1. Press Home, Press Menu , and tap Settings.
2. Tap Wireless & networks
3. In Wireless & Network Settings, uncheck Airplane Mode to disable

4. Confirm Mobile Broadband on system bar is not grayed out
5. Go to Settings-->Wireless & networks
6. Confirm Mobile Networks is enable
Stand alone
A
Mobile Broadband without SIM [UR-03323SG]
1. Turn ON Android System
2. Expand system bar and confirm that Mobile Broadband is disabled
5a. Honeycomb: Go to Settings-->Wireless & Network
5b. ICS: Go to Settings-->Wireless & Networks-->More...
6. Confirm that Mobile Broadband is disabled
Stand alone
A
Mobile Broadband Radio with SIM
1. Turn ON Android System
2. Expand system bar and confirm that Mobile Broadband is enable
3a. Honeycomb: Go to Settings-->Wireless & Network
3b. ICS: Go to Settings-->Wireless & Networks-->More...
4. Confirm that Mobile Broadband is enable
5. Turn OFF/ON mobile broadband radio
6. Confirm it's working properly

- Repeat steps 5-6 for 5 times
Stand alone
A
Mobile Broadband in CDMA mode <<applicable with Gobi-3K only>>
1. Turn ON Android System
2. Go to Settings-->Wireless & Networks-->More...-->Activate Device
3. Select Verizon Wireless or Sprint as carrier
4. Confirm mobile broadband hardware initializes. At this time the firmware for that carrier is downloaded if required.
5. A window will show an activation choices with this message:
How do you want to activate your account?
- Over the Internet (recommended)
- Call to Activate
6. Exit Mobile Broadband Activation
7. Go to Settings-->Wireless & Networks-->More...
8. Confirm that Mobile Broadband enable
Stand alone
A


Connectivity using AT&T [UR-03299SG]
Result
Android
Test Item
Check Item / Criteria
Suspend
1. With Andoid ICS image and activated AT&T sim card, reboot the system.
2. Get connected to AT&T network
- Notice that network type in system tray will show 4G
- But Settings --> About tablet --> Status --> Mobile network type will be shown as HSPA

(Ref ECR:ECR116619 :FT:TS:ICS:AT&T network type shows 4G in system tray but HSPA in setting)
A

File Upload / Download using WAN Network

TEST ITEM
Result
Android
File Download
1. Insert SIM Card and turn ON Android system
2. Connect to Mobile Networks and confirm internet connection
3. Download files using ftp
A
File Upload
1. Insert SIM Card and turn ON Android system
2. Connect to Mobile Networks and confirm internet connection
6. Upload files using ftp (>300MB files)
A
File Upload and Download Simultaneously
  1. Connect Android machine to a WAN network .
  2. Make sure the profile gets connected successfully .
  3. Connect to an FTP site and upload a 100 MB file
  4. Meanwhile start downloading a file greater than 100MB from the website .
  5. Confirm the uploading and downloading proceeds simultaneously .
  6. Make sure files are uploaded and downloaded successfully without any error message .
  7. Make sure there is no connection drop at any point of time during upload and download.
A

Android Mobile Broadband Activation
Result
Android
Test Item
Check Item / Criteria
1. Attach supported WWAN adapter in Android machine.
2. Attach activated SIM card into Android machine's SIM card slot.
3. Boot Android machine
4. Tap Apps > Settings > Wireless & Networks > Mobile Networks
5. In Mobile Networks window, select Activate device to launch the WWAN activation application
5.Activate device is present outside Mobile Networks.
6.Click Activate device and launch the WWAN activation application

(Ref ECR: ECR 116620:TS:ICS:Gobi/Eric:Mobile Network greyed out without SIM card )
No error messages should occur
Mobile Broadband page should launch successfully
A
System is configured for U.S. and the WWAN card supports both CDMA and GSM:



1. After selecting a carrier, a message will prompt "Please wait. Your mobile broadband hardware is initializing. This may take a few minutes." At this time the firmware for that carrier is downloaded if required.
2. A window will show an activation choices with this message: "How do you want to activate your account" With the following choices:
- By phone
- By internet (wi-fi requred)

If the user selects AT&T carrier with activation by phone, the following screen is shown:



If the user selects AT&T carrier with activation through internet, the following screen is shown:



If the user selects Sprint carrier with activation by phone, the following screen is shown:



If the user selects Sprint carrier with activation through internet, the following screen is shown:



If the user selects Verizon carrier with activation by phone, the following screen is shown:



If the user selects Verizon carrier with activation through internet, the following screen is shown:



If the user selects “Other” for the carrier, then the following activation screen is shown.


If the system is configured for U.S. and the WWAN card supports both CDMA and GSM networks, the following carriers:
- Verizon Wireless
- Sprint
- AT&T
- Other
A
System is configured for Switzerland:



When the user selects Swisscom, the following screen is shown:

If the system is configured for Switzerland, the following carrier choices are shown:
- Swisscom
- Other
A
System is configured for Germany:



When the user selects Vodafone, the following screen is shown:


If the system is configured for Germany, the following carrier choices are shown:
- Vodafone
- Other
A


ICS: Network Icon Verification [UR-03335SG]

Test Item Config *1
Result
Android
1. Boot the Indigo tablet
2. Confim that in system bar, status for network connection is 'No internet connection'
3. Expand system tray, notice that mobile broadband is grayed out
4. Go to Settings-->Wireless & Networks--> Turn WiFi radio ON
5. Connect to any listed Wifi network
6. Confirm that in system bar, Wifi connection icon is display
7. No network connection icon' is also displayed
8. Expand system bar and confirm that only Wifi connection is displayed


Note:
By default, mobile broadband icon will always exist in system bar even if you have connected to WiFi.

Repeat step 1-8 with below scenarios:
Wi-Fi Mobile Broadband System Tray Icon
OFF / ON Grayed out (No sim) no SIM icon/no Internet connection icon
OFF/ON OFF + SIM inserted No Internet connection icon
ON+ Connected OFF + SIM inserted Wifi icon + no internet connection icon
ON+Connected ON+SIM inserted Wifi icon + mobile broadband icon
OFF/ON ON+SIM inserted mobile broadban icon


Reference:
ECR116595 TS:ICS:Two network connection icon is displayed in system tray
Stand alone
A
1. Insert active SIM card
2. Expand the system bar and turn Mobile Broadband ON
3. Confirm mobile broadband will connect automatically
4. Confirm that in system bar, mobile broadband connection icon is display and color BLUE


Note:
The part controlling whether icon goes blue is hidden in Google GMS. Working as designed. (Reference: ECR117074)
Stand alone
A


GPS Functionality
Result
Android
Test Item
Check Item / Criteria
Suspend
1. Launch Google Maps and check if current location is shown.
2. Suspend the system.
3. Resume after 1 minute.
4. Confirm current location is shown on Google Maps.
5. Repeat steps 5-8 for 20 trials.
- No error message should appear before and after system Suspend
- No error message should appear while obtaining satellite fix.
- Confirm Status is shown correctly.
- Confirm Google Maps can be launched with tracking started.
- Confirm current location is shown on Google Maps.
A
Hibernate
1. Launch Google Maps and check if current location is shown.
2. Hibernate the system.
3. Resume after 1 minute.
4. Confirm current location is shown on Google Maps.
5. Repeat steps 5-8 for 20 trials.
- No error message should appear before and after system Hibernate
- No error message should appear while obtaining satellite fix.
- Confirm Status is shown correctly.
- Confirm Google Maps can be launched with tracking started.
- Confirm current location is shown on Google Maps.
A
Restart
1. Launch Google Maps and check if current location is shown.
2. Restart the system. Boot to OS.
3. Confirm current location is shown on Google Maps.
4. Launch Google Maps and check if current location is shown.
5. Repeat steps 5-11 for 20 trials.
- No error message should appear before and after system Restart
- No error message should appear while obtaining satellite fix.
- Confirm Status is shown correctly.
- Confirm Google Maps can be launched with tracking started.
- Confirm current location is shown on Google Maps.
A
Shutdown
1. Launch Google Maps and check if current location is shown.
2. Shutdown the system. Power on the system and boot to OS after 1 minute.
3. Confirm current location is shown on Google Maps.
4. Launch Google Maps and check if current location is shown.
5. Repeat steps 5-11 for 20 trials.
- No error message should appear before and after system Shutdown
- No error message should appear while obtaining satellite fix.
- Confirm Status is shown correctly.
- Confirm Google Maps can be launched with tracking started.
- Confirm current location is shown on Google Maps.
A


Google Maps

Config
Result
Test Item
Android
Launching Google Maps and correct GPS positioning
Confirm successful connection.
Enable GPS satellites in Menu > Settings > Location and Security Settings > Use GPS satellites
Launch Google Maps in Menu > Google Maps
Confirm the Google Maps application launches successfully without errors and shows the current location of the User.
Stand alone
A
Launching Google Maps without internet connection
Download Google Maps in Android Market.
Without internet connection / in Airplane Mode launch Google Maps application.
Google Maps should launch successfully.
Stand alone
A

GPS Navigation Test

- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- First satelitte fix time should be with in 40 seconds [since this varies from place to place and depending on weather condition]. This 40secs is for the worst condition.

- Need to perform this test if any major rework is done / image or driver is changed.

-

TTF data :

Satellite Fix [TTF]

TTF data :

- Need to perform the test in Open Sky area [not much of buildings to obstruct]

This needs to be tested in each of location apart from Field Test.

Download GPS Test application from the Anroid Apps [freeware].

Country of Testing : <mention the country name here> No.of Satellite in view
Criteria : Minimum 5 or above
No.of Satellite fix obtained
Mention the time of first satelitte fix obtained :
System with Ericsson card Day : 1
Day : 2
Day : 1
Day : 2
System with Gobi card Day : 1
Day : 2
Day : 1
Day : 2
Onboard GPS Day : 1
Day : 2
Day : 1
Day : 2
Day : 1
Day : 2
Day : 1
Day : 2



Trail on Day : 1
Cold Fix :

[use tool from Development to clear the data] - System Start -> GPSE Tracking -> Satellite Fix

Warm Fix
- Already got fix once and now trying for the second
Hot Fix
- Already got fix once
- Trying to fix second time quickly.
Mention the time here within 4 hours -> Mention the time here
more than 4 hours -> Mention the time here
Mention the time here
By selecting the AGPS [extra] option, then TTF / Accuracy will be lesser than the above. Mention the time here Mention the time here


Trial on Day : 2
Cold Fix :

[use tool from Development to clear the data] - System Start -> GPSE Tracking -> Satellite Fix

Warm Fix
- Already got fix once and now trying for the second
Hot Fix
- Already got fix once
- Trying to fix second time quickly.
Mention the time here within 4 hours -> Mention the time here
more than 4 hours -> Mention the time here
Mention the time here
By selecting the AGPS [extra] option, then TTF / Accuracy will be lesser than the above. Mention the time here Mention the time here

Cold Fix :

[use tool from Development to clear the data] - System Start -> GPSE Tracking -> Satellite Fix

For the commands to refer 'reference section'

Warm Fix
- Already got fix once and now trying for the second



For the commands to refer 'reference section'
Hot Fix
- Already got fix once
- Trying to fix second time quickly.
15mins within 4 hours -> 5 sec
more than 4 hours -> not more than 5 mins.
5 sec.
By selecting the AGPS [extra] option, then TTF / Accuracy will be lesser than the above. By selecting the AGPS [extra] option, then TTF / Accuracy will be lesser than the above.



GPS Navigation Test
- Need to travel by Car or Train with the speed of 50Km or above for Navigation function test.

- No application crash to be noted throughout the testing.

- Need to perform this test if any major rework is done / image or driver is changed.

- Both Fix and Navigation test to be performed on 2 different days.-Test to be performed for 2 days in the same location to get the data for comparison.


IMPORTANT :
If your test results are not meeting the criteria, inform full details to Yamato team before opening the defect. Yamato NW team will confirm with the development and defect should be opened based on Yamato NW team's advise.

Test Item
Check Item / Criteria
Results
Android
GPS - Navigation with WWAN Adapters
Step 1 > Flash Image to system with Ericson / Gobi - wwan adapters + SIM
Step 2 > Make sure "Use GPS satellites" is checked in Location & security
Step 3 > Click Navigation Icon from Apps, "This application requires a working data connection". appears , click exit
Step 4 > Get Connected 3G, try Navigation again
Step 5 > Set "My Location" and "End Point" on Navigation Map*2
Step 6 > Current location will be shown in Google Map, start moving
Step 7 > Real time tracking started, make sure no jump is seen


Navigation needs to be monitored for 20minutes.

Need to test this function using :
Google Maps
Google Navigation.

Note :
If GPS Navigation is supported in location following options can be used
1) Speak Destination 2) Type Destination 3) Contacts 4) Starred Places


This navigation test needs to be tested by using car / high speed train.
  • Tracking on the map should be smooth, and no jump on the map
A
GPS - Navigation with WiFi only (Onboard GPS) via Tethering
Step 1 > Flash Image to system without wwan adapter
Step 2 > Turn ON WiFi in indigo
Step 3 > Get connected to iphone / HTC using Tethering and share tablet data connection via WiFi
Step 4 > Confirm System can access Internet
Step 5 > Click Navigation Icon from Apps, "Waiting for location"
Step 6 > Set "My Location" and "End Point" on Google Map
Step 7 > Current location will be shown in Google Map, start moving
Step 8 > Real time tracking started, make sure no jump is seen

Note :
If GPS Navigation is supported in location following options can be used
1) Speak Destination 2) Type Destination 3) Contacts 4) Starred Places

This navigation test needs to be tested by using car / high speed train.
  • Tracking on the map should be smooth, and no jump on the map
OTHER DETAILS
EUT Quantity : One 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."
2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"
(All Test Activity should be performed with AMT Enabled)
TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :

Update History:
This document is not yet modified.