Test Case

Show / Hide direct link   <ROOT> 5163PA: -draft- Wired LAN Function Verification - PP-80473



Version 1.1
Created on 12/06/2013 17:41:03  by Muralidharan Seshadri
Last modified on  14/06/2016 18:54:36  by m_komatsu_nw
Summary
Preconditions
Status:   New
Priority:   High
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SIV (BBFV), SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To verify the new functions of Win 8.1
CRITERIA

All functions to work correctly and no system performance degradation

EUT QUANTITY

Two systems

EQUIPMENT

PA networking facilities

Critical Attribute:[0] : WLS - Wireless

[1] : ETN - Ethernet

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bit
1 Mobile Broadband Connection Sharing / Tethering / Wi-Fi hotspot capability AAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Mobile Broadband Connection Sharing / Tethering / Wi-Fi hotspot capability

Mobile Broadband Connection Sharing Configuration and Basic Verification

Test Item Check Item / Criteria Limitation / Known restrictions
Win8.1 32
Win8.1 64
Set up Mobile Broadband Tethering / Hotspot

Using Ericsson and Gobi 5000 as host, perform below procedures

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. The currently connected WWAN profile page should show

4. Go to Share this connection

5. Turn ON the radio

6. Enter Network name and password

Note: Try to create a non-ASCII (with Japanese / Chinese / etc. characters or symbols) SSID profile and confirm again the above procedures.

- Confirm that Mobile Broadband Tethering/hotspot is working properly

- Confirm no garbage after creating Network name.

Editing Network name and Password

1.Try editing the Network name and Password.

2.Existing tethering connection will stop and new connection with new Network name and password will be applied

- Confirm that new Network name and password is applied properly

- Confirm that Wan tethering can be started successfully

Connecting and Client connectivity

1. Try connecting at least 5 client devices and access the Mobile Broadband hotspot. Add more than 5 client devices and check maximum capability of Mobile Broadband Tethering.

Windows 8.1 allows maximum tethering capacity of upto 10 client devices

1.1 Using Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame, iPad, iPhone) with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

1.2 Using other machines with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS, with Realtek, Intel, Broadcom WLAN adapters.

2. Confirm success connectivity of client devices

- Confirm that no BSOD or any error messages when client was connected in hotspot.

- Confirm that client can connect successfully to Mobile Broadband hotspot

Client connectivity verification

1. Client should successfully connected in Mobile Broadband Tethering/hotspot.

2. Verify that the client can connect successfully to the internet.

- Confirm that client can connect successfully to Mobile Broadband hotspot

- Confirm that client can access internet successfully

Disconnecting and Client Disconnectivity

1. From Desktop, disconnect WWAN profile.

2. Confirm client devices will also disconnect.

3. From PC Settings, go to Network > Connections

4. Tap currently connected WWAN from Mobile Broadband section and go to Share this connection

5. Turn ON the radio

6. The following message will show:

"We can"t share this Internet connection because we can"t connect to the mobile broadband network."

- Confirm that no BSOD or any error messages when Disconnect WWAN profile

- Confirm that client devices disconnected successfully from Mobile Broadband tethering/hotspot

Data Usage

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. Confirm that there are two option shown under the Data Usage

4. Turn ON the radio of ?Show my estimated data use in the Network list?

5. Launch the Charms bar, go to settings>Networks

6. Confirm that the WAN profile shows the estimated data usage

- Confirm that no error message appears when turn ON/OFF data usage radio
Access Point - [UR-03822SG]

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. Confirm that the name of the SIM card shown is correct

4. Confirm that there are three profile shown, namely the mobile broadband, prepaid broadband and Custom

5. When mobile broadband/prepaid broadband is selected, ensure that the edit button is grey out and by default the Access point name, User name and Type of sign-in info of the SIM card should be shown.

6. When custom is selected, user have to key in the respective information (Access point name, User name, Password and Type of sign-in info) by clicking on the edit button.

7. Confirm that the WAN profile shows the correct access point

- Confirm that no error messages when the Access point is selected

- Confirm that WWAN profile shows the correct information.

Properties

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. Confirm that all the information shown under the properties section are correct

4. Click the copy button to copy the data and paste it in a notepad and ensure that the exact same information have been copied over

- Confirm that the copy button works as per its function

- Confirm that information shown under the properties are all correct

Security

1. Once WWAN profile is connected, from PC Settings, go to Network > Connections

2. Tap currently connected WWAN from Mobile Broadband section

3. Click on the use a pin button to enable the PIN of the SIM card by keying in the correct PIN number

- Confirm that no error messages when the PIN is keyed

Mobile Broadband Connection Sharing Stress Test

1. Configure the Mobile Broadband Tethering of host machine as stated on the previous test items.

2. Connect to the Mobile Broadband hotspot at least 5 client devices then add more to the maximum capability simultaneously (such as Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame, iPad, iPhone) with different OS (such as Android, iOS, Google Chrome, Windows 7, Windows 8, etc.) or with same OS [Windows8.1])

Windows 8.1 allows maximum tethering capacity of upto 10 client devices

3. Confirm connectivity success by continuous ping/browsing to the internet of each devices.

4. After confirming connectivity success of all devices, run stress test (eg. play long video using You Tube) the devices simultaneously.

5. Run the stress test minimum of 30 minutes.

6. Test the above procedures by doing the scenarios below:

Host Machines
WWAN drivers
Environment
Power Options
No. of Client Devices Connected
Time
Results
Remarks
Standalone
Cradle Mode

(for Tablet systems)

W8.1 32
W8.1 64
<mention here the test machine to be used as host machine>
<mention here the driver used in host machine>
<mention here if the host machine is in AC / DC mode>
<mention here if the host machine is in AC / DC mode>
<mention here how many minutes/hours/never put the host machine to enter sleep mode>
<mention here the number and specify all the devices connected to the host machine>
<mention here how many minutes/hours the stress test of the connected devices>
<mention here if PASS / FAIL>
<mention here if PASS / FAIL>
<mention here if any symptoms/observation was seen,

examples:

- No connection drop

- The 5th device cannot connect anymore

- After 45mins, while trying to connect 5th machine, all system disconnected with host system going to limited connectivity. If we do not play Youtube, then no such problem happens.>

<just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above> <just add rows for other test machines and mention the same as above>

Client Youtube Playback on Mobile Broadband Connection Sharing Test

Test Procedure Expected Result(s)
Win8.1 32 Bit
Win8.1 64 Bit
Youtube playback on Client systems:

1. Try connecting at least 5 client devices and access the Mobile Broadband hotspot. Add more than 5 client devices and check maximum capability of Mobile Broadband Tethering.

1.1 Using Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame, iPad, iPhone) with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

1.2 Using other machines with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS, with Realtek, Intel, Broadcom WLAN adapters.

2. Confirm success connectivity of client devices

3. Verify that the client can connect successfully to the internet.

4.Open browser & play HD video(search for 1080P video) on Youtube in Client systems.

5.Confirm video plays smooth & no loss in Connectivity.

Result:

Client-playback
240p
360p
480p
720p
1080p
1
2
3
4
5

Simultaneous playback result:

Client-playback
1
2
3
4
5
Result
240p
360p
480p
720p
1080p

Client -Playback
Video Quality
1
240p
360p
360p
480p
720p
1080p
720p
2
360p
480p
480p
480p
720p
1080p
720p
3
480p
480p
1080p
480p
720p
1080p
720p
4
720p
720p
1080p
720p
480p
720p
720p
5
1080p
720p
720p
720p
1080p
720p
1080p
Result

Note:

Repeat the test steps & update the table with HD playback on Host -Machine also.

- Confirm that HD video plays smooth in all systems.

-Confirm no loss or drop in connectivity.

-Confirm stability of Host machine

-Confirm that the connected devices should not disconnect and continue its functionality (the video streaming should continue).

A
A

Power Management Verification

Test Procedure Expected Result(s)
Win8 32 Bit
Win8 64 Bit
Basic PM Operations

Suspend / Resume

1. Perform Suspend / Resume in Mobile Broadband Tethering system.

2. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Hibernate / Resume

1. Perform Hibernate / Resume in Mobile Broadband Tethering system.

2. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Lid Close / Resume

1. Perform Lid Close / Resume in Mobile Broadband Tethering system.

2. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Reboot

1. Perform Reboot in Mobile Broadband Tethering system.

2. After Mobile Broadband Tethering system reboot.

3. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

System Shutdown

1. Perform Shutdown in Mobile Broadband Tethering system.

2. Boot again Mobile Broadband Tethering system.

3. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

A
A
Connected Standby Mode Operations (for Connected Standby supported systems only)

Note:

Make sure to perform this item by the following environment below:

- AC/DC Mode

- AC Docked in Cradle (for Tablet systems)

- AC USB (for Tablet systems)

1. Connect at least 5 client devices and access the Mobile Broadband hotspot. Add more than 5 client devices and check maximum capability of Mobile Broadband Tethering.

2. Using Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame) with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

2.3 Using other machines with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS

2.4 While the devices are connected to hotspot, play video streaming using You Tube.

3. Let the host system enter in Connected Standby mode.

4. Observe the connected devices.

- Confirm that the connected devices should not disconnect and continue its functionality (the video streaming should continue).
A
A
Event Viewer / Mobile Broadband Service Verification

Suspend / Resume

1. Perform Suspend in Mobile Broadband Tethering system.

2. Resume after 1 minute from Suspend Mobile Broadband Tethering system.

3. Go to Event Viewer:

3.1 Right click My Computer > Manage > Event Viewer

3.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

4. Go to Problem Reports:

4.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

4.2 Open "View all problem reports"

4.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

5. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Hibernate / Resume

1. Perform Hibernate in Mobile Broadband Tethering system.

2. Resume after 1 minute from Hibernate Mobile Broadband Tethering system.

3. Go to Event Viewer:

3.1 Right click My Computer > Manage > Event Viewer

3.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

4. Go to Problem Reports:

4.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

4.2 Open "View all problem reports"

4.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

5. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Lid Close / Resume

1. Perform Lid Close in Mobile Broadband Tethering system.

2. Resume after 1 minute from Lid Close Mobile Broadband Tethering system.

3. Go to Event Viewer:

3.1 Right click My Computer > Manage > Event Viewer

3.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

4. Go to Problem Reports:

4.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

4.2 Open "View all problem reports"

4.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

5. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Reboot

1. Perform Reboot in Mobile Broadband Tethering system.

2. After Mobile Broadband Tethering system reboot.

3. Go to Event Viewer:

3.1 Right click My Computer > Manage > Event Viewer

3.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

4. Go to Problem Reports:

4.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

4.2 Open "View all problem reports"

4.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

5. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

System Shutdown

1. Perform Shutdown in Mobile Broadband Tethering system.

2. Boot again Mobile Broadband Tethering system.

3. Go to Event Viewer:

3.1 Right click My Computer > Manage > Event Viewer

3.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

4. Go to Problem Reports:

4.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

4.2 Open "View all problem reports"

4.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

5. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Perform each PM operations for 5-10 trials

Connected Standby Mode (for Connected Standby supported systems only)

1. Connect at least 5 client devices and access the Mobile Broadband hotspot. Add more than 5 client devices and check maximum capability of Mobile Broadband Tethering.

2. Using Smart Phones, Wireless Printer, Mobile Phones w/ Wi-Fi capability, Wi-Fi Photo Frame) with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS.

2.3 Using other machines with different OS (such as Android, iOS, Google Chrome, etc.) or with same OS

2.4 While the devices are connected to hotspot, play video streaming using You Tube.

3. Let the host system enter in Connected Standby mode.

4. Resume after 1 minute.

5. Go to Event Viewer:

5.1 Right click My Computer > Manage > Event Viewer

5.2 Confirm that there are NO Critical / Error / Warning messages for Mobile Broadband Service.

6. Go to Problem Reports:

6.1 Go to Control Panel then type Problem Reports in "Search Control Panel" textbox

6.2 Open "View all problem reports"

6.3 Confirm that there are NO crash / stopped working messages for Mobile Broadband Service.

7. Connect any supported client to the Mobile Broadband Tethering system through hotspot connection.

Perform each PM operations for 5-10 trials

- Confirm that connection is established successfully after PM operations.

- Confirm that all functions (buttons, links, etc.) can be performed successfully after PM operations.

- Confirm that no error messages should show after PM operations.

- Confirm there are no error / crash / critical / warning messages under Event Viewer and Problem Reports.

Connected Standby:

- Confirm that the connected devices should not disconnect and continue its functionality (the video streaming should continue).

- Confirm there are no error / crash / critical / warning messages under Event Viewer and Problem Reports.

A
A

OTHER DETAILS

EUT Quantity : Two systems 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled) UR-3883PA

Information

ECR185329:Com_W8.1:Design confirm:WAN connection turns on when start tethering -[UR-03829SG]

This is by design. Per MS:

===== Comments Moved by Partner Bug Service 08/29/2013 11:13 AM =====

Thank you for reporting this issue. The observed behavior is by design. Then the user enables sharing the WAN connection, the system will automatically connect the WAN without prompting the user. The assumption here that the user implicitly allows connectivity WAN by performing the steps in the UI to enable connection sharing.

2. Internet sharing when WWAN is not yet connected will not start if user is using Roaming SIM

Comments by MS

"Mobile broadband device is in a roaming state, the user must first manually connect to the network prior to enabling sharing in the settings. This prevents the user from inadvertantly enabling connection sharing while roaming, which may result in significant data usage charges on their bill. We will consider improving this experience in a future."

Ref. Defect: ECR186771 COM:W8.1:WWAN Can't start sharing with Roaming SIM

3. WPA is removed from the security type of Wifi

Comment by MS:

"You will not find WPA listed as a separate element in the manual create of profile wizard though. This change was made to correspond to the Wifi Alliances(WFA) upcoming requirement regarding mixed mode access points. Under those new requirements users are not allowed to select WPA or TKIP alternatives. The correct way for the user to connect to the network is through the list of networks from the charms bar."

Ref. Defect: ECR185864:COM:W8.1: WPA is missing in security type

4. "Unnamed" is the label when SIM card is not inserted

Comment by MS:

"Bug in Win8.1 OS. We filed a bug#475443 to MS but it was resolved as "won't fix""

Ref. Defect:ECR185595:"Unnamed" instead of "NO SIM" message in Settings page

TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :

Update History:
Obsoleted last: 2016-08-19 10:39:52.158, by Miyuki Komatsu_nw, Just created DRAFT, the contents is for WWAN.
Modified last: 2016-06-14 18:54:36.441, by Miyuki Komatsu_nw
Modified last: 2016-06-10 18:42:13.045, by Miyuki Komatsu_nw