Test Case

Show / Hide direct link   <MAIN> 4993PA: W8/W10: FFRT : Ethernet Function Verification Test - PP-80466



Version 1.3
Created on 31/08/2016 17:15:00  by m_komatsu_nw
Last modified on  31/08/2016 19:12:22  by m_komatsu_nw
Summary
Preconditions
Status:   Review Complete
Priority:   Mandatory
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective: a
CRITERIA

a

EUT QUANTITY

a

EQUIPMENT

a

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin10-64bit
1

PM event and Performance

AA
2

WoL

AA
3

WL Auto Disconnect

AA
4

Adapter Disable in BIOS

AA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Limitation

WOL cannot resume from S5 in AC UR-4050ap

Reference:

ECR129967 Win 8:Wake on LAN cant resume from S5 in AC Mode

Reason :

Limitation approved. Help center info

WOL cannot resume from S4 in DC with BIOS Settings: AC and Battery

Reference:

ECR166870 RG2:W864:WOL wakes system in DC mode,BIOS set to AC mode

Reason :

Limitation approved. Help center info

Modify Option is grayed out

Reference:

ECR220226/ECR220227Win7/Win8.1:RTK:Modify option in Ethernet Installer is not clickable

Reason:

The Modify's behavior is the same with Remove, it is unnecessary create two the same options in the installer.

But the Modify option cannot remove from installer, because it is installer limitation.

Therefore, we grayed out this option to disable this function.

Restriction

1. No Opera PDA Web Browser Testing in Win 8/8.1

Information

1. #111753 WOL function testing is not working in Windows 7 Intel ethernet (Permanent Limitation)

2. Ref CMVC: #111838 W7:Wake on Link/Lan not working in Win7 using Realtek ethernet

3. Wake on LAN design based on Microsoft Website http://support.microsoft.com/kb/2776718

The "Wake on LAN" (WOL) feature wakes a computer from a low-power state when a network adapter detects a WOL event. Typically, such an event is a specially constructed Ethernet packet. The default behavior in response to WOL events has changed from Windows 7 to Windows 8.

Windows 7

In Windows 7, the default shutdown operation puts the system into the classic shutdown state (S5), and all devices are put into the lowest power state (D3). WOL from S5 is not officially supported in Windows 7. However, some network adapters can be left armed for waking if enough residual power is available. Therefore, waking from S5 is possible on some systems if enough residual power is supplied to the network adapter even though the system is in the S5 state and devices are in D3.

Windows 8 and Windows 8.1

In Windows 8 and Windows 8.1, the default shutdown behavior puts the system into the hybrid shutdown state (S4), and all devices are put into D3. WOL from S4 or S5 is unsupported. Network adapters are explicitly not armed for WOL in either S5 or S4 cases because users expect zero power consumption and battery drain in the shutdown state. This behavior removes the possibility of invalid wake-ups when an explicit shutdown is requested. Therefore, WOL is supported only from sleep (S3) or hibernation (S4) states in Windows 8 and 8.1.

Defect Reference: ECR167902 W8:Realtek:Shutdown WOL is available in DM

PLAN TO COVER FOR 32bit / 64 bit versions for all the supported OS if not specified in the test plan.

WL hotkey and PM keys are different for each products. Refer the supported keys based on the product support and perform the function accordingly.

WL Hotkey : FnF5 or /F8 /F9

PM : S3 : Fn+F4 or Fn+4

. Ethernet Driver installation- Assume CO UT should cover

Test Item Config
Result
Win 8

. Basic Gigabit Ethernet Verification

- PM evetnt and Performance should use 1Gb hub, Dock to be covered Option team

Result
Test Item Configuration
Win 8

1. PM event and Ethernet Performance

Test Item Configuration
Result
About PM event, Refer to "PM event and priority" attached in 5763PA or 5762PA
Win 8

Connect 1GB ethernet system to 1GB ethernet swich which in turn connected to server configured with 1GB ethernet adapter.

Perform ping and xcopy below command (Inital)

Perform Suspend/Resume=(DCmode:TimerSleep 5min,TimerSleep 5min+Hibernate 70 min, ACmode:LidCSleep, TimerSleep 5min )

ping xxxx -l 65500 -n 128 >> EXECping.log

xcopy > 500MB size >> EXECxcopy.log

Confirm ping: no significant performance degradation from Initial

Confirm no error in xcopy Copy files of > 500MB size

Repeate each Sleep 5times, Hibernate 1times

Standalone

Docking station

2. WoL

Test Item
Result
Win 8
Preparation

Install adapter which has ACPI WOL function

Install the latest driver which supports ACPI WOL.

Enable WOL in the network driver property.

Wake up from Suspend (DCmode:TimerSleep 5min, ACmode:LidCSleep)

(Wake on Magic Packet :WinWake.exe)

Put system into StandBy mode. Then wake up the system

by Ping command sent from another system

Check Network Connection after resume.

Wake up from Suspend (DCmode:TimerSleep 5min, ACmode:LidCSleep )

(Wake-On-Link)

Put system into StandBy mode. Then wake up the system

by unplug and replug the RJ-45 cable.

Check Network Connection after resume.

Wake up from Hibernation(DCmode:TimerSleep 5min+Hibernate 70 min)

(Wake on Magic Packet : Winwake.exe)

Put system into Hibernation mode. Then wake up the system

by Ping command.

Check Network Connection after resume.

Wake up from Hibernation(DCmode:TimerSleep 5min+Hibernate 70 min)

(Wake-On-Link)

Put system into StandBy mode. Then wake up the system

by unplug and replug the RJ-45 cable.

Check Network Connection after resume.

Disable WOL

Disable WOL in Network Driver property and confirm Wake on LAN does not work.

WOL verification

1. Install ethernet adapter > reboot the system

2. Start > my computer > Manage > device manager

3. Network adapters > ethernet adapter > advance tab (verify all options in windows property)

4. In advance tab check if wake on link setting and wake on setting is available.

  • For "Wake on link setting" select this option: Forced.
  • For "Wake on setting" select this option: Wake on Magic & directed packet.
5. In Power Management
  • Enable the option: Allow the computer to turn off this device to save power
  • Enable the option: Allow this device to wake the computer
6. Perform S3-Wake on Magic Packet, S3-wake-on-link, S4-Wake on Magic Packet and S4-Wake-on-link-Disable WOL as listed above and confirm that the WOL functions does not work in Win 7.

3. Wireless Auto Disconnect (KBLake)

Test Item
Criteria
Result
Please refer to 5762PA W10 WLANAutoDisConnect w/WiredLAN, and PM event and Priority
Win 10
1-1. 1-2. S0 WLAN Auto DisConnect (DCmode/ACmode)

2-1. 2-2. WoWLAN w/ WL Auto DisConnect For Only WoWLAN supprot products
3-1. 3-2. S0 WLA AutoDisConnect w/Disabled

. Network Connection via Cross Cable [UR-03619AP] - Removed upon Custmer usage

Test Item
Criteria
Result
Win 8

4. Ethernet Adapter Disable in BIOS

Test Item
Criteria
Result
Win 8
Ethernet Enabled in BIOS - Function test covers as Default

np
Ethernet Disabled in BIOS

1. Enter to BIOS setup by pressing F1 button

2. Under Security > I/O port Access > Ethernet choose Disabled

3. Press F10 to save the settings.

4. Boot to OS

Expected: The adapter should NOT be visible in OS

- Adapter should not be visible in OS

- Adapter cannot be configured

A

OTHER DETAILS

EUT Quantity : a 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled)

TEMS Reviewer Log:
Review Logs
Created last 2016-08-31 19:25:24 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Attached files :
Update History:
Modified last: 2016-08-31 19:12:22, by Miyuki Komatsu_nw
Modified last: 2016-08-31 19:12:12.265, by Miyuki Komatsu_nw
Modified last: 2016-08-31 19:09:32.001, by Miyuki Komatsu_nw, Define PM event coverage, Remove Driver Install, Basic Gb, Add WL AutoDisconnect
Modified last: 2016-08-31 17:27:12.011, by Miyuki Komatsu_nw, Remove Driver Install, Cross Cable, Port Replicator
Version Update History:
2016-08-31 17:15:00, Version 1.3, m_komatsu_nw, Remove Driver Install, Cross Cable, Out of date equipment

Other versions
Version 1.2


Version 1.2
Created on 04/10/2012 11:41:49  by PSI_PA_NW_Japan
Last modified on  24/06/2016 14:08:24  by m_komatsu_nw
Summary
Preconditions
Status:   Review Complete
Priority:  
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Test Coverage
Lessons Learned:No Phase:FVT, SVT, SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective: a
CRITERIA

a

EUT QUANTITY

a

EQUIPMENT

a

Critical Attribute:[0] : WLS - Wireless

CONFIGURATION
REFERENCE PROCEDURE
STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin10-64bit
1 Ethernet Driver Installation AA
2 Basic Gigabit Ethernet Verification AA
3 Power Management and Ethernet Performance Test AA
4 Network Connection via Cross Cable AA
5 Ethernet Adapter Verification in BIOS
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

Limitation

WOL cannot resume from S5 in AC UR-4050ap

Reference:

ECR129967 Win 8:Wake on LAN cant resume from S5 in AC Mode

Reason :

Limitation approved. Help center info

WOL cannot resume from S4 in DC with BIOS Settings: AC and Battery

Reference:

ECR166870 RG2:W864:WOL wakes system in DC mode,BIOS set to AC mode

Reason :

Limitation approved. Help center info

Modify Option is grayed out

Reference:

ECR220226/ECR220227Win7/Win8.1:RTK:Modify option in Ethernet Installer is not clickable

Reason:

The Modify's behavior is the same with Remove, it is unnecessary create two the same options in the installer.

But the Modify option cannot remove from installer, because it is installer limitation.

Therefore, we grayed out this option to disable this function.

Restriction

1. No Opera PDA Web Browser Testing in Win 8/8.1

Information

1. #111753 WOL function testing is not working in Windows 7 Intel ethernet (Permanent Limitation)

2. Ref CMVC: #111838 W7:Wake on Link/Lan not working in Win7 using Realtek ethernet

3. Wake on LAN design based on Microsoft Website http://support.microsoft.com/kb/2776718

The "Wake on LAN" (WOL) feature wakes a computer from a low-power state when a network adapter detects a WOL event. Typically, such an event is a specially constructed Ethernet packet. The default behavior in response to WOL events has changed from Windows 7 to Windows 8.

Windows 7

In Windows 7, the default shutdown operation puts the system into the classic shutdown state (S5), and all devices are put into the lowest power state (D3). WOL from S5 is not officially supported in Windows 7. However, some network adapters can be left armed for waking if enough residual power is available. Therefore, waking from S5 is possible on some systems if enough residual power is supplied to the network adapter even though the system is in the S5 state and devices are in D3.

Windows 8 and Windows 8.1

In Windows 8 and Windows 8.1, the default shutdown behavior puts the system into the hybrid shutdown state (S4), and all devices are put into D3. WOL from S4 or S5 is unsupported. Network adapters are explicitly not armed for WOL in either S5 or S4 cases because users expect zero power consumption and battery drain in the shutdown state. This behavior removes the possibility of invalid wake-ups when an explicit shutdown is requested. Therefore, WOL is supported only from sleep (S3) or hibernation (S4) states in Windows 8 and 8.1.

Defect Reference: ECR167902 W8:Realtek:Shutdown WOL is available in DM

PLAN TO COVER FOR 32bit / 64 bit versions for all the supported OS if not specified in the test plan.

WL hotkey and PM keys are different for each products. Refer the supported keys based on the product support and perform the function accordingly.

WL Hotkey : FnF5 or /F8 /F9

PM : S3 : Fn+F4 or Fn+4

1. Ethernet Driver Installation

Test Item Config
Result
Win 8
Installation (Admin Mode)

- Install the driver in Admin mode using setup

- Check that the installation is successful

- Uninstall the application from 'Add/Remove programs'

- Confirm that application is removed completly.

- Install the application again.

- Check for the correct driver version/date in the device manager

Stand alone
A
Overwrite/Update Installation

- Check that the driver can be installed properly and no malfunction occurs

- Perform update installation from the previous version

- Check for the driver date and version.

Stand alone
A
Installation (user mode)

- Install the driver in user mode using setup

- Criteria : User should not be able to install the driver

- Uninstall the application from 'Add/Remove programs'

Criteria : User should not be able to uninstall the driver

Stand alone
A
Perform the driver installation

a) Using setup option

b) Using Inf installation

Stand alone
A
Options Verifications

In Device manager, select the ethernet adapter, double click to select the properties.

In Advanced tab, Verify the options listed there and its functions.

Stand alone
A
Network Driver utilities and options verifications
  1. Install Intel Proset and other related utilites that comes with the package.
  2. Check for all the options like Intel Priority Packet / Packet protect.
  3. Configure all the options and check for Proset and IP security functions
  4. Confirm all the functions after PM
Stand alone
A
Connect/Disconnect Ethernet profile with Static IP

1. Install latest Ethernet driver.

2. Restart the system as prompted

3. Go to Device Manager > Network and Internet > Network and Sharing Center

4. On Network and Sharing Center's right pane window, click Change adapter settings link.

5. On Network Connections window, right click Ethernet adapter > select Properties

6. On Ethernet Properties, select Internet Protocol Version 4 (TCP/IPv4) > click Properties button

7. Enter IP address and (if applicable) DNS server addresses.

8. Click OK.

9. Attach Ethernet cable to machine's LAN port.

10. Confirm successful connection

11. Disconnect Ethernet profile and confirm that the profile disconnects.

12. Go to the device manager and check for ethernet adapter.

13. Ethernet adapter should not be disabled in Device Manager. It should remain enabled.

  • Ethernet adapter should NOT be disabled from the device manager after disconnecting an Ethernet profile with static IP.
  • Make sure profile gets connected without any Error Message
A
Connect/Disconnect Ethernet profile with DHCP IP

1. Install latest Ethernet driver.

2. Restart the system as prompted

3. Without configuring IP Address in Control Panel, attach Ethernet cable to machine's LAN port.

4. Confirm successful connection

5. Disconnect Ethernet profile and confirm that the profile disconnects.

5. Go to the device manager, ethernet adapter should not be disabled. It should remain enabled.

  • Ethernet adapter should not be disabled from the device manager after disconnecting an Ethernet profile with DHCP IP
  • Make sure profile gets connected without any Error Message
A

2. Basic Gigabit Ethernet Verification

Result
Test Item Configuration
Win 8
- Connect the system directly to 1Gbit hub/Switch

- Confirm the basic network functionality by file copy (300MB file size)

=> It should connect in 1Gbit (1000Mbps speed)

- Measure the file copy performance

Standalone

<No support of Port Replicator (Remove on 2016/06/24)> Please skip

- Connect the system through Port replicator to 1GB hub/Switch

- Confirm the basic network functionality by file copy (300MB file size)

=> It should connect in 1Gbit (1000Mbps speed) if it is connected to 4 pair connector port replicator

=> It should connect in 10/100 Mbps if it is connected to 2 or 3 pair connector port replicator (old models)

- Measure the file copy performance

Port Replicator

(2/3 core connector)

Port Replicator

(4 core connector)

- Connect the system through Docking station to 1Gbit hub/Switch

- Confirm the basic network functionality by file copy (300MB file size)

=> It should connect in 1Gbit (1000Mbps speed) if it is connected to 4 pair connector docking station

=> It should connect in 10/100 Mbps if it is connected to 2 or 3 pair connector docking station (old models)

- Measure the file copy performance

Docking station

(2/3 core connector)

Docking station

(4 core connector)

3. Power Management and Ethernet Performance Test

Test Item
Result
Configuration
Win 8
Connect 1GB ethernet system to 1GB ethernet swich which in turn connected to server configured with 1GB ethernet adapter.

Perform Basic Network functions including File copy

Perform Suspend/Resume

Copy files of > 500MB size

Confirm that the file copy is completed without any error after resuming from suspend

Perform Hibernate/Resume

Copy files of > 500MB size

Confirm that the file copy is completed without any error after resuming from Hibernation

Standalone

Docking station

Performance

1. Copy file from server to client using 1GB network (File size : > 1GB single file)

2. Compare the performance with that of 10/100Mbps

3. Upload 1GB size file from client to server and measure the throughput.

Perform this test for both file copy and null copy

(Refer Reference procedure section for the performance details).

Standalone

Docking station

Perform the above tests when the settings in

Device Manager->Network adapters->select the adapter->Click properties->Advanced tab->Link speed & Duplex is set in

a) Auto Detect mode

b) 1000Mbps/Full Duplex

Standalone

Docking station

Power Management

- Suspend (Fn+F4) the system x 10 times

- Confirm that the ethernet works fine after every suspend

- Hibernate(Fn+F12) the system x 10 times

- Confirm the functionality of ethernet network

- Start copying big files (>500MB)

- Press Fn+F3 x 10 times.

- Check that the file copy is not affected

Standalone

Docking station

Put the system into Suspend or Hibernation

Test Item
Result
Win 8
Preparation

Install adapter which has ACPI WOL function

Install the latest driver which supports ACPI WOL.

Enable WOL in the network driver property.

Wake up from Suspend (S3)

(Ping)

Put system into StandBy mode. Then wake up the system

by Ping command sent from another system

Check Network Connection after resume.

Wake up from Suspend (S3)

(Wake-On-Link)

Put system into StandBy mode. Then wake up the system

by unplug and replug the RJ-45 cable.

Check Network Connection after resume.

Wake up from Hibernation(S4)

(Ping)

Put system into Hibernation mode. Then wake up the system

by Ping command.

Check Network Connection after resume.

Wake up from Hibernation(S4)

(Wake-On-Link)

Put system into StandBy mode. Then wake up the system

by unplug and replug the RJ-45 cable.

Check Network Connection after resume.

Disable WOL

Disable WOL in Network Driver property and confirm Wake on LAN does not work.

WOL verification

1. Install ethernet adapter > reboot the system

2. Start > my computer > Manage > device manager

3. Network adapters > ethernet adapter > advance tab (verify all options in windows property)

4. In advance tab check if wake on link setting and wake on setting is available.

  • For "Wake on link setting" select this option: Forced.
  • For "Wake on setting" select this option: Wake on Magic & directed packet.
5. In Power Management
  • Enable the option: Allow the computer to turn off this device to save power
  • Enable the option: Allow this device to wake the computer
6. Perform S3-ping, S3-wake-on-link, S4-ping and S4-Wake-on-link-Disable WOL as listed above and confirm that the WOL functions does not work in Win 7.

Install and configure all the devices manually [wherever applicable use of Preload is recommended].

Confirm the basic connectivity for all the communication devices.

Ethernet Device

Test Item
Criteria
Result
Win 8
- Device Manager entry

- Check Basic Ethernet connectivity

- Suspend and Resume

- Check Basic Ethernet connectivity

- File copy

Repeate the above steps 5 times

-
- Device Manager entry

- Check Basic Ethernet connectivity

- Hibernate and Resume

- Check Basic Ethernet connectivity

- File copy

Repeate the above steps 5 times

- Device Manager entry

- Check Basic Ethernet connectivity

- Warm boot [system restart]

- Check Basic Ethernet connectivity

- File copy

Repeate the above steps 5 times

- Device Manager entry

- Check Basic Ethernet connectivity

- Shutdown and Restart

- Check Basic Ethernet connectivity

- File copy

Repeate the above steps 5 times

4. Network Connection via Cross Cable [UR-03619AP]

Test Item
Criteria
Result
Win 8
1. Attach USB 2.0 Ethernet Adapter with LAN cable to Machine A

2. Set Network setting. "Turn off password protected sharing" of network setting.

3. Create shared folder C:\file on Machine B

4. Connect Machine A and Machine B with the cross cable.

5. Set a static IP on the test machines.

IP:192.168.0.xxx

Subnetmask:255.255.255.0

Default Gateway:Non

6. Copy ten 100MB files from Machine A to shared folder \file of Machine B of Network Computer.

7. Copy files from Machine A to Machine B.

8. Perform the test on Machine B

Ref: ECR148035 CFF: PR52398: X1 Carbon: Network connectivity issue with USB-Ethernet adapter at Hoshiden

  • Confirm shared folder can be created.
  • File transfer should complete successfully on each machine.
A
Power Management

1. Put the system in suspend mode.

2. Resume after 1 minute and check if both machines can access/communicate on each.

3. Do file transfer via cross cable.

4. Hibernate the system.

5. After 1 minute, resume the system and check connection and access on each.

6. Do file transfer on each machine via cross cable.

  • File transfer should be successful
A

5. Ethernet Adapter Verification in BIOS

Test Item
Criteria
Result
Win 8
Ethernet Enabled in BIOS

1. Enter to BIOS setup by pressing F1 button

2. Under Security > I/O port Access > Ethernet choose Enabled

3. Press F10 to save the settings.

4. Boot to OS

Expected: The adapter should be visible in OS and configurable.

5. Install the driver and confirm that the Ethernet adapter works fine.

- Adapter should be visible in OS

- Adapter can be configured

A
Ethernet Disabled in BIOS

1. Enter to BIOS setup by pressing F1 button

2. Under Security > I/O port Access > Ethernet choose Disabled

3. Press F10 to save the settings.

4. Boot to OS

Expected: The adapter should NOT be visible in OS

- Adapter should not be visible in OS

- Adapter cannot be configured

A

OTHER DETAILS

EUT Quantity : a 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled)

TEMS Reviewer Log:
Review Logs
Created last 2016-06-24 16:27:23 by Eiji Ogata. Review Comments(Review Complete): review completed.
Created last 2016-06-13 13:21:55 by Eiji Ogata. Review Comments(Review Complete): review completed.
Keywords:   None
Requirements :   None
Version Update History:
Modified last: 2016-06-24 14:08:24.843, by Miyuki Komatsu_nw, No. was added into Test Description title. Test item (step) of OPERA was removed.
Modified last: 2016-06-24 13:57:22.965, by Miyuki Komatsu_nw, Remove PortReplicator from 2. Basic Gigabit Ether Verification, because no support any more for long time.
Modified last: 2016-03-09 18:26:25.647, by Yoshihiro Amenomiya
Modified last: 2016-03-09 18:23:52.782, by Yoshihiro Amenomiya