Test Case

Show / Hide direct link   <MAIN> 2699PA: Network Reliability & Performance Function Test - PP-80426



Version 1.9
Created on 02/04/2003 16:58:29  by Muralidharan Seshadri
Last modified on  14/12/2015 17:01:44  by y_amenomiya
Summary
Preconditions
Status:   New
Priority:   Medium
BASIC INFORMATION
Section:S/W Test Require attachment:No
Team:Network Group:Reliability
Lessons Learned:No Phase:SIT
Locations:Inhouse: AWS and Cambridge, Inhouse: AWS, Inhouse: Cambridge, Compal, Flextronics, Quanta, Wistron Owned By:Eiji Ogata/LENOVO
Objective:To confirm the reliability of ethernet driver
CRITERIA

Ethernet should work for long period without any problem.

Ethernet should work after shutdown and restart & PM (mulitiple times).

EUT QUANTITY

One system

EQUIPMENT

PPA Networking facilities

Critical Attribute:[0] : ETN - Ethernet

CONFIGURATION
REFERENCE PROCEDURE

Procedure for LAN Performance:

  1. Bind the TCP/IP protocol (not bind other protocol and Service).
  2. Prepare the FTP Daemon machine and HUB for 100 Base x1, HUB for 10 Base x1.
  3. Combine the client machine with FTP Daemon machine through the HUB.(The temporary server is ready in SW06)
  4. Install the FTP client software. (FTP Explorer is fulfilled the intention)
  5. Connect to FTP Daemon and get the 100 MB.
  6. Write down the byte/sec and in MBbps (check the LOG window).
  7. Repeat 3 times the process 5 to 6.
  8. Disconnect the connection and change the HUB to 10 Base.
  9. Repeat 5 to 6 in 3 times.

Pay attention: Network configuration is essential value. Please write down the your configuration

STATISTIC INFO
Operating System Win81-64bit Win81-32bit Win10-32bit Win10-64bit Win7- 64bit Win7- 32bit Total
Test Points
Duration
Workload
# Step actions Win81-64bitWin81-32bitWin10-32bitWin10-64bitWin7- 64bitWin7- 32bit
1 ATS Test Procedure AAAAAA
2 PERFORMANCE RESULTS (using ATS) AAAAAA
3 PERFORMANCE and RELIABILITY AAAAAA
4 VISTA UNIQUE FUNCTION TEST AAAAAA
DETAILS
ATTENTION!! Please follow below information.
1. Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead, then arrange to open defect, if needed.

2. Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case).

3. All Test Activity should be performed with AMT Enabled as Default (applicable on vPro enabled systems).

4. Please check Usability / Cosmetic issues (correct sentence/appropriate display/etc.) and open defect, if needed.

"Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)"

Note : USE ATS VERSION TEST MGR 3.0 (1303-53-US for US / 1303-53-JP for JP) or later for your testing

Use ATS to check the network reliability test for FTP/HTTP/Network file copy and input the average file copy speed in test report column

UR-1412DS

The Test Manager and Test Scripts are located in FTP Site as mentioned below .

URL : ftp://203.125.96.195

username : guest

password : ZXC23$

< Installer: >

/ATS/SUITE/SETUP/ <Use the latest Test Manager available in this folder>

< Scripts: > [UR-02571SG]

../ATS/SUITE/WIN-XP/SCRIPT/NETWORKRELIABILITYxxx : US Scripts

../ATS/SUITE/WIN-XP(JP)/SCRIPT/NETWORKRELIABILITY(JPxxx): JP Scripts

--/ATS/Suite/Vista(US)/64bit/Network/NETWORKRELIABILITYxxx : US Scripts for 64 bit

--/ATS/Suite/Vista(JP)/64bit/Network/NETWORKRELIABILITYxxx : JP Scripts for 64 bit

--/ATS/Suite/Vista(US)/32bit/Network/NETWORKRELIABILITYxxx : US Scripts for 32 bit

--/ATS/Suite/Vista(JP)/32bit/Network/NETWORKRELIABILITYxxx : JP Scripts for 32 bit

--/ATS/Suite/Win7(US)/64bit/Network/NETWORKRELIABILITYxxx : US Scripts for 64 bit

--/ATS/Suite/Win7(US)/32bit/Network/NETWORKRELIABILITYxxx : US Scripts for 32 bit

ATS Test Procedure:

- Copy the latest ATS suite available and the script locally in the test system to c:

- Install ATS suite using setup.exe

- Open ATS --> select Scrips --> NETWORK --> select NETWORK and Import the script from File --> Import

- Press F5 key to refresh

- Select the script --> click Run

(Select suspend/hibernation/restart operations when prompted and input the number of times as 3)

- Once the test is completed, check the log (C:AutomationLogsxxx.htm) to get the average speed of file transfer

- If any scenario has FAILED or if the average file transfer speed is very less, check the particular scenario manually before opening CMVC

Environment Setup

1. Prepare a seperate machine and install the IIS server in the machine. Disable anonymous authentication and enable basic authentication.Create a password for the user "administrator" so that the webserver can be accessed with that account. The password and username need to be enterted in the netinfo.ini file explained below.

2. In C:AutomationScripts folder, 3 txt files are provided (FtpFileList.txt, NetworkFilelist.txt and HTTP FileList). Arrange the files to be copied in the txt file as follows

a.exe

b.exe

c.iso

image.iso

image.gho

Please note that the ftpfilelist file names are case senitive based on the server used (eg Linux ftp server is case sensitive). The NetworkFileList file will contain files in the network server and the ftpFileList will contain ftp server files and the HTTPFilelist the files on the web Server

3.The Netinfo.ini file to be updated with information pertaining to the network information.

4. A sample netinfo.ini file is shown below

[FTPServer]

IPaddress=192.168.28.10

UserName=ats

Password=ats

Time=3600 (in seconds)

[NetworkServer]

IPaddress=192.168.28.10 (ip address)

FolderName=DownloadsPADD ( to map the network drive)

Username=ats

Password=ats

Time=3600 (in seconds)

[HTTP]

IPaddress=192.168.28.10 (ip address of the setup IIS web server)

UserName=administrator

Password=ats

Time=3600 (in seconds)

[PM]

Restart=2

Suspend=2

Hibernate=2

Please note that there should be no spaces after the end of each entry

5. The Files for the http server copy need to be put in the C:inetpubwwwroot directory. The ftp files in the ftp root directory and the network files in the network maped path.

6.Make sure you have admin rights to the network server and any firewall (symantec client security) is disabled

7. Make sure event viewer is removed from startup

8.Enable AC power for long periods of copy

9.Configure and close any third party application windows before running the script.

PERFORMANCE RESULTS (using ATS)

Network Configuration
Configuration
Average Speed (in Mbps)
OS
Input the average speed taken from ATS log below
Result -
FTP File Copy
Standalone/Docking
A
HTTP File Copy
Standalone/Docking
A
Network File Copy
Standalone/Docking
A

LongRun

Test Item Config
OS
Win 7
Win10 32
Win10 64
Longrun (Overnight test)
- Configure ethernet and TCP/IP protocol

- With ethernet card, download files size of 1GB for 4 hours continuously through FTP

- Copy files of 1GB size through shared network drive for more than 4 hours

-Copy files using ethernet and simulatneously send/receive fax of 10 pages for 1 hour.

Standalone

Portreplicator

Docking station

A
A
A
Shutdown/Restart [UR-00120DS)

- Connect the ethernet cable to the network ethernet port

- Shutdown and power ON manually for 5 times.

- Check that the ethernet works fine after every boot

- Also confirm that the system actually shutdown instead of restart.

Remove the ethernet cable to the network ethernet port

- Shutdown and power ON manually for 5 times.

- Check that the ethernet works fine after every boot

- Also confirm that the system actually shutdown instead of restart.

Standalone

Portreplicator

Docking station

A
A
A
Power Management

- Suspend (Fn+F4) the system x 10 times

- Confirm that the ethernet works fine after every suspend

- Hibernate(Fn+F12) the system x 10 times

- Confirm the functionality of ethernet network

- Start copying big files (>500MB)

- Press Fn+F3 x 10 times.

- Check that the file copy is not affected

Standalone

Portreplicator

Docking station

A
A
A

PERFORMANCE and RELIABILITY

No.
ITEM
Result
WIn7
WIn10 32
Win10 64
1
LL-00838PA (CMVC #hlpct_23990)

Connect to Network

Copy file size of 700MB from Network

Leave the system idel for sometime (10 minutes) after file copy is over.

Confirm that the network connectivity is still retained (use ping command to check connectivity)

Upload files of 300MB size from client to server.

Leave the system for 15minutes after the file copy is over.

Confirm that the system operation, network connectivity are not affected due to system idle condition.

A
A
A

VISTA UNIQUE FUNCTION TEST

Network Diagnostics Framework (NDF)
  • In Vista SP1, Network Diagnostics becomes more detailed. To track and repair the connectivity issue, Windows Diagnostics dialog box now has a ?Diagnose? button to provide more detailed information.

Open the Run window.

Type a non-existing server name.

Click the OK button.

Click the Diagnose button.

Expected results

SImilar kind of trials can be done for

1.Diagnose the failure when user misspells the share name

2. Correct server name but wrong share name

DHCPV6-DNS Interaction
  • In IPv6 network environment, multiple Domain Name System suffixes can be correctly covered. (This was broken without SP1.) (Example: yamato.ibm.com and ibm.com are both set and searched for IPv6 now.)

Pre-requisites or specific configuration for the scenario

DHCPV6 Stateful server joined to a domain (e.g., lhserver.com)

V6 scope configured (e.g. as 3ffe::)

Option 24 configured (e.g., as lhserver.com)

Step-by-step scenario description

Enable V6 stateful mode on the client.

Verify the output of ipconfig /all.

Note: The client should have the ipv6 address.

Verify that the configured domain (lhserver.com) appears in the DNS Suffix Search list, Connection -specific DNS suffix and Connection -specific DNS suffix search list.

From the test client machine, ping a dummy machine registered in the lhserver.com domain, e.g. ping dummy where dummy is the hostname of the dummy machine.

Note: You can verify this with the DNS packets captured using Netmon.

Expected results

The test client should try pinging it through dummy.lhserver.com and the ping request should succeed.

Single Sign on for Wired Networks
  • Single Sign On for wired network is supported and SSO can be checked in Event Viewer. (SSO for Wireless LAN was already supported.)

Scenario 1 ? SSO over Wired:

The IT department requires that all wired devices require layer2 authentication (802.1X, WPA, WPA2) to succeed prior to access to the network. The IT admin configures the network to require user name/password access for both Winlogon Credentials as well as username password for authenticated network access. The user launches/opens the LogonUI, and is prompted for a single username and password. The user enters the credentials and is sequentially authenticated to the network and then the domain. The specific hardware requirement is a network that supports 802.1x authentication. The user must have a wired sso profile applied. See the Notes section below for a sample profile.

Apply an SSO wired profile.

Logoff/ Logon.

Check event logs to ensure sso occurred.

Scenario 2 - Change Password over SSO

A user?s network logon password has expired. When the user goes to logon to the network/machine a change password screen will be invoked, and the user will be able to change his/her sso logon password. No specific hardware requirement. The user must have a wired/wireless sso profile applied. See the Notes section below ? A1 & A2 for a sample wired /wireless profile.

Ensure the user?s credentials is set to be expired.

Apply an SSO wired/wireless profile.

Logoff/Logon.

User should be prompted for a password changed for SSO credentials.

User should be able to change password successfully.

Scenario 3 - The ability to correct a wrong password entered for SSO

A user incorrectly enters his/her SSO network logon password. A screen to correct the user?s SSO password will be invoked, and the user will be given a chance to correct his/her SSO password. No specific hardware requirement. The user must have a wired/wireless sso profile applied. See the Notes section below-A1 & A2 for a sample wired /wireless profile.

Apply an SSO wired/wireless profile.

Logoff/Logon.

At the Logon screen enter the SSO password incorrectly.

The user should be prompted to correct his/her SSO password.

The user should be able to logon with the corrected SSO password.

OTHER DETAILS

EUT Quantity : One system 1. "Please check Error and Warning message in Event Viewer before you start the test case and after you complete the test case, and report it to your team lead."

2. "Perform All Test in Battery Mode (Some of the test items need to perform in AC Mode, follow each Test Case)" (All Test Activity should be performed with AMT Enabled) RESULT

Test Item
Configuration
OS
Win7/Win10
FTP File Copy
Standalone/Docking
A
FTP File Copy after PM
Standalone/Docking
A
FTP File Copy after restart
Standalone/Docking
A
HTTP File Copy after restart
Standalone/Docking
A
HTTP File Copy after PM
Standalone/Docking
A
HTTP File Copy
Standalone/Docking
A
Network File Copy
Standalone/Docking
A
Network File Copy after PM
Standalone/Docking
A
Network File Copy after restart
Standalone/Docking
A

TEMS Reviewer Log:
Review Logs
Keywords:   None
Requirements :   None
Attached files :

Update History:
Modified last: 2015-12-14 17:01:44.117, by Yoshihiro Amenomiya
Modified last: 2015-12-14 16:57:03.519, by Yoshihiro Amenomiya