Purpose
The purpose of this blog is to validate the deployment and impact of changing the user’s primary SMTP address for a mailbox that is stored in Exchange Online. The test and validation tasks outlined in this document are performed using test accounts and test computers in a lab environment to simulate the services and their impact.
Lab Preparation
For the purpose of this testing scenario, there are two SMTP domains that will be used:
- CB5Lab.com
-
CBfiveback.com
For this lab configuration, the necessary DNS records have been created for both SMTP domains, CB5Lab.com and Cbfiveback.com. The configuration of these DNS records will not be covered in this document.
Results
The major takeaway is the user had to either re-enter their username and password within Outlook or create a new Outlook profile (mixed results). On the mobile device, the user had to remove their profile from the Outlook app and reconnect to their mailbox.
User Sets
For the purpose of this testing, we will be using a set of two accounts:
Lenny@CB5Lab.com – Primary test account to test and validate service scenario and their impact.
Justin@CB5Lab.com – Account used to test mail flow to/from the primary test account
Test Cases
Validation Key Color Code
Test Case Color Code Key | |
Pass – no action required by the user | |
Fail – User required to re-enter their username and/or password | |
Fail – User required to remove e-mail profile and recreate |
Outlook 2010
Test Case 001: Outlook Online Mode | |||
Explanation | Ensure the user is able to connect to their mailbox through Outlook 2010 after primary SMTP address is changed in online mode. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments from Test | When launching Outlook after SMTP change for the test account, the account was prompted for credentials. | ||
Test Results | Test Date | Result | |
8/6/2018 | Fail |
Test Case 002: Outlook Cache Mode | |||
Explanation | Ensure the user is able to connect to their mailbox through Outlook 2010 after primary SMTP address is changed in cached mode. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | When launching Outlook after SMTP change for the test account, the account was prompted for credentials. | ||
Test Results | Test Date | Result | |
8/6/2018 | Fail |
Test Case 003: Delegate (Full Mailbox Permissions) | |||
Explanation | Ensure that after the user’s SMTP address is changed, user(s) with full mailbox permissions to this account. This test is to also ensure that any permissions this account has to other mailboxes are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 004: Delegate (Folder Permissions) | |||
Explanation | Ensure that after the users SMTP address is changed, folder permissions to the test account are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 005: Send As Rights | |||
Explanation | Ensure that after a user’s SMTP address is changed that the Send-as permission(s) are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 006: Send on Behalf | |||
Explanation | Ensure that after a user’s SMTP address is changed that the Send on behalf of permission(s) are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 007: Update Calendar Entry (Another Mailbox) | |||
Explanation | Ensure any users that were able to update calendar entries prior to SMTP address change are still able to. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 008: Reply to an email sent to an internal recipient | |||
Explanation | Ensure that the users can reply to emails previously sent from internal recipients. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 009: Reply to an email sent to an external recipient | |||
Explanation | Ensure that the users can reply to emails previously sent from external recipients. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 010: Reply to an email sent from an internal sender | |||
Explanation | Ensure that users can reply to emails sent from an internal mailbox prior to SMTP address change. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 011: Reply to an email sent from an external sender | |||
Explanation | Ensure that user can reply to emails sent from an external mailbox prior to SMTP address change. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Outlook 2016
Test Case 012: Outlook Online Mode | |||
Explanation | Ensure the user is able to connect to their mailbox through Outlook 2016 after the primary SMTP address is changed in online mode. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | When launching Outlook after SMTP change for the test account, the account was prompted for their credentials | ||
Test Results | Test Date | Result | |
8/6/2018 | Fail |
Test Case 013: Outlook Cache Mode | |||
Explanation | Ensure the user is able to connect to their mailbox through Outlook 2016 after the primary SMTP address is changed in cached mode. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | When launching Outlook after SMTP change for test account, the account was prompted for their credentials | ||
Test Results | Test Date | Result | |
8/5/2018 | Fail |
Test Case 014: Delegate (Full Mailbox Permissions) | |||
Explanation | Ensure that after the users SMTP address is changed, users with full mailbox permissions to this account and permissions this account has to other mailboxes are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 015: Delegate (Folder Permissions) | |||
Explanation | Ensure that after the users SMTP address is changed, folder permissions to this account are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 016: Send As Rights | |||
Explanation | Ensure that after a user’s SMTP address is changed that the Send-as permission(s) are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments from Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Justin Kraft | Pass | |
Test Case 017: Send on Behalf | |||
Explanation | Ensure that after a user’s SMTP address is changed that the Send on behalf of permission(s) are not impacted. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 018: Update Calendar Entry (Another Mailbox) | |||
Explanation | Ensure that after a user’s SMTP address is changed they are still able to update other user’s calendar they were given access to.
Ensure that after a user’s SMTP address is changed, any user’s with the ability to update their calendar can still do so. |
||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 019: Reply to email (internal recipient) | |||
Explanation | Ensure that the user can reply to emails previously sent from internal recipients. | ||
Pre-Configuration Actions | Test account – Lenny Paxton has sent an email to Justin Kraft (internal account) prior to changing the SMTP address | ||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 020: Reply to email (external recipient) | |||
Explanation | Ensure that the user can reply to emails previously sent from external recipients. | ||
Pre-Configuration Actions | Test account – Lenny Paxton has sent an email to Justin Kraft (external account) prior to changing the SMTP address | ||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 021: Reply to email (internal sender) | |||
Explanation | Ensure that user can reply to emails sent from an internal mailbox prior to SMTP address change. | ||
Pre-Configuration Actions | Test account – Lenny Paxton has received an email sent by Justin Kraft (internal account) prior to changing the SMTP address | ||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 022: Reply to email (external sender) | |||
Explanation | Ensure that user can reply to emails sent from an external mailbox prior to SMTP address change. | ||
Pre-Configuration Actions | Test account – Lenny Paxton has received an email sent by Justin Kraft (external account) prior to changing the SMTP address | ||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
iOS Devices
Test Case 023: Outlook app | |||
Explanation | Ensure that user can connect to their mailbox through the iOS Outlook app after their SMTP address is changed | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | Outlook was not able to reconnect to the user’s mailbox. The user was prompted to remove the account and add the account to the app. | ||
Test Results | Test Date | Result | |
8/5/2018 | Fail |
Test Case 024: Native app | |||
Explanation | Ensure that user can connect to their mailbox through the iOS native mail app after their SMTP address is changed | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Android Device
Test Case 025: Outlook App | |||
Explanation | Ensure that user can connect to their mailbox through the Android Outlook app after their SMTP address is changed | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 026: Native App | |||
Explanation | Ensure that user can connect to their mailbox through the Android native mail app after their SMTP address is changed | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Supporting Services
Test Case 027: Skype for Business | |||
Explanation | Ensure that user can connect to Skype for Business client after their login has changed | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | User’s login was not transparent, the user was prompted for username and password and was then able to login. | ||
Test Results | Test Date | Result | |
8/5/2018 | Fail |
Test Case 028: OneDrive for Business | |||
Explanation | Ensure users can access their OneDrive for Business after their UPN is updated. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | User account was prompted to re-enter credentials to sync OneDrive for Business folder. | ||
Test Results | Test Date | Result | |
4/8/2016 | Fail |
Test Case 029: Outlook Add-ins | |||
Explanation | Ensure Outlook add-ins work after the user’s SMTP address has been changed. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 030: Outlook Web App (OWA) | |||
Explanation | Ensure user is able to access their mailbox through OWA after their primary SMTP address has been changed. | ||
Pre-Configuration Actions | |||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |
Test Case 031: Outlook Web App (OWA) Offline Mode | |||
Explanation | Ensure that user can access their mailbox in offline mode after their SMTP address has been changed. | ||
Pre-Configuration Actions |
|
||
Test Actions |
|
||
Comments for Test | |||
Test Results | Test Date | Result | |
8/5/2018 | Pass |