Backups Cloud Technology Troubleshooting Veeam

Veeam Enterprise Manager 9.5 Update 4 Login error with vCloud Director Org user

Summary

Login errors in Veeam Enterprise Manager after updating to version 9.5 update 4 are caused by a bug in mentioned version when vCloud organizations have any uppercase character. This is resolved replacing DLL with name Veeam.Backup.VcdLib.dll with the one provided by Veeam Support.
Bug will be fixed on release 9.5 update 5.

Symptoms

After updating Veeam Backup and Replication server and Veeam Enterprise Manager to latest version 9.5 update 4 logins in Enterprise Manager portal returns error when using vCloud Director organization user and password.

Error trying to login using vCloud Director Organization users

On Veeam Enterprise Manager server log shown below file you can see these error messages below ‘C:\ProgramData\Veeam\Backup\Svc.VeeamBES.log’

====Errors with original DLL file and with uppercase Org names====

[13.05.2019 13:14:02] <41> Info     Logon as new vCloud user [bur]. Session [s1]
[13.05.2019 13:14:02] <41> Info     Looking for configuration data for organization [VeeamTest]
[13.05.2019 13:14:03] <41> Info     Looking for backup server for configuration [fa7231a3-324c-4e98-9b47-b256502e6030]
[13.05.2019 13:14:03] <41> Error    Failed to authenticate user (System.Security.Authentication.InvalidCredentialException)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.Enterprise.Core.CAuthorizationManager.CreateUserContextForVcd(CVcdOrgSessionStartupInfo startupInfo, CEnterpriseDb emDb, CVbSrvSessionCache sessionCache, CEnterpriseLicenseStore licStore)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.EnterpriseService.CVCloudPortalClientSession..ctor(Guid sessionId, CSessionName sessionName, CEnterpriseRegistryOptions options, CEnterpriseSvcManagers svcMngrs, CVcdOrgSessionStartupInfo startupInfo)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.EnterpriseServices.CReportingService.OpenVcdSession(CVcdOrgSessionStartupInfo startupInfo, CSessionReConnectInfo sessionInfo)
[13.05.2019 13:14:03] <41> Error    Error opening session. User: []
[13.05.2019 13:14:03] <41> Error    Failed to authenticate user (System.Security.Authentication.InvalidCredentialException)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.Enterprise.Core.CAuthorizationManager.CreateUserContextForVcd(CVcdOrgSessionStartupInfo startupInfo, CEnterpriseDb emDb, CVbSrvSessionCache sessionCache, CEnterpriseLicenseStore licStore)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.EnterpriseService.CVCloudPortalClientSession..ctor(Guid sessionId, CSessionName sessionName, CEnterpriseRegistryOptions options, CEnterpriseSvcManagers svcMngrs, CVcdOrgSessionStartupInfo startupInfo)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.EnterpriseServices.CReportingService.OpenVcdSession(CVcdOrgSessionStartupInfo startupInfo, CSessionReConnectInfo sessionInfo)
[13.05.2019 13:14:03] <41> Error       at Veeam.Backup.EnterpriseServices.CEnterpriseWebService.OpenVcdSession(CVcdOrgSessionStartupInfo startupInfo, CSessionReConnectInfo sessionInfo)
====Working with lower case original DLL====

[15.05.2019 13:45:00] <03> Info     Logon as new vCloud user [bur]. Session [s31]
[15.05.2019 13:45:00] <03> Info     Looking for configuration data for organization [veeamtest]
[15.05.2019 13:45:00] <03> Info     Looking for backup server for configuration [7c4ca789-1b67-463f-9903-4f62727babf5]
[15.05.2019 13:45:15] <15> Info     [LicenseReport] Watermark report task started. Current state:
[15.05.2019 13:45:15] <15> Info     [LicenseReport] Watermark state: WatermarkDueDate = 1/01/0001 12:00:00 a.m.; WatermarkFailureCount = 0; WatermarkFirstFailDate = 1/01/0001 12:00:00 a.m.; AdjustLastDate = 1/05/2019 11:03:24 p.m.; ForceAdjustTimeOffset = 00:00:00; AdjustLastFailTime = 1/01/0001 12:00:00 a.m.; FirstReportDate = 9/07/2017 5:01:29 p.m.; 13/05/2019 1:07:42 a.m. = 13/05/2019 1:07:42 a.m.; LastOfflineReportDate = 13/05/2019 1:07:41 a.m.; 
[15.05.2019 13:45:16] <15> Info     [LicenseReport] Received reply: Status: "Ok" Data: "
====After replacing DLL file and login works====

[16.05.2019 07:16:31] <16> Info     Logon as new vCloud user [bur]. Session [s36]
[16.05.2019 07:16:31] <16> Info     Looking for configuration data for organization [VeeamTest]
[16.05.2019 07:16:31] <16> Info     Looking for backup server for configuration [fa7231a3-324c-4e98-9b47-b256502e6030]
[16.05.2019 07:16:36] <33> Info     Looking for configuration data for organization [VeeamTest]

Workaround

1- Ensure jobs are not running in Veeam Backup and Replication server
2- Stop Veeam Backup Service
3- Open C:\Program Files\Veeam\Backup and Replication\Backup
4- Rename existing Veeam.Backup.VcdLib.dll to Veeam.Backup.VcdLib.dll.old
5- Paste new DLL file into the folder
6- Start Veeam Backup Service
7- Test logins in Veeam Enterprise Manager

Download file here

Disclaimer

Above procedure content is based in our labs and DLL file was provided by Veeam Support.
Veeam users should contact Veeam support for this solution and to get the DLL file for this fix but if you decide to play around use under your own risk.

Baking Clouds is sharing this workaround with intention to inform the community of existing errors on technologies.