[KB6502] No RDP connection after ESET Server Security product installation (8.x–9.x)

Issue

Details


Click to expand
 

After an ESET Server Security product installation (for example, ESET Server Security for Microsoft Windows Server), there is no longer a working RDP connection. This is due to the Base Filtering Engine (BFE) service not starting. It happens on systems that run on virtualization platforms (such as QEMU or OpenStack) while using Red Hat VirtIO Ethernet Adapter that has Receive Segment Coalescing (RSC) enabled.

ESET server security product's Web access protection module does not support RSC. While running Windows Server OS on a virtual machine, Windows will automatically disable the RSC on a network adapter if RSC is unsupported. However, there is an issue with VirtIO driver where Windows tries to disable the RSC on VirtIO adapter but with no success. Therefore, the BFE service will not start, which prevents RDP connection.


Solution

To prevent issues with VirtIO driver, RSC, and BFE service, there are three solutions. Choose the solution you prefer and perform the modifications as indicated below:

Disable RSC manually using adapter properties

  1. On the hosted Windows Server OS, navigate to Network Connections, open Ethernet Adapter properties and disable RSC for both IPv4 and iPv6

  2. After you have manually disabled RSC on the network adapter, you must restart the machine for the changes to take effect.


Disable RSC manually using the command line

  1. Refer to the following TechNet article: Disable-NetAdapterRSC.

  2. After you have manually disabled RSC on the network adapter, you must restart the machine for the changes to take effect.


Disable RSC manually using registry modification

  1. Open registry editor and search for VirtioAdapter in: 

    HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Control\Class{4d36e972-e325-11ce-bfc1-08002be10318}\

  2. Set *RscIPv4 and *RscIPv6 to 0.

  3. After you have manually disabled RSC on the network adapter, restart the machine for the changes to take effect.


Change the network adapter device

Refer to your virtualization system documentation on how to change the network adapter type. Here is an example of how to change the ethernet interface in OpenStack: Changing the VM's ethernet interface from VirtIO to e1000.


Remove the Web and email component

  1. On the hosted Windows Server OS, navigate to Programs and Features, right-click your ESET server security product and click Change.

  2. After the Modify, Repair or Remove installation window appears, click Modify, select Web and email component and then select Entire feature will be unavailable.

  3. Click Modify.

  4. You will be asked to restart the machine. Click Yes.

Chat with ESET AI Advisor for support