Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

iTechGuides is reader-supported. When you buy through links on our site, we may earn an affiliate commission. As an Amazon Associate I earn from qualifying purchases. Learn more

A secure GPU server exposes only the services its documented role requires, keeps out-of-band management off public networks, authenticates every administrator with strong (preferably phishing-resistant) controls, patches the full hardware-to-software stack, and repeatedly verifies that the approved design still matches reality. There is no universal “GPU server port list”: an inference endpoint, DGX appliance, Kubernetes worker, storage node, and shared HPC node have different flows.

Use the server’s role to define its security boundary

Start with the workload and architecture, not with a copied list of port numbers. Record each listening service, the interface on which it listens, its owner, its intended client, and why the connection is necessary. The resulting inventory is the source for firewall rules and for later validation.

Server role Typical security questions What must be documented
Inference or API host Which client networks may call the endpoint? Is administration separated from API traffic? API listener, health checks, load-balancer path, management sources and egress needs
GPU compute or HPC node Which scheduler, login, storage and fabric flows are required? Is the node shared between users? Scheduler and fabric dependencies, storage paths, job isolation and sanitization procedure
Kubernetes worker Which control-plane, overlay, registry and observability connections are required? Cluster-specific ports, node-to-control-plane scope, image-registry access and administrative path
Storage or data-service node Which GPU hosts may reach storage, and is storage traffic on its own segment? Client allowlist, replication flows, backup path and management interface
Appliance such as a DGX system Which model guide applies, and where is its BMC connected? Model-specific management, firmware and service requirements from the current vendor guide

NIST SP 800-223 (February 2024) and CISA guidance both support purpose-specific segmentation and restricted management access. They do not define one port allowlist that fits every GPU deployment. Draw specific ports from the vendor deployment documentation and your approved local architecture.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

1. Inventory and minimize exposed ports

Build an authoritative listener inventory

  1. On each host, list listening TCP and UDP sockets and the owning processes. On Linux, an example is ss -tulpn; use the equivalent approved tooling on other operating systems.
  2. Map every listener to an approved service, owner, client network and business purpose. Mark anything that cannot be explained for investigation.
  3. Record the bound interface. A service listening only on a private interface has a different exposure than one bound to every interface.
  4. Compare the host inventory with load-balancer, security-group, router and firewall configurations. A closed perimeter rule is not a reason to leave an unnecessary daemon running.

Remove unnecessary and insecure services

Disable services that are not part of the documented role. CISA specifically calls out plaintext or obsolete services such as Telnet, FTP and unneeded HTTP services. Replace them with protected alternatives where the workload requires file transfer or administration. Remove default demonstration endpoints and unused management plugins, then reboot or restart as needed and verify that the listener is gone.

#1 Best Overall
Yubico - Security Key C NFC - Basic Compatibility - Multi-Factor authentication (MFA) Security Key and passkey, Connect via USB-C or NFC, FIDO Certified
  • POWERFUL SECURITY KEY: The Security Key C NFC is the essential physical passkey for protecting your digital life from phishing attacks. It ensures only you can access your accounts.
  • WORKS WITH 1000+ ACCOUNTS: Compatible with Google, Microsoft, and Apple. A single Security Key C NFC secures 100 of your favorite accounts, including email, password managers, and more.
  • FAST & CONVENIENT LOGIN: Plug in your Security Key C NFC via USB-C and tap it, or tap it against your phone (NFC) to authenticate. No batteries, no internet connection, and no extra fees required.
  • TRUSTED PASSKEY TECHNOLOGY: Uses the latest passkey standards (FIDO2/WebAuthn & FIDO U2F) but does not support One-Time Passwords. For complex needs, check out the YubiKey 5 Series.
  • BUILT TO LAST: Made from tough, waterproof, and crush-resistant materials. Manufactured in Sweden and programmed in the USA with the highest security standards.

Scope firewall rules narrowly

  • Permit only the required destination port, protocol and source network.
  • Restrict administration to approved management hosts or a management VPN rather than an entire corporate or internet address range.
  • Separate user-facing, storage, management and high-performance-compute flows when the architecture permits.
  • Log denied traffic at a useful level so unexpected connection attempts can be investigated without overwhelming the logging system.

Scan the reachable boundary

Run an authenticated host check where possible and an external or perimeter scan from the same networks an attacker or untrusted tenant could reach. Confirm that observed listeners match the approved inventory. Repeat after firewall changes, software installations and role changes. CISA recommends restricting device management to trusted devices and networks, using segmentation and reviewing exposure over time.

2. Isolate the management plane

Put the BMC on a dedicated network

The baseboard management controller (BMC) is an independent control path with powerful capabilities such as console access, power control and firmware operations. Treat it as a management-plane interface, not as ordinary application traffic.

For DGX H100/H200 systems, NVIDIA’s user guide (last updated January 26, 2026) states: “NVIDIA recommends that you connect the BMC port in the DGX H100/H200 system to a dedicated management network with firewall protection.” The guide also recommends an isolated secure method, such as a VPN server, for required remote access. NVIDIA’s DGX B300 guide (last updated October 5, 2026) gives the corresponding dedicated-network and firewall recommendation for that platform. Apply model-specific details only after checking the current guide for the exact system.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Control who can reach management interfaces

  1. Place BMC addresses in a management VLAN or physically separate management network.
  2. Allow connections only from designated administration workstations, jump hosts or a secured VPN termination point.
  3. Block direct internet exposure and prevent general user or tenant networks from routing to the BMC.
  4. Use separate credentials and logging for BMC administration; do not reuse an operating-system administrator password.
  5. Review management firewall rules and routing whenever administrators, sites or remote-access methods change.

NIST SP 800-223 explains that multiple physical networks are highly recommended for access control and fault tolerance in HPC environments. Purpose-specific private networks limit which nodes connect to each network and make traffic easier to monitor.

3. Harden administrator authentication

Use individual, least-privilege accounts

Give each administrator a named account, not a shared “admin” identity. Grant only the privileges required for the person’s role, separate routine operations from emergency root or equivalent access, and review membership on a defined schedule. Remove accounts promptly when staff, contractors or projects no longer need access.

Rank #2
Sale
Thetis Nano-A FIDO2 Security Key Hardware Passkey Device with USB Type A, TOTP/HOTP, FIDO2.0 Two Factor Authentication 2FA MFA, Works with Windows/mac/iOS/Android/Linux/Gmail/Facebook/GitHub/Coinbase
  • Ultra-Compact FIDO2 Security Key - Plug-and-stay or carry on a keychain. This USB-A hardware security key offers portable, always-on protection for desktop and mobile use. (Item Size: 0.75 X 0.74 IN x 0.25 IN)
  • USB-A Hardware Key for All Devices - Works with USB-A ports on PC, Mac, Android, and other laptop/notebook device. Enables secure, cross-platform login with FIDO2.0 passkey support.
  • FIDO Certified Security Key - Meets FIDO and FIDO2 standards. Works with Google, Microsoft, GitHub, Dropbox, and more. Please check service compatibility before purchase.
  • Passwordless Login with Passkey - Supports passkey login via WebAuthn and CTAP2. Enjoy password-free sign-ins where supported. Not all websites or services currently support passkeys.
  • Advanced Multi-Factor Authentication - Offers 200 FIDO2 passkey slots and 50 OATH-TOTP slots. Strong, flexible 2FA/MFA support across various apps and authentication platforms.

Require phishing-resistant MFA

Where the identity provider and access path support it, require multi-factor authentication and prefer a phishing-resistant secondary verification method. CISA gives hardware-based PKI and FIDO authentication as examples. A FIDO2 security key can be part of that design, but it does not protect an exposed service and cannot substitute for segmentation, patching or least privilege.

Before selecting a method, verify compatibility among the server’s login stack, identity provider, administrator workstation and remote-access gateway. Test recovery procedures, replacement keys and break-glass access without weakening the normal policy.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Protect administrative protocols and keys

  • Use encrypted administration protocols and disable plaintext remote logins.
  • For public-key administration, protect private keys with hardware-backed storage or an approved agent and enforce a passphrase or equivalent control.
  • Limit which source addresses may initiate administrative sessions.
  • Record successful and failed logins, privilege elevation and BMC actions, then send logs to a protected central system.

4. Patch the complete GPU platform stack

“The server is patched” is incomplete if it covers only the operating system. Track and update the operating system, BMC and platform firmware, GPU drivers, GPU management tools, container runtime, orchestration agents, inference or scheduler services and other installed software.

Operate a controlled update cycle

  1. Maintain an asset-to-version inventory for each host, GPU, BMC and critical package.
  2. Subscribe to vendor security advisories and identify whether an issue affects the exact hardware model, driver branch or software edition you run.
  3. Prioritize internet-reachable and management components, then vulnerabilities with active exploitation or severe impact.
  4. Test updates on a representative node or maintenance pool. Confirm driver, firmware, container and scheduler compatibility before broad deployment.
  5. Schedule a maintenance window, back up required configuration, apply the update and record the resulting versions.
  6. Run health checks, workload smoke tests and port scans after the change. Keep a rollback path for failed firmware or driver updates.

CISA recommends keeping systems and software current and automating updates where feasible with vendor-provided mechanisms. NVIDIA directs customers to its product-security bulletins for driver and software-package updates and mitigations. NVIDIA announced that, from October 1, 2026, its PSIRT would publish bulletins on GitHub in Markdown, CSAF and CVE formats while continuing to make bulletins available through its product-security website. That publication arrangement is time-sensitive; verify the current notification and bulletin process when maintaining your program.

5. Design network zones and egress deliberately

Separate management, user-facing services, storage and high-performance-compute traffic according to the workload. A practical zone model might include a restricted management network, a service or API zone, a storage network and an HPC fabric; the exact topology depends on the platform.

Rank #3
FIDO2 U2F Security Key Passkey Two-Factor Authentication (2FA) USB Key PIN+Touch (Non-Biometric) USB-A Type TrustKey T110
  • Security Key : Protect your online accounts against unauthorized access by using FIDO2 and U2F authentication with T110. It's the world's most protective security key that works with windows, Mac OS, Linux as well as Chrome, Firefox, Edge and many other major browsers.
  • Certified with the new FIDO2 standard, T110 provides the benefit of fast login and strong protection against phishing, account takeover as well as many other online attactks.
  • Works with : Bank of America, Github, Google, Microsoft, DUO, Twitter, Facebook, Dropbox, Apple, ebay, BINANCE, mor and more.
  • Fits USB-A port : Insert the T110 security key into the USB-A port of each service and log in conveniently with one touch
  • For the driver download and user guide, please visit TrustKey Solutions Home support page.
  • Allow only documented flows between zones, with source and destination restrictions.
  • Keep inbound management on the management path; do not expose SSH, BMC or orchestration administration on a public interface.
  • Restrict egress for hosts that do not need general internet access. Permit only required repositories, registries, telemetry endpoints or update services.
  • Review proxy and NAT designs. NIST notes that they can enable downloads or sharing but also introduce security risks that require mitigation.
  • Require a documented owner and expiry or review date for temporary firewall exceptions.

After every network change, test from each trust zone: an approved client should succeed, while an unapproved source should be denied and logged.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

6. Add controls for shared GPU and HPC nodes

Sanitize between jobs or tenants

Multi-tenant GPU nodes can retain data or state after a job ends. NIST SP 800-223 lists a sanitization approach that can include an end-of-job health check, removing or rebooting unhealthy nodes, working with vendors on GPU sanitization hooks, resetting GPUs to remove residual data, validating firmware, rebooting the operating system and checking critical files.

Define which steps are mandatory for each sensitivity level and measure their effect on utilization. NIST cautions that sanitization must be balanced against utilization; skipping it silently is not an acceptable optimization. If a platform cannot reliably reset or sanitize a device, place workloads with compatible trust requirements on that node or use dedicated hardware.

Separate tenant traffic

Use scheduler policy, network zoning and storage permissions together. A job should receive only the devices, files, service endpoints and network paths it needs. Do not treat a scheduler boundary alone as proof that tenants cannot reach one another.

Distinguish retirement deletion from routine hygiene

NVIDIA’s DGX guides describe secure SSD deletion procedures for system retirement or data-destruction requirements. Those procedures address media disposal; they do not replace routine patching, access control, network isolation or between-job GPU sanitization.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.
Rank #4
Sale
Thetis Nano-C for Business - USB C FIDO2 Security Key L1 MFA & Passkey Access for School ERP, Employee Online Account, Compatible with Coinbase Google Workspace Apple ID Window Salesfore - 2 Pack
  • FIDO2 & Passkey Ready: Business-ready and FIDO2 L1 certified. This key is supported by major management suites and is ideal for both individual and enterprise deployment. Works seamlessly with Gmail, Facebook, GitHub, Dropbox, Coinbase, and more.
  • Dedicated Manager App: Use the Thetis Manager App for the initial hardware PIN setup. Setting the PIN on the device first ensures a smooth registration process. Once the PIN is configured, you can begin registering the key across your favorite FIDO2-compatible online services.
  • USB TYPE C Connectivity & DONGLE Design: Designed for PCs, Macs, laptops, iPhones, and Android devices that utilize a USB-C port. Plug and stay, or carry it on a keychain. (Item Size: 0.73 x 0.60 x 0.30 inches)
  • Enhanced MFA (FIDO2 & TOTP/HOTP): Strengthen your security with flexible options. Use the Manager App to access TOTP/HOTP features for accounts that do not yet support FIDO2.
  • Check FIDO2 compatibility before purchase - Known limitations: ID Austria is not supported (requires FIDO2 Level 2). Windows Hello login only works with Windows Enterprise editions that support Entra ID. NFC functionality is not supported.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

7. Make validation recurring

Cadence or trigger Validation activity Evidence to retain
At deployment and role change Approve service inventory, interfaces, zones, firewall rules and administrator access. Architecture diagram, port matrix, owner and change record
After every patch or installation Check versions, service health, listeners, firewall behavior and workload compatibility. Update log, scan results and test outcome
Regularly scheduled review Rescan reachable boundaries, review denied traffic, reconcile accounts and remove stale rules. Scan report, access review and exception decisions
After an alert or suspected compromise Restrict access, preserve logs, compare listeners and versions with the baseline, and rebuild or rotate credentials as required. Incident timeline, containment actions and recovery approval

Use the same approved inventory for firewall review, vulnerability management and incident response. Drift—such as a newly installed service, a BMC moved to a routable network or an expired temporary rule—is itself a security finding.

Choose controls by deployment context

Decision axis Questions to answer Security consequence
Workload role and required flows Is the host serving users, running scheduled jobs, storing data or joining a cluster? Determines the legitimate listeners and firewall paths.
Dedicated out-of-band management Does the platform provide a BMC, and is it on an isolated network? Determines whether power and firmware control can be separated from production traffic.
Single-tenant or shared node Can unrelated users or projects run jobs on the same GPU? Determines the need for sanitization, stronger zoning and tenant-aware policy.
Identity-provider capability Can the login and remote-access stack enforce phishing-resistant MFA? Determines the strongest practical administrator authentication and recovery design.
Vendor advisory support Are firmware, drivers and software covered by timely, actionable bulletins? Determines how quickly and reliably the stack can be patched.

Use the exact hardware guide and current security advisories for platform-specific decisions. NIST SP 800-123 (July 2008) remains useful as foundational server-security framing, but it is not a substitute for current operating-system, GPU, firmware and vendor guidance.

When a check fails

An unexpected port is listening

Identify the owning process, determine whether it belongs to the approved role, and restrict or stop it if it is unnecessary. If it is required, bind it to the correct interface, narrow the firewall source range and add it to the inventory before reopening access.

Administrators cannot reach the BMC

Verify the management VLAN, routing and VPN path first. Do not solve the problem by publishing the BMC to the internet. Confirm that the source workstation is in the approved management set and that the BMC firmware and account policy are current.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

A driver or firmware update breaks workloads

Take the node out of service, preserve the update and health-check results, use the tested rollback or recovery procedure, and validate driver, container and scheduler compatibility on a maintenance node before retrying.

A shared node fails sanitization

Stop scheduling new tenants to it, quarantine or reboot it according to the approved procedure, inspect firmware and critical files, and return it to service only after the required health and reset checks pass.

Administrator sign-off checklist

  • Every listener has an owner, purpose, interface and approved client.
  • Unused services and plaintext protocols are disabled.
  • Perimeter scans match the approved inventory; denied traffic is logged.
  • BMC and other out-of-band interfaces use a dedicated, firewall-protected management path.
  • Administrative access uses individual least-privilege accounts and phishing-resistant MFA where supported.
  • Operating system, firmware, drivers, GPU tools, containers and services are in the patch inventory.
  • Management, service, storage and compute traffic are zoned with only necessary flows.
  • Egress and temporary firewall exceptions have explicit owners and review dates.
  • Shared nodes have a documented, utilization-aware sanitization procedure.
  • Recurring scans, access reviews, advisory monitoring and post-change tests are scheduled.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.