To use RDP with port, open Remote Desktop Connection on Windows and enter the IP address followed by the port number (for example, 192.168.1.1:3389). This allows connection through a specific port instead of the default. Make sure the port is enabled in the firewall and correctly configured on the remote system for secure and successful access.