Yes, you can do this provided you know the IP address for the server where you are hosted. This information can be found within your control panel.
Our IP addresses do not change that often and so, if you are more comfortable with this solution, you can simply add an A record on your DNS server which points to our server IP.