Way to build only the server in OpenBSD?

[fluorine]

I'm wanting to run only the server on OpenBSD and then connect to that from my local network and from the outside world (through the firewall) while I'm at work. The problem is that its looking for X and I only want to build the server. Is there a way that only the server can be built without having to build a client ?

[Thue]

./configure --enable-client=no