You can bear off towards the port tacker as long as the port tacker is not attempting to duck you. (16.2 I believe) If your forcing him to tack early your ok. If your bearing off causes him to decide to duck you could be on shakey ground.