If your partner stays in New Zealand, and you both plan to stay together in one country, rather than living miles apart, you can apply for a New Zealand Spouse Visa in that case. As per New Zealand Immigration two people of opposite gender or same gender eligible for a spouse visa to New Zealand if they have:
If you are planning to apply for a spouse visa then you need to qualify the following set of eligibility criteria regarding the same to the immigration officer:
You can check for the requirements as they tend to vary from temporary to permanent resident visas. Make sure you are checking it for New Zealand Spouse Visa.