Currently, this site offers material on recent budgets, and a substantial amount of information on general fiscal issues and New Zealand, such as their annual report, an overview of the country's financial and economic framework, some regulatory issues, etc.
http://www.treasury.govt.nz/