Google posted Android 5.1 system images for Nexus handsets
As long as you have access to fastbot, you will be able to flash the system image without problems. You will also find updated binaries with the drivers needed to run ROMs on the devices you update. In order to flash a factory image, you will need an unlocked bootloader.
You can download the image for your device from the list below: