The highest IP address among the active interfaces will be used.
Look in to HSRP is you are using Cisco routers. I'm sure there are other router solutions out there. Each interface will need to be connected to the same vlan as the network it is connected to. For instance - R1 int. 1 and R2 int 1 would be on N1. R1 int2 and R2 int 2 would be on N2. There also might be a cool switch trick you could do that would monitor the interface - think spanning tree.... if it were to ever go down, then the other interface would come up. Many ways you can skin this cat.