Need some help with designing my new ESXi environment.
I have a C7000 Blade enclosure with 6 GbE2c switches in bays (1+2) (5+6) (7+8). I have G8 half height blades with 2 onboard nic(mapped to switches 1+2 downlinks) and a 4 port Nic mezzanine mapped to (switches 5+6+7+8 downlinks).
I want the networking to be a redundant as possible so I have 2 lacp trunks( trk7-8) carrying 3 vlans(2,3,4) connected to switch GbE2c in bay 2 and GbE2c in bay 5. So on each blades pNic 1(onboard) and pNic 2(mezzanine) is connected to the core through the trunks. Then on the ESXi I have the two pNics teamed to a vswitch.
I hope you can follow that so far, dang hard to explain without a picture
Now the issue I see is that any inter-blade traffic that is not originating from the same GbE2c switch has to leave the enclosure and go through the core router using one of the trunks. ie.. blade 1 uses pNic 1 and blade 2 uses pNic 2 they are physically connected to seperate switches(2 and 5) on the c7000 enclosure so in order to talk to each other (vmotion) they need to go through the core.
The only other option I can see is to have the trunks connected to GbE2c switches that are side by side and enable the trunk between the two bay's (port 17-18) but then i cannot seperate the vm pNics to two seperate pieces of blade hardware (on board and mezzanine) in case of failure.
What do you guys think is the best scenario? or am i missing something (which is entirely possible)
I was looking for some examples online of setups but could not find much.
I defer to the experts.
Thanks