Nutanix – Redeploying nodes with Foundation

Problem

I recently deployed a Nutanix cluster which was a combination of old and new 3000 series nodes. Setup of the new machines went according to plan, however I found the old servers were reporting incorrect block IDs and/or positions.

For those who aren’t familiar with 3000 series systems, the product is Nutanix badged SuperMicro hardware, 4 servers in 2U of rack space. Each chassis has 4 slots (A-D).

Photo: 3000 series nodes

Solution

To fix the issue you need to update the factor settings on the Controller VM (CVM). Here are the steps:

  1. Document your node locations, double and triple check.
  2. Step two varies based on your hypervisor. In my case I was configuring an ESXi cluster so I needed to Foundation before I could expand the cluster.
  3. Run a scan in Foundation. Cross reference this with your doco from step 1.
  4. If it doesn’t match, edit the “factory_config.json” file which is found in “/etc/nutanix/” directory on each node. This assumes you’ve already configured your IPMI or have direct access to the physical equipment.
  5. Update the “rackable_unit_serial:”, “node_position:” or both to match your layout. Caution! Json files are particular… Don’t screw up the formatting.
  6. Restart the Genesis service by typing “genesis restart” at the $ prompt.
  7. Re-run Foundation. Nodes should now correspond to the desired layout.

Good luck.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s