For multi-node clusters, how to choose between IB and RoCE?

For large-scale LLM training, prefer InfiniBand: lower latency and higher bandwidth. For small and medium clusters on a budget, Ethernet RoCE cuts hardware cost and is easier to operate.