usage: https://github.com/CarperAI/trlx/blob/3396bf118869cd823b6909e082caf3810d8989e0/examples/nemo_ilql_inference.py

edit above file and below config to have num_nodes = 2 and devices = 8

python trlx/examples/nemo_ilql_inference.py trlx/configs/nemo_configs/megatron_65b.yaml "/path/to/checkpoints"