[vLLM] Update to the latest upstream code (#217) #659

Job	Run time
megatron-data / unit-test	1m 14s
flagscale-./ / unit-test	23s
flagscale-launcher / unit-test	36s
megatron-./ / unit-test	1m 19s
megatron-dist_checkpointing / unit-test	7m 7s
megatron-distributed / unit-test	1m 30s
megatron-fusions / unit-test	50s
megatron-inference / unit-test	1m 31s
megatron-models / unit-test	1m 40s
megatron-pipeline_parallel / unit-test	1m 13s
megatron-tensor_parallel / unit-test	2m 6s
megatron-transformer / unit-test	1m 24s
megatron-transformer/moe / unit-test	13m 31s
train-mixtral / functional-test	7m 56s
train-aquila / functional-test	4m 21s
hetero_train-aquila / functional-test	3m 14s
flagscale-coverage-test	0s
megatron-coverage-test	0s
	49m 55s

Provide feedback