finetune llma model from huggingface ckpt

[uygnef]

Hi there,
I want to fine-tune the Llama model using Megatron. It seems that Megatron cannot load checkpoints from Hugging Face Transformers checkpoints. Does anyone know where I can download the Llama checkpoint for Megatron or any method to transfer Hugging Face checkpoints to Megatron?

### Tasks
- [ ] https://github.com/microsoft/Megatron-DeepSpeed/pull/246

[uygnef]

Hi，I made a script to transfer weight: #246