Need help in understanding time and GPU memory required for finetuning a LLM

I want to fine tune, models like llama-70b, code Alpaca or Starcoder for my use case. I actually have a dataset of 10,000 dockerfiles and want to finetune a model on this dataset.

What can be the expected time needed for this kind of training and what GPU should I use? Also, will the requirements differ for just using the model than training?

Ps: I am very new to the world of deep learning, LLMs and GPUs. Any help would …

alpaca case code dataset deeplearning finetuning gpu kind llama llm memory starcoder training understanding