[D] Setting up a small HPC for orchestrating a small teams AI research

I am wanting to know the communities opinions and experiences on setting up a HPC (single machine with loads of compute) to be used for AI/CV/LLM research in a small team. Essentially, setting up the HPC so that multiple users can store datasets on slow storage, auto-magically transfer the datasets to fast storage for training and remove when done, select 1->N GPUs (allowing for multiple users to train at a time or one for a big job) and prevent the …

ai research auto communities compute datasets hpc llm llm research machine machinelearning multiple opinions research small storage team teams