all AI news
How to Load model.tar.gz from S3 for Fine-Tuning with SageMaker Training Jobs
May 3, 2023, 6:35 a.m. | Atsushi Suzuki
DEV Community dev.to
Having previously conducted pre-training for a Tabular BERT model with SageMaker Training Jobs, I proceeded to create a job for fine-tuning using the model.tar.gz
file from the pre-training results.
Although the job is fundamentally similar to the pre-training process, certain adjustments were required in the following aspects, which I have compiled as a memo:
- Extracting the tar file
- Switching arguments between local environment and SageMaker using environment variables
Extracting the tar file
The pre-training job has saved the model.tar.gz
file …
aws beginners bert deeplearning fine-tuning job jobs pre-training process python sagemaker tabular training
More from dev.to / DEV Community
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Data Scientist
@ Motive | India - Remote
Senior Perception Engineer
@ NVIDIA | US, CA, Santa Clara
Business Data Analyst, Finance and Treasury Data Repositories, Senior Associate
@ State Street | Krakow, Poland
Junior AI Engineer (Internship)
@ Sony | SEU - Italy - Roma
Manager, Data Science 3
@ PayPal | USA - Pennsylvania - Virtual