Leveling up Training: NVTabular and PyTorch Lightning

Training a wide and deep recommender model on MovieLens 25M

NVTabular is a feature engineering framework designed to work with NVIDIA Merlin. It can process large datasets typical in production recommender setups. I tried to work with NVIDIA Merlin on free instances, but the recommended approach seems to be the only way forward. But I still wanted to use NVTabular since the value of using the GPU for data engineering and data loading is very attractive. In this post, …

deep learning machine learning nvidia pytorch pytorch lightning recommendation-system training