Sept. 28, 2022, 3:20 p.m. | /u/Beneficial_Law_5613

Machine Learning www.reddit.com

I have the following data structure:
ID, type x_coorde, y_coord, velocity, ... , speed, NG1,NG2.. NG9, lane.
the format looks like a two 2D Array

[
 [
  [1,1,0.9832,0.55,...,1,...0],[1,1,0.9832,0.55,...,2,...0],..., [1,1,0.9832,0.55,...,3,...0] (here are 9 arrays with 31 elements)
 ],
 [...],...[...] (39 million)
]
in total, I have 39 million arrays, each containing 9 arrays with 31 elements.
When I try to load this dataset into the GPU to train I have CUDA out of memory RuntimeError. My question is:
Is there any …

data machinelearning

Senior Marketing Data Analyst

@ Amazon.com | Amsterdam, North Holland, NLD

Senior Data Analyst

@ MoneyLion | Kuala Lumpur, Kuala Lumpur, Malaysia

Data Management Specialist - Office of the CDO - Chase- Associate

@ JPMorgan Chase & Co. | LONDON, LONDON, United Kingdom

BI Data Analyst

@ Nedbank | Johannesburg, ZA

Head of Data Science and Artificial Intelligence (m/f/d)

@ Project A Ventures | Munich, Germany

Senior Data Scientist - GenAI

@ Roche | Hyderabad RSS