all AI news
[D] Shrink or Compress data size
Sept. 28, 2022, 3:20 p.m. | /u/Beneficial_Law_5613
Machine Learning www.reddit.com
ID, type x_coorde, y_coord, velocity, ... , speed, NG1,NG2.. NG9, lane.
the format looks like a two 2D Array
[
[
[1,1,0.9832,0.55,...,1,...0],[1,1,0.9832,0.55,...,2,...0],..., [1,1,0.9832,0.55,...,3,...0] (here are 9 arrays with 31 elements)
],
[...],...[...] (39 million)
]
in total, I have 39 million arrays, each containing 9 arrays with 31 elements.
When I try to load this dataset into the GPU to train I have CUDA out of memory RuntimeError. My question is:
Is there any …
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Senior Marketing Data Analyst
@ Amazon.com | Amsterdam, North Holland, NLD
Senior Data Analyst
@ MoneyLion | Kuala Lumpur, Kuala Lumpur, Malaysia
Data Management Specialist - Office of the CDO - Chase- Associate
@ JPMorgan Chase & Co. | LONDON, LONDON, United Kingdom
BI Data Analyst
@ Nedbank | Johannesburg, ZA
Head of Data Science and Artificial Intelligence (m/f/d)
@ Project A Ventures | Munich, Germany
Senior Data Scientist - GenAI
@ Roche | Hyderabad RSS