all AI news
[D] How to reduce the Keras prediction time
Jan. 13, 2022, 3:17 p.m. | /u/Fun-Moose-3841
Machine Learning www.reddit.com
Hi,
I found out that my trained model requires about 40~60ms to make a prediction. Is there a way to speed this up? The input to the model consists of two floats and the output is one integer value. I also tried with use_multiprocessing flag in the predict function, but it didn't improve the performance. I am loading the trained model as below:
loaded_model = keras.models.load_model("/my_path") loaded_model.predict(dnn_input ,use_multiprocessing=True,batch_size=1)
Below the summary of the trained model:
Model: "sequential_1" _________________________________________________________________ …!-->
More from www.reddit.com / Machine Learning
Jobs in AI, ML, Big Data
Senior ML Researcher - 3D Geometry Processing | 3D Shape Generation | 3D Mesh Data
@ Promaton | Europe
Data Scientist, Senior
@ Pacific Gas and Electric Company | Oakland, CA, US, 94612
AML Reporting Data Specialist
@ Wise | Tallinn, Estonia
Bachelorarbeit im Bereich IT - "Einsatz von Generative AI im Konzernumfeld" (WiSe 24/25)
@ AGCO | Marktoberdorf, DE
Big Data Engineer
@ ACL Technology | Argentina
REF25217Q-Deputy Manager - MIS (Power BI, Dashboard, Excel) - GGN
@ WNS Global Services | Gurgaon, India