TLP: A Deep Learning-based Cost Model for Tensor Program Tuning. (arXiv:2211.03578v2 [cs.LG] UPDATED)

Tensor program tuning is a non-convex objective optimization problem, to
which search-based approaches have proven to be effective. At the core of the
search-based approaches lies the design of the cost model. Though deep
learning-based cost models perform significantly better than other methods,
they still fall short and suffer from the following problems. First, their
feature extraction heavily relies on expert-level domain knowledge in hardware
architectures. Even so, the extracted features are often unsatisfactory and
require separate considerations for CPUs …

arxiv cost deep learning tensor