LARF: Two-level Attention-based Random Forests with a Mixture of Contamination Models. (arXiv:2210.05168v1 [cs.LG])

New models of the attention-based random forests called LARF (Leaf
Attention-based Random Forest) are proposed. The first idea behind the models
is to introduce a two-level attention, where one of the levels is the "leaf"
attention and the attention mechanism is applied to every leaf of trees. The
second level is the tree attention depending on the "leaf" attention. The
second idea is to replace the softmax operation in the attention with the
weighted sum of the softmax operations with …

arxiv attention random random forests