Skip to content

MultiPruneEnsemble: Integrating Multi-Base Decision Tree Prunings via Gradient-Based Weighting

· 0 citations · 34 references

TL;DR

A new framework, MultiPruneEnsemble, is proposed, which integrates the diversity of pruning with the flexibility of gradient-based optimization, and indicates that integrating multiple decision tree pruning by gradient-based weighting is a feasible way to improve the accuracy and robustness of learning.

View source

Similar papers

#artificial intelligence Preprint Aug 2026

Adaptive Multi-Branching for Shallow Decision Tree Induction

This work proposes the Multi-Branch Neural Decision Tree with Adaptive Pruning (MBNDT), a single axis-aligned tree trained end-to-end with differentiable multi-way splits that achieves the best average rank and mean balanced accuracy among depth-constrained single-tree baselines.

H. Park, Jeonghoon Choi, Juseong Kim et al. · 0 citations
#machine learning Preprint Oct 2026

MotherTree: Meta-learning on synthetic data improves decision tree training

Conventional decision tree algorithms produce effective, transparent models that can be audited, communicated, and deployed independently of the training data, but require learning every new task from scratch. In contrast, tabular foundation models demonstrate that meta-learning from a synthetic prior distribution enab...

Zi-Yu Wang, Fredrik D. Johansson · 0 citations
#artificial intelligence Preprint Aug 2026

EvoRank: LLM-Guided Evolution of Multi-Objective Learning-to-Rank Pipelines

EvoRank is presented, an open autonomous ranking engineer: an LLM-guided evolutionary loop that discovers complete Learning-to-Rank pipelines (features, models, losses, ensembles) for multi-objective e-commerce search and is released as a headroom gate that predicts, before any LLM spend, whether the loop will pay off.

Rayhan Patel, S. Patel · 0 citations
#artificial intelligence Preprint Oct 2026

Rethinking Self-Distillation for Multi-Teacher Capability Merging

Combining capabilities of multiple expert models trained starting from the same base checkpoint has become increasingly common in frontier language-model post-training. Recent trends suggest that multi-teacher on-policy distillation (MOPD) outperforms conventional off-policy methods. However, despite the higher inferen...

Roy Xie, Dan Friedman, Feng Nan et al. · 0 citations
Preprint Aug 2026

DICS: Data-Informed Centroid Splitting for Decision Tree Classifiers

Data-Informed Centroid Splitting (DICS), a clustering-based framework that constructs a compact and informative set of candidate splits using data-driven priors, significantly reduces the split search space for classification tasks while preserving predictive performance.

Saifur Rahman Mazumder, Feng Yu · 0 citations
Aug 2026

Weighted Optimal Classification Forests

WOCFs complement existing methods such as CART (Classification and Regression Trees), optimal classification trees, random forests and XGBoost and provide nontrivial improvement in interpretability and usability of the trained model in terms of counterfactual explanation.

Víctor Blanco, Alberto Japón, Justo Puerto et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.