Consistent Individualized Feature Attribution for Tree Ensembles (1802.03888v3)

Abstract: Interpreting predictions from tree ensemble methods such as gradient boosting machines and random forests is important, yet feature attribution for trees is often heuristic and not individualized for each prediction. Here we show that popular feature attribution methods are inconsistent, meaning they can lower a feature's assigned importance when the true impact of that feature actually increases. This is a fundamental problem that casts doubt on any comparison between features. To address it we turn to recent applications of game theory and develop fast exact tree solutions for SHAP (SHapley Additive exPlanation) values, which are the unique consistent and locally accurate attribution values. We then extend SHAP values to interaction effects and define SHAP interaction values. We propose a rich visualization of individualized feature attributions that improves over classic attribution summaries and partial dependence plots, and a unique "supervised" clustering (clustering based on feature attributions). We demonstrate better agreement with human intuition through a user study, exponential improvements in run time, improved clustering performance, and better identification of influential features. An implementation of our algorithm has also been merged into XGBoost and LightGBM, see http://github.com/slundberg/shap for details.

Overview of AAAI 2018 Formatting Instructions for Authors Using LaTeX

The paper "2018 Formatting Instructions for Authors Using LaTeX" serves as a comprehensive guide created by AAAI Press to standardize the submission of papers for their proceedings, working notes, and technical reports. The document primarily focuses on the LaTeX formatting guidelines that authors must follow to ensure a uniform appearance across all published papers.

Key Requirements and Restrictions

Usage of AAAI Style Files

Authors must use the 2018 AAAI Press LaTeX style file and BibTeX file included in the author kit. Any deviation from these files, such as altering spacing or font sizes, is strictly prohibited as it would compromise the document's standardized formatting.

Document Formatting

Numerous specific formatting requirements are outlined:

• PDFLaTeX must be used for compiling the document.
• Fonts must be embedded in the PDF file.
• Nonstandard fonts, especially those requiring non-Roman language support, are not allowed in the text and should be restricted to bitmapped figures.
• LaTeX 209 documents and documents using Computer Modern fonts for the text are not accepted.
• The document must be in two-column format, using US letter size.

Submission Requirements

Authors must ensure their submissions include:

• A fully-compliant PDF file.
• The LaTeX source file submitted as a single .tex file.
• Graphics files referenced within the document.
• LaTeX-generated files and nonstandard style files if applicable.

Document Compilation

All submitted source files will undergo review and recompilation on AAAI systems. This step is vital in verifying compliance with formatting guidelines and ensuring documents compile without error.

Housekeeping and Formatting Details

Preamble Setup

The document's preamble must include specific metadata and proper structuring commands for LaTeX to correctly format the title, author information, and keywords.

Figures and Graphics

Figures should be in .jpg, .png, or .pdf format, and must be cropped outside LaTeX. The use of trim and clip commands within LaTeX is not allowed. Moreover, figures must not use low-resolution formats, and all fonts in the figures must be embedded.

Font and Type Requirements

Authors must use Times Roman or Nimbus fonts for the text and stick to the prescribed font packages, avoiding type 3 fonts which are not designed for high-resolution displays and can cause issues in the publication process.

Potential Pitfalls and Common Errors

The document enumerates several common errors and forbidden commands:

• Commands like \renewcommand, \baselinestretch, and \columnsep are not permitted.
• Footnote styles, space alterations around floats and sections, and the use of unauthorized packages such as geometry, layout, and hyperref need to be strictly avoided.

Implications and Future Considerations

This rigorous set of guidelines demonstrates the importance AAAI Press places on uniformity and professionalism in their published materials. From a practical standpoint, adhering to these guidelines ensures a seamless experience for both human readers and computational processes involved in indexing and archiving. The formalization of such detailed instructions highlights the collaborative effort between authors and publishers to maintain high standards in academic publishing.

As LaTeX continues to be a preferred typesetting system in academic circles, the need for clear and comprehensive formatting guides remains pivotal. Future updates to these guidelines may focus on incorporating new LaTeX packages or addressing emerging issues in digital publishing standards.

Conclusion

The "2018 Formatting Instructions for Authors Using LaTeX" serves as a critical document for researchers submitting papers to AAAI Press. By providing explicit, stringent instructions, this guide helps streamline the submission process, ensuring consistency and quality across all published works. For experienced researchers, meticulous compliance with these guidelines is essential to facilitate a smooth and efficient publication workflow.