Papers
Topics
Authors
Recent
Search
2000 character limit reached

Scaling Up Influence Functions

Published 6 Dec 2021 in cs.LG, cs.CL, and cs.CV | (2112.03052v1)

Abstract: We address efficient calculation of influence functions for tracking predictions back to the training data. We propose and analyze a new approach to speeding up the inverse Hessian calculation based on Arnoldi iteration. With this improvement, we achieve, to the best of our knowledge, the first successful implementation of influence functions that scales to full-size (language and vision) Transformer models with several hundreds of millions of parameters. We evaluate our approach on image classification and sequence-to-sequence tasks with tens to a hundred of millions of training examples. Our code will be available at https://github.com/google-research/jax-influence.

Citations (80)

Summary

An In-Depth Review of the AAAI Press Formatting Instructions for Authors Using LaTeX

The paper "AAAI Press Formatting Instructions for Authors Using LaTeX A Guide" serves as a comprehensive manual for authors who wish to submit their research to AAAI Press using LaTeX. This document provides intricate details on the formatting and submission specifications required by AAAI Press to maintain uniformity across all published papers. The paper's relevance is particularly significant for researchers who intend to contribute papers for AAAI proceedings, technical reports, or working notes, necessitating adherence to stringent formatting guidelines.

The primary objective of this paper is to ensure that all submissions have a consistent appearance by providing detailed instructions on the use of the AAAI LaTeX style file (aaai21.sty) and the associated bibliography style file (aaai21.bst). These style files are designed to standardize the layout and formatting of manuscripts, which include specifics on paper size, font, margins, and the handling of figures and tables.

Key elements outlined in the document include the prohibition against altering the configuration of the provided style file, mandates against the use of non-compatible packages or commands, and essential regulations about the nature and formatting of figures and tables within the manuscript. Authors are guided to use embedded fonts in figures and ensure compatibility with PDF\LaTeX{} to facilitate the printing and electronic dissemination of documents.

Strict instructions are provided on the submission of electronic files, emphasizing the need for a fully-compliant PDF and a single .tex file for LaTeX source submission. This paper also highlights essential procedures such as the requirement to use a two-column format, specific margin settings, and conventions concerning author information formatting. Furthermore, it addresses issues of language support, such as the restriction of non-Roman alphabets to bit-mapped figures, ensuring the text remains accessible and printable across diverse platforms.

The document also rigorously detailed the expectation for the lauded AAAI copyright notice, section numbering practices, as well as citation and reference formatting using BibTeX tailored for AAAI publications. It underscores the importance of authors embedding complete metadata with their PDF files for more efficient indexing and discovery.

In terms of implications, meticulous adherence to these guidelines streamlines the production process of conference proceedings, offering practical benefits in terms of visual consistency and printability. For researchers, understanding and applying these instructions represent an essential step in ensuring their work is published without unnecessary delays due to formatting non-compliance.

Looking ahead, as the field of Artificial Intelligence advances, the integration of more sophisticated tools and technologies in manuscript preparation may become normative. However, for now, the detailed directions encapsulated in this paper remain an indispensable resource for authors committed to contributing rigorously prepared papers to AAAI venues.

This paper conveys a critical institutional procedure pivotal to the academic dissemination within the AAAI community, and thus, carries significance for all researchers aspiring to participate in this scholarly discourse.

Paper to Video (Beta)

No one has generated a video about this paper yet.

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 2 tweets with 309 likes about this paper.