SpeechCLIP: Integrating Speech with Pre-Trained Vision and Language Model (2210.00705v2)

Abstract: Data-driven speech processing models usually perform well with a large amount of text supervision, but collecting transcribed speech data is costly. Therefore, we propose SpeechCLIP, a novel framework bridging speech and text through images to enhance speech models without transcriptions. We leverage state-of-the-art pre-trained HuBERT and CLIP, aligning them via paired images and spoken captions with minimal fine-tuning. SpeechCLIP outperforms prior state-of-the-art on image-speech retrieval and performs zero-shot speech-text retrieval without direct supervision from transcriptions. Moreover, SpeechCLIP can directly retrieve semantically related keywords from speech.

Overview of "Author Guidelines for Blind SLT 2022 Manuscripts"

This document provides a comprehensive guide for authors preparing blind submissions for the SLT 2022 conference. It details the formatting and submission requirements necessary to ensure consistency and anonymity throughout the review process, which is fundamental in maintaining a fair and unbiased evaluation framework. By adhering to these standards, authors can contribute to a robust peer review mechanism.

Formatting Specifications

The paper outlines explicit formatting guidelines to be followed, including the use of a two-column layout with specified margins and spacing. The importance of uniformity in typeface and font size is emphasized to ensure readability and aesthetic coherence across the proceedings. Authors are advised to utilize Times-Roman font to achieve high-quality print and electronic rendering. The prescribed maximum length for the abstract and the illustrated sectioning style (using capitalized major headings and structured subheadings) ensure a logical flow and ease of navigation through the content.

Blind Review Process

A crucial element of this document is the blind review requirement, which necessitates the omission of authors' names and affiliations in the initial submission. This measure is designed to mitigate biases and uphold the integrity of the peer review process. Additionally, authors are instructed to refer to their previous work in the third person and remove acknowledgments until the final, camera-ready version is submitted post-acceptance.

Technical Instructions and Layout

Precise dimensions for print areas, column widths, and inter-column spacing are provided to facilitate the proper preparation of manuscripts. To enhance visual appeal and clarity, the guidelines recommend positioning figures and illustrations strategically within the designated margins and assigning clear labels and captions. The guidance also includes tips on balancing column lengths using specific LaTeX commands for enhanced document presentation.

Reference Management

The guidelines specify the use of numbered referencing, either alphabetically or by order of appearance, with citations in the text enclosed in square brackets. An additional reference page is permitted, provided it strictly contains prior literature citations without extending the main content.

Footnotes and Pagination

Minimal use of footnotes is encouraged, emphasizing clarity and conciseness in primary text. The document also unequivocally states that authors should refrain from paginating their manuscripts, as session identifiers and page numbers will be appended during the compilation of conference proceedings.

Implications and Future Considerations

Adhering to these guidelines ensures authors present their scholarly work in a manner that meets academic standards and facilitates the peer review process. These precise formatting and anonymity requirements are integral to maintaining high academic integrity and the impartial assessment of submissions. As the field of AI and machine learning evolves, the continual refinement of submission guidelines will play a pivotal role in preserving the quality and credibility of academic exchanges at conferences like SLT. Looking forward, such structured documentation might increasingly incorporate technological solutions to further streamline and automate adherence to formatting standards.