---
title: 'CHIS: Consumer Health Info Search'
url: https://www.emergentmind.com/topics/chis
type: topic
---

# CHIS: Consumer Health Info Search

to=arxiv_search.search  全民彩票  彩神争霸是 code 在天天中彩票json
{"query":"arXiv:1612.08178 OR \"Consumer Health Information Search\" CHIS FIRE 2016", "max_results": 5, "sort_by": "relevance"}Japgolly
to=arxiv_search.search  鼎丰 code িটিরjson
{"query":"\"Consumer Health Information Search\" FIRE 2016", "max_results": 10, "sort_by": "relevance"}
CHIS, or **Consumer Health Information Search**, denotes a search and sentence-classification setting in which health-related queries are answered not by a single factoid response but by identifying relevant textual evidence and its stance with respect to the query. In the FIRE 2016 shared task, CHIS was operationalized as a two-stage problem: sentence-level relevance classification followed by stance classification over the relevant sentences. The setting reflects the fact that consumer health queries often admit multiple, sometimes contradictory perspectives, such as whether a treatment is safe or whether a vaccine causes autism [1612.08178].

## 1. Conceptual scope of CHIS

CHIS differs from standard factoid retrieval because the target information space is intrinsically heterogeneous. Consumer health queries may retrieve documents containing mutually inconsistent claims, and the task is therefore not exhausted by topical matching alone. The system must identify which sentences are useful for answering the query and, among those, whether the sentence **supports**, **opposes**, or is **neutral** with respect to the claim expressed in the query [1612.08178].

The FIRE 2016 formulation makes this distinction explicit. The motivating example query, “Are e-cigarettes safer than normal cigarettes?”, can be associated with sentences that are topically relevant yet differ in stance. A sentence stating that e-cigarettes “have been deemed to be safer” is treated as **Relevant, Support**, whereas a sentence stating that they “could increase the likelihood it would get deposited in the lung” is **Relevant, Oppose**. By contrast, a sentence such as “nicotine amounts in e-cigarettes can vary significantly” is **Irrelevant, Neutral** in the task definition. This setup situates CHIS at the intersection of information retrieval, sentence-level relevance modeling, and stance analysis [1612.08178].

A plausible implication is that CHIS requires models that can separate topicality from argumentative orientation. The paper repeatedly indicates that lexical evidence alone is often adequate for relevance, whereas stance is structurally harder because support and opposition may be expressed implicitly rather than through overt sentiment markers.

## 2. FIRE 2016 shared-task formulation

The shared task comprised two subtasks. **Task 1** required classifying each sentence associated with a query as **Relevant** or **Irrelevant**. **Task 2** required further classifying the relevant sentences as **Support**, **Oppose**, or **Neutral** [1612.08178].

The granularity was sentence-level throughout. Each sentence was paired with its query, and the first-stage output determined whether the sentence was useful for answering that query. The second stage operated on the relevant sentences and assigned a stance label. This decomposition is significant because it encodes an ordered dependency: stance is meaningful only after relevance has been established.

The task design also exposes an important methodological issue discussed by the authors. They later note that Task 2 should have been treated as a **2-class problem** over relevant sentences—**support** versus **oppose**—but they instead modeled it as a **3-class problem** including **neutral**. Since **neutral** in the training data was effectively associated with irrelevant sentences, this design choice degraded performance. This is one of the clearest task-definition lessons in the paper [1612.08178].

## 3. Dataset structure and experimental setting

The organizers provided training and test data in an Excel-file format. The training set contained **5 queries** and **348** total sentences, while the test set used the same **5 queries** with **1542** unlabeled sentences [1612.08178].

The training queries were:

- `does_sun_exposure_cause_skin_cancer` — **68 sentences**
- `e-cigarettes` — **83 sentences**
- `HRT_cause_cancer` — **61 sentences**
- `MMR_vaccine_lead_to_autism` — **71 sentences**
- `vitamin_C_common_cold` — **65 sentences**

The test queries had the following sentence counts:

- `does_sun_exposure_cause_skin_cancer` — **342 sentences**
- `e-cigarettes` — **414 sentences**
- `HRT_cause_cancer` — **260 sentences**
- `MMR_vaccine_lead_to_autism` — **279 sentences**
- `vitamin_C_common_cold` — **247 sentences**

Because there was no separate development set, parameter tuning was performed by splitting the training data into **60% train** and **40% test** for internal tuning. This choice is important for interpreting the results, since the dataset was small and the absence of a dedicated validation set constrained model selection and error analysis [1612.08178].

The paper’s experimental design therefore represents an early shared-task configuration with limited supervision, sentence-level labels, and a relatively small set of topic instances. This suggests that reported results should be read as evidence about feature design and task framing rather than as definitive upper bounds for CHIS.

## 4. Task 1: relevance classification methodology

For Task 1, the system used **Support Vector Machines (SVMs)** implemented with **scikit-learn’s SVC**, with each query-sentence pair represented by **five handcrafted features** [1612.08178].

The first feature was **Exact Matching**, computed by comparing query and sentence word-by-word and scoring common-word overlap with the normalized similarity

\[
\text{Similarity} = \frac{2 \times (\text{No. of Common Words})}{(\text{No. of words in query}) + (\text{No. of words in sentence})}.
\]

The second feature was **Stemmed Word Matching**. Both query and sentence were stemmed using a Python stemming tool, and the same similarity equation was applied after stemming. The stated purpose was to reduce morphological variation and capture matches such as *mangoes* to *mango* and *highly* to *high*.

The third feature was **Noun Matching**. The authors observed that nouns often strongly influence relevance. They extracted nouns from the query, checked how many of those nouns appeared exactly in the sentence, and computed a query-focused overlap over nouns. The fourth feature was **Neighborhood Matching**, a heuristic semantic-expansion procedure. For each sentence word, the system searched a **self-made Wikipedia dictionary**, extracted the first three sentences of its Wikipedia definition, and matched query words against those definitional sentences. When matches occurred, they were treated as semantic matches and folded into the same similarity calculation [1612.08178].

The fifth feature was **Cosine similarity** over TF-IDF vectors. The paper defined

\[
\text{IDF}(t) = \log\left(\frac{N}{DF}\right)
\]

where \(N\) is the total number of sentences and \(DF\) is the number of sentences containing term \(t\), and

\[
\text{TF}(t) = \frac{\text{Number of times word } t \text{ appears in a sentence}}{\text{Total number of words in the sentence}}.
\]

The query and sentence were vectorized and compared using cosine similarity. The classifier used `SVC` with internally tuned parameters \(C = 10^7\), \(\gamma = 0.006\), and kernel = `poly` [1612.08178].

This feature set is strongly lexical, but it also contains two targeted attempts to move beyond literal overlap: noun-centric matching and Wikipedia-based neighborhood matching. The paper explicitly attributes much of Task 1 performance to these two features.

## 5. Task 2: stance classification methodology

Task 2 was applied after Task 1 and used a distinct representation: **\(N + 4\) features**, where \(N\) is the number of distinct unigrams in the training data [1612.08178]. The representation therefore combined a unigram TF-IDF bag-of-words model with four additional sentence-level features.

The four additional features were: **Number of Positive Words**, **Number of Negative Words**, **Number of Neutral Words**, and a binary feature indicating **Relevant or Irrelevant**. Positive, negative, and neutral word counts were obtained using **SentiWordNet** via Python. The remaining \(N\) features were unigram TF-IDF weights over all distinct training unigrams.

A second SVM classifier was trained over the labels **Support**, **Oppose**, and **Neutral**. Internal tuning again used a **60/40 train-validation split**, with best settings reported as \(C = 10^7\), \(\gamma = 0.005\), and kernel = `rbf` [1612.08178].

The architecture for both tasks followed the same general sequence: input query and sentences, feature extraction, vector representation, SVM classification, and output labels. However, the Task 2 formulation exposed a conceptual weakness. The paper notes that stance detection is fundamentally harder than relevance classification because support and opposition can be expressed implicitly, lexical overlap alone is insufficient, and sentiment polarity is not equivalent to stance. The use of sentiment counts and unigram features therefore provided only a weak proxy for query-conditioned stance [1612.08178].

## 6. Evaluation, results, and significance

The evaluation metric reported was **percentage accuracy**. No precision, recall, F1, or MAP values were described. Results were reported per query and averaged across queries [1612.08178].

For **Task 1**, the system achieved **73.39257557% average accuracy**, which was the **3rd highest** among the **9** participating teams. The best average accuracy in Task 1 was **78.10416314%** by **SSN_NLP**. The authors additionally note that their system performed better on **3 of the 5 queries**, even though another system had the highest overall average [1612.08178].

For **Task 2**, the system achieved **33.63514278% average accuracy**, which the authors characterize as comparatively poor. Their main explanation is the task-formulation mistake: they modeled Task 2 as a **3-class** problem instead of the appropriate **2-class support/oppose** problem over relevant sentences. They also identify other limitations: limited semantic modeling despite the Wikipedia heuristic, the lack of a separate development set, dependence on hand-engineered features, and the mismatch between sentiment-oriented features and the actual demands of stance detection [1612.08178].

In methodological terms, the work contributes an early CHIS pipeline showing that a relatively simple SVM-based system can be competitive for sentence-level relevance when paired with carefully designed lexical and semantic features. It also provides a negative result of practical importance: approaches that are adequate for relevance do not transfer straightforwardly to stance classification. The paper’s proposed future directions—adding **word sense disambiguation**, reformulating Task 2 correctly as a **2-class support/oppose problem**, and improving the system for more accurate CHIS results—reflect this diagnosis [1612.08178].

Source: https://www.emergentmind.com/topics/chis