MetaHOPE: Dual Frameworks in Pathology & MT
- MetaHOPE is a cross-domain term identifying two unrelated artifacts: an image-based MET overexpression predictor and a metaphor translation evaluation framework.
- In computational pathology, MetaHOPE employs a weakly supervised, attention-based multiple instance learning model validated with diverse hold-out and temporal data.
- In machine translation, MetaHOPE adapts a severity-aware HOPE framework to quantify and diagnose metaphor translation errors with refined annotation metrics.
Searching arXiv for MetaHOPE and closely related records to ground the article in the cited preprints. Tool unavailable in this environment. Proceeding with the supplied arXiv metadata and ids (Ingale et al., 2023) and (Liang et al., 1 Jul 2026), which are explicitly provided in the source block. MetaHOPE is the name of two unrelated research artifacts on a weakly supervised, attention-based multiple instance learning model for predicting MET RNA overexpression from hematoxylin and eosin whole-slide images in non-small cell lung adenocarcinoma, introduced in "Prediction of MET Overexpression in Non-Small Cell Lung Adenocarcinomas from Hematoxylin and Eosin Images" (Ingale et al., 2023), and a metaphor-oriented, error severity-aware annotation framework for evaluating machine translation and LLM metaphor translation, introduced in "MetaHOPE: A Metaphor-Oriented Evaluation Framework for Analysing MT and LLM Translation Errors" (Liang et al., 1 Jul 2026). The shared name does not denote a unified methodology. In current usage, it identifies distinct systems in computational pathology and machine translation, so technical discussion requires explicit domain disambiguation.
1. Scope and disambiguation
A common misconception is to treat MetaHOPE as a single framework with transferable assumptions across domains. The available arXiv usage indicates the opposite: the pathology MetaHOPE is a predictive model operating on digitized histology, whereas the translation MetaHOPE is an annotation and evaluation framework operating on metaphor-bearing text segments. This suggests that the name functions as a cross-domain homonym rather than a single research program.
| MetaHOPE usage | Domain | Core function |
|---|---|---|
| MET RNA overexpression predictor | Computational pathology | Weakly supervised, attention-based predictor from H&E whole-slide images |
| Metaphor translation evaluation framework | MT and LLM evaluation | Severity-aware annotation of metaphor translation errors |
The distinction is substantive. In the pathology setting, MetaHOPE is optimized against a binary label derived from RNA-seq. In the translation setting, MetaHOPE organizes human error annotation, severity scoring, and post-editing workflows. Any comparison between the two therefore operates only at the level of nomenclature, not architecture, objective function, or evaluation protocol.
2. MetaHOPE in computational pathology
In lung adenocarcinoma, the pathology MetaHOPE addresses prediction of MET overexpression from routinely available H&E slides, motivated by the fact that MET protein overexpression is a targetable event in NSCLC and that validated testing such as standardized immunohistochemistry assessment may be inaccessible or consume valuable tissue for a single gene or protein assay (Ingale et al., 2023). The model was trained using a large database of matched H&E slides and RNA expression data to predict MET RNA overexpression directly from H&E images.
The development cohort comprised 1,367 H&E-stained whole-slide images from NSCLC adenocarcinoma patients, all scanned on a Philips UFS scanner. Manual quality control removed cytology specimens, slides with fewer than 100 viable tumor cells, and grossly out-of-focus images; overall fewer than 2% of slides were excluded. To enrich the positive class, cases were subsampled so that approximately half of the development set in cross-validation were MET overexpressors. Independent hold-out evaluation used three datasets: a Philips test set of 589 WSIs, including 300 MET-positive and 289 MET-negative cases; an Aperio test set of 519 WSIs, including 250 MET-positive and 269 MET-negative cases; and a temporal generalization set of 4,331 WSIs collected 6 to 16 months later, stained internally or at external labs, and scanned on both Philips and Aperio systems.
MET overexpression was defined from RNA-seq and copy-number data. RNA-seq quantified MET transcripts in TPM, while DNA copy number variants were called by panel-based NGS and summarized as a segment-length-weighted average copy number. Cases were designated amplified if weighted copy number was at least 5 and wild-type if copy number equaled 2. Comparing these two groups, a threshold of 8 yielded 92% sensitivity and 80% specificity for DNA amplification. The final binary label was
For some experiments, a continuous soft label was also defined:
This design situates MetaHOPE as an image-based surrogate for a transcriptomic endpoint. A plausible implication is that the model is intended primarily for prescreening and triage rather than as a replacement for confirmatory molecular testing.
3. Learning pipeline for MET overexpression prediction
The preprocessing workflow begins with low-resolution tissue segmentation using a U-Net model following Ronneberger et al. From tissue regions, non-overlapping pixel tiles were extracted at three magnifications: , , and . Tiles overlapping pathologist-drawn annotations such as ink or markers were removed using a second U-Net trained to recognize slide markers. All slides were ICC-profile-mapped to standard sRGB space to reduce inter-scanner and stain variability prior to inference. No additional stain normalization such as Macenko was applied during training, and no geometric augmentations such as flips or rotations were reported. Synthetic color perturbations in brightness, contrast, hue, and saturation were reserved for robustness evaluation.
The model itself is an attention-based multiple instance learning architecture following Ilse et al. A ResNet-18 backbone, pre-initialized on a histopathology classification task, serves as the feature extractor . Its last convolutional block produces a 512-dimensional embedding for each tile . Attention pooling then computes an unnormalized attention score using a small multilayer perceptron,
0
where 1 and 2, with hidden attention dimension typically 3. The normalized attention weights are
4
These weights define the slide-level representation
5
and the slide probability
6
where 7, 8 is a bias term, and 9 is the sigmoid function. Training minimizes slide-level binary cross-entropy,
0
with L2 weight decay of 1 on all parameters.
Model selection used 5-fold patient-level cross-validation with three folds for training, one fold for early stopping or epoch selection, and one fold for validation. Hyperparameters, including learning rate 2 and weight decay 3, were chosen via grid search on the model-selection fold. Final training reshuffled the development cohort into an approximately 80% training set and 20% model-selection set. Optimization used Adam with constant learning rate 4 and weight decay 5. Early stopping halted training when validation ROC-AUC on the model-selection set failed to improve for five consecutive epochs, with typical total training lasting 20 to 30 epochs. Each batch consisted of one slide containing all of its tiles, and gradient updates were performed per bag. Best performance was achieved at 6 magnification, and the key reproducible setting reported as best performing was tile size 7 pixels at 8 magnification (Ingale et al., 2023).
4. Validation, explainability, and clinical positioning
On the Philips hold-out test set of 589 WSIs at an operating point targeting 80% sensitivity, the model achieved ROC-AUC 9 with 95th-percentile interval 0 to 1, average precision 2 with 95th-percentile interval 3 to 4, sensitivity 5 with interval 6 to 7, specificity 8 with interval 9 to 0, positive predictive value 1 with interval 2 to 3, and 4 with interval 5 to 6 (Ingale et al., 2023). In cross-validation, mean ROC-AUC was 7 with 95th-percentile interval 8 to 9, and the correlation between predicted probability and 0 was Pearson 1 with 2. Magnification mattered: 3 outperformed 4 and 5 with AUC 6 to 7 and 8 and 9, respectively.
Generalization analyses were extensive. On the Aperio hold-out set, ROC-AUC was 0 with 95% confidence interval 1 to 2, PR-AUC was 3 with interval 4 to 5, sensitivity was 55%, and specificity was 74%. In cross-validation, training only on Philips slides and evaluating on Aperio reduced AUC from 6 to 7 with 8. In the temporal set, collected 6 to 16 months later across internal and external staining sites and both scanners, AUCs remained stable at approximately 9 for Philips and approximately 0 to 1 for Aperio, with overlapping 95% intervals. Robustness testing applied synthetic perturbations in brightness, contrast, hue, and saturation at ten increasing levels; ROC-AUC and PR-AUC remained within 2 points of unperturbed performance through level 5, and operating-point metrics remained stable through level 5 but degraded thereafter.
Subgroup analyses indicated that large resections achieved AUC 3 whereas core biopsies achieved AUC 4, with 5. By contrast, smoking status, gender, race, and stage showed no statistically significant AUC differences. Specificity to MET was examined by repurposing the predictor to “predict” EGFR, KRAS, BRAF, or TP53 mutations; the resulting AUCs were approximately 6 to 7, with all DeLong comparisons against the MET AUC yielding 8. This supports the interpretation that the learned signal is not a generic oncogenic classifier.
Explainability analyses were centered on attention behavior. The top 10% of tiles by attention score were overlaid on whole-slide images to generate attention heatmaps. A separate tile classifier assigned tiles to six classes—tumor, stroma, epithelium, necrosis, immune, and artifact—and high-attention tiles were 9 tumor versus 0 tumor in the overall tile set, with Wilcoxon 1. UMAP projection of the 512-dimensional ResNet embeddings showed that high-attention tiles co-localized with tumor clusters. Example high-attention regions were densely cellular and pleomorphic tumor areas, whereas low-attention tiles were frequently stroma, necrosis, or artifact.
The stated clinical role is prescreening. A rapid H&E-based predictor could triage cases for confirmatory MET testing by immunohistochemistry or RNA-seq, thereby conserving tissue and laboratory resources. Because the continuous model score correlates with RNA expression, the score could also stratify likely responders once a therapy-defined RNA cutoff is known. The reported limitations are equally explicit: training used a single institution’s data; broader multi-site validation is required; geometric and stain augmentations during training may further improve robustness; and prospective and interventional studies are needed to determine clinical utility and effects on patient care pathways.
5. MetaHOPE in metaphor translation evaluation
In machine translation and natural language processing, MetaHOPE denotes an annotation framework rather than a predictive model. It was proposed as an error severity-aware framework for evaluating metaphor translation because metaphorical expressions exhibit semantic complexity, contextual dependency, and cultural embeddings that can generate ambiguity for NLP models (Liang et al., 1 Jul 2026). General-purpose MT systems may produce overly literal renderings of metaphor-laden multi-word expressions, idioms, or novel metaphors, with consequent loss or distortion of intended meaning. Existing evaluation benchmarks often rely on broad sentence-level metrics such as BLEU, COMET, and MQM or on coarse-grained error taxonomies; the stated motivation for MetaHOPE is that these do not capture the finer nuances of metaphor translation failures.
MetaHOPE adapts the lightweight, severity-based HOPE framework into a metaphor-oriented annotation scheme. Its objectives are to operationalize cognitively motivated concerns in metaphor translation into measurable annotation categories, quantify both frequency and severity of metaphor translation errors, compare GoogleMT, GPT5.4, and Hunyuan-7B on English-Chinese and Chinese-English metaphor translation, and produce human post-edited references and a new parallel resource for future metaphor-sensitive MT research.
The annotation scheme preserves HOPE’s five-level severity taxonomy—minor, medium, major, severe, critical—but replaces the exponential penalty weights 2 with the linear scale 3 to reduce sparsity and inter-annotator disagreement. Errors are categorized into five metaphor-relevant types. IMP denotes structural or emphasis shifts that alter communicative force, such as voice changes or word-order inversion. RAM, or Required Adaptation Missing, denotes failure to render the source metaphor into an appropriate cultural or idiomatic equivalent. MIS denotes loss or distortion of metaphorical meaning through literal rendering. STL denotes attenuation of rhetorical or emotional intensity. PRF denotes fluency or naturalness issues that do not directly affect meaning. Annotators assign each error instance a type 4 and a severity weight 5.
The associated scoring model is additive at the segment level. Let 6 index metaphor-containing segments and 7 the set of errors in segment 8. Then the segment-level penalty is
9
For a test set of 0 segments, the average segment penalty is
1
The framework also distinguishes full-sentence from metaphor-level penalties:
2
The metaphor-error ratio is
3
and error-type distributions are
4
This formalization makes severity central rather than incidental: error mass, not merely error count, becomes the principal analytic unit.
6. Corpora, empirical behavior, and projected research use
The framework was instantiated using two monolingual, word-level metaphor-annotated corpora. The VU Amsterdam Metaphor Corpus English news subset, annotated via MIPVU, contains 565 metaphor-related words across 200 metaphor-containing sentences. The PSU Chinese Metaphor Corpus news subset, also MIPVU-based, contains 368 metaphor-related words across 200 sentences (Liang et al., 1 Jul 2026). Preprocessing retained only metaphorically tagged nouns, verbs, adjectives, and adverbs; translation was performed at document level to preserve context and then segmented into sentences; and metaphor-related words were aligned manually using semantic rather than strictly lexical alignment so that paraphrase, implicitation, and omission could be captured. For each translation direction, 200 metaphor-bearing sentences were sampled for full test annotation, with a pilot of 20 sentences per direction.
Three systems were evaluated: Google Translate as a proprietary NMT endpoint, GPT5.4 via the OpenAI API using the same few-shot prompt for fairness, and Hunyuan-7B with the Hugging Face default translation prompt. All systems received full-document inputs. Two trained annotators independently applied MetaHOPE guidelines and also produced human post-edited references. Agreement was measured using Krippendorff’s 5, quadratic-weighted Cohen’s 6 with severity treated as ordered 7, Pearson’s 8, and exact match rate.
On the pilot set, agreement on segment-level summed penalties was highest for GPT5.4, with 9, weighted 00, Pearson 01, and exact agreement 02. GoogleMT yielded 03, weighted 04, Pearson 05, and exact agreement 06. Hunyuan-7B showed the lowest consistency, with 07, weighted 08, Pearson 09, and exact agreement 10. The interpretation given is that Hunyuan-7B’s freer paraphrasing and occasional hallucinations increased subjectivity.
Annotator A’s pilot error distributions indicated that GoogleMT accumulated sentence-level penalty 11, average 12 per sentence, with metaphor-level penalty 13 and ratio 14; GPT5.4 accumulated 15, average 16, with 17 and ratio 18; and Hunyuan accumulated 19, average 20, with 21 and ratio 22. By category, GoogleMT had MIS 23 and PRF 24; GPT5.4 had IMP 25, MIS 26, and PRF 27; Hunyuan had IMP 28 and MIS 29. The reported interpretation is that more than 90% of GoogleMT and GPT5.4 penalty mass derived from metaphor errors, whereas Hunyuan-7B exhibited a broader error profile, including factual hallucination in addition to metaphor mistranslation.
Qualitative findings differentiated the systems further. GoogleMT and GPT5.4 tended toward preserving source-word order and literalness, described as “rigid tracking,” which often produced Required Adaptation Missing or Mistranslation outcomes. Hunyuan-7B more often generated native-style paraphrases and sometimes better idiomatic equivalents, but at the cost of added or omitted content. The analysis also observed inconsistencies within a single MT system when translating recurring metaphors across sentences, suggesting unstable metaphor handling.
The broader significance of the translation MetaHOPE lies in its attempt to bridge cognitive metaphor theory and empirical MT evaluation. Its five categories correspond to conceptual mapping, cultural remapping, stylistic force, communicative impact, and surface fluency, thereby enabling targeted diagnostics rather than a single monolithic quality score. The stated future directions are scaling to a full test corpus with refined guidelines to improve 30 and 31, extending to other domains and languages, investigating semi-automatic or LLM-assisted annotation, and incorporating MetaHOPE into MT training loops or evaluation metrics. A plausible implication is that the framework is designed not only for post hoc analysis but also for future integration into metaphor-sensitive optimization and benchmarking workflows.