Research notes
Glossary
Quick definitions for terms used across the papers and notes.
Glossary
Quick definitions for terms used above and in the papers.
- MCAR / MAR / MNAR
- Missing Completely At Random (the gap is unrelated to anything), Missing At Random (related only to observed values), Missing Not At Random (related to the missing value itself). The emergency dataset is largely MCAR, which makes imputation harder to exploit but fairer to evaluate.
- Class imbalance
- Some labels appear far more often than others. A model can score high overall while being useless on the rare classes — hence macro-averaged metrics.
- Fidelity (synthetic data)
- How well synthetic data reproduces the real data’s distributions and the relationships between columns.
- Membership-inference / privacy risk
- Whether an attacker can tell that a specific real record was in the training set — the main privacy test for a generative model.
- Embedding
- A learned vector representation of something discrete (a word, a category) so that similar items sit near each other.
- Latent space
- The compressed internal representation a model works in — e.g. an autoencoder’s bottleneck, or a GAN’s noise input.
- Epoch / batch
- One epoch is a full pass over the training data; a batch is the small chunk processed before each weight update.
- Overfitting / regularisation
- Overfitting is learning the training set’s noise instead of its signal; regularisation (dropout, weight decay, early stopping) is any technique that discourages it.
- Mode collapse
- A GAN failure where the generator produces only a narrow slice of the real variety.
- Coverage ratio
- In this work, the fraction of the actions that should have been recommended for a case that actually appear somewhere in the model’s ranked lists.
References: missing-data taxonomy — Rubin, “Inference and missing data,” Biometrika 63(3), 1976; membership inference — Shokri et al., IEEE S&P 2017, arXiv:1610.05820; mode collapse — Salimans et al., NeurIPS 2016, arXiv:1606.03498; embedding / latent space / epoch / regularisation — Goodfellow, Bengio & Courville, Deep Learning (2016); coverage ratio — my TeleNotArzt paper, doi:10.5220/0014481000004052.