Karim Aly, Alexei Sharpanskykh, Jacco Hoekstra
7 min
Extreme events in air transport, such as severe arrival delays and abnormal air times, cause cascading network disruptions with substantial operational, economic, and safety costs. Such events are rare in historical records, leaving insufficient training signal for machine learning models. Synthetic data augmentation offers a principled solution, but conventional generative models under-represent distributional tails and give no guarantee against operationally infeasible instances, such as a short air time paired with a long flight distance. No existing approach addresses both limitations for mixed-type tabular records. We propose TailBooster, a dual-layer generative framework combining generative modelling with two anomaly detection layers. A statistical layer extracts extremes via the interquartile range, supplying tail-concentrated training signal to dedicated generative models, here a Tabular Variational Autoencoder. A deep learning layer then applies autoencoder-based cleaning, discarding synthetic records that violate the operational envelope learned from historical data. The framework was evaluated on US flight records across five dimensions: diversity, statistical similarity, fidelity, operational validity, and utility, the latter two being the primary improvement targets. Data-driven cleaning markedly improved operational validity, while targeted augmentation enhanced utility for extreme-event prediction. Across six regression algorithms, training on the framework's records reduced Mean Absolute Error by 47-49% on extreme air time and 29-57% on extreme arrival delay prediction relative to conventional synthetic data, with comparable gains when real records were enriched with synthetic extremes. Being fully data-driven and model-agnostic, TailBooster extends to domains where extreme-event prediction is critical and domain-specific rules are unavailable.
Extreme operational events in air transport, such as severe arrival delays and abnormal air times, are rare in historical records. This data scarcity leaves machine learning models with insufficient training signals to learn distributional tails accurately, leading to poor predictions where it matters most. Furthermore, standard generative models for tabular data often produce operationally infeasible instances—such as a short air time paired with a long flight distance—because they prioritize high-density regions and lack mechanisms to enforce domain constraints. No existing generative framework simultaneously targets tail under-representation and enforces operational validity for mixed-type tabular records.
This paper proposes TailBooster, a dual-layer generative framework that brackets a Tabular Variational Autoencoder (TVAE) with two anomaly detection layers. First, a statistical layer uses the interquartile range to isolate extreme subsets for designated target features, supplying a tail-concentrated training signal to dedicated TVAE models trained on both the full dataset and individual extreme subsets. Second, after synthetic records are generated and filtered for valid origin-destination airport pairs, a deep learning layer applies pre-trained autoencoders to discard samples falling outside the empirical operational envelope learned from historical data. This data-driven cleaning ensures operational feasibility without requiring hand-crafted symbolic rules.
The framework was evaluated on U.S. domestic flight records across five dimensions: diversity, statistical similarity, fidelity, operational validity, and regression utility. Data-driven cleaning markedly improved operational validity, while targeted augmentation enhanced utility for extreme-event prediction. Across six regression algorithms spanning three distinct families, training on the framework's synthetic records reduced Mean Absolute Error by 47% to 49% for extreme air time and 29% to 57% for extreme arrival delay prediction compared to conventional synthetic data. Comparable performance gains were observed when real records were enriched with synthetic extremes.
TailBooster provides a fully data-driven, model-agnostic solution for extreme value augmentation in domains where rare events carry high operational, economic, and safety costs. By addressing both tail under-representation and operational invalidity in mixed-type tabular data, it benefits both practitioners with access to historical records—through data enrichment—and those without, by enabling the generation of high-quality, operationally valid substitute datasets.
Alex: So it is not just generating more data—it is generating data that actually respects how planes behave in the real world.
Sam: That is the core idea. And when they tested it, training on these checked, extreme-enriched records reduced prediction error by roughly half on extreme air times compared to using conventional synthetic data.
Alex: That is a meaningful improvement. But how do they know the system isn't just memorizing individual real flights and spitting them back out?
Sam: The paper checks this carefully. They measure how far synthetic records sit from their nearest real counterparts, and compare that to how far real records typically sit from each other. If the model had memorized the training data, synthetic records would cluster suspiciously close to real ones. Instead, all three of their cleaned synthetic datasets showed the generated records were, on average, more spread out from the real data than real records were from each other—a sign of genuine generalization.
Alex: And were there any cases where a synthetic record was too close to a real one?
Sam: For the extreme subsets, none fell below the memorization threshold. In the larger base dataset, only fourteen records out of nearly sixty thousand were flagged, and thirteen of those differed by just a few minutes in their time values—a pattern consistent with the model learning a general pattern rather than copying. The single true duplicate was traced to one very common route appearing repeatedly in the training history.
Alex: So the pipeline is producing new, plausible flights rather than replaying its training history. Did that better coverage actually translate into more accurate predictions when things go wrong?
Sam: It did. They tested six different prediction algorithms on the extreme subsets. For severe arrival delays, training on the augmented data reduced prediction error by roughly thirty to fifty-seven percent depending on the model. The fact that the improvement held across all six algorithms matters—it tells you the gains come from the richer data, not from any one particular prediction method being a good fit.
Alex: So the data enrichment is doing the heavy lifting, not a clever choice of algorithm.
Sam: Precisely. And when you visualize it, the difference is clear. Conventional synthetic data misses the extremes entirely and produces some records that fall outside the bounds of what real flights look like. The cleaned, augmented version covers the long-haul and long-delay extremes while keeping every record inside the historical operational envelope.
Alex: The authors are also fairly candid about the limitations, right?
Sam: They are. The evaluation draws on one month of U.S. domestic flights from a single region, so we do not yet know how well the approach generalizes across different seasons, weather patterns, or airport networks. That is the most significant open question.
Alex: And there is also the question of how you formally measure whether a generated flight is operationally plausible?
Sam: Yes. Right now the plausibility check is validated visually rather than with a strict numerical score, which makes it harder to compare results across different studies. Formalizing that into a quantitative metric is flagged as important future work.
Alex: What about situations where the extreme events are even rarer than what they studied here? Would there be enough data to train on at all?
Sam: That is their third major caution. A model trained on very few examples has limited diversity, which raises real questions about how well it captures the full range of extreme events in sparser settings. The framework is promising, but its limits in data-scarce environments still need to be mapped out.
Alex: So the honest picture is: meaningful gains in a well-defined setting, with important open questions about how far those gains extend.
Sam: That is a fair summary. The wider implication is the possibility of forecasting systems that can safely synthesize rare crisis scenarios before they occur—giving airlines and air traffic managers a clearer picture of what to prepare for, even when the historical record offers very few examples to learn from.
Alex: That is a meaningful contribution to how we think about preparing for high-impact disruptions. Thanks for walking us through it, Sam.
Sam: Thank you for the thoughtful questions, Alex. And thanks to our listeners for joining us on ResearchPod.