- AutorIn
- Matthias Böhm Technische Universität Dresden, Fakultät für Informatik, Database Research Group
- Dirk HabichTechnische Universität Dresden, Fakultät für Informatik, Database Research Group
- Wolfgang LehnerTechnische Universität Dresden, Fakultät für Informatik, Database Research Group
- Titel
- On-demand re-optimization of integration flows
- Zitierfähige Url:
- https://nbn-resolving.org/urn:nbn:de:bsz:14-qucosa2-863803
- Quellenangabe
- Information Systems
Erscheinungsjahr: 2014
Jahrgang: 45
ISSN: 0306-4379 - Erstveröffentlichung
- 2014
- Abstract (EN)
- Integration flows are used to propagate data between heterogeneous operational systems or to consolidate data into data warehouse infrastructures. In order to meet the increasing need of up-to-date information, many messages are exchanged over time. The efficiency of those integration flows is therefore crucial to handle the high load of messages and to reduce message latency. State-of-the-art strategies to address this performance bottleneck are based on incremental statistic maintenance and periodic cost-based re-optimization. This also achieves adaptation to unknown statistics and changing workload characteristics, which is important since integration flows are deployed for long time horizons. However, the major drawbacks of periodic re-optimization are many unnecessary re-optimization steps and missed optimization opportunities due to adaptation delays. In this paper, we therefore propose the novel concept of on-demand re-optimization. We exploit optimality conditions from the optimizer in order to (1) monitor optimality of the current plan, and (2) trigger directed re-optimization only if necessary. Furthermore, we introduce the PlanOptimalityTree as a compact representation of optimality conditions that enables efficient monitoring and exploitation of these conditions. As a result and in contrast to existing work, re-optimization is immediately triggered but only if a new plan is certain to be found. Our experiments show that we achieve near-optimal re-optimization overhead and fast workload adaptation.
- Andere Ausgabe
- Link zum Artikel, der zuerst in der Zeitschrift 'Information Systems' erschienen ist.
DOI: 10.1016/j.is.2014.03.005 - Freie Schlagwörter (DE)
- Integrationsflüsse, Optimierung, Workload-Anpassung
- Freie Schlagwörter (EN)
- Integration flows, Optimization, Workload adaptation
- Klassifikation (DDC)
- 004
- Verlag
- Elsevier, Amsterdam
- Version / Begutachtungsstatus
- angenommene Version / Postprint / Autorenversion
- URN Qucosa
- urn:nbn:de:bsz:14-qucosa2-863803
- Veröffentlichungsdatum Qucosa
- 04.07.2023
- Dokumenttyp
- Artikel
- Sprache des Dokumentes
- Englisch
- Lizenz / Rechtehinweis