Airbyte 2.0: Data integration up to six times faster
The open-source platform Airbyte is released in version 2.0 with significantly higher sync speed, data activation, and a hybrid enterprise approach.
(Image: Yurchanka Siarhei / Shutterstock.com)
Airbyte has released version 2.0 of its free data integration platform, promising a significant acceleration of data processing. According to the developers, the new version synchronizes data on average four to six times faster than before, while simultaneously optimizing resource consumption. The “Faster Sync Speed” feature is now generally available and is intended to make ELT (Extract, Load, Transform) processes significantly more efficient.
The most important new features
Just over a year after the release of Airbyte 1.0, the new major release overhauls the architecture of the open-source platform. In addition to performance improvements, version 2.0 introduces two central new features: Data Activation and Enterprise Flex. Data activation enables companies to feed processed data from their data warehouse back directly into operational systems such as CRM platforms, marketing tools, or support systems. This allows business decisions to be made not only based on dashboards and reports but also to be implemented directly in the work tools that teams use daily.
Enterprise Flex is specifically aimed at companies with strict compliance and data sovereignty requirements. The hybrid architecture combines a fully managed cloud control plane with separate data planes that users can operate in their infrastructure. This is particularly relevant for organizations that, for regulatory reasons—such as data protection with GDPR—need to maintain complete control over data movements yet still want to use managed services. Existing Airbyte Cloud customers can switch to Enterprise Flex.
The Connector Builder, which allows developers to create their own connectors for APIs and data sources, has been fundamentally revised. The user interface now aligns more closely with the underlying YAML specification, which is intended to make switching between UI and YAML mode more intuitive. Almost all functions that were previously only available in YAML mode can now be used via the graphical interface. Existing custom connectors automatically migrate to the new interface without developers needing to intervene.
OAuth 2.0 and flexible stream configuration
A significant innovation in the Connector Builder is the full support of OAuth 2.0 flows, including asynchronous streams. Each stream can now be configured with its API endpoint URL and an individual authentication method—the previous global configuration for base URL and authentication is eliminated. The new API Endpoint URL field replaces the previous separate fields for URL path and API base URL. In addition, Airbyte has merged the panels for parent streams and parameterized requests in the new partition router. An additional Advanced panel makes functions such as file transfers accessible, which were previously only usable in YAML mode.
Videos by heise
Helm Chart V1 is expiring – migration required
For administrators of self-hosted Airbyte installations, version 2.0 brings an important change: it is the last version that supports Helm Chart V1. From version 2.1 onward, Helm Chart V2 will be mandatory. New deployments should therefore rely directly on Helm Chart V2; existing installations should migrate promptly to avoid blocking future updates. The Airbyte documentation offers separate migration guides for core and self-managed enterprise. Those who set up Airbyte with the abctl tool must first update to abctl version 0.30.2 before upgrading to version 2.0.
Revised Organization Management
The developers have also restructured the user interface for organizations and workspaces. The navigation bar now clearly separates between the organization and workspace level, and they have divided the general settings into separate areas for organization and workspace. User settings and application tokens are now found under the username in the menu. Organizations receive a new start page that displays all workspaces as well as ongoing, successful, and failed syncs across the board—a kind of dashboard view for all accessible workspaces. In addition, version 2.0 now ships with Ingress configurations as standard with the Helm Chart, which is intended to simplify the setup of new deployments.
Airbyte 2.0 is now available both as a self-hosted open-source version and via Airbyte Cloud. The complete release notes with all technical details can be found in the project's GitHub repository.
(fo)