Qlik Adds Streaming Ingestion, Real-Time Transformations, Data Quality, and Expanded Integrations to Open Lakehouse
Qlik®, a global leader in data integration, data quality, analytics, and artificial intelligence (AI), today announced new capabilities in Qlik Open Lakehouse that bring streaming ingestion and real-time transformations to its managed, Apache Iceberg–based lakehouse.
With these additions, teams can ingest high-volume events from Apache Kafka, Amazon Kinesis, and Amazon Simple Storage Service (Amazon S3) into governed Iceberg tables and apply transformations as the data lands. Data quality, lineage, cataloging, and the Qlik Trust Score™ are applied automatically. The data is immediately available to analytics, applications, and ML teams, with ingestion and transformation offloaded to cost-effective compute.
Qlik also expanded its Iceberg ecosystem integrations with support for Snowflake Open Catalog, enhanced Apache Spark compatibility, and zero copy mirroring to Databricks and Amazon Redshift, alongside the already available mirroring to Snowflake, to simplify hybrid lakehouse and warehouse designs.
“The next phase of AI is operational,” said Drew Clarke, EVP Product and Technology at Qlik. “It runs on fresh, governed data, not nightly batches. By adding streaming ingestion and on-the-fly transformations to Open Lakehouse, teams get access to an open and trusted enterprise data foundation in their own cloud, built on Iceberg and integrated with the engines they already use. It shortens time to action and turns AI from pilots into performance.”
What’s new
- Streaming ingestion to Apache Iceberg from Apache Kafka, Amazon Kinesis, and Amazon S3, without consuming data warehouse compute
- Streaming transformations including cleansing, filtering, normalisation, flattening, and more as data arrives
- Automatic Iceberg optimisation for compaction and metadata maintenance to sustain performance at scale
- Comprehensive data quality and governance, including data lineage, catalogue services, and Qlik Trust Score applied to data in Iceberg tables and to mirrored datasets
- Integration with Snowflake Open Catalog in addition to AWS Glue
- Zero-copy mirroring to Databricks and Amazon Redshift, reflecting Iceberg data without duplicating it
- Enhanced Apache Spark compatibility for seamless access to up-to-date Iceberg tables
Real-time work stalls when data is late or duplicated. Qlik Open Lakehouse now unifies real-time ingest, on-the-fly transforms, optimisation, and governance so data is usable on arrival. It connects to hundreds of sources and adds real-time pipelines without depending on warehouse compute for ingestion or streaming transformations. Data writes once to Apache Iceberg in the customer’s account and is queryable by range of engines including Snowflake, Amazon Athena, Amazon SageMaker Studio, Apache Spark, Trino, Presto and more, with data quality, lineage, and Trust Score built in.
Open Lakehouse manages Apache Iceberg tables on Amazon S3 inside the customer’s environment. Streaming pipelines write events and apply transforms as data flows, with automatic compaction and metadata updates to sustain performance. Governance in Qlik Talend Cloud enforces data quality and lineage and keeps the catalogue current. Zero-copy mirroring makes the same Iceberg datasets available in Snowflake, Databricks, and Amazon Redshift without extra copies.
“Our customer projects consistently shows that an open lakehouse only reaches its true potential when simplicity and strong governance come together,” said Peter-Christian Quint, Managing Partner at cimt. “Qlik enables organisations to turn modern, open data architectures into something truly usable. Data is written once to open, fully-governed Apache Iceberg tables, and from there, operational insights flow directly into AI and analytics, in near real time. The result is a step-change in efficiency that boosts performance and delivers real cost savings — and that’s exactly where Qlik sets itself apart.”
The new streaming ingestion and streaming transformations capabilities for Qlik Open Lakehouse are planned for general availability in Q1 2026 for Qlik Talend Cloud customers. Support for Snowflake Open Catalog, enhanced Apache Spark compatibility, and zero-copy mirroring to Databricks and Amazon Redshift are expected to roll out in phases beginning as early as Q1 2026, with regional timing announced as features become available.
Customers and prospects can see the new capabilities at AWS re:Invent in the Qlik booth #1727 and request an in-depth discussion. For tailored scenarios and more information, contact your Qlik representative or start a free trial.
Article Enquiry
Email Article
Save Article
Feedback
To advertise email advertising@creamermedia.co.za or click here
Press Office
Announcements
What's On
Subscribe to improve your user experience...
Option 1 (equivalent of R125 a month):
Receive a weekly copy of Creamer Media's Engineering News & Mining Weekly magazine
(print copy for those in South Africa and e-magazine for those outside of South Africa)
Receive daily email newsletters
Access to full search results
Access archive of magazine back copies
Access to Projects in Progress
Access to ONE Research Report of your choice in PDF format
Option 2 (equivalent of R375 a month):
All benefits from Option 1
PLUS
Access to Creamer Media's Research Channel Africa for ALL Research Reports, in PDF format, on various industrial and mining sectors
including Electricity; Water; Energy Transition; Hydrogen; Roads, Rail and Ports; Coal; Gold; Platinum; Battery Metals; etc.
Already a subscriber?
Forgotten your password?
Receive weekly copy of Creamer Media's Engineering News & Mining Weekly magazine (print copy for those in South Africa and e-magazine for those outside of South Africa)
➕
Recieve daily email newsletters
➕
Access to full search results
➕
Access archive of magazine back copies
➕
Access to Projects in Progress
➕
Access to ONE Research Report of your choice in PDF format
RESEARCH CHANNEL AFRICA
R4500 (equivalent of R375 a month)
SUBSCRIBEAll benefits from Option 1
➕
Access to Creamer Media's Research Channel Africa for ALL Research Reports on various industrial and mining sectors, in PDF format, including on:
Electricity
➕
Water
➕
Energy Transition
➕
Hydrogen
➕
Roads, Rail and Ports
➕
Coal
➕
Gold
➕
Platinum
➕
Battery Metals
➕
etc.
Receive all benefits from Option 1 or Option 2 delivered to numerous people at your company
➕
Multiple User names and Passwords for simultaneous log-ins
➕
Intranet integration access to all in your organisation


















