ClearBlade, a leading provider in Edge AI and connected Digital Twins, has announced the launch of its innovative MQTT-to-Database Connector. This native ClearBlade capability is set to transform how enterprises handle device data by enabling real-time streaming into preferred databases without requiring any custom code.
Seamless Data Integration
The new connector offers a straightforward, configuration-only method to route MQTT messages into various external data systems, such as Google BigQuery, CloudSQL, Postgres, SQL Server, MongoDB, CouchDB, MySQL, Oracle, Redshift, and MariaDB. By converting MQTT topics into instantly bindable data sinks, organizations can now transition from ‘device to database’ in just minutes, a process that previously took weeks.
A Native, No-Code Solution
The MQTT-to-Database Connector enhances ClearBlade’s existing database integration library by allowing any supported database connector to function as an MQTT endpoint. With ClearBlade’s native binding, teams can map incoming MQTT topics to database collections, tables, or objects effortlessly, eliminating the need for service coding, custom logic, or integration scaffolding.
High-Performance Batching
To cater to large-scale device deployments, which may involve tens of thousands to hundreds of thousands of devices, the connector includes a robust batching layer designed to significantly boost throughput and system performance. Key features of the batching system include:
– Batch-write messaging for grouping incoming messages before insertion.
– Configurable batch sizes to optimize performance for different workloads.
– Stream-then-write behavior, enabling real-time ingestion while optimizing downstream writes.
Instead of processing each message individually, the connector intelligently aggregates messages, writing them in efficient batches. Initial deployments have demonstrated significant performance improvements, particularly for high-frequency telemetry streams that require structured ingestion for digital twins and AI inference.
Simplifying Enterprise Integration
The connector expands ClearBlade’s cross-cloud flexibility, facilitating easier integration with leading hyperscaler services and third-party systems without additional engineering overhead. Enterprises can now link MQTT data directly to any database, thanks to the MQTT-to-Database Connector built into the ClearBlade platform as a native capability. Its features include:
– A generic MQTT-to-Database API for real-time streaming.
– No-code configuration via MQTT topic bindings.
– Compatibility with all existing ClearBlade database connectors.
– Massive scalability for high-volume device ecosystems.
Comprehensive Support for Streaming and File-Based Connectors
The new connector complements ClearBlade’s existing support for both streaming and file-based connectors. File-based ingestion efficiently supports modern cloud file storage and legacy FTP-based transmissions, while streaming encompasses cloud services like Pub/Sub, Kinesis, and EventHub, alongside open-source solutions such as Kafka and Pulsar.
Availability
The ClearBlade MQTT-to-Database Connector is now available to all ClearBlade Enterprise and Intelligent Assets customers, marking a significant advancement in the market for industrial edge compute platforms.
For more insights and updates, follow us at devtechtrend.com.
Note: This article is inspired by content from https://www.arcweb.com/blog/clearblade-launches-no-code-mqtt-database-connector-real-time-streaming. It has been rephrased for originality. Images are credited to the original source.