Capture: New releases 05/2024
See what's new in Capture and check the improvements and functionalities in this May 2024 update. This update is scheduled to roll out on Wednesday 15/05 around 5pm.
Highlights
Grafana Update V10.4.2 (Latest stable)
The V10.4.2. update provides an improved user experience & new user interface. Als includes better transformation options such as using dashboard variables in your transformations.
Full Release Notes
Blob integration (sync files to capture)
Blob integration is a new integration between our timeseries database and Azure Blob storage. This integration aims to improve storage efficiency and query performance when dealing with large files (blobs) within timeseries data.
When our API receives base64 encoded files within any field, and the device is linked to a configured Azure storage container, the system performs the following actions:
- Uploads the file data to the linked Blob container in Azure storage.
- Replaces the original base64 encoded data within the timeseries record with the corresponding Blob URL for efficient future retrieval.
More info on the blob data format.
Additionally, a custom Grafana datasource has been developed to enable:
- Querying the influx database to retrieve Blob URLs associated with specific data points.
- Querying the Azure Blob container using the retrieved URLs to access the actual blob data within Grafana.
Advantages
- Store blob data in your own Azure account
- Offloading blob data to Azure storage significantly reduces the load on the timeseries database, leading to faster queries.
- Timeseries databases are optimized for time-series data, not large files. By storing blobs in Azure, you leverage a more suitable and potentially cheaper storage solution.
Heartbeat status for devices
With this feature, we added an extra indicatior to see if the device is able to contact the Capture cloud. This change should allow faster troubleshooting by showing the source of a potential problem (network connection vs data source).
New ingest layer
With this update we will roll out a new ingest layer, separating our APIs from databases and introducing a central message bus. This further increases performance, and is a necessary step towards custom app integration, transformations and data mapping (unified namespace).
Alerting updates
With this update, we added some powerful new alerting features to keep you on top of your data.
- Alert scheduler: Craft precise schedules with cron expressions for maximum control over alert timing.
- Alert on specific text patterns using regular expressions (regex) and "contains" logic for string-based alerts.
- Hierarchical Email Notifications when using alerting in combination with fleets. Ensure alerts reach the right people. Leverage your company hierarchy to deliver notifications based on recipient roles or departments.
Support display name for databases
By adding a display name for databases, we can now rename databases.
Full release notes
Portal
- Feature: Grafana V9 -> V10.4
- Feature: Blob integration (sync files to capture)
- CRUD links with Azure blob store
- link blob store to timeseries location (timeseries data can be mixed with image references)
- Grafana backend plugin to query blob data
- Queries timeseries data which contains links to the attached blobstore
- Queries the blobstore to receive the blob objects inside the timeseries data
- Blob provider endpoint for grafana backend plugin
- Get list of blob objects from azure based on a list of blob urls
- Check auth on each request
- Feature: Project dashboards: Fleet dashboards from devices linked to the project are added to the project dashboard overview
- Feature: Added tracing in backend calls => makes it possible for us to find an debug bugs faster
- Feature: Fleet database templates & auto create databases in subcompanies (already in production)
- Feature: Preselect config & retention to write when selecting a fleet for a new device (already in production)
- Feature: Device "Created by" in detail overview
- Feature: Software resources support for semantic versioning V2
- Feature: Backend uses blob store to save software resources, reports,..
- We need this to be able to run in kubernetes
- Feature: Support display name for databases
- We generate a unique database name in the background
- Grafana, reporter, alerting use the display name to interact with the database
- This makes it possible to change a database name
- Feature: Download docker version returns a default config without references to localhost
- Feature: Added a heartbeat status for devices
- Indicates if a device has contact with our cloud, even if it is not syncing at that moment
- Feature: Add Redis database number field to connections with type redis in logger configurations
- Chore: Swagger backend api docs cleanup
- Fix: Timescale user rights issues on tables and schemas when a company name changes
- Fix: Timescale correct default privileges
- Fix: several frontend fixes
- Reload after editing a device
- Search filter on company users tab
- Real time sync info page switches on list refresh + overflow issues
- Configeditor synclist not always correct
- Company overview filter fixes
- Alert overview grouping whitescreen
- Whitescreen when changing company on a device detail page
- Alertconfig device list
- Wrong button style in some views
Capture ingest
- Feature: New ingest layer
- stability
- system load reduce
- future proof => we can use this layer to build features like isa95 modeling, transformations & calculations on incoming data
- Feature: Added blob support
- Api can detect blob data in the incoming messages
- Blob data such as images are sent to the attached blob store
- In the original message (timeseries), the blob info will be replaced with a reference to the blob store (url)
- Api can detect blob data in the incoming messages
Alerting
- Feature: schedule interval with cron expression
- Feature: Allow alerting on string with regex & contains sequence
- Feature: Alert config copy
- Feature: Alert config enable/disable on config overview page
- Feature: No data alert on fleets (Already in production)
- Fix: keep only last 100 alerts for overview page
- Feature: Mail notification based on company hierarchy