Roadmap


Description: A comprehensive overview of the features released, in-progress, and upcoming in Obsrv.

Completed Features (1.2.0-RC)

Feature

Description

Status

Release

πŸ“¦ Connector Framework

- Add and manage connectors via APIs - Create and drop streams (Flik) or batch jobs (Spark) via APIs - Add and manage custom jobs via APIs - Enhanced stability with rigorous testing and fixes for key issues - Open-source connectors for Kafka, JDBC, and Object Store

βœ… Completed

1.2.0-RC

πŸ”Œ Open-Source Connectors

- Supported connectors: β€’ Kafka β€’ JDBC β€’ Object Store

βœ… Completed

1.2.0-RC

🏞️ Lakehouse

- Transactional Data Lake Platform for scalable and reliable data processing and storage

βœ… Completed

1.2.0-RC

βš™οΈ Automation Refactor

- Stabilized scripts for greater reliability and ease of use - Support for AWS, GCP, Azure, and on-premises environments - Streamlined installation for seamless deployments across any setup

βœ… Completed

1.2.0-RC

πŸ“Š Dataset Management

- Comprehensive dataset management with advanced features: β€’ Automatic schema evolution at processing/storage layers β€’ Seamless import/export β€’ Auto schema generation and indexing β€’ Proactive alerts and monitoring β€’ Masking and encryption β€’ JSONata and SQL transformations β€’ Data exhausts β€’ Data aliases for simplified replay and migration without downtime

βœ… Completed

1.2.0-RC

πŸ›‘οΈ RBAC

- Manage users and roles via APIs for robust role-based access control

βœ… Completed

1.2.0-RC

πŸ“‘ Obsrv Exporter

- Export OpenTelemetry-compliant monitoring data for seamless integration with external monitoring systems

πŸ”„ Partially Completed

1.2.0-RC

πŸ–₯️ Obsrv Management Console

- Full-featured Obsrv Management Console for managing datasets and connectors - Effortless dataset lifecycle management (Draft β†’ Ready for Publish β†’ Published β†’ Retired) - Source Connector Configuration for Kafka, JDBC, Object Store - Seamless Export/Import functionality - Automatic Schema Generation & Indexing - Proactive Alerts & Monitoring for dataset health - Resource Monitoring for system performance

βœ… Completed

1.2.0-RC

πŸ“ Query APIs

- Query from Data Sources: Query from multiple data sources such as Druid, Hudi, Lakehouse, and others. - Exhaust API: API for retrieving data exhausts from blob stores for reporting and analysis. - Template API: API for creating and using query templates, enabling reusable and efficient queries across different datasets and environments.

βœ… Completed

1.2.0-RC


Upcoming Features

Feature

Description

Status

Release

βš™οΈ Stabilization Enhancements

- Improve automation scripts for greater reliability and ease of use.

⏳ Planned

Future

πŸ”’ Security & Performance Upgrades

- Software updates for critical components like Druid, Flink, and Kubernetes.

⏳ Planned

Future

πŸ–₯️ User Experience Improvements

- Enhanced management console for a better user experience, simplifying workflows for dataset and connector management.

⏳ Planned

Future

πŸ”— Connector Framework Stabilization

- Optimization and stabilization of the connector framework and its supported connectors.

⏳ Planned

Future


Last updated

Was this helpful?