Roadmap
Description: A comprehensive overview of the features released, in-progress, and upcoming in Obsrv.
Completed Features (1.2.0-RC)
Feature
Description
Status
Release
📦 Connector Framework
- Add and manage connectors via APIs - Create and drop streams (Flik) or batch jobs (Spark) via APIs - Add and manage custom jobs via APIs - Enhanced stability with rigorous testing and fixes for key issues - Open-source connectors for Kafka, JDBC, and Object Store
✅ Completed
1.2.0-RC
🔌 Open-Source Connectors
- Supported connectors: • Kafka • JDBC • Object Store
✅ Completed
1.2.0-RC
🏞️ Lakehouse
- Transactional Data Lake Platform for scalable and reliable data processing and storage
✅ Completed
1.2.0-RC
⚙️ Automation Refactor
- Stabilized scripts for greater reliability and ease of use - Support for AWS, GCP, Azure, and on-premises environments - Streamlined installation for seamless deployments across any setup
✅ Completed
1.2.0-RC
📊 Dataset Management
- Comprehensive dataset management with advanced features: • Automatic schema evolution at processing/storage layers • Seamless import/export • Auto schema generation and indexing • Proactive alerts and monitoring • Masking and encryption • JSONata and SQL transformations • Data exhausts • Data aliases for simplified replay and migration without downtime
✅ Completed
1.2.0-RC
🛡️ RBAC
- Manage users and roles via APIs for robust role-based access control
✅ Completed
1.2.0-RC
📡 Obsrv Exporter
- Export OpenTelemetry-compliant monitoring data for seamless integration with external monitoring systems
🔄 Partially Completed
1.2.0-RC
🖥️ Obsrv Management Console
- Full-featured Obsrv Management Console for managing datasets and connectors - Effortless dataset lifecycle management (Draft → Ready for Publish → Published → Retired) - Source Connector Configuration for Kafka, JDBC, Object Store - Seamless Export/Import functionality - Automatic Schema Generation & Indexing - Proactive Alerts & Monitoring for dataset health - Resource Monitoring for system performance
✅ Completed
1.2.0-RC
📝 Query APIs
- Query from Data Sources: Query from multiple data sources such as Druid, Hudi, Lakehouse, and others. - Exhaust API: API for retrieving data exhausts from blob stores for reporting and analysis. - Template API: API for creating and using query templates, enabling reusable and efficient queries across different datasets and environments.
✅ Completed
1.2.0-RC
Upcoming Features
Feature
Description
Status
Release
⚙️ Stabilization Enhancements
- Improve automation scripts for greater reliability and ease of use.
⏳ Planned
Future
🔒 Security & Performance Upgrades
- Software updates for critical components like Druid, Flink, and Kubernetes.
⏳ Planned
Future
🖥️ User Experience Improvements
- Enhanced management console for a better user experience, simplifying workflows for dataset and connector management.
⏳ Planned
Future
🔗 Connector Framework Stabilization
- Optimization and stabilization of the connector framework and its supported connectors.
⏳ Planned
Future
Last updated