Sunbird Obsrv
  • Introduction
    • The Value of Data
    • Data Value Chain
    • Challenges
    • The Solution: Obsrv
  • Core Concepts
    • Obsrv Overview
    • Key Capabilities
    • Datasets
    • Connectors
    • High Level Architecture
    • Tech Stack
    • Monitoring
  • Explore
    • Roadmap
    • Case Studies
      • Agri Climate Advisory
      • Learning Analytics at Population Scale
      • IOT Observations Infra
      • Data Driven Features in Learning Platform
      • Network Observability
      • Fraud Detection
    • Performance Benchmarks
  • Guides
    • Installation
      • AWS Installation Guide
      • Azure Installation Guide
      • GCP Installation Guide
      • OCI Installation Guide
      • Data Center Installation Guide
    • Dataset Management APIs
    • Dataset Management Console
    • Connector APIs
    • Data In & Out APIs
    • Alerts and Notification Channels APIs
    • Developer Guide
    • Example Datasets
    • Connectors Developer Guide
      • SDK Assumptions
      • Required Files
        • metadata.json
        • ui-config.json
        • metrics.yaml
        • alerts.yaml
      • Obsrv Base Setup
      • Dev Requirements
      • Interfaces
        • Stream Interfaces
        • Batch Interfaces
      • Classes
        • ConnectorContext Class
        • ConnectorStats Class
        • ConnectorState Class
        • ErrorData Class
        • MetricData Class
      • Verifying
      • Packaging Guide
      • Reference Implementations
    • Coming Soon!
  • Community
  • Previous Versions
    • SB-5.0 Version
      • Overview
      • USE
        • Release Notes
          • Obsrv 2.0-Beta
          • Obsrv 2.1.0
          • Obsrv 2.2.0
          • Obsrv 2.0.0-GA
          • Obsrv 5.3.0-GA
          • Release V 5.1.0
          • Release V 5.1.2
          • Release V 5.1.3
          • Release V 5.0.0
          • Release V 4.10.0
        • Installation Guide
        • Obsrv 2.0 Installation Guide
          • Getting Started with Obsrv Deployment Using Helm
        • System Requirements
      • LEARN
        • Functional Capabilities
        • Dependencies
        • Product Roadmap
        • Product & Developer Guide
          • Telemetry Service
          • Data Pipeline
          • Data Service
          • Data Product
            • On Demand Druid Exhaust Job
              • Component Diagram
              • ML CSV Reports
              • Folder Struture
          • Report Service
          • Report Configurator
          • Summarisers
      • ENGAGE
        • Discuss
        • Contribute to Obsrv
      • Raise an Issue
  • Release Notes
    • Obsrv 1.1.0 Beta Release
    • Obsrv 1.2.0-RC Release
Powered by GitBook
On this page
  • Completed Features (1.2.0-RC)
  • Upcoming Features

Was this helpful?

Edit on GitHub
  1. Explore

Roadmap

Description: A comprehensive overview of the features released, in-progress, and upcoming in Obsrv.

Completed Features (1.2.0-RC)

Feature

Description

Status

Release

📦 Connector Framework

- Add and manage connectors via APIs - Create and drop streams (Flik) or batch jobs (Spark) via APIs - Add and manage custom jobs via APIs - Enhanced stability with rigorous testing and fixes for key issues - Open-source connectors for Kafka, JDBC, and Object Store

✅ Completed

1.2.0-RC

🔌 Open-Source Connectors

- Supported connectors: • Kafka • JDBC • Object Store

✅ Completed

1.2.0-RC

🏞️ Lakehouse

- Transactional Data Lake Platform for scalable and reliable data processing and storage

✅ Completed

1.2.0-RC

⚙️ Automation Refactor

- Stabilized scripts for greater reliability and ease of use - Support for AWS, GCP, Azure, and on-premises environments - Streamlined installation for seamless deployments across any setup

✅ Completed

1.2.0-RC

📊 Dataset Management

- Comprehensive dataset management with advanced features: • Automatic schema evolution at processing/storage layers • Seamless import/export • Auto schema generation and indexing • Proactive alerts and monitoring • Masking and encryption • JSONata and SQL transformations • Data exhausts • Data aliases for simplified replay and migration without downtime

✅ Completed

1.2.0-RC

🛡️ RBAC

- Manage users and roles via APIs for robust role-based access control

✅ Completed

1.2.0-RC

📡 Obsrv Exporter

- Export OpenTelemetry-compliant monitoring data for seamless integration with external monitoring systems

🔄 Partially Completed

1.2.0-RC

🖥️ Obsrv Management Console

- Full-featured Obsrv Management Console for managing datasets and connectors - Effortless dataset lifecycle management (Draft → Ready for Publish → Published → Retired) - Source Connector Configuration for Kafka, JDBC, Object Store - Seamless Export/Import functionality - Automatic Schema Generation & Indexing - Proactive Alerts & Monitoring for dataset health - Resource Monitoring for system performance

✅ Completed

1.2.0-RC

📝 Query APIs

- Query from Data Sources: Query from multiple data sources such as Druid, Hudi, Lakehouse, and others. - Exhaust API: API for retrieving data exhausts from blob stores for reporting and analysis. - Template API: API for creating and using query templates, enabling reusable and efficient queries across different datasets and environments.

✅ Completed

1.2.0-RC

Upcoming Features

Feature

Description

Status

Release

⚙️ Stabilization Enhancements

- Improve automation scripts for greater reliability and ease of use.

⏳ Planned

Future

🔒 Security & Performance Upgrades

- Software updates for critical components like Druid, Flink, and Kubernetes.

⏳ Planned

Future

🖥️ User Experience Improvements

- Enhanced management console for a better user experience, simplifying workflows for dataset and connector management.

⏳ Planned

Future

🔗 Connector Framework Stabilization

- Optimization and stabilization of the connector framework and its supported connectors.

⏳ Planned

Future

PreviousExploreNextCase Studies

Last updated 5 months ago

Was this helpful?