Roadmap

Engine

• Update platform to add support for Hadoop 2.8. This will bring in critical fixes for HDFS and YARN.

• Elasticsearch updated to version 7.9

• XML Serde improvements and large XML support

• JSON Serde improvements

• Improved fault tolerance with support for multiple standby name nodes

• Scalable Timeline server for improved scalability and reliability of timeline service.

• Workload management - resource pooling

• Improved ACID transaction support

• Spark Engine for data pipeline and analytics

Inventory Manager

• Auto schema and version management to handle source system schema changes

• Recon-Merge tooling improvements. Additional state management for improved error handling and restarts.

• Simplify dependency – remove additional web service dependency to simplify the configuration generation and deployment process.

• Support for Centralized Schema registry for use with ingestion and improve configuration management.

New Pipeline Source DB Connectors

• Oracle

• Postgres

• MySQL

Discovery Pipeline

• Kafka 2.x support

• Pipeline error log capture to HDFS to display mapping and transformation errors from Hive.

• Schema registry and AVRO payload support

Miscellaneous

• Improved alerting and monitoring integration with 3rd party tools

• Tooling for Kafka Lag monitoring and alerting for Operations.

• nmon collection agents for performance metrics

OS Support

• RHEL 8.x

• CentOS 8.x

Container Support

• Docker, Podman

• Kubernetes

• Openshift