Roadmap

Engine

  • Update platform to add support for Hadoop 2.8. This will bring in critical fixes for HDFS and YARN.

  • Elasticsearch updated to version 7.9

  • XML Serde improvements and large XML support

  • JSON Serde improvements

  • Improved fault tolerance with support for multiple standby name nodes

  • Scalable Timeline server for improved scalability and reliability of timeline service.

  • Workload management - resource pooling

  • Improved ACID transaction support

  • Spark Engine for data pipeline and analytics

Inventory Manager

  • Auto schema and version management to handle source system schema changes

  • Recon-Merge tooling improvements. Additional state management for improved error handling and restarts.

  • Simplify dependency – remove additional web service dependency to simplify the configuration generation and deployment process.

  • Support for Centralized Schema registry for use with ingestion and improve configuration management.

New Pipeline Source DB Connectors

  • Oracle

  • Postgres

  • MySQL

Discovery Pipeline

  • Kafka 2.x support

  • Pipeline error log capture to HDFS to display mapping and transformation errors from Hive.

  • Schema registry and AVRO payload support

Miscellaneous

  • Improved alerting and monitoring integration with 3rd party tools

  • Tooling for Kafka Lag monitoring and alerting for Operations.

  • nmon collection agents for performance metrics

OS Support

  • RHEL 8.x

  • CentOS 8.x

Container Support

  • Docker, Podman

  • Kubernetes

  • Openshift

PreviousReferenceNextService Troubleshooting

Last updated