मुख्य विषयवस्तु में जाएं

Bifrost Classic Support Matrix: Components and Platforms

This page lists what the Classic path migrates and what it migrates onto: the components of the default target, the supported source platforms, operating systems, JDKs, databases, and security integrations. The layout follows the support matrix published for Apache Bigtop releases.

The default target is the Ilum Bigtop distribution, managed by Apache Ambari (Ilum build), operated directly or through Ilum Cluster Ops. The default target line is certified and proven in production.

The Ilum Bigtop distribution broadly extends Apache Bigtop. It keeps services that Apache Bigtop has retired, such as Oozie, Sqoop, and Hue, and it adds services that Apache Bigtop does not package, such as Impala, Atlas, and Spark 2 alongside Spark 3. Each of them is a full management plane service with its own configuration, start order, and health checks, not a manual add-on.

Status Definitions​

StatusMeaning
CertifiedPart of the default target line. Built, deployed, and validated end to end by Bifrost, including the before-and-after canary.
SupportedHandled by Bifrost and validated for each estate during the assessment.
On requestNot part of the default target line. Support is added for an engagement on request.

Component Support​

Every service below is deployed as a management plane service. Certified services are part of the default target line and are checked by the before-and-after canary; Tez is checked through Hive queries. The Roles column lists the daemons and clients that are carried. The Apache Bigtop column shows whether a service comes from Apache Bigtop or is added by the Ilum Bigtop distribution.

Storage and Resource Management​

ComponentRolesDepends onStatusApache Bigtop
एचडीएफएसNameNode, Secondary NameNode, DataNode, JournalNode, failover controller, Router, HttpFS, clientZooKeeper (for high availability)CertifiedIncluded
धागाResourceManager, NodeManager, Timeline Service, Registry DNS, clientHDFS, ZooKeeper (for high availability)CertifiedIncluded
MapReduceJobHistory Server, clientYARN, HDFSCertifiedIncluded
ZooKeeperServer, clientNoneCertifiedIncluded
OzoneOzone Manager, Storage Container Manager, DataNode, S3 Gateway, Recon, clientNoneSupportedAdded by Ilum

SQL and Processing​

ComponentRolesDepends onStatusApache Bigtop
छत्ताHive Metastore, HiveServer2, WebHCat, clientHDFS, YARN, Tez, metastore databaseCertifiedIncluded
TezClientधागाCertifiedIncluded
ImpalaStatestore, Catalog Server, Impala Daemon, shellHDFS, Hive MetastoreCertifiedAdded by Ilum
Spark 3History Server, clientYARN, HDFS, Hive MetastoreCertifiedIncluded
Spark 2History Server, clientYARN, HDFS, Hive MetastoreCertifiedAdded by Ilum
Livy for Spark 3Livy ServerSpark 3CertifiedIncluded
Livy for Spark 2Livy ServerSpark 2CertifiedAdded by Ilum
बहादुरHistory Server, clientYARN, HDFSSupportedIncluded
ComponentRolesDepends onStatusApache Bigtop
HBaseMaster, RegionServer, REST Server, Thrift Server, clientHDFS, ZooKeeperCertifiedIncluded
काफ्काBrokerZooKeeperCertifiedIncluded
SolrSolr Server, for both service Solr and Infra-SolrZooKeeper, HDFSCertifiedIncluded
KuduMaster, Tablet ServerHive Metastore (for table integration)SupportedAdded by Ilum
Kafka ConnectConnect workerकाफ्काSupportedAdded by Ilum
Schema RegistrySchema Registry ServerKafka, Schema Registry databaseSupportedAdded by Ilum
Streams Messaging ManagerSMM Server, SMM UIKafka, SMM databaseSupportedAdded by Ilum
Streams Replication ManagerDriver, Serviceकाफ्काSupportedAdded by Ilum
Cruise ControlCruise Control ServerKafka, ZooKeeperSupportedAdded by Ilum

Security and Governance​

ComponentRolesDepends onStatusApache Bigtop
RangerRanger Admin, UserSync, TagSyncRanger database, Solr for auditCertifiedIncluded
Ranger KMSKMS ServerRanger, KMS databaseCertifiedIncluded
AtlasAtlas Server, clientHBase, Solr, KafkaCertifiedAdded by Ilum
KnoxGatewayLDAP or Active Directory for authenticationCertifiedAdded by Ilum

Workflow, Data Flow, and User Tools​

ComponentRolesDepends onStatusApache Bigtop
OozieOozie Server, clientHDFS, YARN, Oozie databaseCertifiedAdded by Ilum
SqoopClientYARN, MapReduceCertifiedAdded by Ilum
HueHue Server, Kerberos Ticket RenewerHue database, HDFS, HiveCertifiedAdded by Ilum
ज़ेपलिनZeppelin ServerSpark, LivyCertifiedIncluded
NiFiNiFi Node, NiFi RegistryZooKeeper (for clustering)SupportedAdded by Ilum

Component Notes​

  • HDFS. NameNode high availability is carried as configured on the source. The Ilum build carries backported security fixes.
  • Impala. The Ilum build of Impala carries later upstream fixes. Authorization stays with Ranger.
  • Spark 3. The Apache Iceberg runtime libraries are included. The Spark Thrift Server and the स्पार्क-एसक्यूएल shell are not shipped, matching the source.
  • Spark 2. Runs side by side with Spark 3. The Cloudera Spark service maps to Spark 2 and the Cloudera Spark 3 service maps to Spark 3, each with its own Livy.
  • Solr. An estate with two SolrCloud instances, for example Infra-Solr and a service Solr, is given a second Solr service.
  • Ranger. Plugins are connected for HDFS, YARN, Hive, HBase, Kafka, Solr, Atlas, and Knox.
  • Atlas. Runs on the cluster's HBase, Solr, and Kafka. Hooks are carried for Hive, HBase, Sqoop, Impala, Kafka, and Spark.
  • Zeppelin. The notebook storage format of the source is kept, so existing notebooks open unchanged.

Libraries and Agents​

ComponentUsed byApache Bigtop
Apache PhoenixHBase, installed when the estate uses PhoenixIncluded
Apache Avro, Apache Parquet, Apache ORCHive, Impala, SparkIncluded
Apache Iceberg runtimeSpark 3Added by Ilum
Hive Warehouse ConnectorSpark 2 and Spark 3Added by Ilum
Spark Atlas ConnectorSpark 2 and Spark 3Added by Ilum
HBase Spark connectorSpark 2 and Spark 3Added by Ilum
Prometheus JMX exporterJava daemons, for Prometheus monitoringAdded by Ilum

Version Policy​

By default, the component versions of the target are aligned with the source release. HDFS metadata, the Hive Metastore schema, client applications, and notebooks are therefore carried without an upgrade, and rollback does not have to revert data. Version differences between the source and the target are reported by discovery and reviewed in the assessment.

When an estate needs newer versions, for example a later Hadoop, Hive, or Spark release, an upgraded-version target is built for it and validated with the same canary. The versions delivered for an estate are confirmed in the assessment. See Version-aligned target.

Management Plane​

ComponentNotes
Apache Ambari (Ilum build), server and agentsBigtop stack definition extended with the services added by Ilum. Runs on JDK 17.
Ilum Cluster OpsOperates the Ambari-managed cluster from Ilum.
Ambari alertsActive from the first start of the adopted cluster.
Prometheus and GrafanaOptional, enabled with bifrost_adopt_monitoring: true.

Apache Ambari (Ilum build) adds service definitions that the Bigtop stack of upstream Apache Ambari does not include: Atlas, Hue, Impala, Knox, Oozie, Sqoop, Spark 2 with its Livy, a second Solr, and Prometheus. See Management plane.

Source Platforms​

SourceStatusNotes
Cloudera CDP Private Cloud Base 7.xCertifiedThe target is aligned with the source release, including the Cloudera Spark 3 parcel.
Cloudera CDH 6.xSupportedThe Hive Metastore schema is upgraded to the Hive 3 schema, and Sentry is translated to Ranger.

Discovery reads Cloudera Manager 6.x and 7.x through its REST API. The API version is negotiated, and an unsupported version is refused instead of being read partially.

Operating Systems​

Operating systemReleasesStatus
Red Hat Enterprise Linux8, 9, 10Certified
Rocky Linux, AlmaLinux8, 9, 10Certified
Oracle Linux8, 9, 10Certified
Ubuntu and Debian-based distributionsCurrent LTS and stable releasesSupported

Rocky Linux, AlmaLinux, and Oracle Linux are binary-compatible with Red Hat Enterprise Linux and are certified on the same terms. Cluster nodes run on the x86_64 architecture; aarch64 is available on request.

The requirements for the controller host are listed in Getting started.

जावा​

JDKUsed byStatus
JDK 11All stack components (default)Certified
JDK 8All stack components, when chosen with ambari-takeover --component-java-homeSupported
JDK 17Apache Ambari server and agentsCertified
JDK 17Stack componentsOn request

One JDK is used for all adopted components. When the source runs its own JDK 11, that JDK is reused.

डेटाबेस​

डाटाबेसहाइव मेटास्टोरRanger, Ranger KMS, Oozie, HueApache Ambari
पोस्टग्रेएसक्यूएलCertifiedCertifiedCertified (default)
Oracle DatabaseCertifiedCertifiedCertified
MySQL and MariaDBSupportedSupportedOn request

Service databases are reused in place; no database is migrated. Apache Ambari connects to Oracle Database with the Oracle JDBC driver 19c or later.

प्रतिभूति​

CapabilityStatusNotes
Kerberos with MIT KDCCertifiedPrincipals and keytabs are reused; no key version changes.
Kerberos with Active DirectoryCertifiedThe KDC type is read from Cloudera Manager.
TLS with corporate PKI or Cloudera Manager Auto-TLS certificatesCertifiedKeystores and truststores are reused, not reissued.
Ranger authorizationCertifiedPolicy content is compared before and after the cutover.
LDAP and Active Directory loginCertifiedAtlas, Ranger Admin and UserSync, Hue, and the Ambari console.
HDFS encryption zones with a database-backed Ranger KMSCertifiedEvery zone is verified by a decryption probe before finalize.
Ranger KMS backed by a hardware security module (HSM)CertifiedThe HSM client is installed on the target hosts, and key custody is attested before finalize.
Sentry (CDH 6 sources)SupportedRoles and grants are translated to Ranger policies.
Key Trustee KMSOn requestKeys are moved to Ranger KMS before the migration window.
Other external key storesOn requestAssessed for each estate.

देखना Security and encryption.

Requesting Support​

Support for a component, version, operating system, or integration that is not listed is added on request. A new service is delivered the same way as the services above: as packages of the Ilum Bigtop distribution, with a management plane service definition and canary checks.

To request support, contact [ईमेल संरक्षित] with the component and the version required.

अगले कदम​