Network Requirements

Introduction

Depending on the specific requirements and nature of the RDBMS and backend environment, Gluent Data Platform packages may be installed on the following servers/clusters:

  • RDBMS Server: Mandatory

  • Hadoop Cluster (if applicable): Optional

  • Gluent Node (where applicable): Optional

Due to the optional location of certain components, the network requirements are presented by component in this guide. Each table shows the target components that need to be reachable and their default port.

Oracle ↔ Cloudera Data Hub (CDH)

Data Daemon

Target

Default Port

Details

CDH Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 1

CDH HDFS DataNode(s)

50010 2 / 9866 3

HDFS for Result Cache file retrieval

CDH NameNode

8020

HDFS for Result Cache file retrieval
1

The use of a load balancer is supported.

2

CDH5.x.

3

CDH6.x.

Gluent Offload Engine

Target

Default Port

Details

CDH Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 4

CDH Edge/Spark Node

22

SSH to run Sqoop or Spark and HDFS commands 7

CDH NameNode

50070 5 / 9870 6

WebHDFS to run HDFS commands 7

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
4

The use of a load balancer is supported.

5

CDH5.x.

6

CDH6.x.

7(1,2)

Interactions with HDFS can be achieved with either SSH or WebHDFS.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 8
8

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 9
9

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 10
10

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 11
11

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Cloudera Data Platform (CDP) Private Cloud

Data Daemon

Target

Default Port

Details

CDP Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 12

CDP HDFS DataNode(s)

9866

HDFS for Result Cache file retrieval

CDP NameNode

8020

HDFS for Result Cache file retrieval
12

The use of a load balancer is supported.

Gluent Offload Engine

Target

Default Port

Details

CDP Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 13

CDP Edge/Spark Node

22

SSH to run Sqoop or Spark and HDFS commands 14

CDP NameNode

9870

WebHDFS to run HDFS commands 14

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
13

The use of a load balancer is supported.

14(1,2)

Interactions with HDFS can be achieved with either SSH or WebHDFS.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 15
15

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 16
16

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 17
17

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 18
18

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Cloudera Data Platform (CDP) Public Cloud

Data Daemon

Target

Default Port

Details

CDP Impala API Endpoint

443

Interact with Impala Daemon Frontend 19
19

Either Data Hub or Data Warehouse endpoint depending on environment configuration.

Gluent Offload Engine

Target

Default Port

Details

CDP Impala API Endpoint

443

Interact with Impala Daemon Frontend 20

CDP Data Hub Node

22

SSH to run Sqoop or Spark and HDFS commands

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
20

Data Hub endpoint only.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 21
21

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 22
22

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 23
23

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 24
24

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Google BigQuery

Data Daemon

Target

Default Port

Details

Google APIs

443

Interact with Google BigQuery and Google Cloud Storage

Gluent Offload Engine

Target

Default Port

Details

Gluent Node

22

SSH to run Spark commands 25

Oracle Database Server(s)

1521

Connection to Oracle Net Listener

Google APIs

443

Interact with Google BigQuery and manage data in Google Cloud Storage
25

SSH is only required when Gluent Offload Engine commands are not executed on a node with the spark-submit script available.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Google BigQuery through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 26
26

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Google BigQuery through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener

Google APIs

443

Write data to Google Cloud Storage bucket

Oracle ↔ Snowflake

Data Daemon

Target

Default Port

Details

Snowflake APIs

443

Interact with Snowflake

Gluent Offload Engine

Target

Default Port

Details

Cloud Storage APIs

443

Manage data in cloud storage bucket or container

Gluent Node

22

SSH to run Spark commands 27

Oracle Database Server(s)

1521

Connection to Oracle Net Listener

Snowflake APIs

443

Interact with Snowflake
27

SSH is only required when Gluent Offload Engine commands are not executed on a node with the spark-submit script available.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Snowflake through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 28
28

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Snowflake through Data Daemon

Spark

Target

Default Port

Details

Cloud Storage APIs

443

Write data to cloud storage bucket or container

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener

Documentation Feedback

Send feedback on this documentation to: feedback@gluent.com