Network Requirements

Introduction

Depending on the specific requirements and nature of the RDBMS and backend environment, Gluent Data Platform packages may be installed on the following servers/clusters:

  • RDBMS Server: Mandatory

  • Hadoop Cluster (if applicable): Optional

  • Gluent Node (where applicable): Optional

Due to the optional location of certain components, the network requirements are presented by component in this guide. Each table shows the target components that need to be reachable and their default port.

Oracle ↔ Azure Synapse Analytics

Data Daemon

Target

Default Port

Details

SQL Pool

1433

Interact with Azure Synapse Analytics SQL pool database

Gluent Offload Engine

Target

Default Port

Details

Cloud Storage APIs

443

Manage data in Azure storage container

Gluent Node

22

SSH to run Spark commands 1

Oracle Database Server(s)

1521

Connection to Oracle Net Listener

SQL Pool

1433

Interact with Azure Synapse Analytics SQL pool database
1

SSH is only required when Gluent Offload Engine commands are not executed on a node with the spark-submit script available.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Azure Synapse Analytics SQL pool database through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 2
2

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Azure Synapse Analytics SQL pool database through Data Daemon

Spark

Target

Default Port

Details

Cloud Storage APIs

443

Write data to Azure storage container

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener

Oracle ↔ Cloudera Data Hub (CDH)

Data Daemon

Target

Default Port

Details

CDH Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 3

CDH HDFS DataNode(s)

50010 4 / 9866 5

HDFS for Result Cache file retrieval

CDH NameNode

8020

HDFS for Result Cache file retrieval
3

The use of a load balancer is supported.

4

CDH5.x.

5

CDH6.x.

Gluent Offload Engine

Target

Default Port

Details

CDH Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 6

CDH Edge/Spark Node

22

SSH to run Sqoop or Spark and HDFS commands 9

CDH NameNode

50070 7 / 9870 8

WebHDFS to run HDFS commands 9

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
6

The use of a load balancer is supported.

7

CDH5.x.

8

CDH6.x.

9(1,2)

Interactions with HDFS can be achieved with either SSH or WebHDFS.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 10
10

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 11
11

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 12
12

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 13
13

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Cloudera Data Platform (CDP) Private Cloud

Data Daemon

Target

Default Port

Details

CDP Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 14

CDP HDFS DataNode(s)

9866

HDFS for Result Cache file retrieval

CDP NameNode

8020

HDFS for Result Cache file retrieval
14

The use of a load balancer is supported.

Gluent Offload Engine

Target

Default Port

Details

CDP Impala Daemon Node(s)

21050

Interact with Impala Daemon Frontend 15

CDP Edge/Spark Node

22

SSH to run Sqoop or Spark and HDFS commands 16

CDP NameNode

9870

WebHDFS to run HDFS commands 16

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
15

The use of a load balancer is supported.

16(1,2)

Interactions with HDFS can be achieved with either SSH or WebHDFS.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 17
17

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 18
18

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 19
19

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 20
20

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Cloudera Data Platform (CDP) Public Cloud

Data Daemon

Target

Default Port

Details

CDP Impala API Endpoint

443

Interact with Impala Daemon Frontend 21
21

Either Data Hub or Data Warehouse endpoint depending on environment configuration.

Gluent Offload Engine

Target

Default Port

Details

CDP Impala API Endpoint

443

Interact with Impala Daemon Frontend 22

CDP Data Hub Node

22

SSH to run Sqoop or Spark and HDFS commands

Oracle Database Server(s)

1521

Connection to Oracle Net Listener
22

Data Hub endpoint only.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Impala through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 23
23

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Impala and/or HDFS through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 24
24

Only applicable when Spark is used for offload transport.

Sqoop

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 25
25

Only applicable when Sqoop is used for offload transport.

YARN

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener 26
26

Only applicable when Sqoop or Spark on YARN is used for offload transport.

Oracle ↔ Google BigQuery

Data Daemon

Target

Default Port

Details

Google APIs

443

Interact with Google BigQuery and Google Cloud Storage

Gluent Offload Engine

Target

Default Port

Details

Gluent Node

22

SSH to run Spark commands 27

Oracle Database Server(s)

1521

Connection to Oracle Net Listener

Google APIs

443

Interact with Google BigQuery and manage data in Google Cloud Storage
27

SSH is only required when Gluent Offload Engine commands are not executed on a node with the spark-submit script available.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Google BigQuery through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 28
28

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Google BigQuery through Data Daemon

Spark

Target

Default Port

Details

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener

Google APIs

443

Write data to Google Cloud Storage bucket

Oracle ↔ Snowflake

Data Daemon

Target

Default Port

Details

Snowflake APIs

443

Interact with Snowflake

Gluent Offload Engine

Target

Default Port

Details

Cloud Storage APIs

443

Manage data in cloud storage bucket or container

Gluent Node

22

SSH to run Spark commands 29

Oracle Database Server(s)

1521

Connection to Oracle Net Listener

Snowflake APIs

443

Interact with Snowflake
29

SSH is only required when Gluent Offload Engine commands are not executed on a node with the spark-submit script available.

Metadata Daemon

Target

Default Port

Details

Data Daemon

50051

Request information from Snowflake through Data Daemon

Oracle Database Server(s)

1521

Request information from Oracle Database instance 30
30

Connections are via the Oracle Net Listener only in Oracle Multitenant/Pluggable Database environments.

Smart Connector

Target

Default Port

Details

Data Daemon

50051

Request information from Snowflake through Data Daemon

Spark

Target

Default Port

Details

Cloud Storage APIs

443

Write data to cloud storage bucket or container

Oracle Database Server(s)

1521

JDBC connection to Oracle Net Listener

Documentation Feedback

Send feedback on this documentation to: feedback@gluent.com