Release Notes

Documentation Conventions

  • Commands and keywords are in this font.

  • $OFFLOAD_HOME is set when the environment file (offload.env) is sourced, unless already set, and refers to the directory named offload that is created when the software is unpacked. This is also referred to as <OFFLOAD_HOME> in sections of this guide where the environment file has not been created/sourced.

  • Third party vendor product names might be aliased or shortened for simplicity. See Third Party Vendor Products for cross-references to full product names and trademarks.

Introduction

This document includes the Release Notes for Gluent Data Platform 4.2.

New Features

The following new features were added in this release:

  • Support for Google BigQuery BIGNUMERIC data type

  • Support for Google Cloud Key Management Service customer-managed encryption keys (CMEK) with Google BigQuery

  • Support for long Oracle identifiers

  • Partition-Based Offload, Subpartition-Based Offload and Predicate-Based Offload support for tables (sub)partitioned by VARCHAR2

  • Partition Functions feature for custom synthetic partitioning schemes (BigQuery only)

  • Incremental Update support for Google BigQuery

Supported Operating Systems and Versions

Gluent Data Platform can be installed on the following operating systems:

  • Red Hat Enterprise Linux, CentOS, Oracle Linux, 64-bit, versions 6 and 7

Supported RDBMSs and Versions

Gluent Data Platform can be used with the following RDBMSs:

  • Oracle Database versions 11.2.0.4, 12.1.0.2, 12.2.0.1, 18.3, 19.3

Oracle Database Requirements

  • Gluent Data Platform is certified with Oracle Database Enterprise Edition only

  • Gluent Data Platform cannot be used if the Oracle Database Vault option is enabled

  • Gluent Data Platform requires the use of the following Oracle Database license packs:

    • Smart Connector requires Oracle Diagnostic Pack

    • Gluent Advisor and Hybrid Query Report require Oracle Diagnostic Pack and Oracle Tuning Pack

Supported Backend Data Platforms

Gluent Data Platform can be used with the following backend platforms:

  • Cloudera Data Hub versions 5.7+, 6.x

  • Cloudera Data Platform versions 7.x

  • Google BigQuery

  • Snowflake

Known Backend Issues

The following backends and versions are known to have issues when using Gluent Data Platform:

  • Cloudera Data Hub 5.13.0: issue with incorrect results in Avro, fixed in 5.15.2 and 5.16.1 (https://issues.apache.org/jira/browse/IMPALA-7360)

  • Cloudera Data Hub 5.15.0: issue affecting hybrid queries that include the Oracle Database CHAR data type

It is recommended that a later patch version is used instead.

  • The Snowflake JDBC driver shipped with Gluent Data Platform for use by Data Daemon does not support Java 16.

Configuration Changes

New Configuration Files

None.

Deprecated Configuration Files

None.

New or Modified Configuration Parameters

The following configuration parameters are new or changed in this release:

Configuration File

Configuration Parameter

datad.properties

datad.initial-request-pool-size

datad.max-request-pool-size

offload.env

DATA_SAMPLE_PARALLELISM

GOOGLE_KMS_KEY_NAME

GOOGLE_KMS_KEY_RING_LOCATION

GOOGLE_KMS_KEY_RING_NAME

OFFLOAD_TRANSPORT_SMALL_TABLE_THRESHOLD

OFFLOAD_TRANSPORT_VALIDATION_POLLING_INTERVAL

OFFLOAD_UDF_DB

OFFLOAD_VERIFY_PARALLELISM

Deprecated Configuration Parameters

The following configuration parameters are deprecated in this release:

Configuration File

Configuration Parameter

datad.properties

datad.max-concurrent-requests

offload.env

HDFS_AVSC

Gluent Data Platform Option Changes

New or Modified Gluent Data Platform Parameters

The following Gluent Data Platform options are new or modified in this version:

Software Component

Option

Offload

--data-sample-parallelism

--offload-transport-validation-polling-interval

--partition-functions

--verify-parallelism

Validate

--frontend-parallelism

Deprecated Gluent Data Platform Parameters

None.

Restrictions

Gluent Data Platform 4.2 has the following restrictions:

  • Amazon EMR is not supported as a backend in this version. For Amazon EMR support, use Gluent Data Platform 3.x

  • Incremental Update is not supported for use with Snowflake or Cloudera Data Platform Public Cloud

Third Party Vendor Products

Gluent Data Platform interacts with a number of third party vendor products. For simplicity, third party vendor products might sometimes be aliased or shortened in the Gluent Data Platform product documentation. The references and their official product names are provided in the table below.

Third Party Vendor Products and References

Reference

Vendor Product Name

Trademark

Oracle

Oracle Database

Oracle Corporation

Oracle Linux

Oracle Linux

Oracle RAC

Oracle Real Application Clusters

Oracle Wallet

Oracle Wallet

Data Guard

Oracle Data Guard

Java

Java

SQL Developer

Oracle SQL Developer

SQL*Plus or sqlplus

SQL*Plus (Oracle Database)

CDH

Cloudera Data Hub

Cloudera, Inc.

CDP

Cloudera Data Platform

Impala

Apache Impala or Cloudera Impala

Hadoop

Apache Hadoop

The Apache Software Foundation

HDFS

Hadoop Distributed File System

Knox

Apache Knox

Livy

Apache Livy

Ranger

Apache Ranger

Sentry

Apache Sentry

Spark

Apache Spark

Sqoop

Apache Sqoop

BigQuery

Google BigQuery

Google, LLC

GCP

Google Cloud Platform

GCS

Google Cloud Storage

Amazon EMR or EMR

Amazon Elastic MapReduce (EMR)

Amazon Web Services, Inc.

Amazon IAM or IAM

Amazon Identity and Access Management (IAM)

Amazon S3 or S3

Amazon Simple Storage Service (S3)

Azure ADLS or ADLS

Azure Data Lake Storage Generation 1

Microsoft Corporation

Azure ABFS or ABFS

Azure Data Lake Storage Generation 2

Windows

Microsoft Windows

Snowflake

Snowflake

Snowflake Inc.

CentOS

CentOS

The CentOS Project

macOS

macOS

Apple Inc.

RHEL

Red Hat Enterprise Linux

Red Hat, Inc.

Documentation Feedback

Send feedback on this documentation to: feedback@gluent.com