Google Cloud release notes

External TCP/UDP Network Load Balancing is now supported with backend services. Compared to the target pool backend, a backend service gives you more fine-grained control over your load balancer, including access to features such as connection draining, failover policies, and support for managed instance groups as backends.

Network load balancers with a backend service can also use health checks that match the traffic (TCP, SSL, HTTP, HTTPS, or HTTP/2) they are distributing.

To get started, see:

• Network Load Balancing with backend services
• Setting up a network load balancer with a backend service
• Transitioning a network load balancer from a target pool to a backend service

This feature is available in Preview.

Added support for the MonitoringAlertPolicy resource.

Added maintenancePolicy field to ComputeNodeGroup.

Added exclusions field to LoggingLogSink.

Added authEnabled field to RedisInstance.

Added interface field to ComputeDisk.

Added mtu field to ComputeNetwork.

Added privateIpv6GoogleAccess field to ComputeSubnetwork.

Added confidentialNodes field to ContainerCluster.

Added skipInitialVersionCreation field to KMSCryptoKey.

• Airflow 1.10.12 is now available for Cloud Composer.
• The GKE release channel is set to STABLE for new and upgraded Composer environments.

A new multi-region instance configuration is now available in North America - nam8 (Los Angeles/Oregon/Salt Lake City).

Identify resources like persistent disks, IP addresses, and custom disk images that aren't in use. Viewing and applying idle resources recommendations can help reduce unused resources and reduce your Compute Engine bill. This feature is Generally available.

Compute-optimized (C2) machine types are now available in Sydney, Australia, australia-southeast1-c. For pricing details, see VM instance pricing.

By using the new gcloud command and API for live tailing, you can now stream your logs in real time as your applications write them to the Cloud Logging API. To learn more, see Live tailing log entries.

Field descriptions now document immutability.

DataflowJob labels are now mutable.

The Cloud Healthcare API offers single-region support in the europe-west6 (Zurich, Switzerland) region.

Enhancements to the VM Details page. A new Event Timeline shows important events as bars on a timeline. Hovering over any event bar displays summary information about the event and provides a link to the Incident Details page for the event.

PostgreSQL version 13 is now generally available. To start using PostgreSQL 13, see Creating instances.

Dataflow now supports Dataflow Shuffle, Streaming Engine, FlexRS, and the following regional endpoints in GA:

• us-west2 (Los Angeles)
• southamerica-east1 (São Paulo)
• europe-west6 (Zurich)
• asia-south1 (Mumbai)

Users can now build containers without a Dockerfile or a Cloud Build config file using Cloud Native Buildpacks.

Dialogflow CX now supports the same languages as Dialogflow ES.

Preview support for the following integration:

• Transfer Appliance

1.7.3-asm.6 is now available

Anthos Service Mesh 1.7 is compatible with and has the feature set of Istio 1.7, subject to the list of Anthos Service Mesh supported features.

Added support for on-premises secure key management, provided by Thales Luna HSM 7+ and Hashicorp Vault.

Added a shell script to automate Anthos Service Mesh installation and migration from Istio 1.6. See the installation guide for details.

Added revision label support to sidecar injection for greater control over various scenarios, such as canary upgrades and more.

Anthos 1.4.4 is now available.

Updated components:

• Anthos GKE on-prem release notes
• Anthos Config Management release notes

Anthos 1.3.5 is now available.

Updated components:

• Anthos GKE on-prem release notes
• Anthos Config Management release notes

You can now use Private Google Access to provision images for your GKE on AWS environment. For more information, see spec.ubuntuRepositoryMirror in the AWSManagementService resource.

Anthos GKE on-prem 1.4.4-gke.1 is now available. To upgrade, see Upgrading GKE on-prem. GKE on-prem 1.4.4-gke.1 clusters run on Kubernetes 1.16.11-gke.11.

Anthos GKE on-prem 1.3.5-gke.2 is now available. To upgrade, see Upgrading GKE on-prem. GKE on-prem 1.3.5-gke.2 clusters run on Kubernetes 1.15.12-gke.6400.

You can now configure cache modes, cache TTLs and set custom response headers in the Cloud Console, in addition to the existing gcloud and REST API support.

Secret Manager support for Customer-Managed Encryption Keys (CMEK) is available to all customers via public preview.

Learn more at Enabling CMEK in Secret Manager.

• More detailed error messages are now provided for errors during Python package installation.

In Cloud SQL for MySQL, 80 supported flags that previously were in beta are now generally available.

Added a dataproc:dataproc.cooperative.multi-tenancy.user.mapping cluster property which takes a list of comma-separated user-to-service account mappings. If a cluster is created with this property set, when a user submits a job, the cluster will attempt to impersonate the corresponding service account when accessing Cloud Storage through the Cloud Storage connector. This feature requires Cloud Storage connector version 2.1.4 or higher.

Anthos Config Management now includes the ability to sync from multiple Git repositories. This is a preview feature. To learn more, see Syncing from multiple repositories.

The following updates for Cloud Spanner SQL are now available:

• Ability to convert between BYTES and base32-encoded strings using FROM_BASE32 and TO_BASE32 functions.

• Support for ARRAY_IS_DISTINCT.

NVIDIA® V100 GPUs are now available in the following additional regions and zones:

• South Carolina, North America: us-east1-c

For information about using V100 GPUs on Compute Engine, see GPUs on Compute Engine.

You can use VM Manager in VPC Service Controls. This feature is available in beta.

Document AI Preview released

The following beta and preview features are available in API version v1beta3:

• Procure-to-pay processors: Invoice parser and receipt parser.

Beta stage support for the following integration:

• VM Manager

• Added PyTorch 1.6 CUDA 11 environments that support A100 GPU accelerators. This special PyTorch build provides another option to add to our A100-compatible TensorFlow Enterprise builds.

Organization policy constraints for Cloud Interconnect is now available in General Availability.

You can now create sinks from within the Logs Explorer and Logs Router pages. To learn more, see Exporting logs with the Google Cloud Console.

Organization policy constraints for Cloud NAT is available in General Availability.

Add spec.requestProjectPolicy field to ConfigConnectorContext CRD

You can now start import and export operations from the Google Cloud Console.

M58 release

• Added PyTorch 1.6 CUDA 11 images that support A100 GPU accelerators. This special PyTorch build provides another option to add to our A100-compatible TensorFlow Enterprise builds.
• Added the PyTorch/XLA package.
• Added the Swift for TensorFlow framework.
• Added the Ubuntu 18.04 OS.

You can now use use a custom container to customize how you serve predictions. To try using a custom container, read the new tutorial on serving predictions from a PyTorch model.

This feature is in preview.

Read a new document about using custom service accounts with custom containers or custom prediction routines.

This feature is in beta.

BigQuery standard SQL now supports the SUBSTRING function. This function is generally available (GA).

Cloud CDN can now cache more response codes, including common error codes such as 404 (Not Found), 301 (Permanent Redirect), 302 (Temporary Redirect), and many others.

If you are sending valid cache directives from your origin, you do not need to make any changes to benefit from this.

You can also set (and override) per-status code TTLs by configuring negative caching as of gcloud SDK 316.0.0.

A new configuration field enable_full_index, has been added for HL7v2 stores. This field enables indexing for all HL7v2 message fields so that you can search on any message field using a new generic filter.

Enhancements to the pre-configured Compute Engine VM Instances dashboard. The inventory table now includes a Logging Agent Status column, and the Logging agent can be installed by using a UI workflow from the table.

N2D Machine types are now available in London, europe-west2-a,b. See VM instance pricing for details.

N2D Machine types are now available in Eemshaven, Netherlands, europe-west4-a. See VM instance pricing for details.

Anthos 1.5.1 is now available.

Updated components:

• Anthos GKE on-prem release notes

Anthos GKE on-prem 1.5.1-gke.8 is now available. To upgrade, see Upgrading GKE on-prem. GKE on-prem 1.5.1-gke.8 clusters run on Kubernetes 1.17.9-gke.4400.

Binary Authorization for GKE on-prem Preview is now available:

• Binary Authorization for GKE on-prem extends centralized Binary Authorization enforcement policies to GKE on-prem user clusters.
• Set up Binary Authorization for GKE on-prem

This release enables customers to generate credential configuration templates by using the gkectl create-config credential command.

Published the best practices for how to set up GKE on-prem components for high availability and how to recover from disasters.

Published the best practices for creating, configuring, and operating GKE on-prem clusters at large scale.

• The following Composer environment database metrics are now available in Cloud Monitoring: CPU usage, CPU cores, CPU utilization, memory usage, memory quota, memory utilization, disk usage, disk quota, disk utilization.

Cloud Run services can now be triggered using Eventarc (available in public preview)

A new multi-region instance configuration is now available in North America - nam7 (Iowa/North Virginia/Oklahoma).

Access levels now support checking the Storage encryption (allowedEncryptionStatuses), Require admin approval (requireAdminApproval) and Require corp owned device (requireCorpOwned) attributes of requests originating from mobile devices.

The ST_GEOGFROMGEOJSON and ST_GEOGFROMTEXT geographic functions support a new make_valid parameter. If set to TRUE, the function attempts to correct polygon issues when importing geography data.

The ST_GEOGFROMTEXT function also supports a new planar parameter. If set to TRUE, the function treats imported WKT geometries as having planar edges.

These new function parameters are in Beta.

Announcing the Alpha release of the Dataproc Persistent History Server, which provides a UI to view job history for jobs run on active and deleted Dataproc clusters.

Cloud SQL for MySQL supports binary logging on read replicas for MySQL versions 5.7 and 8.0.

Added support for externally referencing billing account and organizations in IAMPolicyMember

Added LoggingLogSink resource for creating log sinks at project, folder, and organization scopes

Added ResourceManagerPolicy resource for setting organization policy at project, folder, and organization scopes

For HTTP requests, the httpRequest.remoteIp and httpRequest.serverIp fields can include port information. For example 10.0.0.1:80.

In the Logs Explorer you can now download your logs in JSON and CSV to your computer, Google Drive, or view them in a new tab. To learn more, see Downloading logs.

Cloud Run is now available in the following regions:

• asia-east2 (Hong Kong)
• asia-northeast3 (Seoul, South Korea)
• asia-southeast2 (Jakarta)
• asia-south1 (Mumbai, India)
• europe-west2 (London, UK)
• europe-west3 (Frankfurt, Germany)
• europe-west6 (Zurich, Switzerland)
• southamerica-east1 (Sao Paulo, Brazil)

You can now purchase a custom domain via Cloud Domains using the Cloud Run user interface.

Memory-optimized M1 machine types are available in Frankfurt europe-west3-a,b,c. Memory-optimized M2 machine types are available in Frankfurt, europe-west3-a,b. See VM instance pricing for details.

Adds support for MonitoringNotificationChannel

Announcing the GA (General Availability) release of the Dataproc Ranger Optional Component and the Dataproc Solr Optional Component.

Pub/Sub message ordering is now available in GA.

Data Catalog is now available in Tulsa (us-central2) and the Asia multiregion (asia).

Announcing the GA (General Availability) release of the Dataproc - Docker Optional Component and the Dataproc - Flink Optional Component.

Document AI Preview released

The following beta and preview features are available in API version v1beta3:

• General processors: Document OCR (Optical Character Recognition), form parser, and document splitter.
• Lending processors: W9, 1040, W2, 1099-MISC, and 1003 parsers, as well as lending document splitter & classifier.

Discount sharing for committed use discounts is now Generally Available. With discount sharing enabled, you can apply your purchased commitments across multiple projects within a single Cloud Billing account. Discount sharing helps you minimize the overhead of managing each of your commitments individually and provides increased flexibility so that you can use the compute options that best suit your needs, while also increasing cost predictability.

• For more information about enabling committed use discount sharing, see Turning on committed use discount sharing.
• For more information on the possible cost savings using committed use discount sharing, see Understanding discount sharing.

• Cloud Build logs from the tenant project are now published in the Composer logs. They are available under the log name build-log-webserver.
• Airflow DAG processor manager logs are now published in the Composer logs. They are available under the log name dag-processor-manager.
• If an update operation fails, links to the specific Cloud Build log will now be included in the error message.
• Compatibility with Domain Restricted sharing has been improved. Upgrading your environment to the newest version of Composer can now enable or disable its compatibility with Domain Restricted Sharing based on your organization policy.

You can now specify a minimum number of container instances to be kept warm and ready to serve requests, for services requiring reduced latency and fewer cold starts.

A new multi-region instance configuration is now available in North America - nam9 (North Virginia/Iowa/South Carolina/Oregon).

Support for 1500 MTU in VPC networks is now Generally available.

Support export sub-command in the config-connector CLI

Add support for the AccessContextManagerServicePerimeter resource

Add support for Folder-level IAM Audit Configs

Support for 1500 MTU in VPC networks is now available in General Availability.

Dynamic SQL is now generally available (GA). Dynamic SQL lets you generate and execute SQL statements dynamically at runtime. For more information, see EXECUTE IMMEDIATE.

BigQuery standard SQL now supports the following new functions. These functions are generally available (GA).

• ASCII
• CHR
• INITCAP
• INSTR
• LAST_DAY
• LEFT
• OCTET_LENGTH
• REGEXP_EXTRACT with 2 additional parameters (position and occurrence)
• REGEXP_INSTR
• REGEXP_SUBSTR
• RIGHT
• SOUNDEX
• TRANSLATE
• UNICODE

BigQuery now supports the following new statements. These statements are generally available (GA).

• CREATE EXTERNAL TABLE
• DROP EXTERNAL TABLE
• ALTER TABLE ADD COLUMN
• EXPORT DATA
• TRUNCATE TABLE

BigQuery standard SQL now supports DATE arithmetics operators.

The following INFORMATION_SCHEMA views are now generally available (GA).

• TABLES
• TABLE_OPTIONS
• COLUMNS
• COLUMN_FIELD_PATHS
• VIEWS
• ROUTINES
• ROUTINE_OPTIONS
• PARAMETERS
• SCHEMATA
• SCHEMATA_OPTIONS

BigQuery now supports Unicode table names. For more information, see Table naming.

Queries can now have duplicate column names.

Compute-optimized (C2) machine types are now available in the following regions and zones:

• Finland: europe-north1-a,b,c
• Seoul: asia-northeast3-a,b,c

See VM-instance-pricing for details.

Sign in with Apple is now supported.

1.4.10-asm.19 is now available

In runtimes that use buildpacks you can now configure aspects of your build by setting build configuration variables. See Using Environment Variables for more information. In Preview.

You can now control egress traffic from a service and route all outbound requests to your VPC network. This allows you to configure a static outbound IP address by leveraging Cloud NAT.

CHECK constraints is now generally available, allowing you to define a boolean expression on the columns of a table and require that all rows in the table satisfy the expression. For more information, see Creating and managing check constraints.

Generated columns support is now generally available, allowing you to define columns that are computed from other columns in a row. For more information, see Creating and managing generated columns.

Cloud Talent Solution has launched the v4 version of the API. Migrate to Cloud Talent Solution v4 by October 14, 2021 to continue using Cloud Talent Solution.

Obtaining the status of the latest transfer operation is in Preview.