The following release notes cover the most recent changes over the last 30 days. For a comprehensive list, see the individual product release note pages .
You can see the latest product updates for all of Google Cloud on the Google Cloud release notes page.
To get the latest product updates delivered to you, add the URL of this page to your
feed
reader, or add the feed URL directly: https://cloud.google.com/feeds/gcp-release-notes.xml
September 22, 2020
AI Platform TrainingAI Platform Training runtime version 2.2 now supports training with TPUs using TensorFlow 2.2.
The histogram panel in the Logs Viewer (Preview) now contains a viewport to help you quickly understand the time range of the log entries you're viewing within the Query results pane. To learn more, go to the Histogram panel.
NVIDIA® T4 GPUs are now available in the following additional regions and zones:
- Sydney, Australia:
australia-southeast1-a
For information about using T4 GPUs on Compute Engine, see GPUs on Compute Engine.
September 21, 2020
AI Platform NotebooksAI Platform Notebooks API is now Generally Available. The API now includes an isUpgradable endpoint and adds manual and auto-upgrade functionality to notebooks instances created using the API.
Cloud Audit Logging for AI Platform Notebooks is now Generally Available.
Granular IAM permissions for AI Platform Notebooks is now Generally Available.
AI Platform Notebooks now supports E2 machine types.
The following new regions have been added:
europe-west2(London, UK)europe-west3(Frankfurt, Germany)europe-west6(Zürich, Switzerland)
The following time-unit partitioning features are now Generally Available (GA):
- Creating partitions using hourly, monthly, and yearly time-unit granularities.
- Using a
DATETIMEcolumn as the partitioning column.
Logs Buckets are now generally available. For information about this feature, refer to the Managing logs buckets guide.
Cloud SQL has upgraded Replicating from an external server to version 1.1. You can now:
- Replicate from sources where GTID is not enabled.
- Allow Cloud SQL to copy data directly from an external server to a Cloud SQL replica.
- Use new APIs that give you greater control to verify replication requirements, retry after making external server configuration changes, and remove the 30-minute limit for successful connectivity to an external server.
Cloud SQL for SQL Server enables you to set a default collation value for databases in an instance. This collation value is a default for sorting rules, case, and accent sensitivity. You can set this value through the Cloud Console, the gcloud command, and the Cloud SQL Admin API.
You can now use workload identity federation, available in beta, to grant access to Google Cloud resources from on-premises and multi-cloud workloads.
Running Connectivity Tests to and from Google-managed services is available in Alpha. This release includes support for Google Kubernetes Engine (GKE) cluster masters and Cloud SQL instances.
September 18, 2020
BigQueryBeginning in late 2020, all BigQuery predefined roles with permission to create jobs, including queries, will also be able to get information about their own jobs and cancel their own jobs. This change does not include permission to see jobs created by other users.
Events for Cloud Run for Anthos is now available in beta.
New sub-minor versions of Dataproc images: 1.3.69-debian10, 1.3.69-ubuntu18, 1.4.40-debian10, 1.4.40-ubuntu18, 1.5.15-debian10, 1.5.15-ubuntu18, 2.0.0-RC11-debian10, and 2.0.0-RC11-ubuntu18.
All image versions
- Upgrade Conscrypt to version 2.5.0
Image 2.0 preview
- Enable outbound private IPv6 Google APIs access from cluster nodes by default.
- Upgrade Miniconda to version 4.8.3
- Upgrade Python to version 3.8
- Upgrade Delta Lake to version 0.7.0
- Upgrade Iceberg to version 0.9.1
- Upgrade Spark to version 3.0.1
- Backport HIVE-18702:
INSERT OVERWRITE TABLEdoesn't clean the table directory before overwriting.
September 17, 2020
Anthos Anthos GKE on AWSGKE on AWS 1.4.3-gke.7 is now available. GKE on AWS 1.4.3-gke.7 clusters run on Kubernetes 1.16.13-gke.1402.
To Upgrade:
- Upgrade your Management service to 1.4.3-gke.7.
- Upgrade your user clusters to to 1.16.13-gke.1402.
A vulnerability, described in CVE-2020-14386, was recently discovered in the Linux kernel. The vulnerability may allow container escape to obtain root privileges on the host node.
All GKE on AWS nodes are affected.
To fix this vulnerability, upgrade your management service and user clusters to this patched version. The following GKE on AWS version contains the fix for this vulnerability:
- GKE on AWS 1.4.3
For more information, see the Security Bulletin
Anthos GKE on-prem 1.4.3-gke.3 is now available. To upgrade, see Upgrading GKE on-prem. GKE on-prem 1.4.3-gke.3 clusters run on Kubernetes 1.16.11-gke.11.
Fixes:
Fixed CVE-2020-14386 described in Security Bulletin.
Preflight check for hostname validation was too strict. We updated the hostname validation following the RFC 1123 DNS subdomain definition.
There was an issue in the 1.4.0 and 1.4.2 releases where the node problem detector didn't start when the node restarted. This is fixed in this version.
Anthos GKE on-prem 1.3.4-gke.3 is now available. To upgrade, see Upgrading GKE on-prem. GKE on-prem 1.3.4-gke.3 clusters run on Kubernetes 1.15.12-gke.15.
Fixes:
- Fixed CVE-2020-14386 described in Security Bulletin.
The BigQuery Data Transfer Service is now available in the following regions: Los Angeles (us-west2), São Paolo (southamerica-east1), South Carolina (us-east1), Hong Kong (asia-east1) and Osaka (asia-northeast2).
The BigQuery Data Transfer Service is now available in the following regions: Los Angeles (us-west2), São Paolo (southamerica-east1), South Carolina (us-east1), Hong Kong (asia-east1) and Osaka (asia-northeast2).
- New versions of Cloud Composer images:
composer-1.12.0-airflow-1.10.3,composer-1.12.0-airflow-1.10.6,composer-1.12.0-airflow-1.10.9, andcomposer-1.12.0-airflow-1.10.10. The default iscomposer-1.12.0-airflow-1.10.6. Upgrade your Cloud SDK to use features in this release.
- Airflow 1.10.10 is now available.
- You can now securely store Airflow connections and secrets by configuring Composer environments with Secret Manager.
- All new Environments now use Zonal DNS names.
- Validation has been added to prevent setting DAG serialization and async DAG bag loading at the same time.
- Fixed rendering templates in the Airflow UI when async DAG bag loading is on.
- Fixed an issue with Airflow worker Pod placement on GKE Nodes after environment upgrade and update.
- Added validation to the v1 API so that environment creation fails quickly if Domain Restricted Sharing is enforced in the project.
- Environment variables set by the user at the environment creation are now correctly propagated to Pub/Sub topics.
- A fix for the broken Airflow Sentry integration has been backported to older Composer Airflow versions.
Airflow 1.10.9:
- Fixed an issue where task retries did not work while DAG serialization was turned on.
- Fixed an issue that broke Airflow database connections when DAG serialization was turned on.
- Fixed an issue where the default worker concurrency could not be set, causing problems with cluster resources usage.
You can now configure a ParserVersion in an HL7v2 store, which allows you to set the version of the unschematized parser. A new parser version, V2, has been added, which allows parsedData to include every given non-empty message field. This version parses the MSH segment starting with the MSH-1 field and is in accordance with the HL7v2 standard.
In the Logs Viewer (Preview), you can now pin log entries within the Query results and Histogram panes. To learn more, go to Pinning logs.
In the Logs Viewer (Preview), you can now view a log entry in its resource context. To learn more, go to Viewing a pinned log entry in its resource context.
You can now copy a link to a log entry in the Logs Viewer (Preview). To learn more, go to Copy a link to a log entry.
You can now migrate a VM instance from one network to another. This feature is available in Beta.
The issue with undeleting service accounts has been resolved. You can now undelete most service accounts that meet the criteria for undeletion.
September 16, 2020
Compute EngineTroubleshoot VMs by capturing a screenshot from the VM. This is Generally Available.
You can now use the goog-firestoremanaged billing report label to view costs related to export and import operations.
You can now use the goog-firestoremanaged billing report label to view costs related to import and export operations.
There is a known issue with the upgrade from GKE 1.16 to 1.17. Any custom resources you created in the istio-system namespace are deleted during an upgrade to 1.17 (R30 or earlier). These resources must be manually recreated. We recommend that you do not upgrade to GKE 1.17 until a patch release fixes the issue. The fix will be rolled out in GKE release R31.
September 15, 2020
Cloud Load BalancingAdded total latency to external HTTP(S) load balancer Cloud Logging entries. Total latency measures from when the external HTTP(S) load balancer receives the first bytes of the incoming request headers until the external HTTP(S) load balancer finishes proxying the backend's response to the client. This feature is now available in General Availability.
Cloud SQL now offers serverless export. With serverless export, Cloud SQL performs the export from a temporary instance. Offloading the export operation allows databases on the primary instance to continue to serve queries and perform other operations at the usual performance rate.
Cloud SQL now offers serverless export. With serverless export, Cloud SQL performs the export from a temporary instance. Offloading the export operation allows databases on the primary instance to continue to serve queries and perform other operations at the usual performance rate.
The following PostgreSQL minor versions have been upgraded:
- PostgreSQL 9.6.16 is upgraded to 9.6.18.
- PostgreSQL 10.11 is upgraded to 10.13.
- PostgreSQL 11.6 is upgraded to 11.8.
- PostgreSQL 12.1 is upgraded to 12.3.
SSD persistent disks attached to certain VMs with at least 64 vCPUs can now reach 100,000 write IOPS. To learn more about the requirements to reach these limits, see Block storage performance.
September 14, 2020
Cloud CDNCache Modes, TTL overrides and custom response headers are now supported on backend buckets and backend services, and are available in beta.
Cache modes allow Cloud CDN to automatically cache static content types, including web assets like CSS, JavaScript and fonts, as well as image and video content.
TTL overrides support fine-tuning how long Cloud CDN caches your responses, and custom response headers introduce a new {cdn_cache_status} variable that is populated with the cache status response.
External HTTP(S) Load Balancing now supports setting custom response headers on backend buckets and services. This feature is available in beta.
Custom response headers make it easier to set common web security headers and/or override response headers from your application at the load balancer.
The External HTTP(S) Load Balancer now supports setting custom response headers on backend buckets and services. This feature is available in Beta.
Custom response headers make it easier to set common web security headers and override response headers from your application at the load balancer.
Cloud Logging now offers the ability to view a history of your ran queries through the Recent queries tab. To learn more, go to the Recent queries section on the Building queries page.
Compute-optimized (C2) machine types are now available in Sydney, Australia australia-southeast1-a. See VM instance pricing for details.
The gcloud datastore index create and gcloud datastore index cleanup commands now require gcloud version 279.0.0 or greater. To update the gcloud CLI, use the gcloud components update command.
There is no longer a requirement that the subnet of the deployment cluster is under the same network as the Cloud Extension.
Bug fix for shot change detection API: Tuned internal model parameters to reduce false positives under certain scenarios.
September 11, 2020
BigQueryYou can now use the BQ.JOBS.CANCEL system procedure to cancel a job. For more information, see Canceling jobs.
Compute Engine TPU Metrics and Logs In-Context
New Monitoring tab for TPUs provides key TPU Metrics and access to logs at a glance. You can see a variety of key TPU metrics including MXU utilization, CPU, memory, sent/received traffic, and more. In addition, it provides instant access to TPU logs which give insight into important events.
You can build highly available deployments of stateful workloads on VM instances using stateful managed instance groups (stateful MIGs). A stateful MIG preserves the unique state of each instance (instance name, attached persistent disks, and/or metadata) on machine restart, recreation, autohealing, or update. Stateful MIGs are Generally available.
Added the PrivateIpv6GoogleAccess API field to allow configuring IPv6 access to Dataproc cluster.
New sub-minor versions of Dataproc images: 1.3.68-debian10, 1.3.68-ubuntu18, 1.4.39-debian10, 1.4.39-ubuntu18, 1.5.14-debian10, 1.5.14-ubuntu18, 2.0.0-RC10-debian10, and 2.0.0-RC10-ubuntu18.
1.3-1.5 Images:
HIVE-18323:
Vectorization: add the support of timestamp in
VectorizedPrimitiveColumnReader for parquet
1.5 and 2.0 preview images:
Upgraded the jupyter-core and jupyter-client packages in the 1.5 and 2.0 images to be compatible with the installed notebook package version.
2.0 preview image:
- HIVE-21085: Materialized views registry starts non-external Tez session.
- HIVE-22647: Enable session pool by default.
- HDFS-14759: HDFS cat logs an info message.
- Upgraded Scala to 2.12.12 version.
- Upgraded Druid to 0.19.0 version.
- Upgraded Flink to 1.11.1 version.
- Upgraded Hue to 4.7.1 version
- Upgraded Presto SQL to 340 version.
Fixed a regression that could cause clusters to fail to start if user-supplied keystore/truststore are provided when enabling Kerberos.
September 09, 2020
Cloud CDNAdded a new tutorial: Faster web performance and improved web protection for load balancing.
Added a new tutorial: Faster web performance and improved web protection for load balancing.
The API for creating and managing alerting policies is now Generally Available. For information on using this API, see Managing alerting policies by API.
Cloud Spanner introduces a new introspection tool that provides insights into queries that are currently running in your database. Use Oldest Active Queries to analyze what queries are running and how they are impacting database performance characteristics.
You cannot undelete most service accounts at this time. Our engineering team is working to resolve this issue.
September 08, 2020
Cloud Data Loss PreventionSTREET_ADDRESS infoType detector is now available in all regions.
Two new permissions, healthcare.locations.get and healthcare.locations.list, have been added to the IAM permissions. These permissions are checked whenever the new GetLocation and ListLocations methods are called.
New conditions available for Object Lifecycle Management:
- Noncurrent time conditions allow you to define lifecycle actions based on when an object became noncurrent.
- Custom time conditions allow you to define lifecycle actions based on a custom time that you define for objects.
Custom time metadata is now available for objects.
- Custom time metadata allows you to associate an arbitrary date and time with objects.
Security Command Center Premium is now in general availability (Container Threat Detection remains in beta). Read these notes to learn about updates, usability improvements, and new features.
Improved Summary Dashboard
- A new set of interactive charts and tables provide a high-level overview of all threats and vulnerabilities.
- An updated time selector lets you choose preset and customizable time ranges for reviewing findings and creating reports.
- New page headers provide users with more page-specific context.
Learn more about Using the Security Command Center dashboard.
Onboarding and configuration upgrades
- A streamlined interface lets you manage organization-wide service enablement settings.
- A dedicated settings page for integrated services has been added to the configuration interface.
Learn more about Setting up Security Command Center.
Security Health Analytics now supports real-time detections, with some exceptions. Read more about Security Health Analytics detectors and findings.
Managed Web Security Scans are now available to all Security Command Center Premium users. Learn more about managed scans in our Overview of Web Security Scanner.
gcloud integration with new, simplified Beta APIs (Alpha)
- The gcloud command line interface can now access configuration functionality through new Beta APIs. The Beta APIs provide stable, programmatic interaction equivalent in functionality to the Security Command Center interface. Learn to use gcloud to manage Security Command Center settings.
Documentation
- New documentation includes details on onboarding and enablement in the Security Command Center latency overview and updates on billing tiers. For more information, read our Pricing guide and visit product pages.
September 04, 2020
Data CatalogData Catalog is now available in Jakarta (asia-southeast2).
Switched 1.3 and 1.3-debian image version aliases to point to 1.3 Debian 10 images.
When Enhanced Flexibility Mode is enabled, increased app master, task, and Spark stage retries to 10 to improve resiliency of applications to downscaling and preemption of preemptible VMs.
Support more than 8 local SSDs on VMs. Compute Engine supports 16 and 24 SSDs for larger machine types.
Changed secondary workers default boot disk size to 1000 GB in clusters created with 2.0 preview images.
Improved node memory utilization in clusters created with 2.0 preview images.
September 03, 2020
Config ConnectorBigtableInstance: numNodes on resources is now optional. You can then programmatically scale your Bigtable instances. You cannot add the numNodes field after creating a BigtableInstance.
For production instances where the numNodes will be managed by Config Connector, this field is required with a minimum of 1. For a development instance or for an existing instance where the numNodes is managed outside of Config Connector, this field must be left unset.
Traffic Director can now be set up for GKE Pods with automatic Envoy injection.
September 02, 2020
Cloud CDNReduced cache fill pricing from Cloud Storage, Compute Engine, and external origins by up to 80% starting September 1st.
Google Cloud has also removed cache-to-cache fill and cache invalidation charges.
Firewall Rules Logging metadata controls is now available in General Availability.
September 01, 2020
Assured Workloads for GovernmentAssured Workloads for Government is now generally available for the FedRAMP Moderate compliance regime.
Cloud Logging updated IAM custom role permissions. Users with custom roles should verify their permissions are correct. For a list of the permissions and roles, go to the Permissions and Roles section on the Access control page.
Beta launch of Dialogflow CX. Dialogflow CX provides a new way of designing agents, taking a state machine approach to agent design. This gives you clear and explicit control over a conversation, a better end-user experience, and a better development workflow.
As part of introducing Dialogflow CX, some changes have been made to editions:
- Dialogflow Enterprise Edition is no longer used as an umbrella term for paid editions.
- Dialogflow Standard Edition is now called Dialogflow Trial Edition.
- Dialogflow Plus Edition and Dialogflow Essentials Edition have been merged to one Dialogflow Essentials (ES) Edition.
- Dialogflow Customer Experience (CX) Edition is a new edition with a simpler pricing and quota model.
The service previously named Dialogflow is now called Dialogflow ES, and the term Dialogflow is now an umbrella term used to describe both the Dialogflow ES and Dialogflow CX services.
Filestore Troubleshooting page published. Now you can troubleshoot common Filestore issues.
Beta stage support for the following integration:
August 31, 2020
BigQueryUpdated version of Magnitude Simba JDBC driver includes bug fixes and enhancements such as automatically turning on the BigQuery Storage API for anonymous table reads (no charge for temporary table reads).
Google Cloud internal HTTP(S) load balancers have native support for the WebSocket protocol when you use HTTP or HTTPS as the protocol to the backend. The load balancer does not need any configuration to proxy WebSocket connections.
Cloud SQL for SQL Server supports cloning using the Cloud Console, the gcloud command, and the Cloud SQL Admin API. When you clone an instance, you create an independent copy of the source instance.
Google Cloud Armor Managed Protection Plus Tier is in Beta. Managed Protection Plus Tier offers a monthly subscription that includes all of the features of Standard Tier, and bundles Google Cloud Armor WAF policy, rules, HTTP request usage, and named IP lists.
Pre-configured rules for local file inclusion (LFI), remote file inclusion (RFI), and remote code execution (RCE) are now in General Availability.
In the details pane for a connection, under View flows in BigQuery, Network Topology now provides a table that lists the subnets relevant to the currently selected connection and whether those subnets have VPC Flow Logs enabled. For more information, see Using generated queries to retrieve detailed logs.
August 28, 2020
AI Platform PredictionRuntime version 2.2 is now available. You can use runtime version 2.2 to serve online predictions with TensorFlow 2.2.0, scikit-learn 0.23.1, or XGBoost 1.1.1. Runtime version 2.2 does not currently support batch prediction.
See the full list of updated dependencies in runtime version 2.2.
Runtime version 2.2 is now available. You can use runtime version 2.2 to train with TensorFlow 2.2.0, scikit-learn 0.23.1, or XGBoost 1.1.1. See the full list of updated dependencies in runtime version 2.2.
Risk analysis job creation is now available in the Cloud DLP UI in Cloud Console.
Added additional infoType detectors:
- STORAGE_SIGNED_URL
- STORAGE_SIGNED_POLICY_DOCUMENT
Cloud Trace exemplars can now be viewing in Cloud Monitoring. For more information about Trace exemplars, see Cloud Trace exemplars. For more information about viewing exemplars, see Exploring charted data.
Cloud Trace exemplars can now be viewing in Cloud Monitoring. For more information about Trace exemplars, see Cloud Trace exemplars. For more information about viewing exemplars, see Exploring charted data.
Launched Dataproc Workflow Timeout feature, which allows users to set a timeout on their graph of jobs and automatically cancel their workflow after a specified period.
Dataproc Metastore integration, which allows users to create a cluster using a Dataproc Metastore service as an external metastore, is now available for Alpha release testing.
New features are available for Credential Access Boundaries, currently in beta:
- You can now manage permissions for Cloud Storage objects, in addition to buckets.
- You can now use IAM Conditions to control which permissions are available in a short-lived OAuth 2.0 access token. For an example, see Limit permissions for specific objects.
- You can now use Credential Access Boundaries with a Cloud Storage bucket that does not use uniform bucket-level access.
For Credential Access Boundaries, currently in beta, you must migrate to a new API endpoint, sts.googleapis.com. To learn how to use the new API endpoint, see Exchanging the OAuth 2.0 access token.
Pub/Sub subscription detachment is now generally available.
August 27, 2020
AI Platform OptimizerAI Platform Optimizer's name has changed to AI Platform Vizier.
Anthos Config Management now includes Config Connector v1.15.1.
Anthos Policy Controller has been updated to include a more recent build of OPA Gatekeeper (hash: 1de87b6).
This release includes several logging and performance improvements.
An issue with git submodule support is preventing syncing of configuration stored in submodule repositories. If this affects you, please contact support so we can suggest ways to handle your required use cases while we correct this.
GKE on AWS 1.4.2-gke.1 is released. This release includes Kubernetes version 1.16.13-gke.1401.
This release includes bug fixes and security improvements. We recommend you update your clusters to this version.
To upgrade your clusters, perform the following steps:
- Upgrade your management service to aws-1.4.2-gke.1.
- Upgrade your user cluster's AWSCluster and AWSNodePools to 1.16.13-gke.1401.
- Fixed Perl version to fix security vulnerability CVE-2020-10878
- Removed a dependency on Musl to fix security vulnerability CVE-2019-14697
1.6.8-asm.9 is now available
Adds beta support for joining multiple clusters from different projects into a single Anthos Service Mesh on Google Kubernetes Engine.
Adds Citadel CA support for gcp profiles.
Fixes an issue for enabling trust domain validation at the transport socket level.
Time series model support is now Generally Available (GA). This release includes a new training option: AUTO_ARIMA_MAX_ORDER.
For more information about time series model support, see the following documentation:
Support referencing org-level IAM custom roles for IAMPolicy/IAMPolicyMember
Increase support for cross-project references
August 26, 2020
AI Platform Deep Learning VM ImageM55 release
- Restricts Jupyter memory usage to fix 5* issues
- Updates TensorFlow 2.3 dependencies
- Uses CUDA 11.0 in TensorFlow deep learning images
- Adds support for the us-east4 region
INFORMATION_SCHEMA views for BigQuery reservations are now Generally Available (GA).
Cloud Functions Node 10 runtime now builds container images in the user's project, providing direct access to build logs and removing the preset build-time quota.
The v1beta1 API has begun updating to a revised version. The update will occur over the next several weeks. View Updates to the v1beta1 API for a list of changes and how to update your client code.
The Organization policy constraint for Cloud NAT has launched into beta.
Traffic Director supports advanced traffic management features with proxyless gRPC applications in General Availability. This release includes path- and header-based routing, as well as weight-based traffic splitting.
August 25, 2020
App Engine standard environment GoThe Go 1.14 runtime for the App Engine standard environment is now generally available.
INFORMATION_SCHEMA views for jobs metadata by timeslice are now available.
Cloud SQL for MySQL 8.0 is now generally available. If you have not used MySQL 8.0, familiarize yourself with the What is new in MySQL 8.0 and Changes in MySQL 8.0.
For information about the implementation of MySQL 8.0 on Cloud SQL, see the following topics:
- MySQL 8.0 authentication
- Differences between Cloud SQL and standard MySQL functionality
- Unsupported Cloud SQL feature in MySQL 8.0 for Cloud SQL
To get started using MySQL 8.0 on Cloud SQL, see Creating instances.
Uploading public keys for service accounts is now generally available.
Speech-to-Text has launched the new On-Prem API. Speech-to-Text On-Prem enables easy integration of Google speech recognition technologies into your on-premises solution.
Beta launch of Workflows.