Google Cloud Big Data and Machine Learning Blog

Innovation in data processing and machine learning technology

Using instance metadata in Cloud Dataproc initialization actions

Friday, July 13, 2018

Properly using Compute Engine's instance metadata can help you dynamically trigger other actions and scale resources in Cloud Dataproc. Learn how.

6 must-see sessions on the Internet of Things (IoT) at Next ‘18

Wednesday, July 11, 2018

Join us at Next '18 in San Francisco for sessions on the Internet of Things. Read on to find out more about six top IoT presentations.

7 must-see sessions on data analytics at Next ‘18

Wednesday, July 11, 2018

Join us at Next '18 in San Francisco for sessions on data analytics. Read on to find out more about seven top data analytics presentations.

How to train a ResNet image classifier from scratch on TPUs on Cloud ML Engine

Tuesday, July 10, 2018

Lak Lakshmanan explains how to train the ResNet image classification model with Cloud TPUs and Cloud ML Engine.

Measuring patent claim breadth using Google Patents Public Datasets

Tuesday, July 10, 2018

Learn how to use a public patents dataset in order to measure patent claim breadth, using a TensorFlow estimator model and BigQuery.

Google Cloud hosts weekend-long event with DataKind to solve real-world challenges with data

Monday, July 9, 2018

Google Cloud worked with DataKind to host a weekend-long, data-driven sprint for nonprofits with the goal of defending human rights.

Using Apache Spark DStreams with Cloud Dataproc and Cloud Pub/Sub

Monday, July 2, 2018

Learn about a tutorial we now offer on Apache Spark's Streaming APIs to deploy Dstreams with Cloud Dataproc, Cloud Datastore, and Cloud Pub/Sub.

Dataflow Stream Processing now supports Python

Friday, June 29, 2018

Learn how to build a simple streaming pipeline in Cloud Dataflow with our new Python SDK.

BigQuery in June: a new data type, new data import formats, and finer cost controls

Friday, June 29, 2018

This is the first in a series of monthly BigQuery feature reviews. In this instance, we discuss a new data type, import formats, and cost controls.

Running format transformations with Cloud Dataflow and Apache Beam

Thursday, June 28, 2018

With Apache Beam on Cloud Dataflow and Cloud Storage, you can now run format transformations quickly and easily. We show the example of AVRO to CSV.

6 must-see sessions on AI and machine learning at Next ‘18

Wednesday, June 27, 2018

Be sure to register in advance for these essential Next '18 sessions on machine learning. Learn how to apply ML successfully and effectively.

How RealtimeCRM built a business card reader using machine learning

Friday, June 22, 2018

Google Cloud customer RealtimeCRM explains how they built a business card scanner with node.js, Cloud Vision, and Cloud Natural language.

ML Explorer: talking and listening with Google Cloud using Cloud Speech and Text-to-Speech

Wednesday, June 20, 2018

Try out some new features of the Cloud Speech and Cloud Text-to-Speech APIs in this ML Explorer post. You'll need a development machine with audio working.

Putting a Groovy twist on Cloud Vision

Monday, June 18, 2018

Learn from Groovy's Guillaume LaForge how to build simple Cloud Vision API examples, including OCR, labeling, and landmark detection with Apache Groovy.

Introducing Cloud Dataflow’s new Streaming Engine

Thursday, June 14, 2018

Our new streaming engine for Cloud Dataflow lets you separate compute and state storage for streams, for more responsive autoscaling on fewer resources.

Securing cloud-connected devices with Cloud IoT and Microchip

Thursday, May 31, 2018

Learn how to secure your cloud-connected embedded devices with Cloud IoT and a secure element from Microchip, along with tips on secure manufacturing.

New machine learning specialization on Coursera teaches you to build production-ready models on GCP

Wednesday, May 23, 2018

We made our previously internal Machine Learning Crash Course public. Now we announce ML instruction for Google Cloud with a Coursera specialization.

Google Cloud Platform and Confluent partner to deliver a managed Apache Kafka service

Tuesday, May 22, 2018

Confluent provides GCP customers with a managed version of Apache Kafka, for simple integration with Cloud Pub/Sub, Cloud Dataflow, and Apache Beam.

Cloud ML Engine adds Cloud TPU support for training

Monday, May 21, 2018

Google Cloud now offers managed, serverless support for training TensorFlow machine learning models in Cloud ML Engine on Cloud TPUs.

Google Cloud for Life Sciences: new products and new partners

Monday, May 14, 2018

Google Cloud now serves a multitude of innovative healthcare and research partners using BigQuery, Variant Transforms, and more. Visit us at BioIT World.

Transform publicly available BigQuery data and Stackdriver logs into graph databases with Neo4j

Friday, May 11, 2018

Learn how to use Neo4j to integrate a BigQuery public dataset with Stackdriver logs into a graph database, to surface new conclusions from complex data.

BigQuery at speed: new features help you tune your query execution for performance

Monday, May 7, 2018

New performance dashboarding features allow you live insight into the performance of your BigQuery queries.

Building an image search application using Cloud Vision API

Friday, May 4, 2018

Cloud Vision API lets you classify numerous types of images with its label detection feature. Learn how to add category filters with GloVe.

Queue your questions: common queries from Google Cloud customers

Thursday, May 3, 2018

Read common questions from customers on the show floor at Gartner's Data and Analytics Summit; they cover big data, machine learning, compliance, and more.

Announcing SAP CodeJams for Google Cloud Platform: learn to integrate SAP HANA with GCP

Wednesday, May 2, 2018

Learn more about developer events that help you integrate SAP HANA, App Engine, BigQuery, and ML Engine, among others, as part of our ongoing partnership.

Free Trial

Get $300 free credit to spend over 12 months

TRY IT FREE
  • Big Data Solutions

  • Product deep dives, technical comparisons, how-to's and tips and tricks for using the latest data processing and machine learning technologies.

  • Learn More

12 Months FREE TRIAL

Try BigQuery, Machine Learning and other cloud products and get $300 free credit to spend over 12 months.

TRY IT FREE