Notice: Over the next few months, we're reorganizing the App Engine documentation site to make it easier to find content and better align with the rest of Google Cloud products. The same content will be available, but the navigation will now match the rest of the Cloud products. If you have feedback or questions as you navigate the site, click Send Feedback.

Python 2 is no longer supported by the community. We recommend that you migrate Python 2 apps to Python 3.

google.appengine.api.files.shuffler module

Summary

Files API.

Deprecated since version 1.8.1: Use Google Cloud Storage Client library instead.

Files API Shuffler interface

Contents

google.appengine.api.files.shuffler.shuffle(job_name, input_file_list, output_file_list, callback)source

Shuffle mapreduce files using the shuffler service.

Parameters

  • job_name – unique shuffle job name as string.

  • input_file_list – list of files api file names to shuffle. Files should be in records format with serialized KeyValue protocol buffer as record.

  • output_file_list – list of files api file names to store shuffle result. Files should not be finalized. They will be of records format with serialized KeyValues protocol buffer as record.

  • callback –

    shuffle service call back specification. Can be either url - the task in default queue with default parameters will be enqueued. It can also be a dict with following keys:

    url: url to call back version: app version to call method: HTTP method to use (POST or GET) queue: queue name to enqueue a task in.

Raises

ShufflerUnavailableError if shuffler service is not available.

google.appengine.api.files.shuffler.available()source

Determine if shuffler service is available for the app.

Returns

True if shuffler service is available, False otherwise.