Stay organized with collections
Save and categorize content based on your preferences.
google.appengine.api.files.shuffler module
Summary
Files API.
Deprecated since version 1.8.1: Use Google Cloud Storage Client library instead.
Files API Shuffler interface
Contents
- google.appengine.api.files.shuffler.shuffle(job_name, input_file_list, output_file_list, callback)source
Shuffle mapreduce files using the shuffler service.
Parameters
-
job_name – unique shuffle job name as string.
-
input_file_list – list of files api file names to shuffle. Files should be
in records format with serialized KeyValue protocol buffer as record.
-
output_file_list – list of files api file names to store shuffle result.
Files should not be finalized. They will be of records format with
serialized KeyValues protocol buffer as record.
-
callback –
shuffle service call back specification. Can be either
url - the task in default queue with default parameters will be enqueued.
It can also be a dict with following keys:
url: url to call back
version: app version to call
method: HTTP method to use (POST or GET)
queue: queue name to enqueue a task in.
RaisesShufflerUnavailableError if shuffler service is not available.
- google.appengine.api.files.shuffler.available()source
Determine if shuffler service is available for the app.
ReturnsTrue if shuffler service is available, False otherwise.
Except as otherwise noted, the content of this page is licensed under the Creative Commons Attribution 4.0 License, and code samples are licensed under the Apache 2.0 License. For details, see the Google Developers Site Policies. Java is a registered trademark of Oracle and/or its affiliates.
Last updated 2023-04-04 UTC.
[[["Easy to understand","easyToUnderstand","thumb-up"],["Solved my problem","solvedMyProblem","thumb-up"],["Other","otherUp","thumb-up"]],[["Hard to understand","hardToUnderstand","thumb-down"],["Incorrect information or sample code","incorrectInformationOrSampleCode","thumb-down"],["Missing the information/samples I need","missingTheInformationSamplesINeed","thumb-down"],["Other","otherDown","thumb-down"]],["Last updated 2023-04-04 UTC."],[[["The `google.appengine.api.files.shuffler` module, part of the Files API, is deprecated and users are advised to use the Google Cloud Storage Client library instead."],["The primary function `shuffle` enables shuffling of mapreduce files, requiring a job name, input file list, output file list, and a callback specification."],["The `shuffle` function's input and output files use a records format with serialized KeyValue protocol buffers."],["The `available` function determines if the shuffler service is operational, returning `True` if available and `False` otherwise."],["The `shuffle` function can raise a `ShufflerUnavailableError` if the shuffler service is not accessible."]]],[]]
