- gcloud alpha dataproc - create and manage Google Cloud Dataproc clusters and jobs
gcloud alpha dataproc GROUP [GCLOUD_WIDE_FLAG ...]
(ALPHA) The gcloud dataproc command group lets you create and manage
Cloud Dataproc is an Apache Hadoop, Apache Spark, Apache Pig, and Apache Hive service. It easily processes big datasets at low cost, creating managed clusters of any size that scale down once processing is complete.
More information on Cloud Dataproc can be found here: cloud.google.com/dataproc and detailed documentation can be found here: cloud.google.com/dataproc/docs
To see how to create and manage clusters, run:
- $ gcloud alpha dataproc clusters
To see how to submit and manage jobs, run:
- $ gcloud alpha dataproc jobs
GCLOUD WIDE FLAGS
These flags are available to all commands: --account, --configuration, --flags-file, --flatten, --format, --help, --log-http, --project, --quiet, --trace-token, --user-output-enabled, --verbosity. Run $ gcloud help for details.
GROUP is one of the following:
(ALPHA) Create and manage Google Cloud Dataproc clusters.
(ALPHA) Submit and manage Google Cloud Dataproc jobs.
(ALPHA) View and manage Google Cloud Dataproc operations.
(ALPHA) Create and manage Google Cloud Dataproc workflow templates.
This command is currently in ALPHA and may change without notice. If this command fails with API permission errors despite specifying the right project, you will have to apply for early access and have your projects registered on the API whitelist to use it. To do so, contact Support at cloud.google.com/support These variants are also available:
- $ gcloud dataproc $ gcloud beta dataproc