Home › GCP Data Engineer › cloudcomputing › gcpdeprocess › Which Dataproc feature should a Data Engineer us…
Which Dataproc feature should a Data Engineer use to run a Spark job ONLY when work exists — paying nothing when idle (PDE §5.1 persistent vs job-based clusters)?
ALong-lived 'always on' cluster with no autoscaling
BCloud DNS
CCloud Memorystore
DDataproc Serverless (or ephemeral / job-scoped clusters created per job)
Answer & Solution
Correct answer: D. Dataproc Serverless (or ephemeral / job-scoped clusters created per job)
Dataproc Serverless + ephemeral clusters are the job-based pattern (per PDE §5.1). The others run idle capacity.
Related questions
Which Dataflow feature lets a Data Engineer reuse a published pipeline as a parameterised,Which Dataflow feature should a Data Engineer enable to BACKFILL or REPROCESS late-arrivinWhich GCP service lets a Data Engineer write streaming SQL queries directly against a Pub/Which Pub/Sub delivery model should a Data Engineer use when subscribers should pull messaWhich BigQuery feature lets a Data Engineer run ANALYTICAL QUERIES across data still livinWhich GCP service should a Data Engineer use for lightweight, serverless workflow orchestrWhich GCP service should a Data Engineer use to orchestrate Cloud Dataflow / BigQuery / DaWhich Apache Beam concept handles events arriving AFTER their window closes — letting the