A data engineering team has an existing library of custom Apache Spark applications written and tuned by their engineers, including several jobs that require specific open-source Spark configurations and third-party JAR dependencies. They want to run these jobs on a fully managed, auto-scaling service without provisioning or managing clusters, and they want to pay only for the resources consumed during job execution. Which service best meets these requirements with the least migration effort?