Questions tagged with Amazon EMR Serverless
Content language: English
Select up to 5 tags to filter
Sort by most recent
Browse through the questions and answers listed below or filter and sort to narrow down your results.
I have been testing out using Livy endpoint from a EMR serverless application according to this documentation:...
I'm using the following:
* EMR Serverless 7.1.0
* XGBoost 2.1.1
* PySpark 3.5.0
I'm trying to train an XGBoost model on EMR Serverless using data in a Delta Lake that's stored on s3. I've previously...
EMR Serverless requires the use of a NAT Gateway for outbound Internet access. The link is [here](https://docs.aws.amazon.com/emr/latest/EMR-Serverless-UserGuide/vpc-access.html).
Will AWS consider...
I'm running into this issue when running a spark job on EMR Serverless.
```
ERROR SparkContext: Error initializing SparkContext.
java.io.IOException: Mkdirs failed to create...
My ultimate goal is to have my EMR Serverless application Internet egress access to invoke a specific third party API/REST call. Unfortunately, the EMR Serverless application must then be put into a...
Hello,
Can we get solution for this error `Service: EmrServerlessResourceManager; Status Code: 403; Error Code: AccessDeniedException` while running spark submit jobs at EMR Serverless.
Below is...
I am unable to find any easy way of configuring Java 17 with EMR serverless via API or CLI commands. Most of the answers are old. Have there been any updates recently on this?
Good day.
I'm trying to submit EMR Serverless job using custom docker image for the serverless app and submitting JAR file to run.
All script and spark arguments are passed correctly. Job stars but...
Unfortunately, the aws-cdk-lib.aws_stepfunctions_tasks module doesn't have any tasks for EMR Serverless. I want to create one that starts an EMR Serverless job (sync). The ASL task state is described...
I know the recommended strategy is to use EMR Serverless or EMR. However, I have a particular use case where I only need to run a fairly small PySpark job and need quick results. I've already gotten...
Hello, I have gone documentation and practically observed the limitation for ENV Keys `spark.emr-serverless.driverEnv` and `spark.emr-serverless.executorEnv` with EMR Serverless which is limited to 50...
Hello,
Im trying with EMR Serverless, switching from EMR getting below error
```
Traceback (most recent call last):
File "/tmp/spark-07b8331c-566b-43e9-bf1a-f0a77cb86420/spark_main.py", line 7,...