Software Developer ( Python Spark & AWS )
Software Developer ( Python Spark & AWS )
Conch Technologies, Inc
Columbus, OH
See who Conch Technologies, Inc has hired for this role
Hi,
Greetings from Conch Technologies Inc
Job Title: Python Spark AWS
Location: Columbus, OH – nonlocal candidates accepted
Duration: 12+ Months COntract or Direct Fulltime
Job Responsibilities
Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus
Thanks & Regards
Nayak Teketi
Phone : 901-317-3453
Email:nayak@conchtech.com
Web: www.conchtech.com
Greetings from Conch Technologies Inc
Job Title: Python Spark AWS
Location: Columbus, OH – nonlocal candidates accepted
Duration: 12+ Months COntract or Direct Fulltime
Job Responsibilities
Develop and maintain data platforms using Python, Spark, and PySpark.
Handle migration to PySpark on AWS.
Design and implement data pipelines.
Work with AWS and Big Data.
Produce unit tests for Spark transformations and helper methods.
Create Scala/Spark jobs for data transformation and aggregation.
Write Scaladoc-style documentation for code.
Optimize Spark queries for performance.
Integrate with SQL databases (e.g., Microsoft, Oracle, Postgres, MySQL).
Understand distributed systems concepts (CAP theorem, partitioning, replication, consistency, and consensus).
Skills
Proficiency in Python, Scala (with a focus on functional programming), and Spark.
Familiarity with Spark APIs, including RDD, DataFrame, MLlib, GraphX, and Streaming.
Experience working with HDFS, S3, Cassandra, and/or DynamoDB.
Deep understanding of distributed systems.
Experience with building or maintaining cloud-native applications.
Familiarity with serverless approaches using AWS Lambda is a plus
Thanks & Regards
Nayak Teketi
Phone : 901-317-3453
Email:nayak@conchtech.com
Web: www.conchtech.com
-
Seniority level
Mid-Senior level -
Employment type
Full-time -
Job function
Engineering and Information Technology -
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Conch Technologies, Inc by 2x
See who you knowGet notified about new Software Engineer jobs in Columbus, OH.
Sign in to create job alertSimilar jobs
People also viewed
-
Java Backend Developer
Java Backend Developer
-
React JS Developer
React JS Developer
-
Java Fullstack Developer
Java Fullstack Developer
-
Web Developer
Web Developer
-
Python Developer
Python Developer
-
Software Engineer (Remote)
Software Engineer (Remote)
-
Java Developer
Java Developer
-
.Net Developer
.Net Developer
-
Sr. Full-Stack .NET Developer
Sr. Full-Stack .NET Developer
-
Full Stack Java (Java with React)
Full Stack Java (Java with React)
Similar Searches
Explore collaborative articles
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
Explore More