We are seeking a skilled Python Developer with expertise in data engineering, machine learning, and cloud technologies to join our team in Dallas, TX. The ideal candidate will have a passion for solving complex problems, a strong foundation in Python programming, and experience working with distributed systems and big data technologies.
Responsibilities
Develop and maintain Python-based applications for data engineering and machine learning purposes.
Collaborate with cross-functional teams to design and implement scalable solutions for data processing and analysis.
Implement and optimize pyspark code for efficient distributed data processing.
Utilize NoSQL databases, particularly MongoDB, for data storage and retrieval in large-scale applications.
Design and implement real-time streaming solutions for data ingestion and processing.
Deploy and manage applications in Kubernetes environments, ensuring scalability, reliability, and performance.
Design, build, and deploy machine learning pipelines, incorporating best practices for model training, evaluation, and deployment.
Utilize Delta Live Tables for managing data changes and versioning in data lake environments.
Work closely with DevOps teams to automate deployment processes using Azure DevOps and other CI/CD tools.
Stay updated on emerging technologies and industry trends in data engineering, machine learning, and cloud computing.
Requirements
Bachelor's degree in Computer Science, Engineering, or related field.
Strong proficiency in Python programming language and Pyspark Coding.
Experience with distributed data processing frameworks such as pyspark.
Hands-on experience with NoSQL databases, particularly MongoDB.
Familiarity with real-time streaming technologies and frameworks.
Experience deploying and managing applications in Kubernetes environments.
Knowledge of containerization technologies such as Docker.
Experience designing and deploying machine learning pipelines.
Familiarity with cloud platforms such as Azure.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills.
Seniority level
Entry level
Employment type
Full-time
Job function
Other
Industries
IT Services and IT Consulting
Referrals increase your chances of interviewing at Donato Technologies, Inc. by 2x