Job Title: Data Engineer Job Location: Los Angeles, CA Remote Duration: 1 Year Contract About the role: We are looking for a highly motivated and experienced Data Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing and maintaining comprehensive datalake and warehouse solutions. The candidate should be able to tackle challenges that comes with complex large-scale data having different streams of data sources. Key Responsibilities: - Building different types of data lake and warehousing layers based on specific use cases.
- Building scalable data infrastructure and understanding distributed systems concepts from a data storage and compute perspective.
- Utilizing expertise in SQL and having a strong understanding of ETL (Extract-Transform-Load) and data modeling.
- Ensuring the accuracy and availability of data to customers and understanding how technical decisions can impact the business's analytics and reporting.
- Interfacing with other technology teams to extract, transform and load data from a wide variety of data sources.
- Design Data models and Data Products to enable advanced analytics for business
- Developing scalable engineering solutions and building data solutions that drive real impact at the company
- Collaborate with other teams to ensure proper integration of new features and identify areas for improvement.
- Maintain a deep understanding of the software architecture and how different components interact.
- Ensure quality by performing root cause analysis and troubleshooting of defects.
- Stay current with industry trends and advancements in Data Engineering.
Qualifications: - Bachelor's degree in Computer Science, Software Engineering, or a related field.
- 3+ years of experience in Data Engineering, with a strong focus on batch and stream data processing using distributed computing systems like Spark.
- Proficiency in either pySpark or Scala to handle large-volume data processing.
- Proficiency in programming languages like Python or Java.
- Familiarity with AWS.
- Strong SQL skills, including performance tuning.
- Excellent written and verbal communication skills.
- Experience with Agile software development methodologies.
- Ability to work independently and in a team environment.
|