|
Search Jobvertise Jobs
| |
Jobvertise
|
Big Data Engineer Analytics Engineer
Location: US-TX-Dallas
Email this job to a friend
Report this Job
Hi There, Our client is a global information technology, consulting, and outsourcing company providing services to the Financial, Manufacturing, healthcare, telecom, and media industries. They are currently looking for an Big Data Engineer (Analytics Engineer) with a Fulltime project in Remote below is the detailed requirement. Job Title: Big Data Engineer (Analytics Engineer) Location: Remote Duration: Fulltime Required Skills - DBT and snowflake and Tableau reporting Bachelor's degree in Computer science or equivalent, with minimum 6+ Years of relevant experience 3+ Years hands on knowledge on SQL as well as SQL/NoSQL databases Proficient in programming languages such as Python and R Working knowledge of API development Experience in building data pipelines in ETL/ELT methods Experience with integration of data from multiple data sources Experience in one of the NoSQL databases, such as HBase, Cassandra, DynamoDB, MongoDB Knowledge of real-time/streaming/event-based data engineering frameworks, such as Flume, Pub-Sub, Kinesis, Eventhub Working knowledge and experience in Big data services in one of the Cloud Provider will be good (AWS or Azure or GCP) Preferred Requirements Proven fluency in SQL and its use in code-based ETL frameworks such as dbt Understanding of ETL/ELT pipelines, analytical data modeling, aggregations, and metrics Fluency in a development language such as Python Experience with tools we use every day: Storage: Snowflake, AWS Storage Services (S3, RDS, Glacier, DynamoDB) ETL/BI: Airflow, dbt, Matillion, Looker, Tableau Cloud Infrastructure: AWS Kinesis, Lambda, API Gateway, Terraform Experience with tools we don't use, but should, Proven passion and talent for teaching fellow engineers and non-engineers Proven passion for building and learning: open source contributions, pet projects, self-education, Stack Overflow Experience in education or ed-tech Other Requirements BS in Computer Science, Data Science, or equivalent 2+Yrs of professional software development or data engineering experience Strong CS and data engineering fundamentals Knowledge of Data Warehousing design, tooling, and support Strong communication skills in writing and conversation Familiarity with metadata management tools Experience building dashboards, reports, models in business intelligence tools such as Tableau or Looker Responsibilities Implement Data integration and Data Warehouse based solutions using AWS Big Data Technologies. Should be highly proficient in the use of Big Data / Open Source Technologies and standard techniques of Data Integration, Data Manipulation with a hands-on contribution. Should be able to develop cost-efficient and performant data pipelines in the cloud platform In-depth understanding of modern big data technology, including Data modeling and machine learning skills Knowledge of real-time data streaming and aggregation architectural patterns and practice Example Projects You Might Work On - Building well-tested and documented ELT data pipelines for both full and delta extraction
- Engineer novel dataset which expresses a student's progress and performance through an adaptive learning experience which allows for flexible comparison across students and deep analysis of individual students.
- Work with data science to measure the impact of design changes to an administrator reporting application.
- Improve the build and query efficiency of data models constructed from a large volume of event stream data.
- Contributing to leading industry data standards, such as Caliper Analytics or xAPI
- Crafting slowly changing dimensional models that take into account the nuances of K-12 education such as School Year changes and students moving schools or classes.
The Role offers. Opportunity to join a global team to do meaningful work that contributes to global strategy and individual development An outstanding opportunity to reimagine, redesign, and apply technology to add value to the business and operations Gives an opportunity to showcase candidates' strong analytical skills and problem-solving ability Grow into a Technical architect role over a period Essential Qualification BE/BTech in Computer Science, Engineering, or relevant field
Lorven technologies
|
