Sr Data Engineer : Kansas City, Missouri_ Remote_ in person interview

Duration: Long Term     

Experience level: 12+ Years

Job Description:  

Reason for Request: (Migration from Oracle to an Enterprise data platform (Snowflake) This position involves designing, developing, and maintaining scalable data pipelines, databases, and systems to ensure the efficient collection, storage, and accessibility of data. Data Engineers collaborate closely with data scientists, analysts, software engineers, and business stakeholders to ensure data is accurate, reliable, and optimized for analysis.


High Level Technical Skills/Experience Required:

·        Educational Background: bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.

·        Programming Proficiency: Expertise in programming languages such as Python, Java, or Scala.

·        Database Management: Strong knowledge of SQL and experience with relational and non-relational databases like Oracle, Snowflake, PostgreSQL, MongoDB…

·        Problem-Solving: Strong analytical and problem-solving skills to address complex data challenges.

·        Attention to Detail: A meticulous approach to data accuracy and process optimization.

·        Effective communication skills to consult effectively with cross-functional teams.

·        Adaptability to work in a fast-paced and dynamic environment.




Preferred skills:

·        Cloud Platforms: Experience with cloud services like AWS, Google Cloud Platform, or Microsoft Azure.

·        Data Pipelines: Hands-on experience building ETL pipelines using tools like Apache Airflow, Talend, or Informatica.

·        Familiarity with DevOps practices, including CI/CD pipelines and containerization tools like Docker and Kubernetes.

·        Certifications in cloud platforms & Snowflake (e.g., AWS Certified Data Analytics, Google Cloud Data Engineer, SnowPro Data Engineer, and SnowPro Architect).




Useful skills:

·        Domain experience with financial or insurance data and terms.

·        Data Warehouse design

·        Familiarity with Agile methodologies

·        Knowledge of data visualization tools such as Tableau, Power BI, or Looker.




Interview Process: 

·        Resumes reviewed and the top candidates will be invited to a meeting that combines the interview and skills assessment in a meeting lasting ~ 90 minutes.

·        Local staff that can interview in our KC office are preferred. For staff not located in the KC metro area we ask for skills assessment proctoring by the vendors.

·        Candidates that can meet with us in person for skills assessments and are available to occasionally collaborate with us in person at the NAIC KC office are preferred.




Description:

·        This consultant will spearhead the department’s project efforts to move from a legacy Oracle database to an enterprise data platform housed in a snowflake database. This consultant will gather information and confer with technical and non-technical staff to gain an understanding of the applications (A large list of prioritized applications will be available). The consultant will analyze, design, specify, document, and present the data structures and data flows that will support the needs of the migrated application to the team. Recommendations for combining or altering applications as well as suggestions regarding delivery platforms are most welcome.




Include the day-in-the- life:

·        Attend daily standups, report progress, plan for the day and impediments.

·        The work will be performed remotely (in person is a possibility if requested by the consultant) for the NAIC’s Market, Financial, and Licensing Department in the Information Technology Group.