Kansas Works Jobs

Job Description

Insight Global is seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for migrating data pipelines from multiple apps hosted on two legacy databases (on-prem Oracle and MsSQL) into Snowflake. These databases support core applications like Salesforce, NetSuite, Workday, and other enterprise applications. The role involves replicating data in S3 and performing modeling of the data. Key responsibilities include making API calls, querying databases, and handling data extraction and loading processes. The candidate should have experience with AWS Glue for data replication and modeling in Snowflake, as well as using Talend for ETL migrations. Proficiency in AWS Glue, PySpark, and Snowflake is essential. The role will require coding in PySpark. Experience with MySQL server, including querying and stored procedures, is also required. The initial phase of this transformation will focus on Glue and Python, while the final phase will be more focused on Snowflake and stored procedures. The role is 80% hands-on development.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

7+ years' of professional data engineering experience in an enterprise environment

  Proficiency with Snowflake:

   Writing and optimizing stored procedures in Python for data replication and ingestion from S3 into Snowflakes presentation layer. Experience with AWS Glue jobs for data replication and ingestion.

  Proficiency with SQL:

   Loading and transforming data from SQL Server into AWS Glue. Writing SQL queries for data manipulation and transformation.

  Proficiency with Python:

   Developing PySpark jobs for data transformation and movement. Using AWS Glues drag-and-drop interface for data selection and transformation.

  Strong Experience with AWS Glue for ETL:

   Understanding ETL processes, including job creation, scheduling, and monitoring. Integrating data from various sources into a cohesive data pipeline.

Experience with industry best practices and comfortable providing insight on ETL design/builds Experience with Talend for ETL

  Experience with Git for source control

  Experience with JavaScript

SCALA experience null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.