Job Description

1st preference of locations for this role are LA, SEA or NYC; 2nd preference is 100% REMOTE OK

A streaming client is in need of hiring a unique candidate who is a Sr Data Quality Engineer who not only understands data and has the technical background, but also someone who has a 'quality engineering and testing mindset' and is passionate about testing. This role is 50% Data Engineering and 50% Quality focused. You will be responsible for building strong SQL test cases to test data and use Python/PySpark as well for testing. This is a technical role where you will be responsible for helping build the automation process for data validation and testing, while working through a backlog of work. You will be responsible for validating big data from the core media/networks team. Currently, no QE team exists to support this team/their data, so you will be responsible for establishing a QE process. This data is similar to other teams where there is a large amount of big data where you will have to apply business logic to the data, then transform it to become more meaningful to the Data Analysts/Scientists; you will essentially own the quality of data for this team. In addition, you will use automation while doing ETL validations (i.e. the ETL is already built by a different team), so you will be responsible for validating the ETL and adhere to standards. You must also know write queries as well as test your own scripts/queries. You will also be required to attend team/scrum meetings and sprint stand ups and planning sessions. In addition, this team is really looking for a candidate who is passionate about learning, is collaborative, and has excellent communication.

Additional Responsibilities:

. Test and validate ETL logic and Data Pipelines

. Own the quality of every release into production with a data-driven approach

. Create, deliver and continuously improve our quality processes for delivering

operational

data to address all types of subscriber and commerce operations to our stakeholders.

. Partner with Data Analysts, Product and Engineering teams to deeply understand the

underlying transactional systems behavior and business use cases.

. Translate reporting and operational technical specifications, including calculations,

custom groups, parameters, filtering criteria and/or aggregations into test requirements.

. Build automated and reusable tests for data stores to improve quality and

development velocity

. Diagnose issues, report defects, and propose regression tests to catch recurring bugs

. Mentor fellow Test Engineers on the team to ramp up on automation concepts and

contribute towards expanding test coverage

Job Qualifications

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to HR@insightglobal.com .

To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy: https://insightglobal.com/workforce-privacy-policy/ .

Skills and Requirements

1st preference of locations for this role are LA, SEA or NYC; 2nd preference is 100% REMOTE OK

5 +years of experience as a Data Engineer, specifically in Quality Engineering and validating ETL pipelines and Data Warehouses

Strong programming (Scala/Java) or scripting skills (Python)

Expert SQL knowledge and must be able to write strong test cases

Experience in data analytics, data engineering

data modeling, data warehousing, and big data platforms

Experience with but not limited to JUnit/TestNG/BDD, or similar tools

Experience in a range of common big data tools & technologies such as PySpark, Airflow, Hive, Snowflake, Databricks, Spark etc.

Experience in working with large datasets (Terabytes or more)

Experience working with relational databases as well as a working familiarity with a variety of databases

Ability to operate effectively in a team-oriented and collaborative environment

Excellent communication skills and ability to interact with all levels of end users and technical resources AWS experience null

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion,sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military oruniformed service member status, or any other status or characteristic protected by applicable laws, regulations, andordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to HR@insightglobal.com.