Description
PYSPARK Data Engineer
We are Cognizant Artificial Intelligence
Digital technologies, including analytics and AI, give companies a once-in-a-generation opportunity to perform orders of magnitude better than ever before. But clients need new business models built from analyzing customers and business operations at every angle to really understand them. With the power to apply artificial intelligence and data science to business decisions via enterprise data management solutions, we help leading companies prototype, refine, validate and scale the most desirable products and delivery models to enterprise scale within weeks
Location – Remote; United States or Canada
Responsibilities
- Build Data Ingestion pipelines by using Python/Spark and Foundry tools sets and libraries
- Analyze and trouble shoot Data quality and Data discrepancies in the Source System and provide data profiling results.
- Conduct data cleanup address DQ issues for Data Ingestion
- Interpret business questions translate in technical requirement and its underlying data requirements.
- Effectively Interact with QA and UAT team for code testing and migrate to different regions.
- Data Engineer with hands-on experience in PySpark to build data pipes in AWS environments.
- Should be able to understand design documents and independently build the Data Pipes based on the defined Source to Target mappings.
- The candidate should have good exposure to RDBMS and able to convert complex Stored Procedures SQL Triggers etc. logic using PySpark in the Cloud platform.
- The candidate should be open to learn new technologies and implement solutions quickly in the cloud platform.
- Any knowledge of the Palantir Foundry Platform will be a big plus
Required Skills & Experience
- At least 8 years of relevant IT experience
- 5+of proven hands on experience with Python, PYSPARK and AWS technical skills
- You should hold a Bachelors’ degree in Computer Science or equivalent certification
Preferred Qualifications:
- Experience working in an Agile environment with business and technical teams
- Knowledge of provider-sponsored health insurance systems/processes and the healthcare industry
- Knowledge of ETL and ELT using tools like Informatica
Salary and Other Compensation:
The annual salary for this position is between $107,000- $114,000 USD depending on the experience and other qualifications of the successful candidate.
This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.
Benefits:
Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:
- Medical/Dental/Vision/Life Insurance
- Paid holidays plus Paid Time Off
- 401(k) plan and contributions
- Long-term/Short-term Disability
- Paid Parental Leave
- Employee Stock Purchase Plan
Disclaimer:
The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.
Cognizant US Corporation is an Equal Opportunity Employer. If you require accessibility assistance applying for open positions in the US, please send an email with your request to CareersNA2@cognizant.com