data engineer

Full Time
Illinois
Posted
Job description

Duration: 7+ months


Job Description:

  • Within this role, you would be a hands-on leader in data engineering functions including schema design, data movement, data transformation, encryption, and monitoring all the activities needed to build, sustain and govern big data pipelines.


Responsibilities:

  • Own development of large-scale data platform including operational data store, real time metrics store and attribution platform, data warehouses and data marts for advertising planning, operation, reporting and optimization
  • Wider team collaboration and system documentation
  • Maintain next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
  • Advocate the best engineering practices, including the use of design patterns, CI/CD, code review and automated integration testing.
  • Required Education, Experience, Skills and Training
  • Bachelor or above in computer science or EE
  • 5+ years of professional programming in Scala, Java and SQL
  • 5+ years experience developing in Amazon Cloud technologies including S3, Glue, EC2, and Kinesis
  • 5+ years of big data design experience with technical stacks like Spark, Flink, Druid, Clickhouse, Single Store, Snowflake, Kafka, Nifi and AWS big data technologies
  • Proven track record with cloud infrastructure technologies, at least two of Terraform, K8S, Spinnaker, IAM, ALB, and etc.
  • Experience building highly available and scalable services for public consumption
  • Experience with processing large amount of data at petabyte level
  • Strong knowledge of system design, application design and architecture
  • Proficiency in both written and oral English


The Capgemini Freelancer Gateway is enabled by a cutting-edge software platform that leads the contingent labor world for technology innovation. The software platform leverages Machine Learning and Artificial Intelligence to make sure the right people end up in the right job.


A global leader in consulting, technology services and digital transformation, Capgemini is at the forefront of innovation to address the entire breadth of clients’ opportunities in the evolving world of cloud, digital and platforms. Building on its strong 50 year heritage and deep industry-specific expertise, Capgemini enables organizations to realize their business ambitions through an array of services from strategy to operations. Capgemini is driven by the conviction that the business value of technology comes from and through people. It is a multicultural company of over 200,000 team members in more than 40 countries. The Group reported 2018 global revenues of EUR 13.2 billion.

jjbodyshop.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, jjbodyshop.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, jjbodyshop.com is the ideal place to find your next job.

Intrested in this job?

Related Jobs

All Related Listed jobs