Careers at Bigabid

Senior Big Data Engineer

Bigabid is an innovative technology company led by data scientists and engineers devoted to mobile app growth. Our proprietary ad platforms powered by machine learning are the outcome of that devotion.

We deliver valuable results and insights for a fast-growing clientele of major app developers using elite programmatic user acquisition and retargeting technologies. 

Our ever evolving, state-of-the-art machine learning technology analyzes 50TB of raw data per day to produce millions of ad recommendations in real-time. This data is used to power our machine learning predictions, business critical metrics, and analytics to power our decision making.

You will be joining a team responsible for the management of the data layer at petabyte scale by creating and managing enterprise grade systems, and flows that process ~50TB of data every day and growing. The team will constantly evaluate new technologies in the field of stream processing and high scale high concurrency state store. 

Responsibilities:

  • Lead the implementation of scalable streaming data infrastructure that is architected for massive future growth in terms of amounts of data as well as types of fields and information managed in the system.
  • Lead the implementation of a scalable serving layer that is architected for massive parallel throughput at extremely low latency.
  • Be involved in technology selection processes and implementation of new parts of the architecture using these technologies.
  • Have a deep understanding of our data, how it is acquired, managed, versioned, made discoverable, its relations, and how it can be consumed.

Requirements:

  • +6 years of proven experience as a Data/Backend Engineer with Scala, Java or Python. 
  • Experience with designing and building ETL processes and data pipelines using at least one streaming technology like Spark structured streaming, Kafka streaming, Flink etc.
  • Experience with mission critical real-time systems.
  • Proficiency in SQL with strong analytical skills.

Advantage:

  • Cloud native architecture with advantage to AWS.
  • Experience with Iceberg, Airflow, Serverless and containers.
  • CI-CD infrastructures like Terraform, CDK etc.
Please fill out the form below to submit your interest.

Subscribe to
our Newsletter

Contact us
Please fill out the form below to submit your interest.