Senior Data Engineer
Abuja Tech Community
Canada (start remote, then relocate)
·2 yrs
·Full time
·Copy Writing
What you'll be doing:
Working closely with other developers, architects, and product owners using Agile and SCRUM to design big data solutions and shape them into workable stories and plans.
Design and develop software for a large-scale, cloud-based SaaS solution using open-source technologies.
Deliver across the entire software app development lifecycle—design, build, deploy, test, and release.
Peer-reviewing code and mentoring and supporting junior team members. Build strong partnerships with other teams internally and externally to solve problems, and ensure we deliver a cohesive customer experience.
Proactively seeking out new technologies and best practices and supporting the team in adopting them.
Drive benchmarking, optimization, and fine-tuning of software performance.
Who you are:
5+ years of backend software development engineering or data engineering using Ruby, Go, Java or Python.
Identify the different types of e-commerce data and their relevance to the core objectives of the platform; improving conversions, increasing transaction total value, and creating net new customers.
Thorough understanding of lambda and kappa data processing architectures and the ability to apply either depending on the problem definition.
Experience with high-scale data ingestion, transformation, and distributed processing tools like Kafka, Spark, and Databricks.
Ability to create virtual data sets and use them in reporting scenarios to visualize the data.
Excellent verbal and written communication skills.
Bachelor’s degree in CS, CE, EE, or equivalent experience.