City
Toronto
Province
ON
Salary Range
100,000.00 CAD to 140,000.00 CAD
Job Title
Data Engineer
Job Type
Full-Time Regular
Date Posted
8/26/2020
 

Our Fin-tech client located in Toronto is looking to hire a Data Engineer to build futuristic AI products.

Job Overview:

You will be working on writing frameworks building for real time and batch pipelines to ingest and transform events every day. Machine Learning experts and Software engineers consume these for building data products like personalization and fraud detection.

Responsibilities:

  • Building serious data pipelines ingesting and transforming > 10 ^6 events per minute and terabytes of data per day
  • Producing clean, maintainable, and testable code part of real-time data pipeline
  • Hands- on knowledge of micro services work and are familiarity with concepts of data modelling
  • Connect different services for follow the flow of data through various pipelines to debug data issues.
  • Understand issues with ingesting data from applications in multiple data centers across geographies, on-premises and cloud
  • Help optimize the feature pipelines for fast execution and work with software engineers to build event driven micro services.

Must-haves:

  • 3-5 years with Python/Spark/Kafka
  • 3-5 years with Java or Scala
  • Experience with distributed systems
  • Strong skills on reactive frameworks (Project Reactor, Akka, Vert. x or Ratpack.)
  • Prior experience as a Software Engineer

Nice to haves:

  • Knowledge of Flink/Druid/Ignite/Presto/Athena and understand when to use one over the other
  • Understanding of networking premises across multiple data centers
  • BI background would be an asset


STACK IT Recruitment Inc., based in Mississauga, places candidates throughout the Greater Toronto Area. We pride ourselves in being the number one recruitment company in information technology. Don’t take our word for it – our track record of placing highly qualified candidates speaks for itself!



STACK IT Recruitment Inc., based in Mississauga, places candidates throughout the Greater Toronto Area. We pride ourselves in being the number one recruitment company in information technology. Don’t take our word for it – our track record of placing highly qualified candidates speaks for itself!

Apply With