ML Data Engineer
Location | Montreal |
Job Category | Information Technology |
SP-ID | 27656 |
Position Type | Contract |
Application Deadline | March 3, 2021 |
Experience Required | N/A |
Job Duration | 1 year |
Education Required | N/A |
Our client in the Telecom industry is seeking an ML Data Engineer in Montreal. This is a 11 months contract.
Description:
As an ML Data Engineer, you will be responsible for supporting and implementing code in order to build up the ML Development and Production process. You will be working with a team of data scientists and data engineers to provide an advanced security monitoring solution for the firm. For this reason, you will be asked to assess the current Big Data technology in use and to test new ones to evolve the system. We are not looking for a Data Scientist, but for a Big Data Engineer that understands the ML process and has experience working with Data Scientists.
Your responsibilities will be to support the architecture team to realize this ambitious new program of work. You will need to be comfortable building both new systems and implementing and integrating with existing open-source and commercial products.
Part of your daily work will be to challenge certain concepts and ideas. The goal is to help your peers knowledge to evolve and to open their minds to new approaches.
Your responsibilities:
Integrating machine learning models onto a Hadoop based big data environment using streaming technology.
Working with data scientists to develop part of their code to interface with other components.
Liaise with the DevOps team maintaining the underlying hardware and supporting technologies.
Implement automation and monitoring tools with a DevSecOps mindset
Work with the Architecture Team to test new technology and plan the evolution of the Big Data System
Developing a log enrichment pipeline capable of functioning at a massive scale.
Write code for data enrichment and normalization and deploying it to Openshift
Configure Kafka and other components for handling data pipeline
Maintain up-to-date documentation on the systems and procedures
Required skills:
University degree in Computer Science or five years equivalent experience in Information Technology
Previous experience writing code for use at scale i.e. big data – Information security-related applications e.g. SIEM a benefit.
Proven track record of developing effective and efficient real-time big data processing pipelines
Experience with Hadoop, Cloudera or Hortonworks.
Proven experience with OpenShift or Kubernetes
Proven Experience with Apache Spark and Kafka.
Strong ability to develop in Python. Java and/or Scala
Experience with CI/CD
Skilled thinker, proactive, team-player, highly resourceful and detail-oriented.
Able to track the work by following agile methodologies
Security certification: CISSP, CEH, GSEC, OSCP highly desirable
Location: Canada. Remote is accepted as long as the candidate is available between 9 AM ECT and 5 PM ECT
Candidates must live in Canada and possess a valid work permit.
If you believe that you are a good fit for this position, please send your resume to Rachel Sohyun Jeon at
r.jeon@maxsys.ca