Envision Employment Solutions is currently looking for a Data Engineer for one of our partners in the Technology, Information, and Media field.

Job Summary:

We are looking for a data engineer who is skilled in working with large volumes of text and image/video data, such as news articles, social media posts, reviews, and more. You will be responsible for building scalable and reliable data pipelines that collect, process, and store text data from various sources. You will also collaborate with data scientists and other engineers to support natural language processing, topic modelling, and AI for text analysis projects. Your role will also involve consuming scoring endpoints that classify, translate, and qualify text entries. 

• A bachelor’s degree or higher in computer science, data engineering, or a related field, or equivalent work experience 
• 4+ years of experience in a relevant role.
• Strong knowledge of data architectures, data warehousing, databases, and data modelling techniques 
• Strong knowledge/familiarity with Databricks or similar tools for building and orchestrating data processing flows using Spark. 
• Strong knowledge of Spark Streaming and/or other streaming frameworks for real or near real time data processing 
• Proficiency in Python, SQL, and other programming languages and frameworks used for data engineering (e.g. Scala, Go, Java…) 
• Experience in working with cloud platforms such as Azure, and using their services and tools for data storage, processing, and analysis 
• Experience in working with text data and applying data preprocessing, cleaning, and analysis techniques, such as tokenization, lemmatization, stemming, stop words removal, etc. 
• Familiarity with natural language processing, topic modelling, and AI for text analysis techniques and applications, such as sentiment analysis, text summarization, text classification, named entity recognition, topic extraction, text generation, etc. 
• Experience in web development, specifically backend RESTful webservice development to expose data programmatically is desirable but not required 
• Experience in using NLP and ML tools and libraries, such as spaCy, NLTK, TensorFlow, PyTorch, scikit-learn, pandas, etc. 
• Excellent communication and teamwork skills, and the ability to work independently and in a fast-paced environment