Data Engineer with Matillion
Job Overview:
We are looking for an experienced Data Engineer with strong hands-on expertise in Matillion to support one of our enterprise clients through a long-term B2B engagement. You will be responsible for building scalable, secure, and high-performance data pipelines and integrating complex data ecosystems using modern cloud and ETL technologies. The ideal candidate combines deep technical knowledge with experience in data engineering, security, compliance, and cloud-based architecture.
Key Responsibilities:
- Design, build, and maintain scalable ETL/ELT processes using Matillion and other tools such as DBT and BODS.
- Develop, test, and deploy secure data pipelines to Snowflake and Redshift cloud data warehouses.
- Integrate data from various sources, ensuring high data quality, integrity, and performance.
- Ensure secure data transmission using encryption and industry best practices.
- Implement data security, authorization, and authentication mechanisms (e.g., KeyPair, Token, Basic Auth).
- Support automation initiatives and integration with AI/ML platforms and RPA tools.
- Work collaboratively with DevOps teams to automate deployments and monitor data workflows.
- Contribute to documentation (TDD/SDD) and ensure traceability and audit readiness (SoX, GDPR, SPI/PI).
- Participate in analytics and BI integration to enable actionable insights for business users.
- Assist in UI-based data solutions using technologies like HTML, JavaScript, and NodeJS.
Must-Have Skills:
- Strong hands-on experience with Matillion ETL
- Expertise in Snowflake, Amazon Redshift, and Microsoft SQL Server
- Proficiency in ETL/ELT development and cloud data warehouse architectures
- Experience with data integration technologies
- Solid understanding of data security, compliance, and GDPR/SPI/PI handling
- Working knowledge of authentication methods (KeyPair, Token, Basic)
- Knowledge of DevOps practices and CI/CD pipelines
- Familiarity with data retention and archiving policies
- Excellent problem-solving skills and the ability to work independently
Nice to Have:
- Familiarity with AI/ML frameworks and automation tools (e.g., RPA)
- Understanding of SoX controls, auditing requirements, and data governance
- Experience with Python and NodeJS
- Basic knowledge of front-end technologies (HTML, JavaScript)
- Exposure to BI and analytics platforms