Database Engineer
Design and build scalable, high-performance systems that enhance our decision-making platform’s efficiency and reliability.
About the job
We are seeking a Senior Database Engineer with 6+ years of experience to join our Data Platform team. You will design, prototype, and optimize complex data workflows and architectures, focusing on SQL optimization, Python development, and data-driven analysis. This role requires advanced technical expertise and the ability to work collaboratively with the product manager and software architect.
Key Responsibilities
Design, develop, and optimize complex SQL queries and Python macros for data transformations within the DuckDB framework.
Implement advanced data normalization and denormalization strategies to ensure data integrity and performance.
Perform data pipeline transformations and integrate statistical and ML methods into SQL and Python workflows.
Collaborate with cross-functional teams to define data architecture and enhance the lb_duckdb_manager's functionality.
Ensure high performance and scalability of database operations through performance tuning and effective indexing strategies.
Manage changes that need to ripple across tables in the dataset, leveraging efficient update processes and monitoring tools.
Write platform-grade Python code while adhering to best practices and coding standards.
Mentor junior developers, sharing expertise in database design and SQL transformations.
Job Requirements
6+ years of relevant work experience
Expertise in Database Design, Query Engine Design, Database storage engines
Excellent ability to map business domains to data models
Excellent written and spoken communication skills
Advanced SQL Development: Optimize complex queries (CTEs, window functions, pivots, grouping sets) in DuckDB and PostgreSQL.
Data Pipeline Design: Build and optimize data workflows using Python and modern tools like Spark, DBT, Kafka, Dagster, and Flink.
Exploratory Data Analysis (EDA): Apply statistical methods and machine learning principles to derive insights and drive decision-making.
Integration of GenAI Tools: Work seamlessly with tools in IDE environments (Visual Studio Code, Jupyter Notebook).
DataOps and DevOps: Design and optimize pipelines, manage Git-based version control, and implement CI/CD workflows.
Collaboration: Document requirements and analysis, communicate effectively with clients, and contribute to a user-centric development process.
Our office is located in Collingwood, Ontario. You must be willing to come to the office twice a week.
How To Apply
Please send your cover letter and resumé to Nathalie Burstein at info@liquidanalytics.com. Be sure to include the title of the job you’re applying to.
COMPANY
MARKETPLACE APPS
SOCIALIZE WITH US
2024 © Liquid Analytics. All Rights Reserved
Privacy Policy
Terms of Service
COMPANY
MARKETPLACE APPS
SOCIALIZE WITH US
2024 © Liquid Analytics. All Rights Reserved
Privacy Policy
Terms of Service
COMPANY
MARKETPLACE APPS
SOCIALIZE WITH US
2024 © Liquid Analytics. All Rights Reserved
Privacy Policy
Terms of Service