What I Bring to the Table
As a Big Data Engineer, I own the design and operation of scalable, production-grade data platforms that drive strategic insights and business growth. I oversee end-to-end ETL workflows, define data modeling standards, and architect cloud environments to ensure reliable, cost-effective performance at scale.
- Strategic Data Pipeline Leadership: Lead design and implementation of batch and streaming pipelines using industry-standard frameworks such as Apache Spark and Kafka. Ensure data systems handle growing volumes reliably and efficiently.
- Data Modeling & Governance: Define and enforce data modeling best practices for relational and columnar stores (e.g., PostgreSQL, Snowflake, Redshift). Establish rigorous data quality, lineage, and governance processes to empower analytics teams.
- Cloud Architecture & Scalability: Architect secure and cost-optimized data solutions across AWS, Azure, and GCP. Set up scalable storage (e.g., S3, Blob Storage), computation (e.g., EMR, Dataproc), and orchestration (e.g., Airflow, dbt) environments that adapt to evolving business needs.
- Cross-Functional Collaboration & Mentorship: Partner with product, analytics, and engineering teams to shape data strategy. Mentor and guide junior engineers, establish best practices, and continuously improve platform reliability and performance.
Technical Skills & Tools
- Cloud & Storage: AWS S3, DynamoDB, EMR, EKS, Lambda, Glue, CloudFormation, CloudWatch; Azure Fabric; Databricks
- Data Processing & Orchestration: Apache Spark, Kafka, Flink, Delta Lake, Apache NiFi, Apache Airflow, dbt
- Programming Languages: Python, Go, Scala, Java, JavaScript, TypeScript
- Databases: PostgreSQL, Cassandra, MongoDB, Redis, Neo4j, ClickHouse, Amazon Redshift, Snowflake, Google BigQuery
- ML & AI: ML algorithms & Deep Learning using PyTorch, TensorFlow, Hugging Face Transformers
- BI & Visualization: Tableau, Looker Studio, Power BI, Grafana, Plotly, Dash
- DevOps & Infrastructure: Docker, Kubernetes, Terraform, Prometheus, Jenkins, Ansible, InfluxDB
Connect with me via email: [email protected]