Ishtiak Alam

I build the pipelines that land data, and the metrics that make it agree.

Data and Analytics Engineer with 12+ years in fintech, SaaS, telecom and healthcare. I work on Databricks, dbt, Snowflake and Azure, from the first ingestion job to the dashboard your finance team signs off on.

Taking on select consulting projects

Ishtiak Alam
Lead Data & Analytics Engineer
  • Payments data delay, down from 24 hours
  • Saved a year by retiring a legacy SQL Server platform
  • Trade events a day, landed in under 2 minutes
  • Governed metrics in one semantic layer, used by 120+ people
  • Cost per first-funded client, after measuring marketing per real client

Two jobs most teams hire for separately

Data engineers make data arrive. Analytics engineers make it mean one thing. The handoff between the two is where most numbers break, so I do both and the handoff disappears.

Land it reliably

Data engineering

  • Lakehouse design on Databricks (Delta Lake, Unity Catalog) and Snowflake
  • Batch and streaming pipelines in PySpark, Spark Structured Streaming, Kafka and Azure Event Hubs
  • Incremental loads, data contracts and automated reconciliation
  • The platform as code: Terraform, cluster policies, CI/CD
  • SLA alerting, on-call rotations and runbooks

Make it agree

Analytics engineering

  • Metric definitions agreed with the teams that own them
  • dbt models with tests, contracts and slim CI
  • Kimball dimensional modeling and SCD Type 2 history
  • Semantic layers in dbt MetricFlow and Power BI
  • Funnel, cohort, CLV and CAC analysis that changes where money goes

Selected work

Results from production systems at a regulated FX broker and a global SaaS company, with full write-ups for three of them. Client data stays confidential; the numbers are real.

Showing all 6 projects

  • Axi, global FX and CFD broker
    • Data engineering
    • Analytics engineering

    Retired a legacy SQL Server reporting platform

    Moved 25+ finance and FP&A reports to Databricks in six months, with automated reconciliation proving every number matched before anything was switched off.

    Read the case study
    $200Ka year saved in licenses, servers and manual checks
    25+reports moved with business sign-off

    How it’s measured: yearly SQL Server licenses and servers, plus the manual cross-checks, retired along with the old platform.

  • Axi, global FX and CFD broker
    • Data engineering

    Payments data every hour instead of once a day

    Rebuilt payments ingestion from a daily full reload into an incremental hourly job, so finance and risk stopped working from yesterday’s numbers.

    Read the case study
    Data delay
    Before24 h
    Afterunder 1 h

    Job run time

    Before95 min
    After8 min

    How it’s measured: data delay is the longest a payment can wait before it shows in reporting; run time is the job’s wall-clock duration.

  • Axi, global FX and CFD broker
    • Data engineering

    Trade events on the dashboard in under two minutes

    A streaming consumer that lands every trade and account event in the lakehouse, feeding intraday exposure and fraud dashboards.

    <2 minfrom trade to dashboard
    2Mevents a day, peaks of 300 a second

    How it’s measured: time from an event arriving on Event Hubs to being queryable in Delta Lake.

    The problem

    Risk and fraud teams needed to see exposure during the trading day, not after the nightly batch.

    What I did

    Built a Spark Structured Streaming consumer on Azure Event Hubs through its Kafka API, writing to Delta Lake so exposure and fraud dashboards read events within two minutes.

    Built with

    Spark Structured Streaming, Azure Event Hubs, Kafka API, Delta Lake

  • Axi, global FX and CFD broker
    • Analytics engineering

    One semantic layer instead of 30 competing reports

    Sales, marketing, finance and compliance now read the same 45+ metrics from one dbt MetricFlow semantic layer, used by 120+ people.

    Read the case study
    Places the same numbers were defined
    Before30+ reports
    After1 layer
    45+governed metrics
    120+people using them

    How it’s measured: overlapping reports and spreadsheets retired once their numbers came from the semantic layer.

  • Axi, global FX and CFD broker
    • Analytics engineering

    Marketing spend measured per real client

    Clients hold several trading accounts, so acquisition cost was being counted per account. Measuring per person changed where the budget went.

    −18%cost per first-funded client
    15%of paid budget moved to better channels

    How it’s measured: paid media spend divided by clients whose first deposit cleared, counted per person, before and after the budget shift.

    The problem

    MT4 and MT5 accounts belonging to the same person were counted separately in acquisition reporting.

    What I did

    Resolved every account to one Salesforce client ID, defined New Traded Client, first funding and client P&L at client grain with Marketing, and built cost per acquisition by channel. Three underperforming campaigns were cut.

    Built with

    dbt, Databricks, Salesforce data, Power BI

  • Optimizely, digital experience SaaS
    • Data engineering
    • Analytics engineering
    • Governance

    One answer for ARR, churn and active users

    Architected the central Snowflake warehouse that became the single source of truth for 40+ SaaS KPIs, used by 80+ people in finance, product, growth and sales.

    Source systems behind the KPIs
    Before5 systems
    After1 model

    Access and PII incidents a quarter

    Before8
    After4

    How it’s measured: access and PII incidents per quarter, before and after the Atlan rollout.

    The problem

    Five disconnected source systems gave five different answers for ARR, churn and active users.

    What I did

    Built the warehouse with Fivetran ingestion and Airflow orchestration, consolidated the sources into one Kimball model, and rolled out Atlan for cataloging, PII tagging and role-based access. Power BI semantic models removed 40% of recurring report requests.

    Built with

    Snowflake, Fivetran, Airflow, Python, Power BI, Atlan

More results

  • −27%Regulatory submission data errors across ASIC, EMIR, MiFID, MAS and CySEC reportingAxi
  • 10 → 4Data incidents a month after Terraform, SLA alerting and an on-call rotationAxi
  • +9%KYC completion after funnel metrics exposed the biggest onboarding drop-offAxi
  • $190KA month in revenue leakage stopped (BDT 23M) by catching fraud and pricing anomaliesBanglalink, 32M-subscriber telecom
  • 9h → 2hNightly ETL window after redesigning data marts for pharma clientsIQVIA
  • −45%Recurring data inconsistencies in a pharma supply-chain warehouse, with PHI secured under HIPAAIQVIA

Work with me

I take on a small number of consulting projects at a time. Each one starts with a free 30-minute call to check that I’m the right person for the problem.

  • Lakehouse health check

    Fixed fee, 2 weeks

    A review of your Databricks or Snowflake setup: cost, reliability, governance and how the team ships changes.

    You get a written report with findings ranked by impact, and a 90-day plan your team can run without me.

  • dbt and semantic layer build

    Fixed scope, 4 to 8 weeks

    Metric definitions agreed with the people who own them, dbt models with tests and CI, and a semantic layer your BI tools read from.

    You get one set of numbers every team uses, with the code, docs and training to keep it that way.

  • Legacy to lakehouse migration

    Project, scoped per estate

    Moving reporting off SQL Server, Oracle or Teradata to Databricks or Snowflake, with automated reconciliation and business sign-off before anything is switched off.

    You get a retired legacy platform, and a finance team that trusts the new one from day one.

  • Fractional data lead

    Monthly retainer

    Architecture decisions, code review, hiring help and a data roadmap for teams that need senior direction but not a full-time lead yet.

    You get standards, reviews and a roadmap, with a set number of hours each month.

  • Expert session

    60 minutes, paid

    A working session on one hard problem: a slow pipeline, a disputed metric, a design you want a second opinion on.

    You get a direct answer and written notes after the call.

How a project runs

  1. Intro call

    30 minutes, free. You describe the problem; I tell you honestly whether I can help.

  2. Written proposal

    Scope, deliverables, timeline and a fixed price, in writing.

  3. Build in your repo

    Work happens in your code and your cloud, with a demo every week.

  4. Handover

    Documentation, runbooks and a training session, so your team owns it.

Where I’m most useful

  • Regulated fintech, brokers and payments companies
  • B2B and B2C SaaS companies that need one answer for ARR and churn
  • Teams leaving SQL Server, Oracle or Teradata
  • Databricks or Snowflake teams whose dashboards disagree

Working together

I’m based in Dhaka (UTC+6), which overlaps the working day in Singapore, Australia and the Gulf, and the morning in Europe. Everything happens remotely.

I’m used to regulated environments: ASIC, EMIR, MiFID, MAS and CySEC reporting, and PHI under HIPAA. NDAs are no problem.

Start with a 30-minute call

Free, no preparation needed. Bring the problem, and you’ll leave with a clear next step whether or not we work together.

Request an intro call
Portrait of Ishtiak Alam

Md Ishtiak Alam, Dhaka, Bangladesh

About

I’m Ishtiak, a data engineering lead based in Dhaka, Bangladesh. For 12 years I’ve built the systems companies use to count money, customers and risk.

I started as a data warehouse and BI developer at IQVIA, building ETL and dashboards for pharma clients. At Banglalink, a telecom operator with 32 million subscribers, I ran the BI team and caught fraud that was costing about USD 190K a month. At Optimizely I architected the Snowflake warehouse that gave the company one answer for ARR and churn.

Today I Data and Analytics Engineering at Axi, a global FX and CFD broker regulated in five jurisdictions. I own the trading, payments, customer, marketing and finance domains on Databricks, dbt and Azure: 45 production jobs, 80+ dbt models, a semantic layer used by 120+ people, and the regulatory reporting that has to be right every day.

I’ve led teams of 4 to 10, mentored 3 engineers and 15+ analysts, and written the standards other people build on. The work I like best is getting a room to agree on what a number means, then making sure it never drifts.

Career

  1. 2023 – now

    Business Intelligence Manager (Lead Data & Analytics Engineer), Axi

    Data and analytics engineering for trading, payments, customer, marketing and finance. Remote.

  2. 2022 – 2023

    Senior Data Architect, Optimizely

    Central Snowflake warehouse, dimensional model and data governance.

  3. 2022

    Senior Software Developer (Data Engineering), IQVIA

    Pharma supply-chain analytics; automated 90% of manual ETL steps.

  4. 2018 – 2022

    Business Intelligence Manager, Banglalink

    Led a 4-person BI team serving 150+ users across every department.

  5. 2014 – 2018

    Applications Development Specialist 1, IQVIA

    Data warehouse, ETL and Tableau dashboards for pharma clients.

Stack

Languages
SQL, Python, PySpark, Spark SQL, Jinja
Platforms
Databricks (Delta Lake, Unity Catalog, Workflows, Asset Bundles), Snowflake, Azure (ADLS Gen2, Event Hubs), SQL Server, Oracle, Teradata, PostgreSQL
Pipelines
dbt, Airflow, Fivetran, Spark Structured Streaming, Kafka, Auto Loader, REST APIs
Modeling and metrics
Kimball dimensional modeling, SCD Type 2, medallion architecture, dbt MetricFlow, Power BI semantic models and DAX
Quality and DevOps
dbt tests and contracts, pytest, SQLFluff, Terraform, Docker, GitHub Actions, Azure DevOps
BI and governance
Power BI, Tableau, MicroStrategy, Unity Catalog, Atlan, regulatory reporting
AI-assisted work
Claude Code

Credentials

Education

  • MSc, Computer Science and EngineeringDaffodil International University, CGPA 4.0/4.0
  • BSc, Computer Science and EngineeringUniversity of Dhaka

Certifications

  • Power BI Data Analyst AssociateMicrosoft Certified
  • Tableau Desktop SpecialistTableau

Recognition

  • Top 5% “Game Changer” AwardBanglalink
  • Best Performer of the Quarter, twiceIQVIA
  • Hackathon 1st and 2nd runner-upIQVIA
  • LanguagesEnglish, Bengali, Hindi

Find my work online

Code, dashboards, writing and career history live in a few places. Here’s what you’ll find in each.

FX Rates Lakehouse

Open-source reference build on the stack I run in production

The repository goes public soon. Follow me on GitHub to see it first.

  • Hourly Python ingestion from a public FX rates API into Azure Data Lake Storage
  • dbt staging, intermediate and mart models on Databricks, with SCD Type 2 snapshots for rate history
  • Airflow scheduling, Docker, and every piece of infrastructure in Terraform
  • GitHub Actions runs SQLFluff, pytest and dbt build with 50+ data tests on every pull request; freshness checks flag late data

Tell me what you’re working on

Consulting projects, expert sessions, digital products, or a question about your data stack. I reply within two working days.

LinkedIn in/ishtiakalam
Location Dhaka, Bangladesh (UTC+6)