Portfolio Website Data Architecture
End-to-end modern data architecture showcasing operational sources, ingestion pipelines, cloud data lake, and analytics serving layers.
Wajid Jafri
Data Architect
AWS Cloud | Database Architecture | Low-Latency Data Platforms
Hedge Fund & FinTech Systems
Hi — welcome to my portfolio!
I design performance-critical, Low-latency data platforms in AWS and hybrid environments — especially for Fintech and Hedge funds — where milliseconds, resilience, and data integrity matter. This website showcases my work and architecture case studies using cloud services.
Deep database foundations: My architecture work is grounded in 15+ years of hands-on Oracle and SQL Server DBA experience. View my DBA portfolio →
Professional Summary
- 15+ years of hands-on experience designing and operating mission-critical database platforms.
- End-to-end data platform design from operational systems to S3 data lakes, enabling analytics for BI, Snowflake, and AI use cases.
- Strong expertise in AWS and multi-cloud architectures (RDS, Aurora, DynamoDB, DMS, Lambda, CloudFront, S3, OCI).
- Designed low-latency, high-availability data systems for fintech and hedge-fund style workloads.
- Deep background across Oracle, SQL Server, MySQL, PostgreSQL, and NoSQL ecosystems.
- Proven ability to bridge architecture, operations, and business requirements.
Highlights
Cloud & Data Platforms
- AWS: DMS, S3, CloudFront, Route 53, WAF, IAM, Lambda
- RDS: Amazon Aurora Postgres, MySQL, Oracle, SQL Server, DynamoDB, Redshift
- DevOps: Kubernetes, Docker, EKS, ETL, CDC Pipelines, BitBucket, Jenkins
Low-Latency & Reliability
- Multi-AZ, Redis, Memcached, Performance tuning, indexing, query optimization
- HA/DR cross-region design, backups, recovery playbooks
- Observability: logs, metrics, tracing
Security & Governance
- JWT Tokens, KMS encryption, IAM, Secrets Manager
- WAF, AWS Shield, GuardDuty/Inspector, Lambda@Edge security
- Auditing, compliance, data protection
Certifications
Click any item to open in a new tab.
Oracle Certifications
- Oracle Cloud (OCI)
- GoldenGate
- Real Application Clusters (RAC)
- Exadata
- Enterprise Manager (OEM)
- Oracle Big Data
- Oracle Database 12c Administrator (OCP)
Older Oracle DBA versions (8i/9i/10g/11g)
Amazon AWS Certifications
Microsoft Certifications
Professional Experience
AWS Data Architect Engineer — Verition Fund Management
Jun 2024 – Present • Manhattan, NY
Owned and evolved the firm’s cloud database, replication, and access platforms, driving adoption of modern AWS services, reducing cost, and enabling secure, low-latency data access at scale.
- Introduced AWS DMS firm-wide, enabling real-time data replication across Oracle, PostgreSQL, MySQL, and ClickHouse for use cases previously considered impractical.
- Independently built a React-based self-service database access portal integrating Azure Active Directory, JWT, AWS API Gateway, and Lambda to eliminate manual password resets and account unlocks.
- Provided alternate solutions to the high price tag for Oracle Enterprise Edition with GoldenGate and AWS DMS–based read replicas, saving the firm over $1M in licensing costs.
- Established enterprise SSO standards, streamlining secure access to AWS, Snowflake, and internal platforms while eliminating repeated credential usage.
Architectural decisions informed by deep, hands-on database
experience across AWS-managed services, Oracle, SQL Server, HA/DR,
and performance tuning.
Data Architect Engineer — Logicworks
2020 – 2024 • New York, NY
Delivered AWS and Private cloud database reliability, automation, and operational excellence across AWS environments.
- Improved reliability and performance of AWS-hosted Oracle and SQL Server platforms supporting production workloads.
- Designed and tested HA/DR, backup, and recovery strategies across multi-region database environments.
- Led production incident response for database platforms, reducing downtime and MTTR.
- Automated recurring DBA operations using scripting and infrastructure-as-code practices.
Senior Database Administrator (Consultant) — INTL FCStone
Jan 2019 – 2020 • New York, NY
Owned performance, resilience, and security of high-throughput Oracle databases supporting mission-critical financial trading and risk platforms.
- Managed and optimized large-scale Oracle production databases supporting trading, clearing, and risk systems in a regulated financial environment.
- Led performance tuning, capacity planning, and index strategy to maintain low-latency, high-availability systems under heavy transactional load.
- Designed and maintained HA/DR architectures, including RMAN backups, restores, and disaster recovery testing for business-critical systems.
- Implemented database security, auditing, and access controls to meet internal governance and regulatory requirements.
Want the full work history? Download the PDF resume from the top.
My Work - (Operational Sources → Ingestion (CDC/Batch) → S3 Data Lake (Raw/Curated) → Serving (Snowflake/Tableau/AI/BI/APIs) → Observability)
Work-1 Architecture of This Website — SmartCloudDataArchitect.com
Click diagram to view full size.
Work-2 (Full User Self-Service App (React))
Database Self-Service Password Reset & Account Unlock Portal
(Serverless)
React UI → Active Directory → CloudFront → WAF → API Gateway →
Lambda → Oracle RDS → SES
A self-service portal built from scratch by me enabling users to reset their own passwords and unlock accounts securely using AWS-managed services like Active Directory and JWT Tokens. Users log in using network credentials, meaning no usernames or passwords are required.
- Low Latency -> Global CloudFront Edge locations provide fast low latency app performance
- Edge delivery & security — CloudFront CDN with TLS termination, WAF protection, and AWS Shield
- SSO - Cognito Active Directory federation + JWT Tokens allow selective people to connect
- Public API layer - API Gateway Authorization restricts only vetted users to reach API
- Serverless application logic - Lambda connects to the database and changes password + unlock user
- Operational data & notifications — DynamoDB for visitor metadata and SES for event-driven email alerts
Work-3 (Batch + Incremental Ingestion (Hourly) — Oracle → Postgres via AWS DMS)
Click diagram to view full size.
Oracle → Postgres Hourly Refresh (AWS DMS)
EventBridge → Oracle RDS (source) → Lambda Function → AWS DMS
→ PostgreSQL RDS (target)
Automated hourly refresh of reference tables from Oracle RDS database to a RDS Postgres database using DMS and scheduled AWS EventBridge Rules.
- Oracle RDS (source) → Operational Source (Oracle OLTP)
- EventBridge schedule triggers Lambda
- AWS DMS → Ingestion (DMS task: full load + CDC if applicable)
- PostgreSQL RDS (target) → Serving Store (Postgres read model / app DB / reporting)
- Data Quality: row counts • checksum/sample validation • alert on drift
- Consumers: Tableau • Snowflake (optional downstream) • APIs
Work-4 (Environment Data Refresh (PROD → DEV) — controlled export/import)
Click diagram to view full size.
PROD → DEV Table Refresh via Export/Import
EventBridge → Oracle RDS (source PROD) → Lambda Function → AWS
DMS → Oracle RDS (target DEV)
Daily refresh of Oracle Development database tables from Production using AWS export and import Procedures run by a Lambda on an EventBridge Schedule.
- Oracle RDS (PROD) → Source of truth (PROD)
- AWS RDS native DB procedures handle export/import
- S3 → Staging artifacts (export dumps)
- Lambda → Job controller (runbook + guardrails)
- Oracle RDS (DEV) → Non-prod refresh target
- Guardrails: approvals • restricted tables • PII masking • failure rollback
Work-5 (CDC Streaming Pipeline (Near Real-Time) — Oracle → S3 landing → ClickHouse)
Click diagram to view full size.
Oracle → ClickHouse Near Real-Time Sync (POC)
Oracle RDS (source) → AWS DMS → S3 (csv files) → EventBridge
Trigger → Lambda Function → ClickHouse Tables (target)
Serverless CDC pipeline: AWS DMS captures changes and write to S3 as CSV files, New files triggers a Lambda function to loads data into ClickHouse tables.
- DMS captures DML changes in the Oracle RDS database
- S3 (csv files) → S3 Landing Zone (Raw CDC files)
- Lambda → Stream processor (parse + upsert)
- ClickHouse → Analytics Store (low-latency OLAP serving)
- Consumers: BI dashboards • quant research queries • API analytics
Skills
Cloud
- AWS: S3, CloudFront, Route 53, WAF, IAM, Lambda
- Networking: VPC patterns, security groups, endpoints
Databases
- RDS, Oracle, SQL Server, Postgres, MySQL, Redshift, DynamoDB, Snowflake, ClickHouse
- Performance tuning, HA/DR, cross-region backups
Automation
- IaC: CloudFormation / Terraform / Ansible / Jenkins / BitBucket / IntelliJ
- Scripting: Python, Bash, PL/SQL, Java, React
Education & Summary
- Preston University: Masters Degree
- Dakota State University: Database Management • Data Warehousing • Data Mining
- Amazon AWS: Database Specialty • AWS Solution Architect • AWS Cloud Practitioner
- Microsoft: Azure Cloud Database Administrator • MCSA SQL Server 2014 Database Administrator
- Oracle: Oracle Certified Professional Database 12c • Oracle Cloud • GoldenGate • RAC • Exadata • OEM • Big Data