Shiv Prakash
Engineering Leader & Architect
Distributed Systems · Data · AI/ML
Graduate Researcher
Georgia Tech · ML · DL · RL · NLP · CV · Robotics · NSc · Quantum Engg · Algorithms
Industry Analyst
SCM · Data Center · Financial Research · VC
I have built Autonomous Agentic AI platforms, Data Mesh architectures, and Distributed systems that transform enterprise operations at scale. With proven delivery of $75M+ in savings through AI-driven optimization, PetaBytes scale data platforms and systems handling 500K+ TPS for millions of users, I bring hands-on expertise across the full stack - from Machine Learning, Distributed Systems, Data Engineering to Cloud-Native Infrastructure and Engineering Leadership.
Open to Consulting engagements, Technical collaboration, Mentorship, and Volunteer work with non-profits.
Let's discuss how I can help you build scalable systems, review your architecture, or accelerate your team's growth!
What I Can Help With
Consulting
Strategic guidance on architecture, technology decisions, and technical due diligence
- →Architecture Reviews & Design
- →System Design & Technology Selection
- →Technical Due Diligence for M&A/Investments
- →AI/ML Strategy & Roadmap Planning
- →Data Platform & Data Mesh Architecture
Hands-on Building
End-to-end development of critical systems and platforms
- →AI Agents & RAG Systems
- →Data Engineering Pipelines & Platforms
- →Distributed Systems & Microservices
- →Cloud-Native Architecture (GCP, Azure)
- →High-Throughput & Low-Latency Systems
Mentorship
Helping engineers and leaders grow in their careers
- →Engineering Leadership Coaching
- →Technical Career Guidance
- →System Design Interview Preparation
- →Code Review & Best Practices
- →Building High-Performance Teams
Volunteering
Supporting non-profits, education, and open-source initiatives
- →Non-Profit Technology Consulting
- →Educational Initiatives & Workshops
- →Open Source Project Contributions
- →Mentoring Underrepresented Groups in Tech
Portfolio
Data Mesh Platform
Scaled to handle over 3 TB of curated data serving as the central place for company-wide quarter-end reconciliation.
• Reduced the cost of closing quarter from $140k to $8k.
• Launched platforms 1.2 & 1.3 with full compliance certification for IBM ASCA & SOX.
• Reduced the cost of closing quarter from $140k to $8k.
• Launched platforms 1.2 & 1.3 with full compliance certification for IBM ASCA & SOX.
Data MeshData EngineeringIBM ASCASOX
Agentic Platform (Dataverse) & Digital Workforce
Built a production multi-agent system spearheading a digital workforce:
• Dataverse Agent: NL-to-SQL system reducing analytics workload by 80%.
• Platform Review Agent: Automated governance yielding 30% volume reduction.
• Metadata Enrichment Agent: Fine-tuned PHI-3 model achieving widespread adoption.
• Dataverse Agent: NL-to-SQL system reducing analytics workload by 80%.
• Platform Review Agent: Automated governance yielding 30% volume reduction.
• Metadata Enrichment Agent: Fine-tuned PHI-3 model achieving widespread adoption.
Multi-Agent SystemsNL-to-SQLPHI-3Governance Automation
AI Acceleration & Developer Productivity
Led the adoption of Gen AI tools like Cursor, Claude CLI, and Gemini Enterprise, achieving 100% adoption in AI-assisted productivity across 129 associates.
Led rigorous evaluations for coding review agents using state-of-the-art models like Sonnet, Opus, Gemini Pro, and Kimi.
Led rigorous evaluations for coding review agents using state-of-the-art models like Sonnet, Opus, Gemini Pro, and Kimi.
Gen AILLM EvalsDeveloper Productivity
Developer Experience & Programmable Dashboards
Designed programmable dashboards, dynamic visualizations, and UX interfaces as hubs for AI interactions.
Replaced Tableau with a next-gen, SOX-compliant visualization solution, unlocking $2.3 million in immediate savings.
Replaced Tableau with a next-gen, SOX-compliant visualization solution, unlocking $2.3 million in immediate savings.
Developer ExperienceData VisualizationUX Interfaces
Inventory Placement Optimization
Developed a sweeping optimization system for optimal inventory placement across shipping nodes at Walmart.
• Realized $75M of a projected $500M impact.
• Enabled pixel-based demand forecasting to scale next-gen AI automated fulfillment centers.
• Realized $75M of a projected $500M impact.
• Enabled pixel-based demand forecasting to scale next-gen AI automated fulfillment centers.
Optimization AlgorithmsDemand ForecastingSupply Chain
GenAI Placement Optimization Agent
Built assistant agents for placement analysis and approvals using multi-agent orchestrations.
Successfully accelerated weekly analysis and full approval of critical placement decisions to under 4 hours (down from 48 hours).
Successfully accelerated weekly analysis and full approval of critical placement decisions to under 4 hours (down from 48 hours).
Multi-Agent OrchestrationsGenAIDecision Automation
Ops and Engineering Excellence
Realized a 31% reduction in operating costs for the replenishment data lake entirely through continuous monitoring, migration, re-architecture, and optimization.
Improved code quality and build metrics by 15% while maintaining strict 100% CVE compliance against zero-day exploits.
Improved code quality and build metrics by 15% while maintaining strict 100% CVE compliance against zero-day exploits.
Cost OptimizationRe-architectureSecurity Compliance
Centralized Communications Platform
Led a cross-functional team bridging UX, Data, and QA to build a pivotal central comms platform strictly compliant with GDPR, POPIA, and CCPA.
Reduced operational costs by 21.2% and improved CSAT scores by 33.8% through an enhanced integrated chatbot using robust in-house conversational APIs.
Reduced operational costs by 21.2% and improved CSAT scores by 33.8% through an enhanced integrated chatbot using robust in-house conversational APIs.
Big DataConversational APIsChatbotArchitecture
US Walmart Stores Data Platform
Led the design, development, and delivery of automated Data Governance policies serving 34 domain verticals across stores.
• Reduced self-service schema onboarding time from 1.5 weeks to 2 days.
• Designed comprehensive Data Catalog & Quality framework managing lineage and discovery.
• Led SOX & CCPA compliance achieving 99.99% uptime executing >10TB of daily ingestion.
• Reduced self-service schema onboarding time from 1.5 weeks to 2 days.
• Designed comprehensive Data Catalog & Quality framework managing lineage and discovery.
• Led SOX & CCPA compliance achieving 99.99% uptime executing >10TB of daily ingestion.
Data GovernanceBig DataSchema RegistrySOX/CCPAData Lineage
Demand Forecasting Solution (AIMS)
Architected and built the next-generation Automated Inventory Management System (AIMS).
• Consolidated 5 disparate systems into 1 unified platform, reducing code bases from 35 to 3 repos.
• Yielded a massive 40% cost saving and skyrocketed throughput by 500%.
• Delivered a sharable foundational library for ML and Cloud transfers utilized by 6+ company-wide teams.
• Consolidated 5 disparate systems into 1 unified platform, reducing code bases from 35 to 3 repos.
• Yielded a massive 40% cost saving and skyrocketed throughput by 500%.
• Delivered a sharable foundational library for ML and Cloud transfers utilized by 6+ company-wide teams.
Demand ForecastingSystem ConsolidationML LibrariesAnalytics Platform
Tier-0 Global Inventory & Replenishment Systems
Architected Tier-0 Global and Node-level enterprise inventory services executed at massive scale.
• Achieved sub-3ms latency at 13k+ TPS and processed 4 million updates/hr across 22M items.
• Managed a 1 TB Elasticsearch cluster running advanced search and forecasting on billions of records.
• Computed >10TB delta loads weekly, improving forecasts by up to 35% for newly launched items.
• Achieved sub-3ms latency at 13k+ TPS and processed 4 million updates/hr across 22M items.
• Managed a 1 TB Elasticsearch cluster running advanced search and forecasting on billions of records.
• Computed >10TB delta loads weekly, improving forecasts by up to 35% for newly launched items.
High-Scale Distributed SystemsElasticsearchLow-LatencyData Ingestion
Patents
US Patent Office 2017
Database System for Distribution Center Fulfillment Capacity Availability Tracking
Shiv Prakash
Patent for an advanced system that optimizes fulfillment capacity availability tracking in distribution centers.
US Patent Office 2024
Methodology for Delivering Chain of Fallback Customer Communications Using Composite and Concurrent State Machines
Shiv Prakash
Patent for an advanced fallback communication system that enhances customer interactions through composite and concurrent state machines.
Skills
Agentic AI & GenAI
Multi-Agent SystemsLangGraphRAG (Retrieval-Augmented Generation)Fine-tuningVector StoresLLM Orchestration
Data Platforms
Data MeshApache SparkAirflowSnowflakeDBTData Lakes
Cloud & Distributed Systems
Google Cloud PlatformMicrosoft AzureKubernetesMicroservicesEvent-Driven ArchitectureDistributed Systems
Databases
OraclePostgreSQLCassandraElasticsearchRedisSQL & NoSQL
Functional Domains
Supply Chain OptimizationRetail & eCommerceCompliance (SOX, GDPR, CCPA)MLOpsData Engineering
Experience
July 2025 - Present
Senior Engineering Leader – Data & AI — Red Hat
Leading the Data and AI Platform for India, managing a team of 28+ engineers across APAC, NA, and EMEA.
Driving the AI acceleration roadmap, scaling the Enterprise Data Mesh platform, and building the next-generation Agentic AI workforce.
Driving the AI acceleration roadmap, scaling the Enterprise Data Mesh platform, and building the next-generation Agentic AI workforce.
October 2012 - June 2025
Senior Architect / Senior Software Engineering Manager II — Walmart
Over a near 13-year tenure, progressed from SDE II to Architect and Senior Software Engineering Manager, leading large geo-distributed teams across some of Walmart's most critical and complex charters.
Directed the architecture, vision, and scale of massive enterprise initiatives including Inventory Management Systems, Real-Time Availability, Demand Forecasting, Store Systems Data Platforms, Centralized Comms Platform, and a flagship multi-million dollar Inventory Optimization System.
This trajectory built a deeply rounded profile encompassing the full technical stack—architecting high-scale Distributed Systems, modernizing PetaByte-scale Data architecture, deploying rigorous supply chain Optimization Systems, integrating foundational Machine Learning (ML), AI, and pioneering early orchestrations in Gen AI to radically elevate global fulfillment capabilities.
Directed the architecture, vision, and scale of massive enterprise initiatives including Inventory Management Systems, Real-Time Availability, Demand Forecasting, Store Systems Data Platforms, Centralized Comms Platform, and a flagship multi-million dollar Inventory Optimization System.
This trajectory built a deeply rounded profile encompassing the full technical stack—architecting high-scale Distributed Systems, modernizing PetaByte-scale Data architecture, deploying rigorous supply chain Optimization Systems, integrating foundational Machine Learning (ML), AI, and pioneering early orchestrations in Gen AI to radically elevate global fulfillment capabilities.
August 2010 - October 2012
Programmer - Senior Programmer — Best Buy (via Accenture BBTG)
Led critical retail system modernizations, including the overarching Sterling SSFS enterprise upgrade and the development of a unified mobile carrier activation platform.
Education
Georgia Institute of Technology
Master of Science (MS) in Machine Learning (In Progress)
Yeshwantrao Chavan College of Engineering (YCCE)
Bachelor of Engineering in Computer Technology