Photo
Prem
London

15 years of Experience

Senior Scala Developer London

Experienced Scala and Java developer with 15 years in designing and building scalable, high-performance applications and real-time data pipelines. Skilled in functional programming (Cats, ZIO, FS2, tagless final), distributed systems (Akka, Kafka, Spark Streaming), and cloud platforms (AWS, Azure, Databricks, Snowflake). Proficient in API design, data modeling, microservices, and event-driven architectures. Experienced with CI/CD pipelines, TDD/BDD, and DevOps tools including Docker, Kubernetes, Jenkins, and version control systems. Background includes working on financial services, AML/KYC solutions, and large-scale data engineering projects. Certified Scala Developer (Quantexa).

Skills

  • agile
  • Airflow
  • Akka
  • Akka Streams
  • Algebraic Data Types
  • angularjs
  • Ant
  • Apache
  • Apache CXF
  • Apache Spark 2.0
  • API Gateway
  • Atlassian Confluence
  • AWS (S3
  • Azure (App Services
  • Backpressure Handling
  • BDD
  • Big Data Processing
  • Bitbucket
  • Cats
  • Cats Effect
  • CI/CD
  • Cloud platforms
  • Cloud-Native Architecture
  • Compliance
  • Concurrency Models
  • Contract-First Architecture
  • Control-M
  • Crucible
  • CSS
  • Cucumber
  • CVS
  • Data Factory)
  • Data Ingestion
  • Data Lake
  • Data Pipelines
  • Data Transformation
  • Data Warehousing
  • Databricks
  • Delta Lake
  • Distributed Systems
  • Docker
  • Doobie
  • DynamoDB
  • EC2
  • Eclipse
  • Elastic
  • EMR
  • Event Sourcing
  • Event-Driven Architecture
  • Fisheye
  • FS2
  • Functional Programming
  • Functions
  • Garbage Collection
  • Git
  • GitHub
  • Glue
  • Gradle
  • GraphQL
  • gRPC
  • Hadoop
  • HBase
  • HDFS
  • High-Throughput Systems
  • Higher-Kinded Types
  • Hive
  • HTML
  • Http4s
  • Implicits
  • IntelliJ
  • Java
  • javascript
  • JBehave
  • JBoss
  • Jenkins
  • JIRA
  • jQuery
  • JSF
  • JVM Tuning
  • Kafka
  • Kafka Streams
  • Kanban
  • KStreams
  • Kubernetes
  • KYC/AML Solutions
  • Lambda
  • Maven
  • Mentoring
  • Microservices
  • Mockito
  • Modular API Design
  • Multi-Terabyte Data Handling
  • MySQL
  • Next.js
  • NonSQL Databases
  • Optics
  • Oracle
  • Pair Programming
  • Performance Optimization
  • PL/SQL
  • PostgreSql
  • Property-Based Testing
  • Protobuf
  • Quantexa
  • RDS)
  • React
  • Real-Time Analytics
  • REST APIs
  • RESTful APIs
  • RichFaces
  • Scala
  • ScalaCheck
  • ScalaPB
  • ScalaTest
  • Schema Design
  • scrum
  • Selenium
  • Serenity Framework
  • Serialization
  • Snowflake
  • Software Collaboration Tools
  • Spark
  • Spark Streaming
  • SQL
  • Streaming Systems
  • SVN
  • Tagless Final
  • TCP-Based Streaming
  • TDD
  • Testing Automation
  • Time Series Data
  • Tomcat
  • Trade Finance
  • Type-Safe Programming
  • TypeScript
  • Unity Catalog
  • Vagrant
  • Validation Framework
  • VSS
  • WebLogic
  • ZIO
  • ZIO Test

Experience

Aug 2025 - Present

Scala Developer at IBM

– Designed and built a Scala + Slick–based Incident Management Tool for real-time incident routing, escalation, and lifecycle management.
– Implemented type-safe Slick repositories, optimized queries, and bulk operations, reducing database latency and improving platform throughput.
– Developed incident ingestion pipelines, escalation policies, and alert routing logic with high availability and resilient asynchronous workflows.
– Collaborated with SRE and product teams to refine SLAs, routing rules, and platform behavior, ensuring alignment with operational requirements.

Dec 2023 - Mar 2025

Scala Developer at SatanderBank

– Collaborated with stakeholders and data providers to define requirements, ensure data accuracy, and deliver actionable insights through advanced analytics and reporting.
– Designed and implemented scalable Spark pipelines to process multi-terabyte datasets, ensuring high performance and integration with the broader Big Data ecosystem.
– Contributed to the development of an MVP using Quantexa for AML-related trade finance solutions, leveraging entity resolution and network analytics to map customer relationships.
– Customized the platform for KYC and compliance needs, integrating diverse internal and external data sources to create a holistic view of customers.
– Built a validation framework using Scala Cats API to enforce business rules, and developed highly performant, scalable backend APIs with Scala and Spark.
– Designed and implemented scalable data pipelines and custom Data Lake APIs to efficiently ingest, process, and store large-scale structured and unstructured datasets.
– Led the migration of the enterprise data platform from on-premise to AWS, utilizing S3, Glue, EMR, and PostgreSQL to improve performance, reduce costs, and enable cloud-native scalability.
– Developed RESTful APIs in Scala, consumed by TypeScript clients.

Dec 2022 - Aug 2023

Quantexa Scala Developer at Synechron(HSBC)

– Worked as a Scala Developer on a Greenfield project for a financial institution, creating data pipelines for AML-related data products using medallion data architecture.
– Developed web applications and services, wrote unit and integration tests, and deployed applications.
– Tuned Spark applications for optimal parallelism and memory usage.
– Collaborated with stakeholders and data providers to define requirements, ensure data accuracy, and deliver actionable insights through advanced analytics and reporting.
– Designed and implemented scalable Spark pipelines to process multi-terabyte datasets, integrating with the wider Big Data ecosystem.
– Contributed to the development of an MVP using Quantexa for AML trade finance solutions, leveraging dynamic entity resolution and network analytics to map customer relationships.
– Customized the platform for KYC and compliance needs and integrated diverse internal and external data sources to create a holistic customer view.
– Utilized Kafka Streams API with Scala for high-throughput event data transformation and aggregation, enabling real-time analytics.
– Engaged with business analysts to refine requirements into actionable user stories using Agile methodologies.
– Designed and optimized stateful stream processing with Kafka Streams + RocksDB for high-performance distributed state management.
– Built scalable data pipelines and Data Lake APIs with Apache Spark to process structured and unstructured data across cloud storage systems.
– Led migration of the enterprise data warehouse from on-premise to AWS, using S3, Glue, EMR, and PostgreSQL to improve performance, reduce costs, and enable cloud-native scalability.
– Developed highly concurrent and resilient applications with ZIO, leveraging functional effects for predictable, testable workflows.
– Built streaming pipelines and backend services using ZIO Streams for backpressure-aware, composable, high-throughput data flows.

May 2022 - Nov 2022

Scala Developer at BAML

– Worked as a Scala developer on a Greenfield project for a financial settlement platform, managing position updates and downstream data propagation.
– Developed services, APIs, and tests (unit, integration, e2e), and deployed applications.
– Participated in design discussions for a real-time system handling and updating holdings data, ensuring timely and accurate representation.
– Architected resilient distributed systems using Akka and event sourcing for data consistency, durability, and recoverability across microservices.
– Designed and developed scalable, high-performance microservices in Scala with gRPC communication and Protocol Buffers specifications for strong service contracts.
– Built fault-tolerant data processing pipelines using Scala and FS2 streams, applying functional programming patterns (Monads, Typeclasses, Implicits, Futures, Cats Effects, Monix Task) for type-safe Kafka streaming applications.
– Implemented custom TCP-based streaming services with Akka Streams/Netty, enabling low-latency binary protocol communication.
– Developed RESTful and GraphQL APIs in Scala (Akka HTTP / Play Framework), consumed by TypeScript clients (React/Next.js), ensuring consistent contract validation with OpenAPI/JSON Schema.
– Built streaming and batch pipelines in Scala (Spark, Akka Streams) with dashboards and admin tools in TypeScript.
– Implemented cross-language serialization using ScalaPB for Protobuf schemas shared between Scala microservices and TypeScript clients for efficient gRPC and HTTP communication.

Aug 2021 - Apr 2022

Software Engineer at HSBC

– Worked as a Scala developer on a Greenfield project, developing applications, APIs, and automation tests.
Performed data ingestion, transformation, and processing using Azure Data Factory and Databricks.
– Developed, enhanced, and maintained applications using Scala and functional programming (Cats).
– Designed and implemented scalable Spark pipelines to process multi-terabyte datasets, ensuring high performance and integration with the broader Big Data ecosystem.
– Collaborated with stakeholders and data providers to define requirements, ensure data accuracy, and deliver actionable insights through advanced analytics and reporting.
– Designed and optimized stateful stream processing with Kafka Streams + RocksDB for high-performance distributed state management.
– Built Kafka-based real-time streaming solutions on Cloudera, integrating with the Hadoop ecosystem and implementing event-driven, fault-tolerant architectures.
Worked extensively with ADLS and Databricks, optimizing data ingestion, partitioning, and query performance.
– Configured and managed Unity Catalog for fine-grained data access, secure sharing, and metadata lineage tracking.
– Migrated Hive Metastore schemas to Unity Catalog to improve data discoverability, consistency, and manageability.
– Developed streaming data pipelines and backend services using ZIO Streams for composable, backpressure-aware, high-throughput processing.
– Implemented property-based and effectful testing using ZIO Test to enable robust, deterministic, side-effect-free unit and integration tests.

Jun 2021 - Aug 2021

Scala Developer at Morgan Stanley

– Worked as a Scala Developer on a risk platform, developing web components with TDD, BDD, and pair programming.
– Designed and implemented scalable Spark pipelines to process multi-terabyte datasets, ensuring high performance and integration with the data warehouse.
– Collaborated with stakeholders to define requirements, ensure data accuracy, and deliver actionable insights.
– Developed automated workflows using Control-M for end-to-end data pipeline processing, optimizing data flow and availability.
– Led migration of on-premise data assets to Azure Data Lake, improving security, access, and cost efficiency.
– Built streaming systems with Kafka, FS2, and ZIO Streams for real-time, backpressure-aware event processing.

Nov 2020 - Apr 2021

Software Engineer at Citibank

– Worked as a Scala Developer, developing web components with TDD and design patterns.
– Wrote automation tests and leveraged Kafka Streams API to transform and aggregate high-throughput event data for real-time analytics.
– Used Azure Databricks to process and analyze large datasets, generating actionable insights for business decisions.

Sept 2019 - Jun 2020

Software Engineer at JP Morgan

– Worked as a Scala Developer on the Corporate Technology Research team, building platforms and applications in a CI environment.
– Developed integration and automation tests using BDD, TDD, and Selenium.
Assessed Big Data tools in Azure and designed production architectures.
– Built automated workflows with Control-M, optimized data pipelines, and migrated on-premise assets to Azure Data Lake.
– Developed real-time pipelines with Kafka and Spark, implemented Delta Lake for scalable, ACID-compliant data storage, and enabled time-travel queries for historical analysis.

Sept 2014 - May 2019

Software Engineer at Publicis Sapient

– Produced data validation jobs and real-time analytics pipelines using Scala, Spark, and Kafka to optimize data flow and system performance.
– Developed distributed data processing systems and advanced analytics solutions with Quantexa, creating holistic views of customers and solving KYC/AML problems.
– Built scalable Spark and Kafka pipelines, automated workflows with Control-M, and processed large datasets with Azure Databricks.
– Designed high-performance microservices in Java/Scala, leveraging Akka, RabbitMQ, Aeron, Docker, and Kubernetes for event-driven, low-latency, fault-tolerant systems.
– Implemented real-time streaming solutions, data serialization with ScalaPB, and TypeScript client integration for efficient cross-service communication.

May 2013 - Aug 2014

Software Engineer at Genpact Capital Markets

– Worked as a Developer in Test on NHS ERS Choose & Book, building automation frameworks with Selenium and JBehave in an Agile CI environment.
– Trained new team members on best practices and pair programming.
– Worked on front-end and back-end development for Reuters Electronic Trading Admin GUI, including API upgrades, versioning, and test environment releases.
– Implemented cross-language data serialization with ScalaPB and Protobuf, enabling contract-first architecture and seamless communication between Scala microservices and TypeScript clients.

Dec 2009 – Apr 2013

Senior Java Developer at Cetpa Infotech pvt ltd

– Worked on a leading online insurance platform, designing and developing new modules and features to meet evolving business requirements.
– Followed Scrum lifecycle, participated in sprint planning, and performed project estimations.
– Created and maintained REST APIs to support platform functionality.

Education

Education icon
2023

Scala Quantexa (AML)Certification at Quantexa, London

Education icon
2010

Sun Certified Java Programmer at Sun Prometric Centre

Education icon
2008

BTECH Electronics and Communication at U.P.T.U University , India

CTA resume
CTA resume