Privy: Midlleware-Warehouse Systems

Role: Back-End Engineer
Duration: 5 months

Middleware is a centralized portal and gateway that enables integration between multiple client projects and the Privy digital signature platform. This system comprises multiple services, including a warehousing module responsible for managing balance data (e.g., for Signing, E-Meterai, Blast, OTP, etc.). It acts as the transaction backbone, facilitating secure and efficient transactions across services.

Tech Stack

• Languages: Ruby on Rails, Golang
• Database: PostgreSQL
• Caching: Redis
• CI/CD & Containerization: Jenkins, Docker
• APM: Sentry

Challenges

• Built the system entirely from scratch, including deep involvement in planning, API contract, and architectural design.
• Required strong guarantees in consistency, availability, and low latency for handling high-throughput transactional operations.
• Supported over 700,000 accounts with up to 12 currencies.

Contributions

• Prevented race conditions in high-concurrency on transfer balance scenarios by optimistic database locking.
• Designed and implemented a polymorphic data model for extensible balance ownership.
• Improved system availability by denormalized database columns due to high-latency in retrieval query.
• Utilized Redis for real-time balance caching, enabling low-latency client notifications.
• Refactored the system from Ruby on Rails to Go with a clean architecture approach, improving maintainability and performance.

Capabilities Demonstrated

• Strong understanding of concurrency control and race condition mitigation.
• Skilled in implementing database denormalization for low-latency systems.
• Knowledge and practical application of caching mechanisms (specifically Redis) to improve system responsiveness and reduce database load/.
• Expertise in migrating code from Ruby on Rails to Go.
• Capable of handling system design from planning to production-ready deployment.

Architecture

Figure 1. Middleware - Warehouse architecture

Back