Yusuf Manshur
I am a software engineer who consistently leverages best practices to deliver robust, efficient software.
My expertise spans monitoring dashboard, system integration, and significantly contributed to transactional data orchestration systems.
For any questions, please reach out me on LinkedIn
Privy Integration: CRM-ERP Orchestrator
Role: Back-End Engineer
Duration: 11 months
Background
At that time, the CRM and ERP platforms operated in silos, with data flows between systems managed manually. This resulted in fragmented workflows, frequent delays, and high potential for human error. Year-end reconciliation was particularly painful—requiring manual data extraction and alignment across disparate data sources, often leading the mismatched opening and closing balances.
Our objective was to establish a unified, automated pipeline across CRM, ERP, and internal platforms. By eliminating manual intervention, we aimed to reduce data drift, improve reporting accuracy, and enable real-time visibility across marketing, sales, finance, and product teams.
To enable this, we required a workflow orchestration layer capable of handling complex, event-driven synchronization. The system needed to support bi-directional data flow, exception handling, and automated triggers—improving data reliability and operational efficiency.
CRM - ERP GoldenGate
CRM-ERP GoldenGate is a system responsible for orchestrating end-to-end customer interactions including their transactional data—such as top-up, usage, void, and transfer—across internal systems and a third-party platforms. The service acts as a orchestrator ensuring data integrity and near real-time event synchronization to Zendesk, ActiveCampaign, and NetSuite Oracle.
Tech Stack
- Language: Golang
- Database: PostgreSQL, ClickHouse
- Caching & Messaging: Redis, Google Pub/Sub
- CI/CD & Containerization: GitLab CI, Docker, Kubernetes
- APM: Datadog
Challenges
- Enable CRM-ERP integration and seamlessly synchronized with internal platforms.
- Ensure high consistency and low-latency performance for transaction-heavy workloads under high traffic.
- Deliver shadow balance/subscription logic to maintain transactional accuracy before ERP synchronization.
- Support seamless data migration while maintaining system integrity and uptime.
Contributions
- Designed and implemented core processes for top-up, transfer, void, and usage balance modules, ensuring accurate ERP integration across multiple business models.
- Built an event-driven orchestration layer to handle various business-specific transaction behaviors with asynchronous communication patterns.
- Developed shadow subscription service that provide usage transactions querying in FIFO and LIFO scenario based on payment setting.
- Introduced distributed scheduler by leveraging Redis distributed locks to handle aggregated daily usage transactions synchronized to ERP.
- Leveraged Redis queue to implement worker-pool mechanism for logs the integration process asynchronously.
Capabilities Demonstrated
- Experienced in integrating the third-party CRM-ERP systems with strong transaction atomicity guarantees.
- Proficient in providing robust reactive solutions in Go using Google Pub/Sub and Redis as message brokers.
- Skilled in implementing database partitioning, distributed states, data integrity, and asynchronous process for low-latency systems.
Architecture
Related articles: