DevOps, Infrastructure & Networking

A systematic value investing platform that values 60,000+ companies a day over a 5 TB+ database.

The problem

Methodically and systematically valuing every company in the market at once, with daily recomputation on price changes plus quarterly/annual reports, without the system buckling.

Stack decision

Re-architecting the stack from MySQL to PostgreSQL and from Pandas to Polars to make real-time computation viable; billion-row tables with a partitioning scheme to optimize queries.

The technical challenge

Designing a generic data module that generalizes to any asset type and its edge cases (different markets, reporting frequencies) over a 5 TB+ database.

Impact

Real-time daily valuation of 60,000+ companies on a dedicated server with 300+ GB of RAM and 10+ TB of disk. The backbone of Baboon Technologies’ investment fund.

An edge device (NUC/Raspberry) in each club that streams, records and uploads video, orchestrated over VPN.

The problem

Efficiently live-streaming and recording each club’s video, uploading it to the platform and knowing what every NUC should do at any moment.

The technical challenge

Building the VPN architecture (OpenVPN → WireGuard) and a centralized RTMPS server with NGINX to remotely monitor camera and process connectivity in each club.

The cross-cutting infrastructure that orchestrates, deploys and monitors every service and project.

The problem

Managing multiple services and platforms in a reproducible, well-monitored way, with continuous deployment, backups and alerts.

Stack decision

Dokploy + Docker for orchestration, Traefik as reverse proxy, DNS on Cloudflare, WireGuard VPN, SSH tunnels with socat, daily S3 backups and job monitoring with Uptime Kuma plus centralized observability.