Electricity Transmission System Modernization

A cloud-native platform for scalable grid analytics and automation

Client: One of the largest TSOs in the EU, Germany

GPU

accelerated grid calculations and neural networks

Parallel

run beside the legacy system for direct comparison

Cloud-agnostic

modular platform, not tied to one provider

TypeScriptNode.jsPythonPostgreSQLRabbitMQAWSAmazon EC2AWS compute clusterAWS container servicesAmazon SQSAWS registryData centerAzure Kubernetes ServiceAzure Key VaultAzure DevOps servicesAzure Data Lake Storage Gen2Microsoft platformPower BICEPH S3-compatible storageTerraformPlaywrightSeleniumJasmineKarma
TypeScriptNode.jsPythonPostgreSQLRabbitMQAWSAmazon EC2AWS compute clusterAWS container servicesAmazon SQSAWS registryData centerAzure Kubernetes ServiceAzure Key VaultAzure DevOps servicesAzure Data Lake Storage Gen2Microsoft platformPower BICEPH S3-compatible storageTerraformPlaywrightSeleniumJasmineKarma

Challenge

Outdated algorithms, poor data integration, limited scalability and high operational complexity kept the legacy system from analysing the grid in real time — and from growing. Whatever replaced it had to run alongside it with minimal disruption, and to support GPU computation and predictive models.

Solution

A modular, cloud-agnostic platform on microservices and event-driven architecture, with GPU-accelerated services and neural networks. It integrates diverse data sources and scales with the analytics, with logging, SSO and MLOps/DataOps practice for observability and automation.

Implementation

  • 01Independent components developed iteratively
  • 02Spark on Kubernetes for semi-structured data processing
  • 03Microservices and GPU-powered services for grid calculations
  • 04Enhanced logging and log search
  • 05Event-based integration, SSO through AD/IDP, infrastructure automation

Business impact

Running in parallel with the legacy system, so results could be compared directly

Faster decisions through real-time visibility of calculations

Better data quality from automated validation and filtering

A scalable foundation ready for the next modules

Technology stack

Languages & ML
  • Python
  • PyTorch
Frontend & Visualization
  • Angular
  • Grafana
Data & Processing
  • Spark
  • Delta Lake
  • Delta Table
  • ElasticSearch
Architecture & Integration
  • Microservices
  • Kubernetes
  • Event-driven architecture
  • EMQX

Have a complex system to build or modernize?

Tell us what must change. We will bring the relevant domain and engineering leads into the conversation.

Explore all case studies