Results for “mocean”

Train Mixture of Experts (MoE) models using DeepSpeed or HuggingFace, covering architectures, routing, load balancing, and expert parallelism.

Run cloud-native molecular modeling and drug-design workflows via a Python API, covering pKa prediction, docking, conformer and tautomer ensembles, molecular dynamics, and related small-molecule or protein tasks without local HPC infrastructure.

Optimizes MoE expert-parallel communication overlap in Megatron Bridge, covering dispatch/combine overlap, flex dispatcher backends, and expert wgrad scheduling.